QA Lead

3 days ago

Quezon City, National Capital Region, Philippines Playbook Sports Full time ₱1,080,000 - ₱1,440,000 per year

Job Title: QA Lead (AI Agents)

Level: Lead

Location: Remote (Philippines)

Work Hours: Full-time, US EST (Night Shift)

Company Overview:Playbook is the best all-in-one software platform for sports, youth, and community businesses. We are at the forefront of integrating AI to build smarter, more efficient tools for our customers.

The Opportunity:We are seeking a pioneering QA Lead to establish and own the quality assurance strategy for our cutting-edge AI agents. This is not a traditional QA role. You will be responsible for ensuring our AI is reliable, accurate, and safe by designing and implementing sophisticated evaluation frameworks (evals). You will be the company's expert on AI quality, defining how we measure and benchmark the performance of our AI-powered features. This is a unique opportunity to shape a critical function at the intersection of QA and Artificial Intelligence.

Key Responsibilities:

  • AI Evaluation Framework: Design, develop, and maintain a robust framework for evaluating our AI agents. This includes setting up automated and manual evaluation processes.
  • Test Case & Dataset Management: Create and manage comprehensive datasets, test cases, and prompts to benchmark AI performance across key metrics like accuracy, relevance, tone, safety, and factuality.
  • AI QA Strategy: Establish and own the overall QA strategy for all AI-powered features, from initial development to post-release monitoring.
  • Analysis & Reporting: Analyze results from evaluations, identify failure modes, and provide clear, actionable feedback and reports to the engineering and product teams.
  • Collaboration: Work closely with developers and product managers to understand AI agent behavior, define quality criteria, and integrate testing early in the development lifecycle.
  • Tooling & Research: Stay up-to-date with the latest techniques, research, and tools in AI testing and evaluation, and implement best practices within the team.

Qualifications:

  • 4+ years of experience in software quality assurance, with at least 1-2 years of recent, direct focus on testing AI/ML models.
  • Crucial: Direct, hands-on experience designing and implementing evaluation frameworks (evals) for LLMs, chatbots, or other AI agents.
  • Proficiency in a scripting language (Python is strongly preferred) for creating test scripts and analyzing evaluation data.
  • Strong understanding of core machine learning concepts and the unique challenges of testing non-deterministic systems.
  • Experience with API testing tools (e.g., Postman) is highly valuable.
  • Exceptional analytical skills and a meticulous, data-driven approach to quality.
  • Excellent communication skills, with the ability to explain complex AI failures to both technical and non-technical stakeholders.

Job Type: Full-time

Pay: Php90, Php120,000.00 per month

Work Location: In person

  • QA Lead

    1 day ago

    Quezon City, National Capital Region, Philippines Pointwest Full time ₱500,000 - ₱1,000,000 per year

    Pointwest is looking for a QA Lead (Manual Testing) to join our Insurance Business Unit. This role is key to delivering high-quality software through detailed testing, clear defect reporting, and active collaboration with cross-functional teams. You will contribute to project success by ensuring product reliability while aligning with Pointwest's core values...

  • QA Lead

    3 days ago

    Quezon City, National Capital Region, Philippines Pointwest Full time ₱900,000 - ₱1,200,000 per year

    Pointwest is looking for a Manual QA Tester to join our Insurance Business Unit. This role is key to delivering high-quality software through detailed testing, clear defect reporting, and active collaboration with cross-functional teams. You will contribute to project success by ensuring product reliability while aligning with Pointwest's core values...

  • Lead QA

    2 weeks ago

    Makati City, National Capital Region, Philippines Onward Worldwide Management & Consultancy Services Inc. Full time ₱1,200,000 - ₱2,400,000 per year

    Job Description:Leading and managing the QA culture practices processes and documentations.Create, implement, and manage the functional and non-functional test plan.Communicating with other stakeholders such as Product Owner, Product Designers, Developers, and Infrastructure EngineersCollaborate to formulate and improve the QA Test planChecking the daily...

  • QA Assistant Team Lead

    1 day ago

    Quezon City, National Capital Region, Philippines Asticom Technology Inc Full time ₱900,000 - ₱1,200,000 per year

    Job DescriptionDevelops improvement plans based on RCA findings, leads QA operations to ensure delivery of business operations according to client standards, recommends frameworks and strategies for the QA departmentEstablishes organizational goals according to client standardsIdentifies critical success or detrimental factorsImplements continuous...

  • QA Assistant Team Lead

    1 day ago

    Quezon City, National Capital Region, Philippines Asticom Technology Inc. Full time ₱1,200,000 - ₱2,400,000 per year

    Job DescriptionDevelops improvement plans based on RCA findings, leads QA operations to ensure delivery of business operations according to client standards, recommends frameworks and strategies for the QA departmentEstablishes organizational goals according to client standardsIdentifies critical success or detrimental factorsImplements continuous...

  • QA Lead

    1 day ago

    Makati City, National Capital Region, Philippines People Matter PH Full time ₱1,200,000 - ₱1,600,000 per year

    We're hiring a Quality Assurance (QA) Lead to support the delivery of an enterprise software platform used across Europe and the Asia Pacific region. In this role, you'll collaborate with globally distributed teams, create and oversee testing plans, uphold QA standards, and help ensure smooth platform implementation.Key ResponsibilitiesQA &...

  • QA Automation Lead

    1 day ago

    Makati City, National Capital Region, Philippines NISPI Full time ₱1,200,000 - ₱1,300,000 per year

    About the RoleWe are seeking an experienced Quality Assurance Lead with a strong background in both automation and manual testing. The ideal candidate will have extensive experience leading QA teams, ensuring the delivery of high-quality software solutions, and implementing best practices in testing processes.Key ResponsibilitiesLead and mentor QA team...

  • Senior QA Analyst

    1 day ago

    Quezon City, National Capital Region, Philippines Playbook Sports Full time ₱1,200,000 - ₱1,800,000 per year

    Job Title: Senior QA Analyst (Manual)Location: Remote (Philippines)Work Hours: Full-time, US EST (Night Shift)The Opportunity: As a Senior QA Analyst, you will be a guardian of quality for the Playbook platform. You will be responsible for ensuring our software is stable, reliable, and meets the needs of our users. You will immerse yourself in the product,...

  • Quality Assurance Lead

    3 days ago

    Quezon City, National Capital Region, Philippines Probe CX Full time ₱1,500,000 - ₱2,500,000 per year

    Job Summary:We are seeking a highly organized and analytical QA Lead to oversee quality assuranceactivities across multiple BPO accounts. The QA Lead will ensure that customer interactionsmeet client expectations and internal standards, drive continuous improvement, and lead ateam of QA analysts to deliver consistent and actionable feedback.Key...

  • Senior QA Automation

    7 days ago

    Quezon City, National Capital Region, Philippines Eclaro Business Solutions, Inc Full time ₱900,000 - ₱1,200,000 per year

    Core Technical SkillsAutomation Tools: Proficiency in tools like Selenium, Playwright, Cypress, Appium, or similar.Programming Languages: Strong coding skills in Java, Python, JavaScript, or C#.Frameworks: Experience building and maintaining test automation frameworks.CI/CD Integration: Familiarity with Jenkins, GitLab CI, Azure DevOps, or similar tools.API...