QA Lead

5 hours ago

Quezon City, National Capital Region, Philippines Playbook Sports Full time ₱1,080,000 - ₱1,440,000 per year

Job Title: QA Lead (AI Agents)

Level: Lead

Location: Remote (Philippines)

Work Hours: Full-time, US EST (Night Shift)

Company Overview:Playbook is the best all-in-one software platform for sports, youth, and community businesses. We are at the forefront of integrating AI to build smarter, more efficient tools for our customers.

The Opportunity:We are seeking a pioneering QA Lead to establish and own the quality assurance strategy for our cutting-edge AI agents. This is not a traditional QA role. You will be responsible for ensuring our AI is reliable, accurate, and safe by designing and implementing sophisticated evaluation frameworks (evals). You will be the company's expert on AI quality, defining how we measure and benchmark the performance of our AI-powered features. This is a unique opportunity to shape a critical function at the intersection of QA and Artificial Intelligence.

Key Responsibilities:

  • AI Evaluation Framework: Design, develop, and maintain a robust framework for evaluating our AI agents. This includes setting up automated and manual evaluation processes.
  • Test Case & Dataset Management: Create and manage comprehensive datasets, test cases, and prompts to benchmark AI performance across key metrics like accuracy, relevance, tone, safety, and factuality.
  • AI QA Strategy: Establish and own the overall QA strategy for all AI-powered features, from initial development to post-release monitoring.
  • Analysis & Reporting: Analyze results from evaluations, identify failure modes, and provide clear, actionable feedback and reports to the engineering and product teams.
  • Collaboration: Work closely with developers and product managers to understand AI agent behavior, define quality criteria, and integrate testing early in the development lifecycle.
  • Tooling & Research: Stay up-to-date with the latest techniques, research, and tools in AI testing and evaluation, and implement best practices within the team.

Qualifications:

  • 4+ years of experience in software quality assurance, with at least 1-2 years of recent, direct focus on testing AI/ML models.
  • Crucial: Direct, hands-on experience designing and implementing evaluation frameworks (evals) for LLMs, chatbots, or other AI agents.
  • Proficiency in a scripting language (Python is strongly preferred) for creating test scripts and analyzing evaluation data.
  • Strong understanding of core machine learning concepts and the unique challenges of testing non-deterministic systems.
  • Experience with API testing tools (e.g., Postman) is highly valuable.
  • Exceptional analytical skills and a meticulous, data-driven approach to quality.
  • Excellent communication skills, with the ability to explain complex AI failures to both technical and non-technical stakeholders.

Job Type: Full-time

Pay: Php90, Php120,000.00 per month

Work Location: In person

  • QA Lead

    4 hours ago

    Quezon City, National Capital Region, Philippines Probe CX Full time ₱24,000 - ₱60,000 per year

    We are seeking a highly organized and analytical QA Lead to oversee quality assurance activities across multiple BPO accounts. The QA Lead will ensure that customer interactions meet client expectations and internal standards, drive continuous improvement, and lead a team of QA analysts to deliver consistent and actionable...

  • QA Lead

    2 hours ago

    Quezon City, National Capital Region, Philippines Probe CX Full time ₱1,200,000 - ₱2,400,000 per year

    At Probe Group, we're powered by passion, driven by curiosity, enriched by a purpose to do it better. We work hard and love a good challenge (or multiple). With clients spanning across the Pacific, Asia and North America, we're no stranger to thinking big and working with innovative minds to achieve great success. We are dedicated to doing things better than...

  • QA Lead

    3 hours ago

    Quezon City, National Capital Region, Philippines Pointwest Full time ₱900,000 - ₱1,200,000 per year

    Pointwest is looking for a Manual QA Tester to join our Insurance Business Unit. This role is key to delivering high-quality software through detailed testing, clear defect reporting, and active collaboration with cross-functional teams. You will contribute to project success by ensuring product reliability while aligning with Pointwest's core values...

  • QA Assistant Team Lead

    4 hours ago

    Quezon City, National Capital Region, Philippines Asticom Technology Inc. Full time ₱1,200,000 - ₱2,400,000 per year

    Job DescriptionDevelops improvement plans based on RCA findings, leads QA operations to ensure delivery of business operations according to client standards, recommends frameworks and strategies for the QA departmentEstablishes organizational goals according to client standardsIdentifies critical success or detrimental factorsImplements continuous...

  • QA Assistant Team Lead

    3 hours ago

    Quezon City, National Capital Region, Philippines Asticom Technology Inc Full time ₱900,000 - ₱1,200,000 per year

    Job DescriptionDevelops improvement plans based on RCA findings, leads QA operations to ensure delivery of business operations according to client standards, recommends frameworks and strategies for the QA departmentEstablishes organizational goals according to client standardsIdentifies critical success or detrimental factorsImplements continuous...

  • QA Lead

    2 hours ago

    Makati City, National Capital Region, Philippines People Matter PH Full time ₱1,200,000 - ₱1,600,000 per year

    We're hiring a Quality Assurance (QA) Lead to support the delivery of an enterprise software platform used across Europe and the Asia Pacific region. In this role, you'll collaborate with globally distributed teams, create and oversee testing plans, uphold QA standards, and help ensure smooth platform implementation.Key ResponsibilitiesQA &...

  • QA Automation Lead

    5 hours ago

    Makati City, National Capital Region, Philippines NISPI Full time ₱1,200,000 - ₱1,300,000 per year

    About the RoleWe are seeking an experienced Quality Assurance Lead with a strong background in both automation and manual testing. The ideal candidate will have extensive experience leading QA teams, ensuring the delivery of high-quality software solutions, and implementing best practices in testing processes.Key ResponsibilitiesLead and mentor QA team...

  • Senior QA Analyst

    4 hours ago

    Quezon City, National Capital Region, Philippines Playbook Sports Full time ₱1,200,000 - ₱1,800,000 per year

    Job Title: Senior QA Analyst (Manual)Location: Remote (Philippines)Work Hours: Full-time, US EST (Night Shift)The Opportunity: As a Senior QA Analyst, you will be a guardian of quality for the Playbook platform. You will be responsible for ensuring our software is stable, reliable, and meets the needs of our users. You will immerse yourself in the product,...

  • Lead QA/QC Engineer

    4 hours ago

    Makati City, National Capital Region, Philippines AtkinsRéalis Full time ₱4,000,000 - ₱6,000,000 per year

    Job Title:Lead QA/QC EngineerLocation:Malanday Valenzuela, PhilippinesJoin UsWe combine AtkinsRéalis project management expertise and Hitachi Energy's deep technological knowledge to create a company dedicated to substations – we are LinxonWhat will you do?Leads in developing and implementing robust Project Quality Plan in line with project contractual...

  • QA Lead

    5 hours ago

    Makati City, National Capital Region, Philippines Koob Talents Full time ₱30,000 - ₱80,000 per year

    Key Responsibilities•Review and verify medical reports for accuracy•Maintain and update documentation systems•Handled communications with stakeholders•Monitor compliance with healthcare regulationsNon-Negotiable Requirements:•USRN Licensed (6 months validity)•1 year of experience in Medical Account for clerical or administrative...