AI Data Quality Specialist

1 day ago

Mabalacat, Central Luzon, Philippines beBeeDataQualityAnalyst Full time ₱1,280,000 - ₱2,205,000

About the Role: TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies. Our goal is to help clients represent, protect and grow their brands.

We are looking for an experienced data analyst who can perform quality audits on annotated datasets, leverage statistical based quality metrics, analyze annotation errors, and identify areas for improvement. The ideal candidate will have strong analytical and problem-solving skills, excellent written and verbal communication skills, and the ability to work independently in a fast-paced environment.

Key Responsibilities:

  1. Data Analysis - Perform quality audits on annotated datasets, evaluate data quality using statistical based quality metrics such as F1 score and inter-annotator agreement.
  2. Root Cause Analysis - Analyze annotation errors, trends, project processes, and project documentation to identify and understand the root cause of errors and propose remediation strategies.
  3. Edge-Case Management - Resolve and analyze edge-case annotations to ensure quality and identify areas for improvement.
  4. Tooling - Become proficient in using annotation and quality control tools to perform reviews and track quality metrics.
  5. Guidelines - Provide feedback for potential clarifications or improvements on project specific guidelines.

Continuous Improvement

  1. Automation - Identify opportunities to use automation to enhance analytics and improve efficiency.
  2. Documentation - Develop and maintain up-to-date documentation on quality standards, annotation guidelines, and quality control procedures.
  3. Feedback - Provide regular feedback that identifies areas for improvement across the annotation pipeline.

Collaboration & Communication

  1. Cross-Functional Teamwork - Work closely with key project stakeholders and clients to understand project requirements and improve annotation pipelines.
  2. Training - Assist with training annotators, providing guidance, feedback, and support to ensure data quality.
  3. Reporting - Provide regular updates that highlight data quality metrics, key findings, and actionable insights for continuous process improvements.

Requirements:

  • 1+ years of experience as a data analyst with exposure to data quality and/or data annotation in an AI/ML context.
  • Familiarity with the basic concepts of AI/ML pipelines and data.
  • Strong analytical and problem-solving skills with an exceptional eye for detail.
  • Excellent written and verbal communication skills, with the ability to clearly articulate quality issues and collaborate with diverse teams.
  • Ability to work independently and manage time effectively to meet deadlines.
  • A strong problem-solver who thinks critically and drives innovation and continuous optimization.
  • A quick learner with the ability to work independently in a fast-paced environment.
  • A strong focus on detail, balanced against strategic priorities.
  • A positive can-do attitude and the ability to easily adapt to new environments.

Benefits:

  • Competitive industry salaries
  • Comprehensive benefits packages
  • Ongoing training and development opportunities
  • A collaborative and inclusive work environment

How We Partner To Protect You: TaskUs will neither solicit money from you during your application process nor require any form of payment in order to proceed with your application. If you need reasonable accommodations in any part of the hiring process, please let us know. We invite you to explore all TaskUs career opportunities and apply through our website.

  • AI Data Quality Manager

    1 day ago

    Mabalacat, Central Luzon, Philippines beBeeData Full time $100,000 - $150,000

    We are seeking a seasoned Data Quality Leader to spearhead our efforts in ensuring the integrity and accuracy of AI data.">This role is crucial in architecting and upholding high-quality annotation workflows, so AI models are built and evaluated on reliable data without compromising on speed or efficiency.]The ideal candidate will have 3+ years of experience...

  • AI Data Quality Expert

    10 hours ago

    Mabalacat, Central Luzon, Philippines beBeeDataQuality Full time $60,000 - $83,000

    Job SummaryWe are seeking a detail-focused Data Quality Analyst to maintain annotation standards and drive continuous improvements in our AI data quality process.This role offers the opportunity to work on varied projects, build expertise in AI data quality, and expand influence as projects grow.

  • AI Model Data Specialist

    1 day ago

    Mabalacat, Central Luzon, Philippines beBeeEvaluator Full time ₱800,000 - ₱1,000,000

    The role of an AI/LLM Evaluator involves creating training data sets for Artificial Intelligence models to enhance their precision, fluency, coherence, and voice. This entails annotating data to assist AI models align with human values, analyzing and improving grammar, syntax, and sentence structure, and collaborating with cross-functional teams to refine...

  • AI Data Project Leader

    1 day ago

    Mabalacat, Central Luzon, Philippines beBeeData Full time $75,000 - $125,000

    Pareto AI is on a mission to enable top talent around the world to participate in the development of cutting-edge AI models.We have joined forces with top AI and crowd researchers at Anthropic, Character.AI, Imbue, Stanford, and University of Pennsylvania to build a fair and ethical platform for AI developers to collaborate with domain experts to train...

  • Enhancing AI Systems through Precise Data

    1 day ago

    Mabalacat, Central Luzon, Philippines beBeeDataQuality Full time ₱1,000,000 - ₱1,500,000

    AI Data Quality LeaderTaskUs is seeking an experienced leader to oversee AI data quality across its operations.Develop and implement quality assurance processes and standard operating procedures to ensure high-quality outputs.Establish comprehensive quality metrics that align with business objectives and industry standards.Continuously review and refine...

  • AI Model Development Specialist

    1 day ago

    Mabalacat, Central Luzon, Philippines beBeeProgramming Full time $84,323 - $118,438

    Enhance AI-Powered ApplicationsImprove AI-powered applications by partnering with enterprise clients to review and evaluate content for generative AI models. This initiative brings together subject matter experts from various fields to support the development of AI models.Expertise in programming languages is required to produce high-quality, domain-specific...

  • AI Development Specialist

    1 day ago

    Mabalacat, Central Luzon, Philippines beBeeDevelopment Full time ₱4,000 - ₱8,000

    Job DescriptionWe are seeking a highly skilled AI Development Specialist to join our team. As an Experimental Rater, you will play a critical role in shaping the systems that train large language models.Key ResponsibilitiesParticipate in new guideline pilot projects by reviewing ambiguous or edge-case examples with attention to linguistic nuance and rating...

  • Data Annotation Specialist

    1 day ago

    Mabalacat, Central Luzon, Philippines beBeeDataAnnotation Full time ₱500,000 - ₱750,000

    Job SummaryAbout the RoleWe are seeking a detail-oriented and analytical professional to join our team as a Data Annotation Specialist.The ideal candidate will have prior experience in data annotation or GenAI projects and possess strong analytical thinking and attention to detail.Key ResponsibilitiesPerform data annotation tasks across text and multimodal...

  • AI Model Performance Specialist

    1 day ago

    Mabalacat, Central Luzon, Philippines beBeeEvaluator Full time $90,000 - $120,000

    Job OverviewAs an AI/LLM Evaluator, you will play a critical role in shaping the performance of artificial intelligence models.Key ResponsibilitiesTraining Data Development: Create high-quality training datasets that enhance the accuracy, fluency, coherence, and voice of AI models.Data Annotation: Annotate data to align AI models with human values and ensure...

  • AI Proposal Content Specialist

    1 day ago

    Mabalacat, Central Luzon, Philippines beBeeProposal Full time ₱420,000

    Transform Your Career with a Proposal Writing RoleJob DescriptionAs a skilled Proposal Writer and AI Content Specialist, you will be responsible for reviewing, refining, and humanizing AI-generated proposals to make them compelling, accurate, and client-ready. This role involves ensuring that proposals align with client tone, brand, and requirements.Key...