AI Data Quality Analyst

Overview

AI Data Quality Analyst

Why This Role Exists — As AI-driven solutions expand across industries, ensuring the fidelity of training and evaluation datasets is essential for building reliable models. TaskUs needs a diligent, detail-focused Data Quality Analyst who can maintain annotation standards and drive continuous improvements so that essential AI data remains accurate, efficient, and scalable.

Responsibilities

• Quality Audits – Perform quality audits on annotated datasets to ensure they meet established guidelines and quality benchmarks.
• Statistical Reporting – Leverage statistical quality metrics such as F1 score and inter-annotator agreement to evaluate data quality.
• Root Cause Analysis – Analyze annotation errors, project processes, and documentation to identify root causes and propose remediation strategies.
• Edge-Case Management – Resolve and analyze edge-case annotations to ensure quality and identify areas for improvement.
• Tooling – Use annotation and quality control tools to perform reviews and track quality metrics.
• Guidelines – Become an expert in project-specific guidelines and provide feedback for clarifications or improvements.
• Continuous Improvement – Identify opportunities to automate analytics, provide deeper insights, and improve efficiency; develop and maintain documentation on quality standards and procedures.
• Collaboration & Communication – Work with stakeholders and clients to understand requirements and improve annotation pipelines; assist with training annotators and provide feedback; report on data quality metrics and actionable insights.

Qualifications

• 1+ years of experience as a data analyst with exposure to data quality and/or data annotation, ideally within an AI/ML context.
• Familiarity with AI/ML pipelines and data concepts.
• Strong analytical and problem-solving skills with exceptional attention to detail.
• Excellent written and verbal communication; ability to articulate quality issues and collaborate with diverse teams.
• Ability to work independently and manage time effectively to meet deadlines.
• Fast learner who can work independently in a fast-paced environment.

Nice To Have

• Experience with data annotation tools (e.g., Labelbox, Dataloop, LabelStudio).
• Experience with multi-modal AI/ML datasets (images, videos, text, audio).
• Knowledge of Python and data quality concepts for AI/ML models.
• Familiarity with common quality metrics and statistical methods used in AI/ML data quality.
• Experience with prompt engineering and leveraging LLMs in day-to-day work.

Why You’ll Love This Role

• Work remotely from anywhere you’re most productive.
• Audit, analyze, and improve complex AI/ML datasets; no two projects are the same.
• Your quality checks and automation ideas directly influence AI model performance.
• Opportunity to grow and scale expertise in AI data quality.
• Join a mission-driven team focused on accurate, reliable AI.

The Impact You’ll Make

• Guard data integrity through audits against guidelines and benchmarks (e.g., F1, inter-annotator agreement) to uphold data reliability.
• Identify and resolve annotation issues, surface insights, and elevate quality across projects.
• Optimize annotation processes by leveraging QA tools, documenting standards, and proposing automation.
• Collaborate with stakeholders and annotators to clarify requirements and support skill development.
• Track and communicate quality performance with regular reports and actionable insights.

About TaskUs

TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies. We serve clients in sectors including social media, e-commerce, gaming, streaming media, food delivery, ride-sharing, HiTech, FinTech, and HealthTech. Our People First culture focuses on competitive salaries, comprehensive benefits, internal mobility, and professional growth across 23 locations in 12 countries.

DEI & Equal Opportunity

We believe innovation and high performance come from people from all walks of life. TaskUs is committed to equal access to opportunities and providing reasonable accommodations in the hiring process. We celebrate diversity and foster an inclusive environment. If you need accommodations, please let us know. We invite you to explore all TaskUs career opportunities and apply at . TaskUs is an equal opportunity employer and affirmative action employer.

Req Id: R_2507_10226_6

Posted At: Wed Jul :00:00 GMT+0000 (Coordinated Universal Time)

#J-18808-Ljbffr

---