Data Quality Engineering Lead

AI Data Quality and Engineering Lead

The role of an AI Data Quality and Engineering Lead is to ensure the highest quality data for artificial intelligence systems.

This involves designing and executing quality assurance strategies for large-scale, multi-modal data annotation projects. It also includes leading a team of Data Quality Analysts, mentoring them, and fostering a culture of continuous improvement and accountability.

• Build and guide a high-performing team: Lead and mentor a team of Data Quality Analysts, setting clear quality goals, delivering feedback, and fostering a culture of precision and accountability.
• Ensure quality at scale: Develop and continually refine robust QA processes, SOPs, and statistical quality metrics (e.g., F1 score, inter-annotator agreement) to protect the integrity of annotation outputs.
• Drive transparency and insight: Create dashboards and reports that reveal quality trends, root causes of errors, and improvement opportunities - communicating these insights to leadership and clients.
• Champion tool innovation and efficiency: Manage annotation and QA platforms (like Labelbox, Dataloop, LabelStudio), and lead the evaluation or implementation of new automation tools to elevate efficiency and maintain quality.

Requirements and Qualifications:

• 3+ years of experience in data quality management, data operations, or related roles within AI/ML or data annotation environments.
• Proven track record in designing and executing quality assurance strategies for large-scale, multi-modal data annotation projects.
• Proven track record in a leadership role managing and developing high-performing, remote or distributed teams.
• Deep understanding of data annotation processes, quality assurance methodologies, and statistical quality metrics (e.g., F1 score, inter-annotator agreement).
• Strong data-analysis skills, with the ability to interrogate large datasets, perform statistical analyses, and translate findings into actionable recommendations.
• Excellent communication skills, with experience presenting complex data and quality insights to technical and non-technical stakeholders.
• Proficiency with annotation and QA tools (e.g., Labelbox, Dataloop, LabelStudio).
• High-level of proficiency in common data-analysis tools, such as Excel and Google Sheets.
• Familiarity with programmatic data analysis techniques (e.g., Python, SQL).
• Familiarity with the core concepts of AI/ML pipelines, including data preparation, model training, and evaluation.

Preferred Qualifications:

• Prior experience in an agile or fast-paced tech environment with exposure to AI/ML pipelines.
• Experience in a managed services or vendor-driven environment.
• Familiarity with prompt engineering and large-language-model assisted workflows to optimise annotation and validation processes.
• In-depth knowledge of ethical AI practices and compliance frameworks.

Benefits and Opportunities:

We offer competitive industry salaries and comprehensive benefits packages. Our commitment to a People First culture is reflected in the various departments we have established, including Total Rewards, Wellness, HR, and Diversity. We take pride in our inclusive environment and positive impact on the community. Moreover, we actively encourage internal mobility and professional growth at all stages of an employee's career within our organisation.

Join us today and experience firsthand our dedication to supporting People First. Work from anywhere you're most productive and enjoy every challenge being new. You will be working on first-of-their-kind problems at the frontier of AI safety. You will have a visible impact on how the world's leading AI teams mitigate risk and there will be room to grow and build the solutions function from scratch and scale into leadership as revenue follows.

How We Partner To Protect Your Information:

We do not solicit money from applicants during their application process nor require any form of payment in order to proceed with their application. Applicants must always be in communication with only authorized recruiters of ours.

We are committed to providing equal access to opportunities and invite you to explore all our career opportunities and apply through our careers website.

],

---