AI Rater

The role of a Data Scientist is crucial in our AI Rater Incubation Program, uncovering valuable insights from data generated by raters to enhance AI-driven ad relevance and related initiatives. This strategic position involves designing models, building analytics frameworks, and collaborating closely with linguists, program managers, and...

Job Description:We are seeking an AI System Review Specialist to play a critical role in shaping the systems that train large language models.Main Responsibilities:Participate in new guideline pilot projects by reviewing ambiguous or edge-case examples with attention to linguistic nuance and rating logic.Identify inconsistencies, unclear instructions, or...

Senior Linguistic Quality SpecialistThis is a unique opportunity to lead the linguistic quality assurance for a high-impact AI program.The role involves collaborating with cross-functional teams, including program managers, data scientists, and raters to translate client objectives into actionable rating guidelines.Key responsibilities include:

Job OpportunityThis position involves advanced data analysis to support the development, testing, and refinement of AI rating frameworks during early-stage pilot projects. As an Experimental Rater, you will play a critical role in shaping systems that train large language models by identifying gray areas in guidelines, flagging edge cases, and offering...

About the JobWe are seeking a skilled Linguistic Quality Professional to play a crucial role in our AI Rater Incubation Program.This position will ensure that rater guidelines are accurate, usable, and aligned with client objectives.Key ResponsibilitiesTranslate client goals into clear, actionable rating criteria.Ensure criteria reflect what "good quality"...

Job Title:Quantitative AnalystOverviewResponsibilities Develop, implement and maintain program performance metrics in collaboration with cross-functional teams. Design and analyze statistical tests to uncover drivers of performance and label patterns. Build dashboards and reports in Looker Studio or similar BI tools to support operational decisions. ...

Job OverviewWe are seeking an expert in linguistic analysis to lead the development of high-quality guidelines for AI rater evaluation.The ideal candidate will have expertise in semantics, pragmatics, discourse, and applied linguistic analysis. They will design, test, and refine rating frameworks, create pilot test sets, and ensure consistent, high-quality...

Unlock insights from data and drive strategic decisions as a Data Analyst/ScientistDevelop, implement, and maintain performance metrics for program and rater evaluationDesign and analyze experiments to uncover drivers of performance and label patternsBuild dashboards, reports, and automated monitoring systems in business intelligence toolsIdentify and...

Unlock the power of data analytics to drive business growth and innovation. We are seeking a skilled Data Specialist to join our Business Intelligence Team.The ideal candidate will possess strong analytical skills, with expertise in statistical modeling and experimental design. This role entails analyzing and interpreting large datasets using statistical...

Experimental Rater Job DescriptionAs a crucial part of our AI development process, we are looking for an Experimental Rater to support the refinement of AI rating guidelines during early-stage pilot projects. You will play a pivotal role in shaping the systems that train large language models by identifying gray areas in guidelines, flagging edge cases, and...

Job OverviewThis role requires a skilled professional with expertise in critical thinking to support the development, testing, and refinement of AI rating guidelines. The successful candidate will play a key role in shaping systems that train large language models by identifying gray areas in guidelines, flagging edge cases, and offering structured...

We are seeking a Senior Linguist to play a pivotal role in our AI Rater Incubation Program. This position will ensure that rater guidelines are accurate, usable and aligned with client goals, with a strong focus on ads relevance projects.Key Responsibilities:Evaluate and enhance rater guidelines for accuracy and usability.Collaborate with cross-functional...

Job OverviewThe Linguistic Quality Manager is a pivotal role in our AI Rater Program. This position focuses on ads relevance projects, designing rating frameworks, testing and refining them, creating pilot test sets, and ensuring rater training and quality processes drive client outcomes.

Job OverviewWe are seeking a skilled Linguistic Quality Manager to lead our AI Rater Incubation Program, focusing on ads relevance projects. As the primary linguist, you will design, test, and refine rating frameworks, create pilot test sets, and ensure that rater training and quality processes drive desired client outcomes.Main Responsibilities:To translate...

Senior Linguistic Quality SpecialistJob Overview:Our team is seeking a skilled Senior Linguistic Quality Specialist to drive excellence in AI-powered projects. This pivotal role involves developing and refining rating frameworks, ensuring consistency, and collaboration with cross-functional teams.Key Responsibilities:Develop and refine annotation/rating...

Role OverviewAs a pivotal member of our AI Rater Incubation Program, you will play a crucial role in ensuring that rater guidelines are accurate and aligned with client objectives.This position requires a deep understanding of linguistic expertise, quality management, and client collaboration to design, test, and refine rating...

Job Title: Experimental RaterThis is an exciting opportunity to support the development of AI rating guidelines during early-stage pilot projects.

Senior Data AnalystThis role involves leveraging data analysis and statistical skills to uncover insights from rater-generated data, guiding operational decisions, shaping client recommendations, and driving innovation at the intersection of AI, linguistics, and human judgment.Key Responsibilities:Develop, implement, and maintain program and rater...

Job TitleWe are seeking a seasoned professional to join our team as a Data Analyst. In this role, you will play a key part in uncovering insights from data and driving innovation at the intersection of AI, linguistics, and human judgment.As a strategic member of our team, you will analyze operational and labeling data to identify trends, surface bias, and...