ai evaluator

Analyze and evaluate a variety of data and AI-generated content.Annotate information according to project-specific guidelines.Review AI outputs for accuracy, relevance, clarity, and quality.Identify errors, inconsistencies, weak reasoning, and missing information.Provide clear written feedback and recommendations.Complete problem-solving and reasoning tasks...

Contribute to cutting-edge AI development by evaluating model outputs and providing detailed feedback to improve performance through Reinforcement Learning from Human Feedback (RLHF). You will work on complex AI tasks requiring critical thinking, reasoning, and content evaluation.Requirements:2+ years of experience in AI data annotation, evaluation, content...

RecruitFirst Pte. Ltd seeks an AI annotation and evaluation specialist to drive quality in cutting-edge projects. You will implement strategy, audit vendor outputs, and assist with exploratory projects that shape scalable annotation workflows.You will design prompts, analyze data, and stay ahead of industry developments to optimize processes and...

TELUS Digital AI Data Solutions is seeking a dedicated data scientist to ensure data quality and push AI innovation. You will conduct diagnostic testing on model performance and develop evaluation frameworks for accuracy and safety.The ideal candidate has a Bachelor’s Degree in a relevant field and assumes proficiency in data manipulation tools such as...

About OpenTrain OpenTrain AI is the hiring and contracting organization for this role. OpenTrain is the leading platform for finding and building careers in AI training and data labeling, connecting skilled contributors with projects that shape how modern AI systems work. Create a free OpenTrain account to build your profile and apply in minutes. This...

Genpact in the Philippines is seeking a Lead AI Engineer to drive evaluation frameworks for AI models, including performance, safety, and user experience. You will lead large-scale human evaluations, curate test datasets, and translate results into strategic guidance for research, engineering, and product teams.The role requires expertise in AI/ML...

**About Gramian** Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. **About The Role** We are looking...

Key Responsibilities:Evaluate video, audio, image, and text content.Assess AI-generated responses for accuracy, quality, relevance, and guideline compliance.Follow project guidelines while maintaining high accuracy and productivity.Requirements:Graduate of any four-year bachelor's degree programExcellent English communication and comprehension...

Filipino AI Product EvaluatorThe ProjectProductive Playhouse is building a talent pool of Filipino speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S.   This is more than one job....

Help shape the next generation of AI by evaluating code, software outputs, and technical responses generated by AI models. You will apply your software development expertise to assess accuracy, functionality, and overall quality while helping improve AI performance.Requirements:Bachelor's degree in Computer Science, Software Engineering, or related field2+...

Support the development of advanced speech and audio AI systems by evaluating voice interactions, pronunciations, and audio outputs. You will analyze language quality, accuracy, and user experience across diverse accents and international voice datasets.Requirements:Excellent English communication and listening skillsExperience in voice-based,...

SME Careers is seeking an experienced localization specialist for an hourly, fully remote contractor role reviewing and generating Chinese content and AI prompts. You will assess AI responses for accuracy, clarity, and reasoning, while ensuring correct Mandarin localization and English handling. You will apply MQM/LQA concepts to improve model outputs, write...

OpenTrain AI is seeking a senior Java code reviewer to audit AI-generated Java code, validate compliance with prompts, and ensure performance and security standards. You will correct annotator evaluations and provide precise, actionable feedback within a structured QA workflow. The role requires 7+ years in Java, deep JVM expertise, and excellent written...

Job Overview We are seeking detail-oriented Trust & Safety Analysts – AI Evaluation to review and evaluate AI-generated outputs using content safety policies, project guidelines, and expert human judgment. In this role, you will assess complex AI outputs and provide accurate, consistent evaluations that help improve the safety and quality of AI systems....

OpenTrain AI is seeking a senior Java code reviewer to audit AI-generated Java code, validate compliance with prompts, and ensure performance and security standards. You will correct annotator evaluations and provide precise, actionable feedback within a structured QA workflow.The role requires 7+ years in Java, deep JVM expertise, and excellent written...

Crossing Hurdles is looking for a Speech AI Evaluation Specialist fluent in Tagalog to engage in voice conversations with AI models. This remote role involves evaluating AI responses and providing feedback to enhance AI systems in Tagalog.The ideal candidate should have native-level Tagalog fluency and advanced English skills, along with experience in...

Productive Playhouse is seeking a Spanish (Mexico) AI Product Tester to evaluate AI chatbots and language models. You will interact with models, follow the project’s SOW, and submit write-ups, ratings, and recordings.This freelance, project-based role offers flexible hours and the ability to work with multiple clients. Ideal candidates are native Spanish...

Productive Playhouse is seeking Hindi-speaking evaluators to test and rate AI chatbots and language models. You will interact with AI models, provide structured feedback, and contribute to model safety and usefulness. This is a remote, task-based engagement with flexible hours and batch-based work.Ideal candidates are fluent in Hindi and English, have...

Career International FOS Pte Ltd is seeking an Annotation Specialist to support AI model evaluation. You will work across languages such as Thai, Korean, Japanese, French, German, Portuguese (Brazil), and Spanish, ensuring editorial quality and scalability.You will conduct vendor annotation quality checks, help develop guidelines, design and refine system...

Support the development of advanced speech and audio AI systems by evaluating voice interactions, pronunciations, and audio outputs. You will analyze language quality, accuracy, and user experience across diverse accents and international voice datasets. Requirements: Excellent English communication and listening skills Experience in voice-based,...