AI Evaluation

Cobalt is hiring experienced finance professionals to build and review the cases used to test whether frontier AI models can carry out real investment research and financial modeling work. Each case is built around a single company, investment decision, or transaction, and recreates the full body of work an analyst would actually do: the source materials,...

Expedock is seeking a Benchmark & Evaluation Engineer to design and implement scalable data environments, generate large benchmark datasets, and curate tasks with robust evaluation rubrics. The role requires a production-data mindset and experience with multi-system data warehouses and APIs. The candidate will own the evaluation harness, maintain regression-...

CSEA in the Philippines is seeking a Software Code Evaluator to help shape the next generation of AI by evaluating code, software outputs, and technical responses generated by AI models. You will apply your software development expertise to assess accuracy, functionality, and overall quality while helping improve AI performance. The role requires a...

Acclaro Inc seeks a native Filipino linguist for freelance MTPE and AI translation evaluation in software localization. You will review MT/LLM outputs, assess quality, and ensure accuracy for IT and SaaS content from English to Filipino in a remote setting.The role favors those with 5+ years in software localization and a strong command of both Filipino and...

Iaas Lc in the Philippines is seeking a detail-oriented data labeling professional to create training data sets for AI models and annotate data to enhance accuracy and alignment with human values.You will work with data scientists and engineers to refine data recipes, adapt to evolving guidelines, and hit daily production targets such as job count and...

Lifted, an Upwork Company™ invites experienced software developers to participate in an AI coding assistant evaluation project. You bring a personal software project and work with an AI coding assistant to implement features, fix bugs, and document code. You'll compare two AI-generated responses, provide candid feedback, and work from a remote setup....

Mindrift seeks US-licensed physicians (MD/DO) to evaluate written clinical EHR vignettes for a medical AI evaluation project. You will review cases across multiple medical domains, scoring reasoning quality and providing concise rationales based on project criteria. The role is independent contractor, fully self-scheduled with no minimum hours. Candidates...

Creating training data sets for AI models that will help improve their accuracy, fluency, coherence, and/or voiceAnnotating data to help AI models align with human valuesAnalyzing and improving the grammar, syntax, and sentence structure of both expert-generated training data and AI model-generated text to ensure it adheres to

English to Filipino MTPE & AI Translation Evaluator (Software Localization) Company : Acclaro Inc Job Type : Full Time Remote / Work from Home Job Description - English to Filipino MTPE & AI Translation Evaluator (Software Localization) Description Freelance English to Filipino Software Localization