
AI Evaluation Specialist
21 hours ago
This role involves designing and implementing agent evaluation pipelines to benchmark AI capabilities in real-world enterprise settings.
">Benchmarking includes metrics tracking and analysis, with experience in systems engineering, infrastructure roles or performance engineering backgrounds.
Metrics are critical components for evaluating system efficiency and effectiveness. In this context, a strong ownership of metric design and implementation is required.
- Design and develop agent evaluation pipelines;
- Evaluate AI capabilities through real-world use cases;
- Metric design and development experience;
- Benchmarking skills for evaluating system performance;
- Strong understanding of systems engineering and infrastructure principles;
- Experience working in performance engineering environments;
A competitive compensation package is offered to attract top talent and foster a productive work environment. The company aims to provide challenging projects that facilitate professional growth and development opportunities.
-
High-Quality AI Data Specialist
2 days ago
Baguio City, Cordillera, Philippines beBeeData Full time ₱400,000 - ₱700,000Job Title: AI/LLM EvaluatorWe are seeking a skilled AI Data Specialist to join our team. As an AI Data Specialist, you will play a critical role in creating high-quality training data sets for our AI models.Your primary responsibilities will include:Annotating data to ensure it aligns with human values and ethicsAnalyzing and improving grammar, syntax, and...
-
Baguio City, Cordillera, Philippines beBeeEvaluation Full time ₱40,000 - ₱55,000Evaluate AI Responses for Cutting-Edge Spanish ProjectsWe are seeking skilled and detail-oriented freelance annotators to work on a Response Correctness Annotation Project in Spanish. This project involves fact-checking, reasoning, and structured annotations based on detailed guidelines.No writing is required, but strong analytical and reasoning skills are...
-
AI Data Annotation Specialist
2 days ago
Baguio City, Cordillera, Philippines beBeeData Full time ₱350,000 - ₱550,000This role involves working on Gen AI projects that require high-quality data preparation, annotation, and evaluation. The ideal candidate has a generalist skill set, strong analytical abilities, and prior exposure to annotation or AI-driven projects.Key ResponsibilitiesPerform data annotation tasks across text and multimodal datasets.Conduct...
-
AI Engineering Specialist
2 days ago
Baguio City, Cordillera, Philippines beBeeMechanical Full time $20,000 - $50,000Unlock AI PotentialMindrift’s platform connects experts with AI projects from major tech innovators.About the RoleAs an AI Tutor in Auto Engineering, you’ll collaborate on projects that challenge AI models and refine their responses.You’ll work on tasks such as:Generating prompts to test AI limits.Defining scoring criteria for evaluating AI...
-
AI Content Enhancer
2 days ago
Baguio City, Cordillera, Philippines beBeeData Full time $28,800 - $48,000Job OpportunityWe are looking for a Data Specialist to enhance the quality of AI-generated content in Chinese Simplified. This role is ideal for individuals seeking to supplement their income.Key Responsibilities:Assess and score AI-generated responses across various topicsSuggest improvements using natural language examplesEvaluate model outputs through A/B...
-
AI Programming Specialist
2 days ago
Baguio City, Cordillera, Philippines beBeeDevelopment Full time $75,000 - $125,000Unlock your potential as a skilled programmer in this exciting role!This opportunity is part of a broader initiative that brings together subject matter experts from various fields to support the development of generative AI models.The platform supports teams building AI-powered applications—whether through fine-tuning large language models or streamlining...
-
Senior AI Engineer
2 days ago
Baguio City, Cordillera, Philippines beBeeCompliance Full time $4,000 - $5,000Senior AI Engineer - Compliance SpecialistWe are seeking a highly skilled Senior AI Engineer to join our team as a Compliance Specialist. As a key member of our engineering team, you will play a critical role in designing and implementing AI-driven solutions to support advertiser compliance at scale.
-
AI Data Quality Specialist
21 hours ago
Baguio City, Cordillera, Philippines beBeeDataQuality Full time ₱600,000 - ₱800,000Job Description:As a meticulous data quality expert, you will be responsible for ensuring the integrity of training and evaluation datasets. This is crucial for building reliable AI models that can effectively learn from data.The ideal candidate will possess excellent analytical skills, attention to detail, and the ability to work independently in a...
-
AI Project Specialist
2 days ago
Baguio City, Cordillera, Philippines beBeeExpert Full time $30,000 - $40,000Unlocking the Power of AIWe're on a mission to connect people from around the world with exciting freelance projects that help improve artificial intelligence.About the Role As an annotator, you'll be invited to participate in online projects like rating AI-generated content, evaluating factual accuracy, or comparing responses when available.Key...
-
Academic Manuscript Evaluator
2 days ago
Baguio City, Cordillera, Philippines beBeeEducation Full time ₱9,500 - ₱13,450OverviewAs a Freelance Peer Reviewer, you will be responsible for assessing manuscripts and providing constructive feedback to authors.We are currently seeking researchers with a doctorate (PhD/MD) or equivalent advanced degree in their subject area. Candidates should have a thorough understanding of research methodologies and ethical principles within the...