AI Model Assurance Specialist

7 hours ago

San Juan, National Capital Region, Philippines beBeeDataQuality Full time $50,000 - $80,000

About the Role

Ensuring the accuracy and reliability of AI models is a top priority for our organization. The role of an AI Data Quality Analyst plays a vital part in this process by guaranteeing that training and evaluation datasets meet the highest standards.

Key Responsibilities:

  • Perform quality audits on annotated datasets to ensure they adhere to established guidelines and quality benchmarks.
  • Utilize metrics such as F1 score and inter-annotator agreement to assess data quality.
  • Analyze annotation errors, trends, and project documentation to identify root causes and propose remediation strategies.
  • Resolve and analyze edge-case annotations to ensure quality and pinpoint areas for improvement.
  • Effectively employ annotation and quality control tools to conduct reviews and track quality metrics.
  • Become an expert in project guidelines and provide feedback for clarifications or enhancements.
  • Identify opportunities for automation and contribute to the development of quality standards and procedures.

Requirements:

  • 1+ years of experience as a data analyst with exposure to data quality and/or data annotation, preferably in an AI/ML context.
  • Familiarity with fundamental concepts of AI/ML pipelines and data.

Preferred Skills:

  • Strong analytical and problem-solving skills, coupled with an exceptional attention to detail.
  • Excellent written and verbal communication skills to clearly articulate quality issues and collaborate with diverse teams.
  • Ability to work independently and manage time effectively to meet deadlines.
  • Strong problem-solving, critical thinking, and continuous optimization mindset.
  • Capacity to work independently in a fast-paced environment with a focus on detail and strategic priorities.
  • Positive can-do attitude and adaptability to new environments.

This position is remote-friendly. As an AI Data Quality Analyst, you will collaborate with analysts, engineers, and stakeholders to develop accurate and reliable AI models.

What We Offer:

  • Opportunities for professional growth and development.
  • A dynamic and collaborative work environment.
  • The chance to make a meaningful impact on the accuracy and reliability of AI models.

  • Hebrew Language Specialist

    1 day ago

    San Juan, National Capital Region, Philippines beBeeRefinement Full time $800 - $6,500

    Job Title: Hebrew Language Specialist - AI Model RefinerJob Description:We are seeking a skilled Hebrew language expert to assess and refine AI-generated translations for grammatical accuracy, fluency, cultural nuance, and context sensitivity.As a specialist, you will work with large-scale language models to deliver accurate, context-aware translations that...

  • AI Model Quality Specialist

    1 day ago

    San Juan, National Capital Region, Philippines beBeeEvaluator Full time $80,000 - $160,000

    Job Summary:This is a high-priority role that demands exceptional writing and analytical abilities. As a Generative AI Evaluator, you will play a pivotal part in developing and refining large language models.

  • Language Model Optimization Expert

    1 day ago

    San Juan, National Capital Region, Philippines beBeeLinguistics Full time ₱638,739 - ₱1,073,428

    Job SummaryWe are seeking an exceptional Linguistics Specialist to join our team. In this role, you will be responsible for creating high-quality training data sets for AI models, ensuring they meet the required standards of accuracy, fluency, and coherence.Key ResponsibilitiesDevelop expert-generated training data that aligns with human values and meets the...

  • AI Content Specialist

    1 day ago

    San Juan, National Capital Region, Philippines beBeeCreator Full time ₱29,921 - ₱37,469

    Job Description\We are seeking a professional to craft engaging and informative text that will help train AI models. This is an opportunity for you to apply your writing, editing, and communication skills to shape the future of AI.\As a content creator, you will be responsible for crafting original, clear, and fact-checked responses based on project...

  • AI Quality Engineering Specialist

    1 day ago

    San Juan, National Capital Region, Philippines beBeeData Full time ₱6,000,000 - ₱8,000,000

    Job Description:OverviewWe are seeking a proactive leader to architect and uphold high-quality annotation workflows so that AI models are built and evaluated on reliable data without compromising on speed or efficiency.The Role:Lead and mentor a team of Data Quality Analysts, setting clear quality goals, delivering feedback, and fostering a culture of...

  • Software Quality Assurance Expert

    1 day ago

    San Juan, National Capital Region, Philippines beBeeQuality Full time ₱250,000 - ₱500,000

    Job Title:A Quality Assurance Specialist is needed to deliver high-quality Voice AI applications.

  • Gen AI Content Specialist

    1 day ago

    San Juan, National Capital Region, Philippines beBeeContent Full time ₱1,200,000 - ₱1,600,000

    About the RoleThis role combines editing and technical skills to deliver high-quality, Gen AI-optimized content.You will work closely with Senior Gen AI Content Specialists to segment and refactor content for efficient use by Large Language Models (LLMs).You will lead decision-making as you grow in the role, with coaching provided at first, and increasing...

  • AI-Generated Content Reviewer

    1 day ago

    San Juan, National Capital Region, Philippines beBeeData Full time $23,040 - $38,400

    About the RoleWe are seeking a skilled Data Review Specialist to support the improvement of AI-generated content in Chinese Simplified.The ideal candidate will have native-level fluency in Chinese Simplified, proficient English reading and writing skills, and be able to work 10+ hours per week.The role involves reviewing and scoring AI-generated responses...

  • AI Software Developer

    24 hours ago

    San Juan, National Capital Region, Philippines beBeeSoftware Full time $750,000 - $1,500,000

    Are you looking for a challenging role that combines your coding skills with your passion for innovation? As a Software Development Specialist, you will play a key part in reviewing and evaluating content for generative AI models.This is an opportunity to be part of a broader initiative that brings together subject matter experts from various fields to...

  • Hebrew Language Specialist

    1 day ago

    San Juan, National Capital Region, Philippines beBeeHebrew Full time $8 - $65

    Job SummaryWe are seeking a skilled Hebrew language specialist to join our team in shaping the future of AI.Leveraging large-scale language models is crucial for their development.Expertise will be used to train advanced language models on various topics, including verb conjugation, sentence structure, and regional dialects.Key ResponsibilitiesEngage in...