AI Benchmarking Specialist

1 week ago

Pagadian, Zamboanga Peninsula, Philippines beBeeArtificialintelligence Full time $200,000 - $240,000
Technical Staff Position

We are seeking a highly skilled technical professional to join our engineering team. As a key member, you will be responsible for designing and implementing evaluation pipelines that benchmark AI capabilities across real-world enterprise use cases.

The ideal candidate will have strong ownership of metrics and benchmarking, with experience in systems, infrastructure, or performance engineering roles. You should be proficient in Python and comfortable working across full-stack and backend services. Additionally, you should have experience building or using large language models, vector-based search, or agentic frameworks in production environments.

Your responsibilities will include:

  • Designing and implementing agent evaluation pipelines that benchmark AI capabilities across real-world enterprise use cases.
  • Building domain-specific benchmarks for product support, engineering operations, GTM insights, and other verticals relevant to modern SaaS.
  • Developing performance benchmarks that measure and optimize for latency, safety, cost-efficiency, and user-perceived quality.
  • Creating search- and retrieval-oriented benchmarks, including multilingual query handling, annotation-aware scoring, and context relevance.

We are looking for someone who is passionate about measuring what matters and has a deep appreciation for evaluating techniques in natural language processing, information retrieval, or human-centered AI. If you are excited about shaping the KPIs of the AI-native enterprise and bringing rigor to systems that reason, we encourage you to apply.

Bonus: experience contributing to academic or open-source benchmarking projects.

Culture and Benefits

Our culture is built on four core values: hunger, humility, honesty, and heart. We believe in empowering engineers to leverage design, data engineering, and machine intelligence to build customer-centric companies.

At our organization, we are committed to helping companies thrive in the rapidly evolving landscape of AI-driven SaaS.

We continue to push the boundaries of innovation, helping thousands of companies around the world.

  • AI Data Assurance Specialist

    1 week ago

    Pagadian, Zamboanga Peninsula, Philippines beBeeDataQuality Full time ₱1,000,000 - ₱1,500,000

    About This RoleWe are seeking a detail-focused Data Quality Analyst to ensure the fidelity of training and evaluation datasets for AI-driven solutions. This role requires maintaining annotation standards and driving continuous improvements to keep AI data accurate, efficient, and scalable.Key Responsibilities:Perform quality audits on annotated datasets to...

  • AI Content Specialist

    1 week ago

    Pagadian, Zamboanga Peninsula, Philippines beBeeSpecialist Full time ₱8,000 - ₱10,000

    Job Title: AI Content Specialist About the Role:The position involves creating high-quality, engaging content that trains AI models to understand and generate human-like text. You will craft original responses based on project guidelines, ensuring consistency in style and quality standards.Crafting compelling, clear, and fact-checked content for AI training...

  • AI Content Specialist

    1 week ago

    Pagadian, Zamboanga Peninsula, Philippines beBeeProposal Full time ₱420,000

    Job DescriptionWe are seeking a highly skilled and experienced Proposal Writer & AI Content Specialist. The primary responsibility is to manage proposals generated by AI — reviewing, refining, and humanizing them to ensure they are compelling, accurate, and client-ready.Responsibilities:Review and refine AI-generated proposals, ensuring clarity, accuracy,...

  • Human-AI Collaboration Expert

    1 week ago

    Pagadian, Zamboanga Peninsula, Philippines beBeeCollaboration Full time $3,600 - $6,000

    AI Collaboration SpecialistWe are seeking a highly skilled AI collaboration specialist to join our team. As an AI Agent Assistant, you will work closely with large language models (LLMs) to deliver high-quality results and support industries worldwide.Your day-to-day activities may range from fact-checking scientific claims to curating datasets, conducting...

  • AI Automation Solutions Specialist

    1 week ago

    Pagadian, Zamboanga Peninsula, Philippines beBeeAutomation Full time ₱4,500,000 - ₱6,500,000

    Job Title: AI Automation SpecialistWe're looking for a skilled professional to implement AI-powered automation solutions.Key Responsibilities:Configure and deploy pre-built AI automations using tools like Make.com, GPTs, and WhatsApp flowsCustomize prompt logic and tone based on client business needsTest and QA each automation for performance and...

  • QA Expert

    1 week ago

    Pagadian, Zamboanga Peninsula, Philippines beBeeAi Full time ₱2,500,000 - ₱3,500,000

    Job OverviewAs a Quality Assurance Specialist, you will play a vital role in driving innovation and automation within our organization.The ideal candidate will have a strong background in quality assurance or customer experience analytics, with experience working with AI/ML model evaluation frameworks and benchmarks.We are looking for an individual who can...

  • AI Data Annotator

    1 week ago

    Pagadian, Zamboanga Peninsula, Philippines beBeeAI Full time ₱174,753 - ₱299,843

    Part-time Freelance AI SpecialistTackle the exciting challenge of enhancing artificial intelligence models by annotating data.We connect you with advanced AI projects that require human expertise to train and improve their accuracy.You will work on a part-time, remote freelance project that fits around your primary professional or academic...

  • AI Automation Specialist

    1 week ago

    Pagadian, Zamboanga Peninsula, Philippines beBeeAutomation Full time $80,000 - $150,000

    We are seeking a skilled individual to implement AI solutions and automate workflows.This role requires strong analytical and problem-solving skills, as well as experience with AI tools like OpenAI, MidJourney, Zapier, Airtable.ResponsibilitiesLead AI automation projects.Analyze data and optimize AI workflows.Create high-quality AI-generated content.Develop...

  • AI Automation Specialist

    1 week ago

    Pagadian, Zamboanga Peninsula, Philippines beBeeAutomation Full time $120,000 - $150,000

    AI Automation EngineerWe are seeking a highly skilled AI Automation Engineer to join our team. As an AI Automation Engineer, you will be responsible for designing and developing AI-driven solutions that automate manual services.Work closely with the CTO to identify pain points, prioritize ROI, and define success metrics.Develop and deploy AI-first utilities...

  • AI Annotation Specialist

    1 week ago

    Pagadian, Zamboanga Peninsula, Philippines beBeeAnnotation Full time ₱1,800,000 - ₱2,100,000

    Unlock Your Potential as an AI AnnotatorThis is a unique opportunity to contribute to the development of artificial intelligence. As an annotator, you will help machines make sense of the world by rating and evaluating AI-generated content.About This RoleAnnotation involves reviewing provided data (text, images, or videos) and labeling or classifying content...