AI Performance Engineer

1 week ago


Barcelona, Philippines beBeeEvaluation Full time ₱600,000 - ₱800,000
Role Overview

This role is focused on creating and implementing evaluation frameworks for AI capabilities across various enterprise use cases, ensuring accurate benchmarking and performance optimization.

Evaluation pipelines will be built for product support, engineering operations, and other verticals relevant to modern SaaS companies, as well as search- and retrieval-oriented benchmarks.

Key responsibilities include collaborating with AI and infrastructure teams to implement detailed telemetry for outcome-based evaluation, driving human-in-the-loop and programmatic testing methodologies, and contributing to open evaluation tooling and benchmarking frameworks.

Qualifications
  • Strong background in systems, infrastructure, or performance engineering with ownership of metrics and benchmarking.
  • Proficiency in Python and experience working across full-stack and backend services.
  • Experience with large language models (LLMs), vector-based search, or agentic frameworks in production environments.
  • Familiarity with LLM model serving infrastructure and observability tools.
  • Understanding of model tuning workflows, including prompt engineering and fine-tuning.
  • Deep appreciation for measuring what matters, such as latency under load and degradation in retrieval precision.

Bonus: experience contributing to academic or open-source benchmarking projects.



  • Barcelona, Philippines beBeeMechanical Full time ₱20,000 - ₱50,000

    Job OpportunityCollaborate on advanced AI projects and contribute to the development of complex reasoning skills in a global platform.As an AI Tutor, you will work on specialized questions and help shape the future of AI technology.Generate prompts that challenge AI models.Define comprehensive scoring criteria to evaluate the accuracy of AI responses.Correct...

  • Senior AI Engineer

    1 week ago


    Barcelona, Philippines beBeeAI Full time $4,000 - $5,000

    Job TitleA Senior AI Engineer is required to lead the development of full-scale applications leveraging cutting-edge AI tools.Key Responsibilities:Building and deploying production-grade code in Python (Flask) and ReactSupporting sprint milestones by optimizing and maintaining platform featuresIntegrating with backend task orchestration using Celery and...


  • Barcelona, Philippines beBeeAI Full time ₱900,000 - ₱1,200,000

    Job Opportunity: Generative AI SpecialistWe are seeking highly motivated professionals to join our team as Generative AI Specialists. This role involves creating and refining training data sets for AI models, ensuring they align with human values and adhere to linguistic rules.About the Role:This position offers a unique opportunity to contribute to the...


  • Barcelona, Philippines beBeeEngineering Full time ₱3,400 - ₱5,800

    About the RoleJob DescriptionWe are seeking engineering specialists to play a pivotal role in shaping the future of artificial intelligence. Large-scale language models are evolving into powerful engines of scientific discovery, and with high-quality training data, tomorrow's AI can democratize world-class education and streamline engineering design and...


  • Barcelona, Philippines beBeeArtificialIntelligence Full time ₱800,000 - ₱1,320,000

    About the RoleThis position involves designing, developing, maintaining, auditing, and enhancing software applications with a focus on artificial intelligence technologies.The ideal candidate will have experience in full-stack software development, including back-end development with .NET and Python, as well as front-end frameworks such as Angular or...


  • Barcelona, Philippines beBeeDataQuality Full time €60,000 - €90,000

    We are seeking a detail-oriented AI Data Quality Specialist to join our team and drive continuous improvements in AI data.Job Responsibilities:The successful candidate will perform quality audits on annotated datasets, ensuring they meet established guidelines and quality benchmarks.Metrics such as F1 score and inter-annotator agreement will be used to...


  • Barcelona, Philippines beBeeData Full time ₱5,000 - ₱7,000

    Senior Data Engineer PositionWe are seeking a highly skilled data professional to spearhead the development of scalable, high-performance data pipelines across diverse platforms and data sources.Main Responsibilities:Drive the full lifecycle of designing and building efficient data pipelines that meet business needs.Enhance data infrastructure to ensure...


  • Barcelona, Philippines beBeeArtificialintelligence Full time $80,000 - $120,000

    Job Title: AI Engineering LeadYou will spearhead the development of our AI-first approach, driving innovation across our ClinicOS platform.Key Responsibilities:Create a model-agnostic AI framework that enables seamless integration with OpenAI, Anthropic, and open-source models.Promote AI adoption throughout our clinical operating system.Leverage AI to...


  • Barcelona, Philippines beBeeAutomation Full time ₱60,000 - ₱70,000

    About the RoleWe are a cutting-edge technology company building an innovative platform that designs, deploys, and optimizes AI agents for businesses. As our Technical Architect for AI Automation, you will play a pivotal role in shaping the evolution of our platform.This position requires both strong technical expertise and the ability to provide strategic...

  • AI Safety Advocate

    1 week ago


    Barcelona, Philippines beBeeAI Full time $50,000 - $80,000

    Drive Innovation in AI SafetyThis role offers an exceptional opportunity to be at the forefront of promoting responsible AI practices and ensuring the safety of innovative technologies.You will serve as the primary point of contact for prospects and customers interested in our AI safety services, utilizing your excellent communication and interpersonal...