AI Performance Engineer

1 day ago

Province of Palawan, Mimaropa, Philippines beBeeBenchmarking Full time ₱900,000 - ₱1,200,000
Expertise in AI Performance Engineering

We are seeking a skilled professional to join our team and contribute to the development of DevRev's AgentOS, a cutting-edge platform for SaaS companies. This innovative solution connects end users, sellers, support, product people, and developers across a single platform.

This is an exciting opportunity to shape the future of AI-driven SaaS by designing benchmarks that measure success in this rapidly evolving landscape.

Beyond traditional CRMs, our approach takes a blank canvas to collaboration, AI, and analytics, enabling SaaS companies to accelerate product velocity and reduce customer churn.

Key Responsibilities
  1. Design and implement agent evaluation pipelines to benchmark AI capabilities across real-world enterprise use cases.
  2. Develop domain-specific benchmarks for product support, engineering ops, GTM insights, and other verticals relevant to modern SaaS.
  3. Create performance benchmarks that measure latency, safety, cost-efficiency, and user-perceived quality.
  4. Prioritize human-in-the-loop and programmatic testing methodologies for fuzzy metrics like helpfulness, intent alignment, and resolution effectiveness.
Requirements
  • A minimum of 3–7 years of experience in systems, infra, or performance engineering roles with strong ownership of metrics and benchmarking.
  • Proficiency in Python and comfort working across full-stack and backend services.
  • Experience building or using LLMs, vector-based search, or agentic frameworks in production environments.
  • Familiarity with model serving infrastructure (e.g., vLLM, Triton, Ray, or custom Kubernetes-based deployments).

Bonus: contributing to academic or open-source benchmarking projects.

Culture

We value hunger, humility, honesty, and heart at DevRev. Our mission is to empower engineers to embrace their customers through design, data engineering, and machine intelligence.

  • AI Infrastructure Specialist

    2 days ago

    Province of Palawan, Mimaropa, Philippines beBeeArtificial Full time ₱2,000,000 - ₱2,500,000

    Job Title: Senior AI Capacity EngineerWe are seeking a highly skilled and experienced Senior AI Capacity Engineer to join our team. This role will be responsible for ensuring the smooth operation of our artificial intelligence systems, including the creation, updating, and deletion of model pools, as well as accurate provisioning and decommissioning across...

  • Leading AI Innovations in Healthcare

    2 days ago

    Province of Palawan, Mimaropa, Philippines beBeeEngineer Full time $80,000 - $120,000

    Job TitleAI Engineer Lead Role OverviewJob DescriptionThis is a senior AI engineering role where you will be responsible for leading the development of our AI-first future. You will own the entire AI strategy across our platform, transforming how millions access healthcare through intelligent automation.You will work directly with the Head of Engineering and...

  • AI Model Development Specialist

    2 days ago

    Province of Palawan, Mimaropa, Philippines beBeeArtificialintelligence Full time ₱676,400 - ₱5,236,000

    Unlock the Future of AIJob OverviewWe are seeking a skilled Engineering Specialist – AI Trainer to contribute to the development and improvement of our large-scale language models. These models have the potential to revolutionize various industries by providing accurate and reliable information.ResponsibilitiesEngage in real-world conversations with...

  • AI Workflow Engineer

    2 days ago

    Province of Palawan, Mimaropa, Philippines beBeeData Full time $100,000 - $120,000

    Job TitleWe are seeking a proactive leader to architect and uphold high-quality annotation workflows for AI systems.This role is responsible for building and guiding a high-performing team of Data Quality Analysts, leading in-depth data analysis to diagnose quality issues, and assessing the effectiveness of quality strategies.This position requires strategic...

  • Chief AI Innovation Architect

    2 days ago

    Province of Palawan, Mimaropa, Philippines beBeeAutomation Full time $180,000 - $200,000

    Job Summary:The RoleAs an AI Automation Engineer, you will play a pivotal role in transforming manual services into agent-driven workflows. Your expertise in AI and automation will enable the company to streamline processes, enhance efficiency, and drive business growth.ResponsibilitiesPair with the Chief Technology Officer to identify pain points, assess...

  • Engineering Consultant

    1 day ago

    Province of Palawan, Mimaropa, Philippines beBeeMechanical Full time $24,000 - $52,000

    Job OverviewThis is an exciting opportunity to collaborate on projects that challenge AI models and help them achieve complex reasoning skills.We are seeking a skilled Mechanical Engineer to work on designing prompts, developing scoring criteria, and correcting AI model responses based on domain-specific knowledge.ResponsibilitiesDesign comprehensive prompts...

  • High-Performance Data Engineer

    2 days ago

    Province of Palawan, Mimaropa, Philippines beBeeDataPipeline Full time ₱4,000,000 - ₱8,000,000

    Transform Data Pipelines with ExpertiseYou will play a key role in enhancing the efficiency, scalability, and reliability of our data pipelines. By leveraging your technical expertise, you will make informed decisions to optimize technology, platforms, and architectures.About the RoleYour primary objective is to drive technological advancements, streamline...

  • Senior Software Engineer

    2 days ago

    Province of Palawan, Mimaropa, Philippines beBeeDataScientist Full time $100,000 - $120,000

    Join our Team of ExpertsSenior Software Engineer - Data, AI/ML & AnalyticsCanonical is a leading provider of open source software and operating systems to the global enterprise and technology markets.We are hiring Python and Kubernetes Specialist Engineers focused on Data, AI/ML and Analytics Solutions to join our teams building open source solutions for...

  • AI Safety Specialist

    2 days ago

    Province of Palawan, Mimaropa, Philippines beBeeAI Full time ₱600,000 - ₱900,000

    About Our OpportunityWe are a leading provider of AI safety services, dedicated to helping model builders ship responsibly without losing speed.As a member of our team, you will play a crucial role in turning curiosity about safe AI into qualified opportunities.The Impact You'll MakeFill the funnel: Consistently hit monthly targets for sales-accepted leads...

  • High-Performance Automation Engineer

    2 days ago

    Province of Palawan, Mimaropa, Philippines beBeeAutomation Full time ₱1,200,000 - ₱1,500,000

    Automation ExcellenceTap into a high-performing Automation Engineer to elevate your testing capabilities and optimize results.Key ResponsibilitiesDesign, develop, and implement comprehensive automation frameworksCreate and maintain automated test scripts for web, mobile, and API testingIncorporate automation solutions with CI/CD pipelinesDevelop strategic...