AI/LLM Model Performance Specialist

3 days ago

Pasig, National Capital Region, Philippines beBeeEvaluator Full time ₱2,959,437 - ₱4,614,469

**Job Title:** AI/LLM Evaluator

Job Description:

We are seeking a highly skilled and detail-oriented individual to join our team as an AI/LLM Evaluator. As a key member of our team, you will play a crucial role in evaluating the performance of our large language models (LLMs). This is an exciting opportunity to contribute to the development of cutting-edge AI technology.

Responsibilities and Tasks:
  • Develop and maintain high-quality training data sets for AI models to improve their accuracy, fluency, coherence, and voice.
  • Annotate data to help AI models align with human values and ensure they meet the required standards.
  • Improve the grammar, syntax, and sentence structure of both expert-generated training data and AI model-generated text to adhere to linguistic rules and conventions.
  • Collaborate closely with cross-functional teams, including data scientists, researchers, and software engineers, to refine and iterate data sets.
  • Contribute to evolving specifications for AI-model training and data recipes.
  • Navigate a dynamic environment and adapt to shifting guidelines and flexible priorities.
  • Achieve target KPIs, including daily job count and average handle time per job, within specified data production windows.
Required Skills and Qualifications:
  • Bachelor's or Master's degree in Linguistics, Journalism, Creative Writing, English, or similar field.
  • Excellent writing skills, with a strong understanding of grammar, syntax, and semantics.
  • Ability to edit and improve written communication across a wide variety of fields.
  • Creative thinker with strong attention to detail.
  • Well-honed internet research skills.
  • Ability to embrace diverse teams and navigate ambiguity with ease.
  • Adaptability to thrive in a dynamic environment, with the agility to adjust to evolving guidelines and fluid priorities.
What We Offer:
  • Fully remote work environment, allowing for flexibility and autonomy.
  • Collaborative culture, enabled by key tools that facilitate seamless communication.
  • Competitive compensation package, recognizing the value and expertise of our employees.
  • Group Life insurance and medical program, providing comprehensive coverage and peace of mind.
  • Career development and progression opportunities, empowering employees to grow and advance in their careers.
  • Paid leaves, ensuring employees have time to relax, recharge, and attend to personal matters.
  • Employee engagement activities, fostering a sense of community and connection among team members.
  • Wellness programs, promoting physical and mental well-being, and supporting employees' overall health and happiness.

  • AI/LLM Content Curator

    3 days ago

    Pasig, National Capital Region, Philippines beBeeEvaluator Full time ₱500,000 - ₱750,000

    Job OpportunityWe are seeking a highly skilled AI/LLM Evaluator to join our team. As an AI/LLM Evaluator, you will be responsible for creating high-quality training data sets that enhance the accuracy, fluency, coherence, and voice of AI models.Key Responsibilities:Develop comprehensive training data sets for AI models to improve their performance and...

  • AI Performance Specialist

    2 days ago

    Pasig, National Capital Region, Philippines beBeePerformance Full time $180,000 - $240,000

    AI Performance EngineerWe are seeking a skilled AI performance engineer to join our team. As an AI performance engineer, you will be responsible for designing and implementing agent evaluation pipelines for real-world enterprise use cases.You will work closely with cross-functional teams to build domain-specific benchmarks for support, engineering ops, and...

  • AI Trainers

    1 week ago

    Pasig, National Capital Region, Philippines Everglow AI Full time $60,000 - $120,000 per year

    Open Roles:We're hiring across several specialized AI training tracks: AI Trainer – LLM (Language, Logic & Emotional Intelligence) AI Trainer – Creative Content Writer (Storytelling, Character Building, Worldbuilding) AI Trainer – Audio (Voice, TTS, Emotional Delivery) AI Trainer – Video (Visual Expression, Acting, Performance) What You'll...

  • AI Model Developer

    2 weeks ago

    Pasig, National Capital Region, Philippines beBeeArtificial Full time ₱400,000 - ₱800,000

    Job Title: AI Model DeveloperThis is a full-time on-site role located in Pasig for an AI Model Developer. The developer will be responsible for developing, implementing and maintaining AI and machine learning models to enhance fire protection solutions. Key tasks include data analysis, algorithm development, model training, and performance...

  • AI Expert Collaborator

    3 days ago

    Pasig, National Capital Region, Philippines beBeeArtificial Full time $384 - $3,840

    Job OpportunityMindrift is seeking passionate freelance contributors to join the Tendem project and collaborate with large language models.As an AI Agent Assistant, you'll work on complex tasks, fact-checking scientific claims, curating datasets, conducting market research, or refining sales leads.This is a freelance role, where your day-to-day may vary....

  • AI Model Trainer

    3 days ago

    Pasig, National Capital Region, Philippines beBeeData Full time ₱1,500,000 - ₱2,000,000

    Job TitleAs a high-profile contributor to the AI ecosystem, this role focuses on creating top-tier training data sets that amplify AI model accuracy.Key Responsibilities:Training Data Creation: Develop comprehensive training data sets for enhancing AI model performance.Value-Based Annotation: Implement annotation processes that align with human-centric...

  • AI Engineering Lead

    5 days ago

    Pasig, National Capital Region, Philippines beBeeEngineering Full time ₱1,500,000 - ₱1,800,000

    Job DescriptionAchieve Excellence in AI EngineeringWe are seeking an experienced AI Engineering Lead to join our team. As a trusted advisor, you will design and develop scalable Python applications that drive business growth.Your primary responsibility will be to lead the development of innovative AI-enabled solutions using Generative AI, Large Language...

  • AI Workflow Designer

    3 days ago

    Pasig, National Capital Region, Philippines beBeeAutomation Full time $80,000 - $120,000

    Job Title: Automation SpecialistWe are seeking an experienced Automation Specialist to join our team.Design and build robust automation workflows using tools like n8n or Power Platform (e.g. AI Builder) as the orchestration layer.Develop and refine prompts for generative AI use cases (summarization, data transformation, structuring, decision logic).Integrate...

  • Digital Intelligence Solutions Architect and Specialist

    2 days ago

    Pasig, National Capital Region, Philippines Joy~Nostalg (Official) Full time $104,000 - $130,878 per year

    Digital Intelligence Solutions Architect and SpecialistRole: Technical Lead – AI / LLM ProjectsJOB OVERVIEW:We're looking for a technical lead to work closely with the Head of Data Intelligence in building and scaling an AI-powered platform. This is a hands-on leadership role that spans backend systems, full-stack development, and machine...

  • Support Specialist

    2 days ago

    Pasig, National Capital Region, Philippines beBeeTechnical Full time ₱1,440,000 - ₱2,160,000

    Job OpportunityWe are seeking a skilled professional to fill the role of Technical Support Engineer.Key Responsibilities:Debug complex API issues, LLM hallucinations, and integration problems using production tools and techniques.Investigate system performance and identify areas for improvement through analysis of system traces in Honeycomb and other...