Gen AI Associate

6 days ago

Mandaue City, Central Visayas, Philippines Innodata Knowledge Services, Inc. Full time ₱900,000 - ₱1,200,000 per year

Job Title: Gen AI Associate - AI/LLM Evaluator (Orchestration)

Task:

· Evaluate AI/LLM conversations at step, turn, and task levels using structured metrics.

· Conduct Diagnostic evaluations to check tool usage, slot filling, and adherence to system/maker instructions.

· Perform Task Success evaluations to determine if user requests were completed accurately and efficiently.

· Execute Profiling evaluations to capture session- and turn-level insights such as query categorization, complexity, domain alignment, and customer satisfaction signals.

· Provide clear, concise rationales for all judgments, ensuring transparency and traceability.

· Identify errors, inconsistencies, and improvement opportunities in agent interactions.

· Ensure judgment consistency by rigorously applying evaluation guidelines.

· Contribute feedback on trends, guideline refinement, and evaluation process improvements.

· Collaborate with peers and managers to maintain high evaluation standards and meet project timelines.

Skills & Competencies:

· Strong analytical and critical thinking skills.

· Ability to edit and improve technical communication across a wide variety of fields.

· Creative thinker with problem-solving orientation.

· Strong attention to detail and consistency in applying evaluation criteria.

· Well-honed internet research skills to validate information and context.

· Ability to embrace collaboration with diverse, global teams.

· Adaptability to thrive in a dynamic environment with evolving guidelines and priorities.

· Strong written communication skills for documenting rationales.

· Comfortable working with structured evaluation tools and platforms.

· Ability to work independently while meeting deadlines.

Education

· Required: Bachelor's degree (any field with strong analytical or research components: Computer Science, Linguistics, Cognitive Science, Business, Social Sciences, etc.)

· Preferred: Advanced degree or coursework in AI/ML, data science, or domain-relevant fields.

Experience:

· Domain-Specific Roles: Candidates with professional expertise in the relevant domain (e.g., healthcare, finance, telecom, education) are strongly encouraged to apply. For these roles, prior annotation experience is not required but preferred.

· Preferred: Prior experience in AI/LLM evaluation, linguistic annotation, customer support QA, or usability testing.

Nice to have:

· Familiarity with LLM systems, AI agents, or conversational AI.

· Experience in BPO/Customer Support QA (useful for profiling and task success evaluations).

· Exposure to multi-domain environments (healthcare, finance, telecom, etc.).

· Ability to role-play end-user perspectives when evaluating AI interactions.

Employment information:

  • This role may be offered on a project-based, freelance, or full-time basis, depending on business needs.
  • Candidates should be available to work within a consistent time window between 8:00 AM to 8:00 PM

  • AI Journey Manager

    6 days ago

    Cebu City, Central Visayas, Philippines LeadAI Pty Ltd Full time ₱420,000 - ₱600,000 per year

    AI Journey Manager (UI/UX Specialist) – Design Next-Gen Human-AI Experiences at LeadAIIf You're Obsessed with Perfecting the Customer Journey Beyond Just Mapping it in Figma—This is Your Dream Role..Step into the next generation of AI applications where you don't just design screens—you shape how humans and AI work together. What to expect:→ Design...

  • Sales and Engagement Officer

    1 week ago

    Cebu City, Central Visayas, Philippines First Gen Corporation Full time ₱104,000 - ₱130,878 per year

    At First Gen, we take pride in our work of energizing the Philippines through clean power generation technologies. As we grow to become the best in the industry, we are continuously searching for talent who are driven, empowered, and passionate about making a positive difference in the world.We provide employees with ample opportunities and resources that...

  • Customer Service

    6 days ago

    Mandaue City, Central Visayas, Philippines RH-Studio Full time ₱240,000 per year

    About the RoleRH-Studio is looking for a Customer Service & Admin Associate to help with client communications, invoicing, and scheduling. This role mixes customer interaction with simple admin support—perfect for someone who's organized, service-oriented, and eager to learn.Shift ScheduleMid-shift: 3:00 PM – 12:00 AM (Monday–Friday)Onsite only (no...

  • Senior Visual Designer

    4 weeks ago

    Tacloban City, Eastern Visayas, Philippines HiNeon Custom Neon Signs - LED Neon Lights Full time

    OverviewNOVA Signage is launching new B2B products for North America. We need a design lead who's hands-on, fast, and AI-savvy.ResponsibilitiesCreate launch kits: brochure/one-pager, spec blocks, and WordPress landing sections.Produce clean production-ready 2D assets (Illustrator) for web/print.Generate light 3D or AI renders for hero/product shots.Systemize...

  • Business Planning and Analysis Specialist

    1 week ago

    Mandaue City, Central Visayas, Philippines Sandler Group Call Center Services Full time ₱960,000 - ₱1,320,000 per year

    Job Title: Business Planning & Analysis SpecialistSALARY OFFER : 80K-110K (open for negotiation based on experience , skill set and qualifications)Job Type: Onsite | Full time | Night Shift Schedule- 11pm to 8amDepartment: Financial OperationsReporting To: VP of Financial Operations and HRGeneral SummaryReporting to the VP of Financial Operations and HR. The...

  • Financial Planning

    6 days ago

    Mandaue City, Central Visayas, Philippines Sandler Group Call Center Services Full time ₱80,000 - ₱150,000 per year

    Job Title: Business Planning & Analysis SpecialistSALARY OFFER : 80K-110K (open for negotiation based on experience , skill set and qualifications)Job Type: Onsite | Full time | Night Shift Schedule- 11pm to 8amDepartment: Financial OperationsReporting To: VP of Financial Operations and HRGeneral SummaryReporting to the VP of Financial Operations and HR. The...

  • Digital Marketing Specialist

    7 days ago

    Cebu City, Central Visayas, Philippines Momentive Software Full time ₱1,200,000 - ₱2,400,000 per year

    OverviewWe are looking for aDigital Marketing Specialist-SEOto join our growing creative team in Community BrandsPosition OverviewManages SEO-focused marketing activities and programs for the organization. Develops and implements SEO marketing plans to serve the business objectives . Stays current with search engine algorithm updates, keyword trends, and...

  • Guest Experience Associate

    2 weeks ago

    Angeles City, Central Luzon, Philippines VargasAndrews Full time ₱48,000 - ₱60,000 per year

    Important Notes for Applicants Please Read Before Applying: Role Type: This is a full-time independent contractor position, not a permanent employee role.Compensation: The salary range of AU$1, ,300.00 per month is an all-inclusive rate Work Schedule: This is a 42 hour shift per week, the initial schedule is Monday to Saturday, 5:00PM - 1:00AM Brisbane...

  • Managed IT Agent

    2 days ago

    Cebu City, Central Visayas, Philippines Staff4Me Full time ₱250,000 - ₱500,000 per year

    CallTek is a global leader in white-label technical support, trusted by technology operators worldwide for over 20 years. With 10,000+ professionals across nine countries, we deliver 24/7 engineering, software development, customer support, and field services. Backed by top security certifications and innovative AI solutions, we provide secure and seamless...

  • IT Support Specialist

    2 hours ago

    Cebu City, Central Visayas, Philippines St Trinity Property Group Full time ₱450,000 - ₱900,000 per year

    About the Role:The IT Support Specialist is responsible for supporting the organization's IT landscape from a systems and integrations perspective. Operating remotely, this role focuses on application troubleshooting, API integrations, automation workflows, and user support.Key Responsibilities:Remote Systems Support & MaintenanceResolve support tickets...