AI Data Annotation and Evaluation Specialist
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
About the role
Involving on one of following languages: Thai, Korean, Japan, French, German, Portuguese (Brazil), Spanish
This role involves executing annotation workflows and guidelines for AI model evaluation, ensuring editorial quality, accuracy, and scalability. You will conduct systematic quality checks on vendor-delivered annotations, collaborate with project managers to develop annotation guidelines for pioneering AI projects, design and refine system prompts, and analyze annotation datasets to identify error trends and performance gaps.
Key responsibilities
- Execute annotation workflows and guidelines for AI model evaluation, ensuring editorial quality, accuracy, and scalability
- Proactively identify quality risks and error patterns, and communicate findings to stakeholders to drive continuous improvement
- Conduct systematic quality checks on vendor-delivered annotations to verify alignment with project expectations and training objectives
- Maintain detailed audit trails and provide clear and actionable feedback to enhance annotator performance
- Collaborate with project managers to develop annotation guidelines for pioneering AI projects
- Execute hands‑on annotation when workflows are not yet established, helping to shape scalable processes
- Design, test, and refine system prompts to improve model outputs for evaluation tasks
- Develop prompt libraries and best practices that enable efficient and consistent workflows across projects
- Analyze annotation datasets to identify error trends and performance gaps
- Stay current with advancements in large language models and AI evaluation methodologies
Requirements
- Bachelor's degree with strong academic performance
- Experienced in writing and optimizing AI system prompts
- Professional proficiency in English with excellent written and verbal communication skills
- Professional proficiency or native fluency in at least one of the following languages: Thai, Korean, Japan, French, German, Portuguese (Brazil), Spanish
- Strong data sensitivity and analytical skills to identify quality issues and error patterns
- Ability to apply critical thinking to balance individual judgment with collaborative teamwork in fast-paced environments
- Self‑motivated with a strong sense of responsibility, able to adapt to ambiguity and manage multiple priorities within tight cycles
- Genuine interest in AI, large language models, and human‑computer interaction
- Excellent cross‑team collaboration skills and willingness to continuously learn and explore new technologies
-
AI Data Annotation and Evaluation Specialist
4 days ago
Santo Niño 1st, Nueva Ecija, Philippines Career International FOS Pte Ltd Full-time ₱391,000 - ₱614,000 ContractAbout the roleInvolving on one of following languages: Thai, Korean, Japan, French, German, Portuguese (Brazil), SpanishThis role involves executing annotation workflows and guidelines for AI model evaluation, ensuring editorial quality, accuracy, and scalability. You will conduct systematic quality checks on vendor-delivered annotations, collaborate with...
-
Bilingual AI Annotation
1 day ago
santo niño 1st, nueva ecija, Philippines Career International FOS Pte Ltd Full-time ₱614,000 ContractCareer International FOS Pte Ltd is seeking an Annotation Specialist to support AI model evaluation. You will work across languages such as Thai, Korean, Japanese, French, German, Portuguese (Brazil), and Spanish, ensuring editorial quality and scalability. You will conduct vendor annotation quality checks, help develop guidelines, design and refine system...
-
AI Evaluation
5 days ago
Santo Niño 1st, Nueva Ecija, Philippines RecruitFirst Pte. Ltd Full-time ₱2 - ₱3 ContractRecruitFirst Pte. Ltd seeks an AI annotation and evaluation specialist to drive quality in cutting-edge projects. You will implement strategy, audit vendor outputs, and assist with exploratory projects that shape scalable annotation workflows.You will design prompts, analyze data, and stay ahead of industry developments to optimize processes and...
-
Santo Niño 1st, Nueva Ecija, Philippines RecruitFirst Pte. Ltd Full-time ₱2 - ₱3 ContractLocation:Raffles Place / Client Site when required Salary:Up to $5500 Duration:1 year subject to extension / conversion Working Hours:5 days a week, 9am-6pm Responsibilities Strategy Implementation: Execute annotation workflows and guidelines for AI model evaluation, ensuring editorial quality, accuracy, and scalability. Proactively identify quality risks...
-
PARTNER WAREHOUSE OPERATIONS LEAD
1 day ago
santo niño 1st, nueva ecija, Philippines GO-GENIE Full-time ₱1 ContractPARTNER WAREHOUSE OPERATIONS LEAD (English & Mandarin is require) GO-GENIE is an award-winning Singapore-founded smart logistics ecosystem that offers an integrated, scalable, and asset-light solution for businesses. GO-GENIE unifies freight, warehousing, fulfilment, and last-mile delivery into one AI-powered platform. We are addressing the fragmented and...
-
Operations Executive
5 days ago
Santo Niño 1st, Nueva Ecija, Philippines Lim Kim Hai Electric Co (S) Pte Ltd Full-time ₱279,000 - ₱446,000 ContractAbout the roleThe Operations Executive supports the Deputy Manager – Operations across facilities management, fleet, statutory compliance, and sustainability-data processes, ensuring operational paperwork is completed accurately and on time within established frameworks. A key part of the role involves applying and maintaining the company's contractor...
-
Bilingual AI Annotation
4 days ago
Santo Niño 1st, Nueva Ecija, Philippines Career International FOS Pte Ltd Full-time ₱391,000 - ₱614,000 ContractCareer International FOS Pte Ltd is seeking an Annotation Specialist to support AI model evaluation. You will work across languages such as Thai, Korean, Japanese, French, German, Portuguese (Brazil), and Spanish, ensuring editorial quality and scalability.You will conduct vendor annotation quality checks, help develop guidelines, design and refine system...
-
AI Evaluation
7 days ago
santo niño 1st, nueva ecija, Philippines RecruitFirst Pte. Ltd Full-time ₱3 ContractRecruitFirst Pte. Ltd seeks an AI annotation and evaluation specialist to drive quality in cutting-edge projects. You will implement strategy, audit vendor outputs, and assist with exploratory projects that shape scalable annotation workflows. You will design prompts, analyze data, and stay ahead of industry developments to optimize processes and...
-
santo niño 1st, nueva ecija, Philippines RecruitFirst Pte. Ltd Full-time ₱3 ContractLocation: Raffles Place / Client Site when required Salary: Up to $5500 Duration: 1 year subject to extension / conversion Working Hours: 5 days a week, 9am-6pm Responsibilities Strategy Implementation: Execute annotation workflows and guidelines for AI model evaluation, ensuring editorial quality, accuracy, and scalability. Proactively identify...
-
PARTNER WAREHOUSE OPERATIONS LEAD
4 days ago
Santo Niño 1st, Nueva Ecija, Philippines GO-GENIE Full-timePARTNER WAREHOUSE OPERATIONS LEAD (English & Mandarin is require)GO-GENIE is an award-winning Singapore-founded smart logistics ecosystem that offers an integrated, scalable, and asset-light solution for businesses. GO-GENIE unifies freight, warehousing, fulfilment, and last-mile delivery into one AI-powered platform. We are addressing the fragmented and...
-
Test Engineer
4 weeks ago
Santo Tomas, Calabarzon, 40, Philippines Dyson Full-time**About Us** The next few years are going to be Dyson’s biggest and busiest yet. All thanks to a £2.5 billion commitment to its future technology pipeline. This growth will need the support of more new people across other functions around the world, including the Philippines. We have c. 6,000 engineers and scientists worldwide and we are now looking to...
