Policy and Toxicity Evaluator

1 week ago


Philippines Welocalize Full time $40,000 - $80,000 per year
Overview We are seeking Policy and Toxicity Evaluators to support a pilot project focused on analyzing and grading AI-generated model outputs for a leading AI platform. In this role, you will assess model responses to ensure compliance, safety, and adherence to project-specific guidelines. Evaluators will work across three workflows: refusal analysis, toxicity detection, and policy verification, helping to validate the model's behavior and improve its safety and utility. 
What you will do: 
• Analyze AI model outputs to assess quality and safety. 
• Identify instances where the model refuses to answer a prompt and determine if the refusal was necessary or an error (over-refusal).
• Identify toxic content such as hate speech, harassment, explicit material, or self-harm encouragement.
• Review model responses for compliance with project-specific policy guidelines.
• Shift between refusal, toxicity, and policy workflows as needed based on project volume.
Requirements: 
• Excellent command of written English to process complex prompts and long-form model responses quickly. 
• Strong critical thinking and the ability to make objective decisions. 
• Exceptional attention to detail, including identifying borderline violations. 
• Comfort navigating ambiguous or complex content requiring deep judgment. 
• Ability to internalize and strictly follow complex policy guidelines. 
• Prior experience in Trust & Safety, Content Moderation, or RLHF (Reinforcement Learning from Human Feedback) annotation is highly beneficial.    Project Details:  Contract Type: Freelance  Location: Philippines (remote) Duration: 1 to 2 weeks Schedule: 10 hours weekly; flexible based on client's needs   Note: Please do not use VPNs or IP-masking tools during the recruitment process — our security system requires accurate regional verification.  Why Join Welo Data?   Limitless Flexibility   Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy.    Limitless Growth   Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise.    Limitless Support   Be part of a global contributor community with responsive guidance and support.    Real Impact   Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills.  
How to Apply?  Apply now by answering a few quick questions to join our database and become part of our growing community. 
About Welo Data  Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world's most advanced AI systems. We're building smarter, more human AI with a diverse community in 100+ countries.   At Welo Data, Limitless AI. Limitless You. isn't just a slogan—it's our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.  We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

  • Philippines Genius Agency AI Full time $40,000 - $60,000 per year

    For better engagement, updates, and valuable consultation tips, we encourage you to follow our founder on Instagram: @marketingbybahaa. )Global Pacific Support is looking for experienced Insurance Agents who are highly proficient in the Ezlynx system to join and help build our pioneering team. The ideal candidate is detail-oriented, adaptable, and ready to...

  • HR Generalist

    1 week ago


    Valenzuela, Metro Manila, Philippines AvantePH Staffing and Consultancy Full time ₱250,000 - ₱350,000 per year

    Job Responsibilities: Handle end-to-end recruitment and participate in all hiring activities Manage and update employee records (both digital and physical) Assist in staffing coordination and recruitment processes Review resumes, update the candidate database, and screen applicants Prepare reports on performance evaluations and HR documentation Support...


  • Philippines Remote VA Full time ₱250,000 - ₱500,000 per year

    A claims analyst is responsible for reviewing and evaluating claims submitted by customers, ensuring their accuracy, eligibility, and compliance with company policies, by investigating claims, determining validity, and customer settlement (credit) amounts while maintaining detailed records and communicating with team lead for approval.RequirementsReview and...

  • Assistant Manager

    1 week ago


    Philippines EXL Full time ₱600,000 - ₱800,000 per year

    DescriptionThis role is primarily responsible to ensure risk & compliance to Operational / Process Controls, Service Delivery, Fraud Risk Assessment, Client Contracts and Organizational Policies and Procedures in client area.Qualifications1-Ensures adherence of the Operational & Process related controls, compliance for service delivery requirements, fraud...

  • HR Generalist

    1 week ago


    Valenzuela, Metro Manila, Philippines AvantePH Staffing and Consultancy Full time ₱250,000 - ₱350,000 per year

    We are looking for a proactive and well-rounded HR Generalist to support daily human resources operations and ensure smooth implementation of HR policies and programs. The role involves handling end-to-end HR functions, including recruitment, employee relations, performance monitoring, and compliance, while promoting a positive and productive work...


  • Philippines Meaningful Banking from Metrobank Full time ₱900,000 - ₱1,200,000 per year

    This role is open for both iAspire candidates and external talents. We encourage you to refer candidates to this role.Position Title: Credit Review OfficerJob Summary:Preparation and credit assessment of loan proposals and corresponding borrowersCredit Risk and Portfolio ManagementConformity to internal and external policiesSpecific Duties &...


  • Philippines EXL Full time ₱1,000,000 - ₱3,000,000 per year

    DescriptionResponsible for the review and evaluation of clinical information and documentation, fax triage and conversion, and provider calls.Reviews documentation and interprets data obtained from clinical records or systems to apply appropriate clinical criteria and policies in line with regulatory and accreditation requirementsProtects the confidentiality...


  • Philippines Meaningful Banking from Metrobank Full time ₱1,200,000 - ₱2,400,000 per year

    This role is open for both iAspire candidates and external talents. We encourage you to refer candidates to this role.Position Title: Credit Review OfficerJob Summary: ·       Preparation and credit assessment of loan proposals and corresponding borrowers·       Credit Risk and Portfolio Management·       Conformity to internal and...

  • HR Generalist

    1 week ago


    Valenzuela, Metro Manila, Philippines AvantePH Staffing and Consultancy Full time ₱450,000 - ₱600,000 per year

    The HR Generalist is responsible for managing the day-to-day operations of the Human Resources department. This role handles various HR functions such as recruitment, employee relations, timekeeping and payroll support, performance management, and compliance with labor regulations. The HR Generalist ensures that company policies and practices are properly...


  • Philippines IHG Full time ₱1,200,000 - ₱2,400,000 per year

    DescriptionAn HR Manager is responsible for any planning regarding the human resources and development of a company's workforce, and they must be able to transform all policies into executable plans and departmental procedures. Some of their daily responsibilities include:Ensuring employees follow all policies and proceduresAssessing reports provided by the...