MCP & Tools Python Developer - Agent Evaluation Infrastructure

3 weeks ago

Tanauan, Philippines Mindrift Full time

We are looking for hands-on Python engineers for a new project focused on developing Model Context Protocol (MCP) servers and internal tools for running and evaluating agent behavior. You will implement base methods for agent action verification, integrate with internal and client infrastructures, and help fill tooling gaps across the team. Who we are looking for : Calling all security researchers, engineers, and penetration testers with a strong foundation in problem-solving, offensive security, and AI-related risk assessment. Bring a hands-on approach to technical challenges, whether breaking into systems to expose weaknesses or building secure tools and processes. We value contributors with a passion for continuous learning, experimentation, and adaptability. What you'll be doing : Developing and maintaining MCP-compatible evaluation servers Implementing logic to check agent actions against scenario definitions Creating or extending tools that writers and QAs use to test agents Working closely with infrastructure engineers to ensure compatibility Occasionally helping with test writing or debug sessions when needed Although we're only looking for experts for this current project, contributors with consistent high-quality submissions may receive an invitation for ongoing collaboration across future projects. Requirements : 4+ years of Python development experience, ideally in backend or tools Solid experience building APIs, testing frameworks, or protocol-based interfaces Understanding of Docker, Linux CLI, and HTTP-based communication Ability to integrate new tools into existing infrastructures Familiarity with how LLM agents are prompted, executed, and evaluated Clear documentation and communication skills - you'll work with QA and writers We also value applicants who have: Experience with Model Context Protocol (MCP) or similar structured agent-server interfaces Knowledge of FastAPI or similar async web frameworks Experience working with LLM logs, scoring functions, or sandbox environments Ability to support dev environments (devcontainers, CI configs, linters) JS experience Benefits : Get paid for your expertise, with rates that can go up to $47/hour depending on your skills, experience, and project needs Take part in a flexible, remote, freelance project that fits around your primary professional or academic commitments Participate in an advanced AI project and gain valuable experience to enhance your portfolio Influence how future AI models understand and communicate in your field of expertise Notes : This opportunity is for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. Company : Mindrift is powered by Toloka and connects domain experts with AI projects to unlock the potential of GenAI through real-world expertise from across the globe. Seniority level : Mid-Senior level Employment type : Part-time Job function : Other Industry : IT Services and IT Consulting #J-18808-Ljbffr

  • Subject Matter Expert

    5 days ago

    Tanauan, Philippines Innodata Knowledge Services, Inc. Full time

    Subject Matter Expert (Agentic Complex Engineering and Evaluation) - REMOTE Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Innodata Knowledge Services, Inc. Innodata Knowledge Services, Inc., a data‑engineering company delivering AI solutions to global clients, is currently hiring a full‑time Subject...

  • Training & Development Specialist

    2 weeks ago

    Tanauan, Philippines TalentPop App Full time

    Join Our Team as a Training & Development Specialist! This is your chance to join a winning team and one of the fastest-growing companies in the eCommerce Ecosystem! Job Responsibilities Host training classes via Zoom, discussing topics in the training outline (camera on 50–70% of the shift). Train newly hired agents on policies, tools, software, and...

  • Training & Development Specialist

    2 weeks ago

    Tanauan, Philippines TalentPop App Full time

    Join to apply for the Training & Development Specialist role at TalentPop App 1 day ago Be among the first 25 applicants Join to apply for the Training & Development Specialist role at TalentPop App Job Responsibilities Host training classes via Zoom, discussing topics in the training outline (camera on 50–70% of the shift). Train newly hired agents on...

  • Tax Specialist

    1 week ago

    Tanauan, Philippines Creativechaos Full time

    Job Summary: Creative Chaos is seeking a diligent and knowledgeable Tax Specialist (Enrolled Agent) to join our finance team. In this role, you will be responsible for preparing and reviewing tax returns, advising clients on tax-related matters, and ensuring compliance with all applicable federal, state, and local tax laws. Duties & Responsibilities: Prepare...

  • VA Training Specialist

    1 week ago

    Tanauan, Philippines TalentPop App Full time

    Job Overview Join Our Team as a e-Commerce VA Training Specialist! This is your chance to join a winning team and one of the fastest-growing companies in the eCommerce Ecosystem! Responsibilities Host training classes via Zoom, discussing topics in the training outline. Train newly hired agents on policies, tools, software, and resources to help them prepare...

  • wfh sales agent for partimers and fulltimers

    5 days ago

    Tanauan, Cavite, Philippines Norilyn B. Detecio - Insurance Agent Full time ₱24,000 - ₱120,000 per year

    Work From Home - Financial Advisor (Part-time/Full-time)Job Description:-Identify and pursue potential clients to maintain a strong client base-Offer strategic advice on products and services, such as investments, insurance coverage, and debt management tools-Maintain compliance with all rules and regulations in the financial industry-This job is...

  • Digital Skills Training Specialist

    2 weeks ago

    Tanauan, Philippines TalentPop App Full time

    2 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Ready to Join Our Team as a Digital Skills Training Specialist? This is your chance to join a winning team and one of the fastest-growing companies in the eCommerce Ecosystem! Responsibilities Lead Onboarding Week, evaluating and certifying newly hired...

  • Software Engineer

    4 weeks ago

    Tanauan, Philippines me&u Full time

    As a Senior Software Engineer - Site Reliability Engineering - at me&u, you will be pivotal in driving the development of our software products and ensuring their operational performance and efficiency. By working on multiple tasks and features, you will ensure that our codebase, infrastructure, and services remain robust, efficient, and scalable. Your...

  • CX Partner Training Specialist

    2 weeks ago

    Tanauan, Philippines TalentPop App Full time

    Opportunity Drive World-Class Service Delivery. Are you an expert in virtual training and service operations, ready to own and scale a high-performing global training program? We're seeking a CX Partner Training Specialist to manage the learning strategy for our frontline customer service teams across multiple third-party Service Partners . This is a...

  • Member Acquisition Agent

    3 weeks ago

    Tanauan, Philippines PadSplit Full time

    Overview Are you ready to dive into the world of a fast-paced tech startup? Are you ready to change the world? At PadSplit we're disrupting the affordable housing industry by creating safe, attractive, and respectable co-living environments. If you're motivated by the conviction that working people should have a decent place to live, and want to do something...