AI Prompt Tester

2 weeks ago

Taguig, National Capital Region, Philippines Magic Full time

Application Deadline: 25 April 2025

Department: Product

Location: Philippines

Description

About Magic

Magic is a leading modern outsourcing platform that connects SMBs to high-quality remote workers, from SDRs to virtual assistants and more. With roots in Silicon Valley, and backing from top venture capitalists, our workers are supercharged with a combination of the latest AI technology and training.

Background

Our company came out of Y Combinator in 2015. Since then we've grown to 1000+ remote workers, with strong venture-backing (including Sequoia Capital) and over $30M in funding to date. We are fully remote across Asia and US time zones.

  • Check out Magic's Business Profile
  • Know more about our Team via Magic's Careers Page

As an AI Prompt Tester, you'll maximize the effectiveness of our AI tools by developing, testing, and optimizing prompts across various business verticals. As we integrate AI solutions into our products, the AI Prompt Tester will be instrumental in ensuring these tools deliver accurate, relevant, and valuable outputs that enhance user experience and drive business outcomes.

The impact you'll make:

Prompt Development & Optimization

  • Write clear, effective prompts tailored to different business verticals
  • Continuously refine prompts based on real-world assistant results and feedback
  • Conduct experimental testing of prompt variations to identify optimal formulations
  • Document successful prompt patterns and best practices

Cross-functional Collaboration

  • Work side-by-side with product and engineering teams.
  • Share your insights and improvements through regular updates and documentation.
  • Help train internal teams on how to use AI prompts effectively.

Performance Analysis

  • Utilize the prompt dashboard to automate and streamline testing
  • Track and analyze prompt performance metrics across different scenarios
  • Identify trends, issues, and opportunities for improvement
  • Maintain comprehensive records of prompt versions, test results, and iterations

AI Knowledge & Innovation

  • Stay current with emerging AI developments and prompt engineering techniques
  • Participate in relevant workshops, discussions, and training sessions
  • Research and recommend ways to incorporate new AI technologies
  • Contribute to the company's AI strategy and roadmap

Skills, Knowledge and Expertise

  • Demonstrated proficiency with spreadsheet applications for data tracking and analysis
  • Basic understanding of AI platforms (ChatGPT, Gemini, Copilot, Perplexity etc.)
  • Familiarity with fundamental prompt engineering concepts
  • Strong analytical and critical thinking skills
  • Excellent written and verbal communication abilities

Your superpowers are...

  • Attention to detail when crafting and refining prompts
  • Pattern recognition for identifying what works across different contexts
  • Creative problem-solving to overcome AI limitations
  • Clear and concise writing skills
  • Patience and persistence when troubleshooting
  • Curiosity and eagerness to learn about emerging technologies
  • Ability to translate complex technical concepts into simple explanations

You should apply if...

  • You're fascinated by the potential of AI and enjoy exploring its capabilities
  • You find satisfaction in iterative improvement and optimization
  • You thrive in collaborative environments with diverse stakeholders
  • You approach challenges with both creativity and analytical rigor
  • You're comfortable with ambiguity and evolving requirements
  • You're motivated to help shape the future of AI-powered products

Why Magic?

#J-18808-Ljbffr

  • AI Prompt Optimizer

    2 weeks ago

    Taguig, National Capital Region, Philippines Magic Full time

    At Magic, we're revolutionizing the outsourcing industry with our innovative AI-powered platform. We connect SMBs to high-quality remote workers, from SDRs to virtual assistants and more. Our team is comprised of experts who are passionate about harnessing the power of AI to deliver exceptional results.About the RoleWe're seeking a skilled AI Prompt Tester...

  • Prompt Development Specialist

    2 weeks ago

    Taguig, National Capital Region, Philippines Magic Full time

    Magic is a leading modern outsourcing platform that connects SMBs to high-quality remote workers. We're backed by top venture capitalists and have a strong presence in Asia and US time zones. Our team is passionate about harnessing the power of AI to deliver exceptional results.About the JobWe're seeking a skilled AI Prompt Tester to join our team. As an AI...

  • AI Prompt Developer

    9 hours ago

    Taguig, National Capital Region, Philippines beBee Careers Full time

    Promote Efficiency in AI-Powered ConversationsThe ideal candidate for this role will maximize the effectiveness of our AI tools by developing, testing, and optimizing prompts across various business verticals. As we integrate AI solutions into our products, the successful candidate will be instrumental in ensuring these tools deliver accurate, relevant, and...

  • AI Solutions Quality Assurance

    2 weeks ago

    Taguig, National Capital Region, Philippines Magic Full time

    Magic is a leading outsourcing platform that leverages AI to connect SMBs with high-quality remote workers. We're committed to delivering exceptional results and are seeking a skilled AI Prompt Tester to join our team.About the RoleAs an AI Prompt Tester, you'll play a crucial role in maximizing the effectiveness of our AI tools by developing, testing, and...

  • AI Testing and Optimization Expert

    2 weeks ago

    Taguig, National Capital Region, Philippines Magic Full time

    We're Magic, a cutting-edge outsourcing platform that's transforming the way businesses operate. Our AI-powered platform connects SMBs to high-quality remote workers, from SDRs to virtual assistants and more. We're looking for a talented AI Prompt Tester to join our team.About the PositionAs an AI Prompt Tester, you'll be responsible for developing, testing,...

  • Prompt Engineering Specialist

    9 hours ago

    Taguig, National Capital Region, Philippines beBee Careers Full time

    Unlock the Full Potential of AI PromptsIn this key position, you'll work to refine and perfect AI-powered conversations by crafting effective prompts. This involves collaborating with product and engineering teams to ensure seamless integration and optimal performance. Your attention to detail and analytical skills will be crucial in identifying areas for...

  • Conversational AI Optimizer

    9 hours ago

    Taguig, National Capital Region, Philippines beBee Careers Full time

    Crafting Conversational AI ExperiencesWe're seeking an experienced conversational AI optimizer to join our team. In this role, you'll work to develop, test, and refine AI-powered conversations by crafting effective prompts. Your creativity, analytical skills, and passion for AI will enable you to drive innovation and improve user experiences.

  • Marketing and AI Specialist

    5 days ago

    Taguig, National Capital Region, Philippines beBee Careers Full time

    About the RoleWe are looking for a talented Digital Marketing Coordinator to support high-impact projects at our organization. As a digital marketing professional with an interest in AI, you will conduct market research and competitor analysis using our proprietary AI tools.This role involves helping to refine, review, and edit AI-generated marketing intel,...

  • Freelance Full Stack Developer

    2 weeks ago

    Taguig, National Capital Region, Philippines Mindrift Full time

    About the RoleAs a freelance full stack developer, you will play a crucial role in advancing the field of artificial intelligence through collaborative generative AI projects with domain experts.The Mindrift platform allows experts to dive into various tasks, from creating training prompts for AI models to refining AI responses for better relevance. You'll...

  • Java Developer for Generative AI Projects

    2 weeks ago

    Taguig, National Capital Region, Philippines Mindrift Full time

    Job DescriptionIn this mid-senior level part-time freelance role, you will work on developing complex question-answer pairs and create scoring criteria to evaluate and grade the quality of AI responses.You will be responsible for generating prompts that challenge the AI and are likely to produce incorrect responses, and defining comprehensive scoring...