Senior Test Automation Specialist

DevRev

DevRev's AgentOS, purpose-built for SaaS companies, comprises three modern CRM apps for support, product, and growth teams. It connects end users, sellers, support, product people, and developers, reducing 9 business apps and converging 6 teams onto a common platform.

Unlike horizontal CRMs, DevRev takes a blank canvas approach to collaboration, AI, and analytics, enabling SaaS companies to increase product velocity and reduce customer churn. DevRev is used by thousands of companies in search of low latency analytics and customizable LLMs to thrive in this era of GenAI.

Headquartered in Palo Alto, California, DevRev has offices in seven global locations. We have raised $100 million in funding from investors like Khosla Ventures and Mayfield at a $1.1 billion valuation. We are also honored to be named on the Forbes 2024 list of America's Best Startup Employers. Founded in October 2020 by Dheeraj Pandey, former co-founder and CEO of Nutanix, and Manoj Agarwal, former SVP of Engineering at Nutanix, DevRev continues to push the boundaries of innovation, helping thousands of companies thrive in the rapidly evolving landscape of AI-driven SaaS.

We are seeking a highly skilled QA Automation Architect with deep expertise in building and scaling test automation frameworks using the Playwright framework. The ideal candidate has experience defining and driving QA automation strategy across large test suites, implementing clean design principles, and introducing AI-assisted testing methodologies for smarter, more efficient QA cycles.

You will be instrumental in establishing a scalable, maintainable, and robust test automation ecosystem. This role requires both strategic thinking and hands-on execution, serving as a technical leader and mentor to the QA automation team. In this role, you will leverage AI and test automation to enhance and expedite our testing processes, govern and evolve our test frameworks, and develop a comprehensive monitoring and alerting system. Your expertise will ensure the robustness, efficiency, and reliability of our software delivery pipeline.

Key Responsibilities:

• AI-driven Test Automation:
• Implement and utilize AI and intelligent agents to accelerate test generation processes.
• Transition from manual test case development to AI-driven automation solutions, enhancing overall testing efficiency.
• Test case design and documentation:
• Define clear, concise, and comprehensive test cases based on requirements, specifications, and user stories. Ensure test cases cover both positive and negative scenarios, edge cases, and system interactions. Maintain traceability between test cases and product features.
• Test Suite Development & Maintenance:
• Organize and maintain test suites to reflect product changes and evolving test coverage needs. Refactor outdated or redundant tests, ensuring relevance and accuracy. Maintain a clear structure for manual and automated test suites for ease of access and reusability.
• Test Framework Implementation and Governance:
• Design and implement a test automation framework using Playwright for end-to-end web testing that is modular, maintainable, and scalable.
  
  Create a blueprint and best practices for the QA team to onboard and contribute new automated test cases seamlessly.
• Define coding standards, version control practices, branching strategies, and code review guidelines for the QA automation codebase.
• Integrate test automation into CI/CD pipelines with real-time test reporting.
• Explore and integrate AI-powered tools for test case generation, flakiness detection, and intelligent exploratory testing (e.g., Testim, Mabl, Diffblue, or custom LLM-based test generation tools).
  
  Champion shift-left testing practices by collaborating with developers, product managers, and DevOps to catch issues early.
• Oversee the maintenance and continuous improvement of the existing test framework.
• Analyze test failures and test escapes to identify root causes and implement solutions.
• Foster a culture of quality through continuous improvements in testing methodologies and frameworks.
• Test reporting and analytics:
• Design and develop test reports to provide visibility into the test suite's performance and failures.
• Implement an effective test failures alerting system to promptly notify feature owners and responsible developers of SUT issues and failures.

Qualifications:

• Minimum Bachelor's degree in Computer Science, Engineering, or a related field.
• 7+ years of experience in Quality Assurance, with 3+ years architecting automation frameworks.
• Deep hands-on experience with Playwright (JavaScript/TypeScript) in a real-world production environment.
• Demonstrated experience building an automation framework from scratch, with organized test categorization, reusability, and CI/CD integration.
• Strong understanding of software testing methodologies, test planning, and test strategy.
• Familiarity with using AI to enhance testing and software development.
• Strong problem-solving skills and attention to detail.
• Experience with test reporting and analytics tools (e.g., Allure, ReportPortal, TestRail)
• Strong scripting and coding skills (JavaScript/TypeScript)
• Experience with test management and defect tracking systems.
• Experience with cloud-based test execution and containerization (Docker, Kubernetes).
• Familiarity with Git, Jenkins/GitHub Actions/Azure DevOps, and cloud services like AWS/GCP is a plus.
• Excellent communication, teamwork, and documentation skills, with a strong ability to advocate for best practices.

Preferred Skills:

• Hands-on experience with AI in software testing, such as using AI for test case generation, code coverage analysis, or flaky test detection.
• Knowledge of test framework design and development.
• Strong understanding of test reporting tools and technologies.

Nice to Have

• Contributions to open-source QA frameworks or tools.
• Familiarity with visual regression tools (e.g., Percy, Applitools).
• Knowledge of performance testing tools and integration with automation pipelines.
• Experience working in Agile/Scrum or DevOps-centric environments.

Join us in innovating our testing processes and ensuring the delivery of high-quality software products through advanced automation techniques.

Culture

The foundation of DevRev is its culture - our commitment to those who are hungry, humble, honest, and who act with heart. Our vision is to help build the earth's most customer-centric companies. Our mission is to leverage design, data engineering, and machine intelligence to empower engineers to embrace their customers.

That is DevRev