Senior Test Automation Engineer

CriticalRiver Inc. is a global technology consulting company specializing in Salesforce, NetSuite, and Oracle solutions. We provide consulting, implementation, integration, analytics, managed services, and quality assurance to help clients drive digital transformation and improve operational efficiency.

Our expertise spans cloud, automation, and next-generation technologies such as AI/ML, IoT, RPA, and Industry 4.0. We serve a diverse range of industries, including Energy & Utilities, High Tech, Financial Services, Manufacturing, and Not-for-Profit sectors.

At CriticalRiver, we are committed to delivering innovative, end-to-end solutions that empower clients to achieve sustainable business growth—while fostering a culture of collaboration, innovation, and continuous learning.

We are seeking an experienced Senior Test Automation Engineer to design, implement, and maintain automated test frameworks for enterprise-grade software applications.

The ideal candidate will have hands-on experience with TestComplete, ReadyAPI, LoadNinja, and Azure DevOps, along with a strong understanding of software QA methodologies, performance analysis, and defect management.

This role involves close collaboration with developers, business analysts, and product owners to ensure high-quality, reliable software releases through continuous testing and process improvement.

Test Planning & Design

• Analyze business and technical requirements to define test strategies, plans, and detailed test scenarios.
• Participate in requirements and design walkthroughs to ensure adequate test coverage.
• Plan and scope automation test strategy; identify test features for each release.

Test Execution & Review

• Execute manual and automated tests; review results and analyze test failures.
• Enter, track, and manage defects in Jira, ensuring timely triage and closure.
• Collaborate with developers to identify root causes and resolve issues iteratively.

Automation Development

• Design, develop, and maintain automation test suites using TestComplete, ReadyAPI, and LoadNinja.
• Integrate automated tests with Azure DevOps CI/CD pipelines for continuous testing.
• Configure and monitor complex test environments simulating customer conditions.

Performance & Reliability Testing

• Use profiling tools or custom methodologies to identify performance bottlenecks and improve test efficiency.

Process Improvement

• Lead or participate in lessons-learned sessions to identify and drive continuous improvements.
• Follow industry best practices for test automation, QA methodologies, and quality metrics.

Cross-Team Collaboration

• Work closely with Customer Support to identify, reproduce, and validate field issues.
• Participate in project and release planning meetings to align QA deliverables with timelines and business goals.

Delivery & Ownership

• Deliver high-quality, on-time work within defined budget and scope.
• Demonstrate accountability, ownership, and a continuous focus on product stability and customer satisfaction.

Primary Skills

• Test Automation Tools: TestComplete, ReadyAPI, LoadNinja, Selenium, Playwright
• CI/CD Tools: Azure DevOps (Pipelines, Repos, Boards)
• Defect Tracking & Collaboration: Jira, Confluence
• Scripting/Programming: Python / JavaScript / VBScript (as applicable to automation tools)
• Performance Testing & Analysis: Profiling and tracing tools
• Test Management: Test case design, traceability matrix, regression coverage planning
• Virtualization & Test Environments: Virtual machines, test agents, environment configuration

Secondary Skills

• API testing and automation
• Load and stress testing using LoadNinja or equivalent tools
• Version control using Git or Azure Repos
• Strong understanding of SDLC and Agile testing processes
• Basic knowledge of cloud-based testing and deployment (Azure preferred)