Automation QA Engineer
About the Project
Our client is RxPost, a fast-growing health-tech B2B platform focused on building innovative solutions for the healthcare industry. The company operates with a modern serverless-first AWS architecture, leveraging technologies such as AWS Lambda, API Gateway, RDS, Amplify, and Cognito to deliver scalable and reliable products.
As a small, highly collaborative engineering team, they value ownership, automation, and engineering excellence. Their goal is to build a sustainable quality strategy where testing is an integral part of the development process rather than an afterthought.
About the Role
We are looking for a QA Engineer / SDET who enjoys building automated testing solutions and using modern AI tools to improve testing efficiency.
This is a hands-on engineering role where you’ll write test code, develop and maintain automated testing infrastructure, and own the overall QA strategy. You’ll also work on validating AI-powered product features, designing evaluation approaches for non-deterministic systems, and helping the team reduce regressions through reliable automated testing.
You’ll collaborate closely with software engineers to ensure quality is embedded throughout the development lifecycle.
Requirements:
Must-have
- Strong commercial experience with JavaScript / TypeScript
- Hands-on experience with Playwright, Cypress, or another modern E2E testing framework
- Experience writing and maintaining automated test code
- Practical experience using AI tools in the software testing workflow (test generation, maintenance, debugging, or triage)
- Experience testing AI-powered or non-deterministic systems, or a solid understanding of testing approaches for such applications
- Experience working with AWS serverless environments, including Lambda and API Gateway
- Ability to independently define and execute QA strategy within a small engineering team
- Strong analytical and problem-solving skills
- Excellent communication skills and proactive mindset
Nice to have
- Experience with LLM evaluation frameworks or AI evaluation pipelines
- Familiarity with MCP or AI agent-based tooling
- Experience building QA processes from scratch in a startup environment
- Background in HealthTech, FinTech, or other regulated industries
Responsibilities:
- Design, develop, and maintain automated end-to-end and regression test suites using Playwright
- Leverage AI-powered testing tools to improve test creation, maintenance, and overall testing efficiency
- Test AI-powered product features, including LLM- and MCP-based functionality
- Build evaluation frameworks, regression checks, and quality guardrails for AI-driven workflows
- Improve overall test coverage by addressing infrastructure testing, integration testing, and regression gaps
- Develop smoke tests and contract tests for third-party integrations (HubSpot, Dwolla, Intercom, PostHog, Slack)
- Collaborate closely with developers to integrate automated testing into the development lifecycle
- Drive QA best practices and help establish a strong Definition of Done with automated test coverage
Interview Stages
- Resume review and screening
- Extended online interview with technical experts (1.5–2 hours)
- Online interview with the Client (culture & team fit)
- Offer