HSI Logo

HSI

Sr. QA AI Automation

Posted 10 Hours Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Build and maintain enterprise-grade Playwright automation frameworks, integrate automated testing into Azure DevOps CI/CD pipelines, and expand regression coverage across SaaS applications and APIs. Drive AI-assisted test generation using tools such as Claude, establish QA standards and metrics, prioritize automation opportunities, collaborate with engineering, product, and DevOps teams, and mentor junior QA staff.
The summary above was generated by AI

HSI is a leading provider of cloud-based environmental, health, and safety (EHS) compliance and workforce development solutions for businesses. Our platforms deliver safety training and learning solutions that empower organizations to build safer, smarter workplaces.

We are seeking a Senior QA Automation Engineer (AI-Driven Testing) to help drive a major transformation in our quality assurance function.

This role is focused on shifting from manual and vendor-driven testing to an automation-first, AI-assisted QA approach. You will play a key role in building scalable test automation frameworks, leveraging modern tools like Playwright and AI (Claude) to dramatically increase test coverage and reduce production defects.

This is a hands-on role with high visibility and growth potential as the QA organization scales.
Key responsibilities include:

  • Contribute and drive the adoption of an AI-driven QA approach across products and platforms
  • Design, build, and maintain enterprise-grade test automation using Playwright
  • Contribute to establishing an automation-first QA approach, including standards, governance, and reporting
  • Leverage AI tools (e.g., Claude) to generate and scale test cases
  • Support the development of standards for AI-assisted test generation, test data strategy, regression design, and observability
  • Help reduce reliance on manual and outsourced QA efforts
  • Execute and expand regression testing across multiple applications
  • Integrate automated testing into Azure DevOps CI/CD pipelines
  • Partner closely with engineering, product, and DevOps teams
  • Identify and prioritize high-value test scenarios for automation
  • Contribute to QA standards, best practices, and automation strategy
  • Help define and track quality and automation metrics (coverage, regression cycle time, defect escape rate, throughput)
  • Support knowledge sharing, documentation, and reuse of automation frameworks
  • Mentor and support jr. QA team members
  • Communicate progress, risks, and KPI trends to leadership

Requirements
  • 5+ years of QA / Software Quality Engineering experience
  • Strong hands-on experience building test automation frameworks (Playwright required)
  • Experience developing and scaling automated test suites for enterprise SaaS or cloud-based applications
  • Experience integrating automated tests into CI/CD pipelines (Azure DevOps preferred)
  • Experience extending AI usage into advanced QA workflows (e.g., large-scale test generation, optimization, intelligent test selection)
  • Hands-on experience using AI tools (e.g., Claude) in development or QA workflows
  • Experience testing web-based applications and APIs
  • Strong understanding of:
    • Regression testing strategies
    • Test design and coverage
    • Automation best practices
  • Ability to work cross-functionally with engineering, product, and DevOps teams

Preferred Qualifications

  • Scaled automation across multiple applications or product lines
  • Worked with agent-based or model-assisted testing approaches
  • Mentored or supported junior QA engineers
  • Helped transition from manual or outsourced QA to automation-first teams
  • Tested complex, highly integrated SaaS platforms (multi-service or multi-tenant)
  • Built or expanded API automation frameworks (REST and/or GraphQL)
  • Worked in Agile/Scrum environments (Scrum certification a plus)

Benefits
  • Fully Remote Work: Work where you're most productive—we trust you.
  • PTO: Recharge when you need to—we support work-life balance.
  • Career Growth: Unlimited access to our Learning & Development library, including our own HSI LMS content.
  • Well-Being First: Full medical, dental, vision, and mental health coverage.
  • Secure Your Future: Generous $1:$1 401(k) company match—your future is important to us.

Similar Jobs

6 Days Ago
In-Office or Remote
Senior level
Senior level
Big Data • Cloud • Digital Media • Machine Learning • Mobile • Software • Industrial
Design, build, and maintain automated test suites, evaluation scenarios, metrics, and datasets for AI-powered features. Automate QA workflows with Python and CI/CD, test APIs and ML model outputs, define quality strategy and acceptance criteria, create CI/CD quality gates, mentor teams, participate in code reviews, and document findings.
Top Skills: Ai-Powered Testing ToolsAirflowAPIsAWSAzureCadCi/CdCometGithub ActionsGoogle Cloud PlatformGreat ExpectationsJenkinsMetaflowMlflowPythonPyTorchTensorFlowWeights & Biases
6 Days Ago
In-Office or Remote
84K-123K Annually
Senior level
84K-123K Annually
Senior level
Big Data • Cloud • Digital Media • Machine Learning • Mobile • Software • Industrial
Design, build, and maintain automated test suites, evaluation scenarios, and CI/CD quality gates for AI-powered applications. Test APIs, validate ML model outputs, create measurable evaluation rubrics, mentor teams, and contribute to shared QA frameworks and codebases.
Top Skills: Ai-Powered Testing ToolsAirflowAWSAzureCadCometGithub ActionsGoogle Cloud PlatformGreat ExpectationsJenkinsMetaflowMlflowPythonPyTorchTensorFlowWeights & Biases
9 Days Ago
In-Office or Remote
United States
38K-133K Annually
Expert/Leader
38K-133K Annually
Expert/Leader
Agency • Information Technology
Lead QA Automation for agentic AI products by designing eval pipelines, golden datasets, and automated tests for tool-use, hallucination detection, latency/token monitoring, and regression across models and prompts. Integrate performance testing into CI/CD and collaborate with AI engineers to convert requirements into measurable automated evaluations.
Top Skills: Ci/CdClaude 3.5CypressDeepevalGpt-4JSONLangsmithPlaywrightPromptfooPytestPythonRagRagasSeleniumSQL

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account