AQ Automation Lead, AI & Data Platforms

Your Future is our Future

At Lumeris, we believe that our greatest achievements are made possible by the talent and commitment of our team members. That's why we are actively seeking talented and collaborative individuals who are passionate about making a difference in the healthcare industry. Join us today as we strive to create a system of care that every doctor wants for their own family and become part of a community that values its people and empowers you to make an impact.

Position:AQ Automation Lead, AI & Data Platforms

Position Summary:The QA Automation Lead will design and drive the automation strategy for AI-driven healthcare services, including AI agents, Best Next Action (BNA), and supporting data pipelines. They will ensure that testing automation frameworks align with engineering standards and regulatory requirements for safe, explainable AI in healthcare. Acting as a bridge between software engineering and quality assurance, the QA Automation Lead will enhance the reliability and scalability of AI systems through robust test frameworks, automation suites, and CI/CD integration.

Job Description:

Responsibilities 

• Design and implement end-to-end automation frameworks for AI/ML services and APIs. 

• Lead automation coverage across patient store, data ingestion, and communication pipelines. 

• Develop Python-based or TypeScript test suites integrated with ADO Actions, Jenkins, or similar. 

• Collaborate with developers and data science to embed testing early in the delivery lifecycle. 

• Integrate synthetic and production-like data for consistent AI validation. 

• Establish metrics and dashboards (coverage, pass rate, execution time). 

• Mentor QA engineers on automation best practices and code review standards. 

Qualifications 

• Bachelor’s in Computer Science, Engineering, or equivalent. 

• 5+ years in QA/QE automation. 

• Strong Python or JavaScript/TypeScript experience. 

• Familiar with RESTful APIs, Postman, and cloud (AWS/GCP). 

• Experience with frameworks like PyTest, Cypress, Playwright, or Robot Framework. 

• Knowledge of AI testing, data validation, or model QA a strong plus. 

• Excellent understanding of CI/CD, Docker, and test data management. 

• Knowledge of AI risk management frameworks (ISO 42001, NIST AI RMF). 

Healthcare or regulated data environment experience preferred

Pay Transparency:

Factors that may be used to determine your actual pay rate include your specific skills, experience, qualifications, location, and comparison to other employees already in this role. In addition to the base salary, certain roles may qualify for a performance-based incentive and/or equity, with eligibility depending on the position. These rewards are based on a combination of company performance and individual achievements.

The hiring range for this position is:

$122,335.00-$166,114.75

Benefits of working at Lumeris

• Medical, Vision and Dental Plans

• Tax-Advantage Savings Accounts (FSA & HSA)

• Life Insurance and Disability Insurance

• Paid Time Off (PTO, Sick Time, Paid Leave, Volunteer & Wellness Days)

• Employee Assistance Program

• 401k with company match

• Employee Resource Groups

• Employee Discount Program

• Learning and Development Opportunities

• And much more...

Be part of a team that is changing healthcare!

Member Facing Position: No- Not Member or Patient Facing Position

Location:Massachusetts

Time Type:Full time

Lumeris and its partners are committed to protecting our high-risk members & prospects when conducting business in-person. All personnel who interact with at-risk members or prospects are required to have completed, at a minimum, the initial series of an approved COVID-19 vaccine. If this role has been identified as member-facing, proof of vaccination will be required as a condition of employment.Disclaimer:

• The job description describes the general nature and level of work being performed by people assigned to this job and is not intended to be an exhaustive list of all responsibilities, duties and skills required. The physical activities, demands and working conditions represent those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individual with disabilities to perform the essential job duties and responsibilities.

Lumeris is an EEO/AA employer M/F/V/D.