As a Machine Learning Quality Engineer, you will test and ensure the quality of AI technologies, maintain test frameworks, and optimize customer interactions.
Company Description
It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today - ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500®. Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But this is just the beginning of our journey. Join us as we pursue our purpose to make the world work better for everyone.
Job Description
This is a Quality Engineering role and you will be working on our Machine Learning technologies. We are the Conversational AI team and we provide a comprehensive and centralized platform for automating customer interactions, optimizing workflows, and improving user accessibility. Conversational AI is a type of artificial intelligence (AI) that can simulate human conversation. It is made possible by natural language processing (NLP), a field of AI that allows computers to understand and process human language and Google's foundation models that power new generative AI capabilities and Machine Learning capabilities
Qualifications
For positions in this location, we offer a base pay of $123,500 - $191,500, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies, and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs. Compensation is based on the geographic location in which the role is located and is subject to change based on work location.
Additional Information
Work Personas
We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work. Learn more here .
Equal Opportunity Employer
ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.
Accommodations
We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance.
Export Control Regulations
For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities.
From Fortune. ©2025 Fortune Media IP Limited. All rights reserved. Used under license.
It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today - ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500®. Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But this is just the beginning of our journey. Join us as we pursue our purpose to make the world work better for everyone.
Job Description
This is a Quality Engineering role and you will be working on our Machine Learning technologies. We are the Conversational AI team and we provide a comprehensive and centralized platform for automating customer interactions, optimizing workflows, and improving user accessibility. Conversational AI is a type of artificial intelligence (AI) that can simulate human conversation. It is made possible by natural language processing (NLP), a field of AI that allows computers to understand and process human language and Google's foundation models that power new generative AI capabilities and Machine Learning capabilities
- Experience in quality assurance and/or application development
- Strong test automation skills in Java / Python
- Hands-on experience testing large-scale, production systems in Python or Java
- Excellent communication, reporting and problem-solving skills
- Ability to take a project from scoping the requirements and building the test cases
- Maintain existing automation test frameworks
- Familiarity with testing AI/ML models and evaluation of the model quality
- Ability to review results from the test set and create defects based on result patterns
- Work with developers to design specific testing strategies for features being developed and automate them
- Create comprehensive test plans; execute and automate them
- Partner with the engineering organizations in troubleshooting or addressing issues with applications and dev/test environments
Qualifications
- Experience in leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving. This may include using AI-powered tools, automating workflows, analyzing AI-driven insights, or exploring AI's potential impact on the function or industry.
- 2+ years of experience with technologies relevant to SN, Quality engineering and coding skills with high-quality results.
- 2 years of experience as a Machine Learning Quality Engineer
- Bachelor's degree and a minimum of 2 years of related experience; or an advanced degree without experience; or equivalent work experience.
- Experience working within different automated testing frameworks, including Java, JUnit, Python, Selenium, TestNG and other open-source projects.
- Experience with the agile methodology for software development teams.
- Ability to know several testing techniques (e.g. performance, unit, integration, automated), their strengths and weakness, and ability to use them to best effect - including tracking and addressing of any discovered issues.
- Ability to use tools (such as IDE, debugger, build tools, source control, ServiceNow instances, profilers, system administration/Unix tools) to assist with daily tasks
For positions in this location, we offer a base pay of $123,500 - $191,500, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies, and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs. Compensation is based on the geographic location in which the role is located and is subject to change based on work location.
Additional Information
Work Personas
We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work. Learn more here .
Equal Opportunity Employer
ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.
Accommodations
We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance.
Export Control Regulations
For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities.
From Fortune. ©2025 Fortune Media IP Limited. All rights reserved. Used under license.
Top Skills
Java
Junit
Python
Selenium
Testng
Unix
ServiceNow Waltham, Massachusetts, USA Office





View Gallery
275 Wyman Street, 2nd Floor, Waltham, MA, United States, 02451
Similar Jobs at ServiceNow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead quality engineering for AI/ML products by developing test strategies, frameworks, and metrics, while collaborating with cross-functional teams.
Top Skills:
JavaJunitPythonSeleniumTestng
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Develop and support ServiceNow applications, integrate with third-party systems, and maintain API/data integrations, leveraging extensive ServiceNow knowledge.
Top Skills:
ItilItsmJavaScriptRest ApiServicenow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Responsible for managing cloud infrastructure operations for ServiceNow's SaaS platform, requiring strong Linux skills and automation expertise.
Top Skills:
AnsibleBashCactiCfengineChefF5IcingaJavaScriptLinuxLogstashMariadbMySQLNagiosNginxOraclePuppetPythonSplunk
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories