The Principal Engineer, AI/ML Architecture will define the technical direction for Coupa's AI platform, focusing on model training, evaluation, safety standards, and mentoring a team of ML and data engineers.
Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins.
Why join Coupa?
🔹 Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend.
🔹 Collaborative Culture: We value collaboration and teamwork, and our culture is driven by transparency, openness, and a shared commitment to excellence.
🔹 Global Impact: Join a company where your work has a global, measurable impact on our clients, the business, and each other.
Learn more on Life at Coupa blog and hear from our employees about their experiences working at Coupa.
The Impact of a Principal Engineer, AI/ML Architecture at Coupa:
Coupa's AI platform powers production agents, conversational AI (Navi), customer-built agents (Agent Studio), and a suite of ML models for classification, fraud detection, and supplier intelligence. The Principal Engineer, AI/ML Architecture will define the technical direction for the next generation of these capabilities, designing how we train, evaluate, and serve models that are deeply tuned to enterprise spend management. Reporting to the Sr. Director, you will be hands-on in architecture and prototyping while guiding a growing team of ML and data engineers.
What You'll Do:
- Define the architecture for model training, evaluation, and serving across Coupa's AI platform.
- Evaluate and select model approaches (open-weight, commercial, and hybrid) against enterprise accuracy and cost requirements.
- Design evaluation frameworks that measure model quality on Coupa's specific task categories.
- Drive technical partnership evaluations with AI infrastructure and model providers.
- Architect training data pipelines, including synthetic data generation and quality validation.
- Design retrieval-augmented generation (RAG) systems that extend our existing RAG infrastructure with structured knowledge retrieval.
- Establish technical standards for model safety, tenant data isolation, and responsible AI.
- Write code, review PRs, and prototype approaches, especially in the early phases.
- Mentor and guide ML and data engineers across US and India.
- Collaborate with product, existing AI platform, and cloud operations teams.
What You Will Bring to Coupa:
- 15+ years of software engineering experience, with 5+ years focused on ML/AI systems.
- Demonstrated experience training or fine-tuning large language models. Must have shipped a fine-tuned or domain-adapted model to production.
- Deep knowledge of transformer architectures, training optimization (LoRA, QLoRA, PEFT, RLHF, DPO), and inference serving.
- Experience with distributed training on GPU clusters.
- Strong understanding of RAG architectures, vector search, embedding models, and knowledge graph integration.
- Hands-on experience with cloud AI/ML services (model hosting, managed training, or equivalent).
- Experience designing and running custom evaluation suites for LLMs.
- Proficiency in Python, PyTorch, and ML infrastructure tooling.
- Advanced degree in Computer Science, Machine Learning, or equivalent practical experience.
- Experience with enterprise B2B SaaS platforms preferred.
#LI-HYBRID
#LI-AA2
Coupa complies with relevant laws and regulations regarding equal opportunity and offers a welcoming and inclusive work environment. Decisions related to hiring, compensation, training, or evaluating performance are made fairly, and we provide equal employment opportunities to all qualified candidates and employees.
Please be advised that inquiries or resumes from recruiters will not be accepted.
By submitting your application, you acknowledge that you have read Coupa’s Privacy Policy and understand that Coupa receives/collects your application, including your personal data, for the purposes of managing Coupa's ongoing recruitment and placement activities, including for employment purposes in the event of a successful application and for notification of future job opportunities if you did not succeed the first time. You will find more details about how your application is processed, the purposes of processing, and how long we retain your application in our Privacy Policy.
Coupa Boston, Massachusetts, USA Office
53 State Street Suite 1205, Boston, MA, United States, 02109
Similar Jobs at Coupa
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Lead strategy, roadmap, and execution for Intake & Orchestration and Platform products. Build and mentor a product management team, define AI-native automation and integration platform capabilities, partner with engineering/UX/AI/architecture, engage customers and executives, drive platform-first reusable orchestration patterns, and track adoption, usage, NPS, and revenue impact while managing technical debt and engineering quality.
Top Skills:
AIAPIsIpaasMicroservicesMulti-Tenant ArchitectureNo-CodeWorkflow Automation
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Lead and evolve Coupa's LLM/GenAI platform: define architecture and strategy, build MLOps pipelines, manage deployment/lifecycle of LLMs and embeddings, implement IaC and multi-cloud infrastructure, mentor platform engineers, ensure reliability, observability, and enterprise-grade scalability/security.
Top Skills:
Agentic WorkflowsAi AgentsAmazon SagemakerAWSAws BedrockCi/CdDockerEksGCPGkeGoIamJavaKubernetesLancedbLangchainMcp ServersMlopsOpenaiPythonRagS3TerraformVector Databases
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Lead the development and governance of AI systems at Coupa, driving excellence in model performance and MLOps while mentoring a team of data scientists and ML engineers.
Top Skills:
DatabricksGenerative AiKubeflowLlmsMlflowPythonPyTorchSagemakerTensorFlowVertex Ai
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

