Ready to be a Titan?
The AI engineering organization at ServiceTitan is looking for a leader who will drive the core infrastructure of our AI strategy to support our growth now and in the future. The ideal candidate will have experience growing and managing multiple AI engineering teams and managers within a product company, possessing a proven ability to align AI agentic infrastructure with concrete business outcomes, and anchor the organization's technical work within our broader corporate strategy. They will work with business stakeholders across the company and support the creation of a global AI Agentic Infrastructure competency that includes intelligent, autonomous, and semi-autonomous systems.
What You'll Do:
Set the engineering vision and direct the architecture of ServiceTitan's core AI infrastructure and Multi-Agent Systems encompassing model hosting/training, agent hosting, reinforcement learning, intelligence store and rigorous evaluation that bridges agent specifications to business outcomes.
Partner with Product leaders to co-create vision, set strategic direction, and define the technical roadmap for foundational AI capabilities, ensuring the infrastructure seamlessly scales to support all platform-level agents and future product innovations, while ensuring agentic systems are designed with human-in-the-loop controls, observability, and auditability.
Define enterprise-wide standards, budgets, and governance for LLM capabilities and trade-offs (latency, cost) to drive superior customer experiences at scale, and evaluate different technologies to make informed platform-level decisions aligned with business goals.
Oversee highly available data processing architectures, Enterprise-wide Knowledge Graphs, and the foundational Intelligence Store, and feedback loops essential for successful RAG and agentic pipelines at a domain-wide scale.
Architect and drive the adoption of scalable LLMOps and AgentOps frameworks, including building a centralized, high-throughput "Evaluation Core" platform for supporting, evaluating, and securing complex multi-agent deployments in parallel with agent execution.
Direct the architectural integration of advanced techniques (multi-agent systems, function calling, fine-tuning) to enhance agent capabilities and drive operational excellence across the organization.
Align with Engineering and Product leadership on roadmaps to ensure timely delivery of robust production agents that drive revenue and growth, while managing real-world constraints like token budgets, inference latency, and cost-normalized accuracy at an enterprise scale.
Implement governance for ethical, explainable, and compliant AI usage, including data handling and bias considerations.
Hire, mentor, and retain a high-performing AI Engineering organization, including developing and coaching engineering managers, fostering a culture of ownership, accountability, experimentation, and responsible AI development.
What You'll Bring:
Education: MS/Ph.D. in Computer Science, Artificial Intelligence, Computational Linguistics, or a similar quantitative discipline required.
Leadership: 5+ years of experience in ML or AI engineering leadership roles, specifically managing multiple teams (including managing managers) shipping production software.
Technical Expertise: Deep system-level architectural knowledge of modern NLP, large language models (LLMs), transformer architectures, RAG pipelines, and agentic workflows (planning, reasoning, tool use, human-in-the-loop workflows).
Advanced Evaluation Skills: Deep knowledge of evaluation methodologies for non-deterministic systems, including LLM-as-a-Judge, behavioral analysis (evaluating reasoning traces or chain of thought), and championing best practices in model lifecycle management and monitoring.
Data Systems: Expertise in vector databases, and SQL; experience with handling unstructured text data at scale to build foundational data architectures.
Technical Mastery: Deep architectural understanding and proven experience designing and overseeing the core components of enterprise AI platforms. You must bring specific architectural expertise in scalable Model Hosting and Training, managing enterprise-wide Knowledge Graphs, building robust Agent Hosting environments, implementing Reinforcement Learning pipelines, and designing a comprehensive Intelligence Store, You should act as an "Engineer of Engineers," capable of evaluating complex technical tradeoffs across these specific components to guide your teams toward highly scalable, efficient, and secure solutions
Communication: Great communication skills, including the ability to communicate complex AI concepts (like hallucinations or context windows), as well as AI capabilities, limitations, and risks to business stakeholders and articulate product vision to audiences ranging from individual contributors to C-level executives.
Cross-Functional Collaboration: Proven ability to act as a bridge between Engineering, Product Management, and executive leadership, anticipating future business needs and translating competitive market offerings into scalable technical insights
Adaptability: Strong judgment in navigating ambiguity and guiding engineering teams in the fast-paced Generative AI landscape, balancing rapid innovation in AI with long-term platform stability and maintainability.
Remote Location: Candidates based in PST (US/Canada) are highly preferred.
Be Human With Us:
Being human isn’t about checking every box on a list. It’s about the experiences we have, people we meet, and the perspectives we share. So, if you have the skills but are hesitant to apply because of your background, apply anyway. We need amazing people like you to help us challenge the conventional and think differently about the problems that we’re solving. We’re in this together. Come be human, with us.
Use of AI Technology:
We use technology, including automated and AI-assisted tools, to support certain aspects of our recruitment process. These tools are designed to improve efficiency and enhance the candidate experience. AI tools are not used to make hiring decisions; all hiring decisions are made by our hiring teams.
What We Offer:
When you join our team, you’re not just accepting a job. You’re making a career move. Here’s how we’ll support you in doing some of the most impactful work of your career:
Flextime, recognition, and support for autonomous work: Flexible time off with ample learning and development opportunities to continue growing your career. We offer a comprehensive onboarding program, leadership training for Titans at all levels, and other programs and events. Great work is rewarded through Bonusly, peer-nominated awards, and more.
Holistic health and wellness benefits: Company-paid medical, dental, and vision (with 100% employer paid options and 90% coverage for dependents), FSA and HSA, 401k match, and telehealth options including memberships to One Medical.
Support for Titans at all stages of life: Parental leave and support, up to $20k in fertility services (i.e. IUI and IVF), surrogacy, and adoption reimbursement, on demand maternity support through Maven Maternity, free breast milk shipping through Maven Milk, pet insurance, legal advisory services, financial planning tools, and more.
At ServiceTitan, we celebrate individuality and uniqueness. We believe that the convergence of fresh perspectives and experiences from all walks of life is what makes our product and culture so great. We strongly encourage people from underrepresented groups to apply. We do not discriminate against employees based on race, color, religion, sex, national origin, gender identity or expression, age, disability, pregnancy (including childbirth, breastfeeding, or related medical condition), genetic information, protected military or veteran status, sexual orientation, or any other characteristic protected by applicable federal, state or local laws.
ServiceTitan is committed to fair and equitable compensation for all of our employees. We thoughtfully consider a wide range of factors when determining individual compensation.The expected salary range for this role for candidates residing in the United States is between $271,800 USD - $363,500 USD. Compensation for candidates residing outside the United States will vary by location and the specific salary range will be discussed during the hiring process. Actual compensation for an individual may vary depending on skills, performance over time, qualifications, experience, and location. In addition to the base salary, the total compensation package also includes an annual bonus, equity and a holistic suite of benefits.Top Skills
Similar Jobs
What you need to know about the Boston Tech Scene
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories


.png)
