Design, build, and operate production-grade Generative and Agentic AI applications and services. Develop backend services in Python, integrate LLM APIs and agent frameworks, implement RAG and vector search, deploy on major clouds, ensure reliability, observability, and mentor junior engineers.
Background
We are looking for a Staff Generative AI Engineer to design, build, and ship production-grade Generative AI and Agentic AI applications that delivery business value across the organization. This role is focused on building AI applications and services at scale. You will be responsible for building robust, secure, and highly scalable systems that integrate with leading cloud-based AI services.
As a senior individual contributor, you will bring deep technical expertise, drive high-quality engineering practices, and serve as a mentor for junior to mid-level engineers. You will work closely with software engineers, data scientists, and product teams to translate business problems into production-grade AI applications and services
ResponsibilitiesKey Responsibilities Application and Solution Engineering
- Design, build, and ship production-grade Generative and Agentic AI applications and services for internal and external users
- Develop high-quality backend services in Python, with strong software engineering rigor around testing, performance, and maintainability
- Champion reusability and abstraction in everything you build by designing and building modular, well-abstracted components and libraries
- Build multi-agent systems using frameworks such as LangChain, LangGraph, Claude Agent SDK and Google ADK
- Integrate with leading LLM and foundation model APIs, including Azure OpenAI, Google Vertex AI, and AWS Bedrock
- Design and implement Retrieval-Augmented Generation (RAG) pipelines, including document ingestion, chunking strategies, embeddings, vector search, and re-ranking
- Build clean, well-tested RESTful and/or gRPC APIs with a strong focus on reliability, security, and performance
- Implement observability, tracing, evaluation, guardrails for Generative and Agentic AI applications
- Deploy and operate services on major cloud providers (e.g., GCP, AWS, and Azure) leveraging managed services
- Contribute to platform architecture decisions and engineering best practices
- Take applications from prototype through production deployment, hardening, and ongoing operation
Mentorship and Team Development
- Mentor and coach junior and mid-level engineers through code reviews, architecture discussions, and pair programming
- Foster a culture of engineering excellence, knowledge sharing, and continuous improvement
- Participate in technical design reviews and contribute to the professional growth of team members
Required Qualifications
- 10-15 years of professional software engineering experience with at least 3-5 years of experience building AI/ML software products
- Bachelor’s degree in Computer Science or a related field (Master’s degree preferred)
- Strong proficiency in Python, with deep software engineering fundamentals (abstraction, modularity, system design, testing, performance)
- Hands-on experience building and shipping Generative and Agentic AI applications, including LLM integration, prompt engineering, and/or agentic workflows
- Practical experience integrating cloud-hosted LLM APIs such as Azure OpenAI, Vertex AI, and/or AWS Bedrock
- Experience with agent frameworks (e.g., LangChain, LangGraph, Google ADK, Claude Agent SDK) and vector databases (e.g., Pinecone, Weaviate, pgvector, Open Search, AlloyDB)
- Hands-on experience with Google Cloud Platform (GCP), Amazon Web Services (AWS), or Azure
- Strong understanding of API design, distributed systems, and cloud-native architecture
- Proven track record of taking systems from design through production deployment and operation
Preferred Qualifications
- Experience with containerization and orchestration (Docker, Kubernetes)
- Knowledge of Generative AI Risk Management frameworks (NIST RFM)
- Experience supporting developer platforms or internal tooling
- Experience writing design documents or helping define engineering standards
Similar Jobs
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Drive partner and merchant integrations, design technical solutions, collaborate with teams, and provide technical advice as a leading solutions engineer.
Top Skills:
APIsFull-Stack DevelopmentProgramming Language
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Manage and grow a portfolio of enterprise merchant accounts for Cash App and Afterpay. Drive post-sales revenue through renewals, expansions, strategic account plans, cross-functional execution, complex negotiations, and relationship-building with senior executives to maximize retention and profit.
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Rubrik invites engineers to join their talent community to be part of a team dedicated to data security, innovation, and inclusion. Candidates should be motivated to tackle challenges and contribute to product development.
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
