Design, build, and operate a secure, scalable Generative AI platform on AWS (including Bedrock) to support production LLM applications in regulated financial environments. Own platform lifecycle: architecture, deployment, operations, monitoring, incident management, reliability, and performance. Implement LLM inference, RAG, Agents, guardrails, observability, security controls, access management, compliance, and cost optimization. Provide production support, reliability engineering, and AI governance.
JD Experience – 8 + years Key Responsibilities • Design, build, and operate a secure, scalable, and cost efficient enterprise Generative AI platform on AWS, supporting production grade LLM applications in regulated environments. • Own the full GenAI platform lifecycle, including architecture, deployment, operations, monitoring, incident management, and continuous reliability and performance improvements. • Implement and run AWS Bedrock–based solutions, enabling LLM inference, RAG, Agents, and Guardrails with high availability, fault tolerance, and SLA compliance. • Establish strong operational and governance frameworks, covering observability, alerting, RCA, security controls, access management, compliance, and cost optimization. • Bring deep expertise in cloud ML platforms and financial services, with strong Python skills, AWS services knowledge, GenAI hands on experience, and a background in production support, reliability engineering, and AI governance. Required Skills • 8+ years of experience in hands on exposure to AI/ML or Generative AI systems • Strong understanding of AI evaluation techniques, including hallucination detection, factual accuracy, bias, and output consistency • Knowledge of Responsible AI principles, including fairness, transparency, and explainability • Python (must-have) and Experience with: REST APIs and microservices
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
