Lead design, development, and deployment of production-grade Generative AI applications (LLM-based chatbots, agents, RAG systems). Hands-on coding in Python, integrate and benchmark models, build ingestion and vector retrieval pipelines, design architecture for performance and cost, mentor engineers, and implement AI governance, safety, and monitoring.
Job Title: Generative AI Technical Lead Overview
We are seeking a Hands-on Generative AI Technical Lead to design, build, and scale AI-powered applications using state-of-the-art large language models (LLMs) and multimodal systems. This role combines deep technical expertise with leadership, requiring active coding, architecture ownership, and mentorship of engineering teams.
Key Responsibilities- Lead end-to-end GenAI development
- Design, develop, and deploy LLM-based applications (chatbots, copilots, agents, RAG systems)
- Build scalable, production-grade AI systems
- Hands-on engineering
- Write high-quality code (Python, APIs, pipelines)
- Implement prompt engineering, fine-tuning, embeddings, and vector search
- Work directly with frameworks like LangChain, LlamaIndex, or similar
- Architecture & system design
- Define GenAI architecture (RAG, agents, tool use, orchestration)
- Optimize performance, latency, and cost of AI systems
- Model integration
- Integrate with OpenAI, Anthropic, open-source models (Llama, Mistral, etc.)
- Evaluate and benchmark models for use cases
- Data & retrieval systems
- Design vector databases (Pinecone, Weaviate, FAISS, etc.)
- Build ingestion pipelines and knowledge retrieval systems
- Team leadership
- Mentor engineers and guide best practices
- Conduct code reviews and technical design reviews
- Experimentation & innovation
- Stay current with GenAI trends (agents, multimodal, fine-tuning, evals)
- Rapidly prototype and validate new ideas
- AI governance & safety
- Implement guardrails, monitoring, and evaluation frameworks
- Ensure responsible and secure AI usage
- 10+ years of software engineering experience
- Strong programming skills in Python
- Experience with:
- LLM APIs (OpenAI, Anthropic, etc.)
- RAG pipelines and vector databases
- Prompt engineering and evaluation techniques
- Solid understanding of:
- NLP concepts, embeddings, transformers
- Distributed systems and cloud platforms (AWS/GCP/Azure)
- Experience building and deploying APIs and microservices
-
Compensation, Benefits and Duration
Minimum Compensation: USD 62,000
Maximum Compensation: USD 217,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Similar Jobs
Edtech • Social Impact
Own new-logo acquisition for higher education: generate pipeline, run full sales cycles with CS faculty and administrators, close campus partnerships, manage HubSpot pipeline and forecasts, represent CodePath at conferences, and meet quarterly new-partner and enrollment targets. Expect regular travel to events and campus meetings.
Top Skills:
Hubspot
Edtech • Social Impact
Embed with teams to audit workflows, build and productionize LLM/agent automations (using Claude and integrations), create reusable assets and guardrails, coach teams to self-sufficiency, and measure outcomes to prioritize future engagements.
Top Skills:
AsanaClaudeClaude CodeGoogle WorkspaceHubspotLlm ApisLow-Code/No-Code Agent FrameworksMcp IntegrationsNotionSlackZendesk
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead and manage internal investigations, develop and implement compliance policies, advise on regulatory requirements, analyze operational risks, communicate findings to stakeholders, coach and lead teams, and support compliance program implementation and training to strengthen internal controls and ethical standards.
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
