Design and deploy enterprise Generative AI systems across the 7-layer stack: data ingestion, preprocessing, model selection, orchestration, inference, integration, and application. Lead model selection/tuning (commercial and open-source), establish LLMOps and observability, integrate AI with cloud platforms, enforce data protection, manage hallucinations/security, and act as onshore technical lead for client workshops and stakeholder alignment.
Design and deploy enterprise-grade AI solutions (LLMs, RAG, agents) by selecting appropriate models, building data pipelines, and integrating them with cloud platforms (AWS, Azure, GCP). Lead technical strategies across the standard 7-layer GenAI stack (from data ingestion to application interfaces), ensure scalability, manage AI security/hallucinations, and bridge business needs with engineering teams.
Responsibilities- System Design & Architecture: Architect end-to-end Generative AI systems by operationalizing the 7-layer AI architecture (Data Sources, Preprocessing, Model Selection, Orchestration, Inference, Integration, and Application).
- Model Selection & Tuning: Evaluate and select cutting-edge commercial (e.g., GPT-4) and open-source models, and fine-tune models for domain-specific use cases.
- LLMOps, Observability & Pipelines: Establish LLMOps standards for model versioning and CI/CD. Implement foundational observability (OBS) layers using tools like Datadog, Splunk, or Prometheus to monitor system health, API latency, and basic application metrics.
- Integration & Data Protection: Integrate AI solutions with existing APIs while enforcing core data protection measures, including Role-Based Access Control (RBAC), data encryption in transit, and basic PII (Personally Identifiable Information) masking to manage hallucinations and adversarial attacks.
- Strategic Leadership: Collaborate with stakeholders to map business challenges to AI solutions and establish AI governance frameworks.
- Client Consulting: Act as the primary onshore technical liaison, facilitating client workshops, requirements gathering, and translating business pain points into technical AI blueprints.
- Consulting Skills: Exceptional client-facing communication skills; proven ability to present complex technical concepts to business stakeholders.
- Technical Expertise: Deep knowledge of NLP, Python, deep learning frameworks (PyTorch/TensorFlow), and orchestration tools (LangChain, Autogen).
- Cloud & Data Systems: Extensive hands-on experience with AI services on AWS, Azure, or GCP. Expertise in vector databases (e.g., Pinecone, Milvus) and embedding techniques.
- Qualifications: Bachelor’s / Master’s in Computer Science, AI, Data Science, or related field; 8–15 years in software engineering, ML, or AI roles, with demonstrable onshore consulting experience.
Similar Jobs
Artificial Intelligence • Legal Tech
Improve legal, business, and IT operations by building scalable workflows, knowledge systems, automations, reporting, and documentation. Manage legal technology and vendor processes, administer Notion, coordinate cross-functional and IT projects, direct an external IT provider, and partner with Engineering, Security, and People on systems, access, integrations, and employee lifecycle initiatives.
Top Skills:
Gc AiNotionSaaSSpreadsheetsZapier
Enterprise Web • Mobile • Professional Services • Software
Own and improve Salesforce and go-to-market systems, including automation, integrations, CPQ migration, quoting workflows, product catalogs, pricing rules, data structures, and reporting processes. Partner with Sales, Marketing, Finance, Revenue Operations, and Customer Success teams to scope and implement scalable solutions. Administer AI-powered tools, document workflows, conduct training, and support cross-functional strategic decisions.
Top Skills:
Ai IntegrationsChili PiperClaude CoworkCognismDatabase StructuresDealhubGongLeandataSalesforceSalesforce CpqSQLVendori
Healthtech • Logistics • Pharmaceutical
Supports Consumer Category Management through new item ordering and tracking, return authorizations, product image requests, contract status tracking, supplier meetings, and category review materials. The intern collaborates with category managers and business partners while gaining practical experience in supplier relationships, administrative documentation, and category management processes.
Top Skills:
Microsoft Office 360
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
