Design and deploy enterprise Generative AI systems across the 7-layer stack: data ingestion, preprocessing, model selection, orchestration, inference, integration, and application. Lead model selection/tuning (commercial and open-source), establish LLMOps and observability, integrate AI with cloud platforms, enforce data protection, manage hallucinations/security, and act as onshore technical lead for client workshops and stakeholder alignment.
Design and deploy enterprise-grade AI solutions (LLMs, RAG, agents) by selecting appropriate models, building data pipelines, and integrating them with cloud platforms (AWS, Azure, GCP). Lead technical strategies across the standard 7-layer GenAI stack (from data ingestion to application interfaces), ensure scalability, manage AI security/hallucinations, and bridge business needs with engineering teams.
Responsibilities- System Design & Architecture: Architect end-to-end Generative AI systems by operationalizing the 7-layer AI architecture (Data Sources, Preprocessing, Model Selection, Orchestration, Inference, Integration, and Application).
- Model Selection & Tuning: Evaluate and select cutting-edge commercial (e.g., GPT-4) and open-source models, and fine-tune models for domain-specific use cases.
- LLMOps, Observability & Pipelines: Establish LLMOps standards for model versioning and CI/CD. Implement foundational observability (OBS) layers using tools like Datadog, Splunk, or Prometheus to monitor system health, API latency, and basic application metrics.
- Integration & Data Protection: Integrate AI solutions with existing APIs while enforcing core data protection measures, including Role-Based Access Control (RBAC), data encryption in transit, and basic PII (Personally Identifiable Information) masking to manage hallucinations and adversarial attacks.
- Strategic Leadership: Collaborate with stakeholders to map business challenges to AI solutions and establish AI governance frameworks.
- Client Consulting: Act as the primary onshore technical liaison, facilitating client workshops, requirements gathering, and translating business pain points into technical AI blueprints.
- Consulting Skills: Exceptional client-facing communication skills; proven ability to present complex technical concepts to business stakeholders.
- Technical Expertise: Deep knowledge of NLP, Python, deep learning frameworks (PyTorch/TensorFlow), and orchestration tools (LangChain, Autogen).
- Cloud & Data Systems: Extensive hands-on experience with AI services on AWS, Azure, or GCP. Expertise in vector databases (e.g., Pinecone, Milvus) and embedding techniques.
- Qualifications: Bachelor’s / Master’s in Computer Science, AI, Data Science, or related field; 8–15 years in software engineering, ML, or AI roles, with demonstrable onshore consulting experience.
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Drive new SaaS license revenue by prospecting and closing enterprise education customers. Build C-suite relationships, lead account and territory planning, orchestrate cross-functional teams, act as trusted advisor on IT and security roadmaps, and bring specialists into deals. Travel up to 50%.
Top Skills:
AIArmisSaaSServicenowVeza
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Drive new SaaS revenue through account and territory planning, prospect research, and field sales. Build C‑suite relationships, orchestrate cross-functional account teams, act as trusted advisor on IT and AI integration, and identify specialists to win and negotiate deals while meeting sales targets.
Top Skills:
AIArmisSaaSServicenowVeza
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead large-scale, cross-functional technical programs for APEX Strategic Programs, translating business objectives into execution strategy, driving governance, using AI to accelerate delivery, and coordinating stakeholders through program lifecycle to achieve measurable strategic outcomes.
Top Skills:
AIAi AgentsEnterprise SaasServicenowWorkflow Automation
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
