The role involves developing, deploying, and scaling AI and machine learning models, ensuring security, compliance, and performance optimization while collaborating with engineering teams.
About the Role
We are looking for an experienced AI Engineer to architect, implement, and optimize AI-powered solutions driving our next-generation products and platforms.
This hands-on role will focus on integrating, deploying, and scaling machine learning models, collaborating closely with product and engineering teams, and ensuring robust, reliable, and secure AI services across our organization.
Key Responsibilities
- Model Development: Design, train, evaluate, and deploy machine learning models and deep learning architectures for a range of business problems.
- Prompt Management: Build systems to manage, enrich, and filter prompts, including handling sensitive content and ensuring context is maintained for optimal model performance.
- Content Moderation: Implement processes to screen and filter model outputs, ensuring responses are free from harmful or inappropriate content.
- Integration: Develop APIs and supporting systems to serve AI models to client applications, integrating with both internal systems and third-party platforms.
- Data Protection/Masking: Implement rigorous data protection, masking, and encryption strategies to safeguard sensitive information and support compliance requirements.
- MCP: Integrate and support workflows leveraging the Model Context Protocol for contextual management of AI model requests and outputs.
- Performance Optimization: Optimize AI service delivery for scalability, reliability, and low latency, using modern deployment and caching strategies.
- Security and Compliance: Collaborate with security teams to enforce robust access controls, data privacy, and compliance across all AI solutions.
- Monitoring and Observability: Apply logging, monitoring, and tracing for model performance, operational analytics, and cost management.
- Collaboration: Work with ML engineers, software developers, product managers, and DevOps teams to integrate AI capabilities into the larger application landscape.
- Documentation: Create comprehensive documentation, guides, and internal tooling to support the adoption and maintenance of AI systems.
About You
- Experience:
- 3–6+ years of designing, implementing, and maintaining AI/ML models in production (Python, TensorFlow, PyTorch, etc.).
- Hands-on experience with Model Context Protocol (MCP) or similar context management workflows.
- Experience implementing prompt management, data protection, and content moderation systems for AI-powered applications.
- Track record building scalable data and ML pipelines.
- Familiarity with cloud-native architecture (AWS, GCP, or Azure)
- Technical Skills:
- Proficiency in model development, training, and deployment using leading ML/DL frameworks.
- Strong capability in API integration and RESTful service design for serving AI models.
- Experience with data engineering, caching (Redis), and monitoring tools.
- Comfort integrating external APIs (e.g., third-party LLM/AI services) and designing abstraction layers.
- Experience with AI Gateway platforms (Kong, Mosaic, TrueFoundry, Portkey) and integrating with LLM APIs.
- Mindset:
- You value clean code, clear documentation, and thoughtful testing.
- You’re comfortable working in early-stage environments and iterating quickly.
- You have strong communication skills and a collaborative approach.
Nice to Have
- Familiarity with observability stacks (OpenTelemetry, Datadog, Prometheus).
- Background building multi-tenant platforms or scaling AI applications for large user bases
- Experience with the Golang programming language.
Top Skills
AWS
Azure
Datadog
GCP
Kong
Mosaic
Opentelemetry
Portkey
Prometheus
Python
PyTorch
Redis
TensorFlow
Truefoundry
Similar Jobs
Artificial Intelligence • HR Tech • Other • Software • Business Intelligence
The Product Marketing Manager will define product positioning, create narratives, own go-to-market plans, and develop sales enablement materials for Compa's AI platform.
Top Skills:
Webflow
Marketing Tech • Social Media • Software • Analytics • Business Intelligence
The Product Support Specialist will manage customer requests through email and chat, provide technical support, meet performance metrics, and become a product expert through comprehensive onboarding and training.
Top Skills:
ConfluenceFreshdeskJIRAZendesk
Edtech • Information Technology • Software
The Enterprise Account Executive will drive growth by acquiring new customers and expanding existing accounts, mastering complex sales cycles, and collaborating with various teams to ensure success.
Top Skills:
EdtechSaaS
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
