AI Technology Partners Logo

AI Technology Partners

Senior AI Engineer, Agentic Systems

Posted 2 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Lead the design and delivery of agentic systems, integrating enterprise tools and data while ensuring security and compliance. Collaborate with clients to optimize business workflows and develop reusable components.
The summary above was generated by AI

AI Technology Partners (AITP) is a leader in delivering cutting-edge generative AI solutions and managed services, specializing in secure, customizable AI deployments for enterprises. Our offerings are designed to help organizations unlock the full value of AI while maintaining robust security and compliance across their infrastructures.


About the role


At AI Technology Partners (AITP), we empower enterprises to scale revenue & profit —with secure, compliant generative AI solutions.

In this role, you’ll lead the design and delivery of agentic systems that orchestrate tools, data, and policies to solve real business workflows—safely, reliably, and at scale. If you like greenfield architecture, fast iteration, and measurable impact with enterprise clients, this is your playground.


What you'll do

Architecture & System Design (Agentic)

·      Design multi-agent architectures with robust state management, memory, and routing.

·      Choose and implement leading frameworks such as LangGraph/LangChain Agents, Microsoft AutoGen, CrewAI, LlamaIndex Agents, Semantic Kernel, or Haystack Agents—and justify trade-offs.

·      Build modular components (planners, tool registries, policy guards, evaluators) that are reusable across clients and domains.

Tooling & Orchestration

·      Integrate enterprise tools and data sources via function/tool calling, webhooks, and event-driven flows (Queues/Service Bus/Functions).

·      Implement retrieval-augmented generation (RAG) patterns with vector stores (Azure AI Search, pgvector, MongoDB Atlas, Pinecone, Weaviate, Milvus) and structured knowledge (SQL/Graph).

·      Add deterministic fallbacks, circuit breakers, and caching to keep latency and cost predictable.

Reliability, Observability & MLOps

·      Define SLIs/SLOs for agent runs; implement tracing, metrics, and logging (e.g., Langfuse + OpenTelemetry) and build dashboards for run-level analytics.

·      Create evaluation harnesses (automatic + human-in-the-loop) using tools such as Ragas, DeepEval, promptfoo to measure groundedness, task success, safety, and cost.

·      Productionize with CI/CD, environment promotion, feature flags, and canary strategies; optimize cost-per-task and time-to-success.

Safety, Security & Governance

·      Enforce content and safety policies (redaction, classification, guardrails) with policy-as-code; implement role/tenant isolation and data minimization.

·      Collaborate with security teams to align to ISO 27001/SOC 2/NIST/HIPAA/GDPR contexts; deliver audit-ready evidence for agentic workflows.

·      Build privacy-first patterns (no data exfiltration by default, least-privilege tool access, secure prompt/trace storage).

Product & Client Impact

·      Work directly with enterprise client teams to translate business processes into agentic designs; present trade-offs and proofs-of-value that lead to production.

·      Partner with solution leads to create domain-specific agents (e.g., RFP assist, incident RCA drafting, knowledge ops) and reusable templates.


Qualifications

Must-have

·      5–8+ years in software/platform engineering with recent production LLM applications (not just prototypes).

·      Hands-on expertise with agentic frameworks (one or more of: LangGraph/LangChain Agents, AutoGen, CrewAI, LlamaIndex Agents, Semantic Kernel, Haystack Agents) and tool/function-calling patterns.

·      Strong RAG engineering across vector DBs, chunking/embedding strategies, metadata/search ranking, and grounding techniques.

·      Proven track record building observable, cost-aware, and secure LLM systems (tracing, evals, guardrails, secrets/IAM, PII handling).

·      Solid software engineering fundamentals: Python/TypeScript, async patterns, APIs, testing, CI/CD, containerization.

·      Clear communicator who can interface with clients and write crisp technical docs.

Nice to have

·      Azure-first experience (Azure OpenAI, Azure AI Studio, Azure Functions/Container Apps/AKS, Private Link/VNet, Key Vault, Entra ID).

·      Cross-cloud exposure (AWS/GCP) and hybrid integrations; experience with enterprise connectors (SharePoint/OneDrive, ServiceNow, Salesforce).

·      Experience with structured output, constrained decoding, JSON Schemas, and program-of-thought planning.


Location


Remote, US-based candidates preferred. The role may involve working across multiple time zones.

How we work

·      Ownership & velocity: Small team, big surface area. You’ll design, ship, and iterate quickly.

·      Security by design: Data governance and safety are table stakes, not afterthoughts.

·      Evidence over vibes: We measure task success, grounding, and cost—and improve with data.

·      AI as leverage: We use LLMs to accelerate engineering—not replace it.

Compensation

·      Competitive salary for full-time or hourly rate for contract hire, commensurate with experience and engagement model.

What we offer

·      Challenging work on meaningful, production agentic systems for enterprise clients.

·      Learning & sharing culture with deep dives, brown bags, and support for certifications/publication.

·      Inclusive, flexible workplace—bring your whole self; work where you do your best thinking.


How to Apply


Interested candidates are encouraged to submit their resumes and a brief cover letter outlining relevant experience and why they are a good fit for this role.

Equal Opportunity Statement


AI Technology Partners is committed to equal employment opportunity in all practices and reaffirms that there shall be no unlawful discrimination against any employee or applicant for employment on the grounds of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or veteran status.

Top Skills

Autogen
AWS
Azure
Azure Ai Search
Crewai
GCP
Graph
Haystack
Langchain
Langgraph
Llamaindex
Milvus
Mongodb Atlas
Pinecone
Python
Semantic Kernel
SQL
Typescript
Weaviate
HQ

AI Technology Partners Boston, Massachusetts, USA Office

Boston, MA, United States

Similar Jobs

An Hour Ago
In-Office or Remote
San Francisco, CA, USA
128K-200K Annually
Senior level
128K-200K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Product Marketing Manager, you'll develop go-to-market strategies, craft messaging, enable sales teams, conduct research, and monitor business health.
Top Skills: Cloud SolutionsSaaS
An Hour Ago
In-Office or Remote
Seattle, WA, USA
146K-229K Annually
Mid level
146K-229K Annually
Mid level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Machine Learning System Engineer will develop and implement machine learning models, ensuring their effectiveness in various applications while collaborating across teams.
Top Skills: AWSMachine LearningPythonPyTorchTensorFlow
An Hour Ago
In-Office or Remote
Austin, TX, USA
167K-262K Annually
Senior level
167K-262K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The role involves defining product vision for AI-powered People experiences, establishing success metrics, and influencing cross-functional initiatives to enhance employee experiences at Atlassian.
Top Skills: AIData-Driven SystemsEvaluation FrameworksLlm-As-A-Judge

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account