Orion Innovation Logo

Orion Innovation

AI Tech Lead – Platform Intelligence & Applied AI

Posted 5 Days Ago
Remote
Hiring Remotely in United States
50K-110K Annually
Senior level
Remote
Hiring Remotely in United States
50K-110K Annually
Senior level
The AI Tech Lead is responsible for defining and managing AI strategies, model usage, semantic routing, and agent architecture to evolve AI capabilities within the platform.
The summary above was generated by AI

Orion Innovation is a premier, award-winning, global business and technology services firm.  Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity.  We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Role Overview

We are hiring an AI Lead to serve as the technical authority and strategic driver for how artificial intelligence is designed, implemented, and evolved within Advisory’s enterprise delivery platform. This role is responsible for maintaining a deep, hands-on understanding of modern AI systems, monitoring market and research trends, and translating those advancements into practical, enterprise-ready platform capabilities. The AI Lead defines how models are used, intelligence is orchestrated, context is assembled, agents behave, and AI quality and trust are measured at scale.


Core Responsibilities

AI Strategy & Market Intelligence

  • Continuously track and evaluate:
    • LLM and foundation model advancements
    • Agent frameworks and orchestration patterns
    • Retrieval, memory, and context management techniques
    • AI evaluation, safety, and governance approaches
  • Translate emerging AI trends into:
    • Platform design principles
    • Proofs of concept and experiments
    • Scalable, production-ready capabilities
  • Advise leadership on when and how new AI capabilities should be adopted.

Model & Intelligence Management

  • Own the strategy for LLM and model usage across the platform, including:
    • Model selection and benchmarking
    • Versioning and lifecycle management
    • Cost, performance, and latency trade-offs
    • Fallback and redundancy strategies
    • Abstraction layers that enable multi-vendor model support
  • Establish best practices for:
    • Prompt and instruction design
    • Tool and function calling
    • Structured outputs and determinism

Semantic Routing & Orchestration:

  • Design and evolve the platform’s semantic routing layer, including:
    • Intent detection and task classification
    • Routing to appropriate models, agents, or workflows
    • Context-aware decisioning based on workspace state
  • Define orchestration patterns for:
    • Multi-step and parallel execution
    • Long-running and asynchronous tasks
    • Human-in-the-loop controls
  • Ensure routing logic is transparent, testable, and tunable.

Agent Architecture & Execution

  • Define the firm’s agent strategy, including:
    • When to use agents vs. workflows vs. direct LLM calls
    • Agent composition, memory, and tool access
    • Guardrails and behavioral constraints
  • Partner with engineering to implement:
    • Agent frameworks and runtime infrastructure
    • Monitoring and debugging capabilities
  • Ensure agents are:
    • Predictable and auditable
    • Aligned to service methods and delivery workflows
    • Safe for enterprise and client-facing use

Workspace Context & RAG Architecture

  • Own the design of contextual intelligence within workspaces, including:
    • Document ingestion, chunking, and enrichment strategies
    • Vector, keyword, and hybrid retrieval approaches
    • Context assembly across client data, firm IP, and engagement artifacts
  • Define standards for:
    • Source attribution and transparency
    • Data isolation and compliance
    • Relevance, freshness, and performance
    • Continuously evaluate new approaches to memory, retrieval, and grounding.

AI Evaluation, Testing & Trust

  • Establish the platform’s AI evaluation and testing framework, including:
    • Task-based and scenario-driven evaluations
    • Regression testing for prompts, agents, and routing logic
    • Comparative benchmarking across models and configurations
  • Define metrics for:
    • Accuracy, relevance, and consistency
    • Cost efficiency and latency
    • User trust and explainability
  • Partner with engineering and risk teams to ensure:
    • Observability into AI behavior
    • Safe deployment and controlled experimentation

Qualifications:

  • 5+ years of proven expertise
  • Bachelor's degree required.

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains:

  • What information we collect during our application and recruitment process and why we collect it;
  • How we handle that information; and
  • How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.


Top Skills

Agent Frameworks
AI
Context Management
Llm
Machine Learning
Semantic Routing

Similar Jobs

An Hour Ago
Remote or Hybrid
Texas, USA
122K-168K Annually
Senior level
122K-168K Annually
Senior level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
The Manager of Brand & Portfolio Management leads brand strategy, commercial planning, and marketing execution to drive revenue growth and manage P&L for consumer products.
Top Skills: ExcelPowerPoint
An Hour Ago
In-Office or Remote
30-62 Hourly
Mid level
30-62 Hourly
Mid level
Fintech
This role manages Non-Discrimination Testing, ensuring compliance with regulations, overseeing testing processes, and collaborating with teams to resolve issues.
Top Skills: ExcelMicrosoft OutlookMicrosoft Word
An Hour Ago
In-Office or Remote
62K-102K Annually
Mid level
62K-102K Annually
Mid level
Fintech
The Quality Engineer II is responsible for leading QA efforts, designing test strategies, performing automation testing, and mentoring a team. They will collaborate with cross-functional teams to ensure software reliability and quality.
Top Skills: .NetJavaScriptJqueryJSONPlaywrightSeleniumT-SqlXML

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account