Haslam Sports Group Logo

Haslam Sports Group

Applied AI Engineer

Posted 10 Hours Ago
In-Office
Boston, MA, USA
109K-164K Annually
Mid level
In-Office
Boston, MA, USA
109K-164K Annually
Mid level
Build and refine AI character systems that maintain consistent personalities, voices, canon knowledge, safety boundaries, and response quality. Responsibilities include prompt architecture, guardrails, LLM evaluation frameworks, RAG systems, embedding and vector retrieval, regression testing, multi-provider LLM integration, and collaboration with creative and brand teams. The role requires production LLM experience, strong Python and AWS skills, and familiarity with voice AI technologies.
The summary above was generated by AI

We take play seriously. We’re looking for curious adventurers ready to find their party, fueled by imagination and drive to build what’s never been built before. At Hasbro and Wizards of the Coast, you’ll collaborate with passionate teams to reimagine our iconic brands and create experiences that spark joy, connection, and community through the magic of play. This is your chance to shape legendary play that lasts a lifetime.


We're building something new inside our AI Studio, and we're looking for an Applied AI Engineer to help shape it with us. This role sits at the center of a new and constantly evolving set of challenges. The problems are still being defined, and the approaches are actively being invented. What excites us is the opportunity to determine what it truly means for an iconic character to think, respond, and stay true to itself - consistently, safely, and at scale.

We work where storytelling, imagination, and technology converge. Our focus is on the intelligence layer: the systems that determine how characters understand context, form responses, maintain a consistent voice, and hold carefully defined boundaries. This is where canon knowledge meets language model behavior, and where the quality of every character interaction gets defined and measured.

This role owns one of the most creatively and technically interesting areas on the team: making characters that actually feel like themselves. Working closely with engineers, creative partners, and brand leaders, the Applied AI Engineer will define prompt architecture, own guardrails and evaluation frameworks, and build the retrieval systems that ground characters in their own lore. Success here means developing the tools and practices that make character fidelity measurable.

What You'll Do
  • Design, implement, and continuously refine system prompts, character behavior definitions, and guardrails for our AI character platform.
  • Build evaluation frameworks to measure character fidelity, response quality, and safety — establishing quantitative standards for what "in character" actually means across interaction types.
  • Architect and implement RAG systems to ground character responses in canonical knowledge, including embedding strategies, vector retrieval, and relevance evaluation.
  • Partner with creative and brand teams to translate character attributes — personality, voice, canon, tone, and boundaries — into precise, testable AI behavior and system requirements.
  • Lead prompt versioning, regression testing, and model evaluation practices to ensure character behavior remains consistent across provider updates and model changes.
  • Integrate with multi-provider LLM APIs (OpenAI, Google Gemini, etc.) and make principled selection decisions as the landscape evolves.
  • Evaluate and adopt emerging techniques in prompt engineering, agentic design, and LLM evaluation that meaningfully advance the quality and reliability of character experiences.
What You Will Bring
  • 3+ years of experience building and shipping production LLM-powered systems.
  • Deep expertise in prompt engineering — system prompt design, few-shot techniques, chain-of-thought, multi-turn conversation management, and structured output.
  • Experience designing and implementing evaluation frameworks for LLM outputs, including adversarial and security testing.
  • Hands-on experience with RAG architectures: embedding models, vector stores, chunking strategies, and retrieval evaluation.
  • Proficiency with major LLM APIs (OpenAI, Google Gemini, Anthropic, or equivalent) and experience making principled decisions between them.
  • Strong Python skills and comfort working in AWS environments.
  • Familiarity with how voice AI services work (TTS, STT) — enough to understand how spoken delivery shapes prompt and response design.
  • The ability to communicate AI system behavior clearly to creative, brand, and non-technical collaborators.
Extra Credit
  • Familiarity with guardrails frameworks (NVIDIA NeMo Guardrails, Guardrails AI, or equivalent).
  • Conceptual understanding of fine-tuning and RLHF, even if not a primary area of focus.
  • Background in entertainment, gaming, or IP-driven product development.

The pay transparency range for this role is listed below. The hiring range will vary based on factors such as experience, skills, location and market conditions. Additionally, employees may be eligible for annual and long-term incentives as part of their overall compensation package.

Pay Range
$109,200$163,800 USD

Employees may be eligible for annual and long-term incentives as part of their overall compensation package, depending on role, location, and eligibility. Benefits and programs may include:

  • Health & Wellness
  • Time Off to Recharge
  • Financial Well-being
  • Life & Family Support
  • Volunteer and Community Initiatives
  • Learning & Development 
  • Exclusive Perks

Please review our Applicant Privacy Notice to learn how we collect, use, and protect your personal information in connection with the application process. 



Similar Jobs

7 Days Ago
Easy Apply
Hybrid
Boston, MA, USA
Easy Apply
176K-264K Annually
Senior level
176K-264K Annually
Senior level
Consumer Web • eCommerce • Marketing Tech • Retail • Software • Analytics • Generative AI
Lead the technical and product direction for Klaviyo’s Customer Agent, building and scaling production conversational AI systems. Design orchestration, evaluation, guardrails, memory, context, and failure-handling capabilities; write and review code; resolve complex production issues; establish reusable engineering patterns; mentor engineers; and partner with product, design, data science, and go-to-market teams. The role requires hands-on ownership of reliable, secure, multi-tenant agentic systems operating against live customer traffic.
Top Skills: Agentic Ai SystemsAi GuardrailsAi ObservabilityAi OrchestrationEvaluation SystemsHuman-In-The-Loop WorkflowsLlmsMemory And Context SystemsMulti-Tenant Platforms
Yesterday
Hybrid
108K-205K Annually
Senior level
108K-205K Annually
Senior level
Aerospace • Defense
Design, build, evaluate, and deploy production AI and ML solutions, including generative AI, large language models, retrieval-augmented generation, and agentic workflows. Develop reliable software, APIs, integrations, evaluations, and observability capabilities while partnering with architecture, platform, data, cybersecurity, and business teams. Apply AI engineering practices across enterprise, cloud, hybrid, and regulated environments.
Top Skills: Agentic AiAPIsArtificial IntelligenceAws BedrockCi/CdCloud ComputingCrewaiDockerEmbeddingsEnterprise SearchGenerative AiIbm WatsonxKnowledge GraphsKubernetesLanggraphLarge Language ModelsMachine LearningMicrosoft Ai PlatformsMlopsModel Context ProtocolN8NPythonRetrieval-Augmented GenerationVector Databases
One Month Ago
Easy Apply
Hybrid
Boston, MA, USA
Easy Apply
216K-324K Annually
Senior level
216K-324K Annually
Senior level
Consumer Web • eCommerce • Marketing Tech • Retail • Software • Analytics • Generative AI
Lead architecture and implementation of Klaviyo's Customer Agent platform: design scalable agentic/LLM systems, drive technical strategy, ship AI-powered features, ensure reliability and observability, mentor engineers, and partner cross-functionally to deliver conversational AI at scale.
Top Skills: Agent WorkflowsAi ObservabilityConversational AiDistributed SystemsEvaluation FrameworksHuman-In-The-Loop WorkflowsLlmsOrchestration FrameworksRetrieval Systems

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account