CAST AI Logo

CAST AI

AI Solutions Architect

Posted 6 Days Ago
In-Office or Remote
Hiring Remotely in Boston, MA, USA
Entry level
In-Office or Remote
Hiring Remotely in Boston, MA, USA
Entry level
Serve as the founding customer-facing engineer for Kimchi, leading demos, customer environment setup, LLM inference optimization, model routing, governance policy implementation, and serverless API integrations. Translate customer feedback into product improvements while identifying revenue expansion opportunities. Explain complex AI concepts to non-ML engineers and optimize workloads for coding, reasoning, and planning use cases.
The summary above was generated by AI
Why Cast AI?

Cast AI is an automation platform that operates cloud-native and AI infrastructure at scale. By embedding autonomous decision-making directly into Kubernetes and cloud environments, Cast AI continuously optimizes performance, reliability, and efficiency in production.

The old way doesn't work. As Kubernetes and AI environments grow, manual decisions don’t. Cast AI replaces tickets, alerts, and manual tuning with continuous automation that adapts infrastructure as conditions change. Efficiency and cost savings follow naturally from that automation.

Over 2,100 companies already rely on Cast AI, including Akamai, BMW, Cisco, FICO, HuggingFace, NielsenIQ, Swisscom, and TGS.

Global team, diverse perspectives
We're headquartered in Miami, but our impact is international. We take a global and intentional approach to diversity. Today, Cast AI operates across 34 countries spanning Europe, North America, Latin America, and APAC, bringing a wide range of perspectives into how we build and lead. 

Unicorn momentum
In January 2026, we achieved unicorn status with a strategic investment from Pacific Alliance Ventures, the corporate venture arm of Shinsegae Group (a $50+ billion Korean conglomerate). Our valuation now exceeds $1 billion, and we're just getting started.

Join us as we build the future of autonomous infrastructure.

About this role: 

You'll be the founding customer-facing engineer for our flagship Kimchi product within our Customer Success organization. Kimchi executes multi-model LLM workflows and autonomous agents with embedded governance and cost control. It intelligently routes across frontier and open-source models while enabling teams to establish strict budget caps, enforce model access policies, configure roles, and audit TCO via deep analytical tracking. Through Kimchi Studio, developers gain desktop access to agentic workflows, helping organizations accelerate adoption without sacrificing operational governance or spend visibility.
This is a hands-on, individual contributor role where you will live at the intersection of inference optimization, autonomous coding agents, multi-model routing and LLM governance. You will have the unique opportunity to architect and execute the growth strategy that scales Kimchi adoption and creates new revenue expansion opportunities for our existing customers.

Requirements:
  • Deep hands-on experience with LLMs: you've deployed them, fine-tuned them, evaluated them, or debugged their failure modes. You care about why model A outperforms model B for a specific task.
  • You know what it's like to operate in a fast-moving environment that’s prone to change. 
  • You've built or optimized inference systems out of curiosity. You know the difference between latency, throughput, and total cost of ownership. You ballpark costs and performance implications in your head.
  • You can explain complex inference concepts to non-ML engineers and help them see why it matters to their business.
  • You can think commercially. You understand revenue expansion, can identify expansion opportunities within customer organizations, and can design strategies to capture them. You're not just a technical person, you're someone who combines technical excellence with entrepreneurial thinking about growth.
Responsibilities:
  • Lead hands-on demos of our flagship inference products - Kimchi Coding, Studio and Teleport. 
  • Set up Kimchi Studio workspaces within customer environments. Help teams configure worktrees, integrations (Slack, repos, docs), and skills so agents understand their conventions.
  • Design and drive implementation of governance policies for customers: spending limits per team/developer, cost attribution by project, model routing preferences. Make sure the hard budget caps actually work for their org.
  • Help teams integrate Kimchi's serverless inference API. Optimize model selection and routing for their specific workloads (coding, reasoning, planning tasks).
  • Translate customer feedback into product input. Highlight where the agent fails, where Studio UX gets in the way, where governance policy doesn't match their needs.
What’s in it for you?
  • Enjoy a flexible, remote-first global environment.
  • Collaborate with a global team of cloud experts and innovators, passionate about pushing the boundaries of Kubernetes technology.
  • Equity options.
  • Get quick feedback with a fast-paced workflow. Most feature projects are completed in 1 to 4 weeks.
  • Spend 10% of your work time on personal projects or self-improvement. 
  • Learning budget for professional and personal development - including access to international conferences and courses that elevate your skills.
  • Team-building budget and company events to connect with your colleagues.
  • Equipment budget to ensure you have everything you need.
  • Extra days off to help maintain a healthy work-life balance.
Hiring process
  • Screening call with Recruiter
  • Hiring Manager interview
  • 1-2 additional interviews based on the role
  • Culture Check interview with an executive

*As part of our standard hiring process, we would like to inform you that a background check may be conducted at the final stage of recruitment through our third-party provider, Checkr.
*Please note that Cast AI does not provide any form of visa sponsorship/work permit.
#LI-Remote

Similar Jobs

Yesterday
Remote
United States
106K-223K Annually
Senior level
106K-223K Annually
Senior level
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Design secure, scalable AI and cloud architectures for strategic Microsoft partners. Lead architecture sessions, develop proofs of concept and pilots, provide technical implementation guidance, modernize legacy systems, and help partners build AI practices, reusable intellectual property, agentic solutions, and managed services. Collaborate with partner executives, architects, developers, and Microsoft engineering while integrating AI models with enterprise data, applications, APIs, security, governance, and observability.
Top Skills: Ai AgentsAPIsAzureAzure Ai ServicesCloud InfrastructureCopilot StudioDynamics 365Generative AiGovernanceIdentity And Access ManagementMicrosoft 365 CopilotMicrosoft FoundryMicrosoft GraphMicrosoft TeamsObservabilityPower PlatformProsciSaaSSecurity
Yesterday
Remote
USA
11K-19K Annually
Expert/Leader
11K-19K Annually
Expert/Leader
Other • Retail
Leads enterprise master data and product data architecture, defining target-state designs, data models, governance, quality, enrichment, classification, matching, and AI-enabled automation. Translates complex business and technical needs into scalable, secure solutions; evaluates platforms and vendors; manages architecture risks and trade-offs; and mentors architects, engineers, analysts, product owners, and delivery teams. Partners with senior leaders to advance Ferguson’s master data, product data, and responsible AI strategy.
Top Skills: APIsAzure Data FactoryAzure Data LakeClaudeCloud StorageDatabricks GenieDatabricks LakehouseGenerative AiInformatica MdmMachine LearningNoSQLReltioSap MdgSemarchySQLStibo Systems
6 Days Ago
Remote
2 Locations
111K-194K Annually
Mid level
111K-194K Annually
Mid level
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software
Build and optimize conversational AI and agentic virtual agents on Genesys Cloud. Responsibilities include prompt engineering, NLU model development, intent and entity design, production conversation analysis, evaluation framework creation, performance optimization, scripting, and customer collaboration. The role focuses on improving reliability, task completion, edge-case handling, and user experience across LLM and NLU systems.
Top Skills: Conversational AiGenesys CloudLlmsNlpNluNode.jsPrompt EngineeringPython

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account