Stellar Cyber Logo

Stellar Cyber

Machine Learning Infrastructure Engineer - LLM & Agentic AI

Posted Yesterday
Remote
Hiring Remotely in United States
150K-215K Annually
Junior
Remote
Hiring Remotely in United States
150K-215K Annually
Junior
Build scalable infrastructure for LLM-based agentic AI supporting autonomous security operations. Responsibilities include designing agent orchestration frameworks, LLM inference and resource-management systems, MCP servers, supporting APIs, and distributed backend services. The role collaborates with machine learning, security research, engineering, and product teams. Required experience includes backend infrastructure, distributed systems, APIs, microservices, cloud deployment, containerization, orchestration, and Python, Java, or Go.
The summary above was generated by AI

Join a fast-growing global leader in cybersecurity, trusted by some of the biggest names in the industry. In addition to some of the world’s largest enterprises and government agencies, more than 30% of the world’s top MSSPs rely on our platform. We’re at the forefront of protecting organizations against sophisticated cyber threats using cutting-edge AI and automation technologies. Our culture is built on diversity, openness, and collaboration, fostering creativity and innovation that drives real impact in the market.

We are looking for a highly skilled Machine Learning Infrastructure Engineer with a passion for building robust and scalable systems to power Stellar Cyber’s Autonomous SOC applications. In this role, you will be at the forefront of AI infrastructure innovation, responsible for developing the foundational components that enable intelligent agents to work like true SOC analysts to operate in dynamic SecOps environments.

 Responsibilities
  • Design and build Agentic AI frameworks to orchestrate LLM-based agents capable of reasoning, planning, and executing SecOps tasks in Stellar Cyber’s Open XDR platform.
  • Design and develop scalable LLM inference infrastructure that supports runtime- and cost-efficient serving and resource management across LLM hosting providers.
  • Develop MCP servers that interact with Open XDR platform services and features, and integrate with LLM-based agents.
  • Develop other supporting API services necessary for Autonomous SOC applications to provide reliable and extensible interface for agent operations.
  • Collaborate closely with machine learning / security researchers, UI / backend / infrastructure engineers, and product management to align infrastructure with evolving product needs.

Requirements
  • Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience.
  • 2 years of experience with software development or 1 year of experience with an advanced degree in an industry setting.
  • 2 years of experience with data structures or algorithms in either an academic or industry setting.
  • 2 years of experience with developing backend infrastructure, distributed systems, APIs (REST / gRPC), and microservices for MLOps related projects.
  • Experience with cloud computing technologies, including containerization, orchestration, and deployment (Docker, Kubernetes, etc).
  • Experience in one or more of the following programming languages: Python, Java, Go.
Preferred Qualifications
  • Experience working on LLM applications in high-sensitivity domains (e.g., finance, defense, health).
  • Experience with Generative AI frameworks (e.g., LangChain, LangGraph, AutoGen, or other frameworks) and technologies (prompt engineering, vector databases, RAG, etc.).
  • Experience with observability practices in ML systems (e.g., metrics, cost tracking).
  • Experience deploying and scaling LLMs for inference using frameworks such as vLLM, llama.cpp, and etc.
  • Experience working on ML platform teams and/or building tools for researchers.
  • Knowledge of SecOps concepts, activities, workflows is a plus.

Benefits

We pride ourselves in recognizing our employees. Here are some examples of our benefits program:

  • Pre-IPO Stock Options
  • Medical, Dental & Vision care
  • 401(k)
  • Employee Assistance Program
  • Employee Discount Program
  • Life Insurance
  • Paid time off
  • Referral Program
  • Rewards and Recognition Program
Why Join Us
  • Work at the forefront of cybersecurity innovation within a dynamic, fast-growing team.
  • Opportunity to significantly influence and shape the integration architecture of a next-generation SecOps platform powered by AI and automation.
  • Competitive salary, comprehensive benefits, and ample career growth opportunities.

The base compensation range for this role is USD 150,000-215,000 per year. Total compensation includes bonus opportunity and equity, and will vary based on candidate location.

Similar Jobs

53 Minutes Ago
Remote or Hybrid
USA
91K-203K Annually
Senior level
91K-203K Annually
Senior level
Machine Learning • Payments • Security • Software • Financial Services
Owns cloud security capabilities across Azure, AWS, and Palo Alto platforms, including CNAPP enablement, vendor relationships, security control ownership, attestation evidence, and control effectiveness reviews. Develops Microsoft Power BI dashboards for cloud configuration violations and stakeholder reporting. The role also designs, implements, documents, and supports security solutions, partners with architecture and operations teams, and drives cloud security improvements.
Top Skills: Amazon Web Services (Aws)Azure DefenderCloud-Native Application Protection Platforms (Cnapp)Cortex CloudAzureMicrosoft Power BiPalo AltoPrisma Cloud
An Hour Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Supports a global executive by managing complex calendars, priorities, meetings, travel, communications, stakeholder engagements, leadership rhythms, and follow-up. Uses AI-enabled executive assistant tools, generative AI, automation, and productivity technologies to improve executive-office workflows, reduce administrative friction, anticipate needs, and increase executive capacity. Requires exceptional judgment, discretion, adaptability, accuracy, executive presence, and communication skills in a fast-paced global technology environment.
Top Skills: Ai-Enabled Executive Assistant Tools And PlatformsGenerative AiProductivity TechnologiesWorkflow Automation
An Hour Ago
Remote or Hybrid
32K-63K Hourly
Mid level
32K-63K Hourly
Mid level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Guide SMB and mid-market sellers through onboarding, implementation, training, and activation of Square products. Manage multiple seller engagements, track milestones and go-live readiness, resolve blockers, escalate technical issues, and maintain proactive client communication. Contribute to onboarding process improvements, product knowledge, team collaboration, and AI-enabled workflow enhancements.
Top Skills: Ai Tools And PlatformsLookerOnline IntegrationsPosSalesforceSquare Products And Services

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account