LiteLLM Logo

LiteLLM

Senior Security Engineer

Posted 7 Days Ago
Remote
Hiring Remotely in USA
220K-260K Annually
Senior level
Remote
Hiring Remotely in USA
220K-260K Annually
Senior level
Lead application and infrastructure security for LiteLLM, focusing on Python code reviews, vulnerability remediation, threat modeling, secure development tooling, CI/CD and supply-chain security, cloud and IT controls, incident response, and LLM-specific attack testing. Partner closely with engineers to strengthen authentication, authorization, tenant isolation, secrets management, deployment security, monitoring, vulnerability management, and disclosure processes.
The summary above was generated by AI
Senior Security Engineer

LiteLLM is the world’s most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. Our platform gives developers secure, reliable access to LLMs and adjacent services. We’re looking for our first Security Engineer to help secure LiteLLM’s application, infrastructure, and software-delivery pipeline.

About the role

This is a hands-on security generalist role with a strong emphasis on application security. You’ll spend most of your time reviewing and hardening LiteLLM’s Python codebase, identifying new attack surfaces, working directly with engineers to fix vulnerabilities, and making secure development practices part of how we build.

You’ll also own security work across IT, CI/CD, cloud infrastructure, and the software supply chain. The ideal candidate has built application/product/infrastructure security programs from scratch and genuinely enjoys security outside of work—through CTFs, vulnerability research, open-source projects, or independent experimentation.

ResponsibilitiesApplication security
  • Conduct deep security reviews of LiteLLM’s Python proxy, APIs, authentication systems, and enterprise features.

  • Identify and remediate vulnerabilities involving authentication, authorization, secrets, tenant isolation, injection, and data exposure.

  • Partner directly with engineers throughout design, implementation, code review, and release—not only after code is shipped.

  • Build application-security tooling into the development lifecycle, including SAST, DAST, dependency scanning, and secrets detection.

  • Perform internal red teaming and adversarial testing against LiteLLM’s APIs, proxy, and LLM-specific attack surfaces.

  • Threat-model new products and architecture changes before they reach production.

  • Create secure coding guidelines and train engineers on common vulnerabilities and defensive practices.

Infrastructure, CI/CD, and supply-chain security
  • Harden LiteLLM’s Docker images, PyPI packages, GitHub Actions workflows, and release infrastructure.

  • Detect dependency confusion, poisoned packages, compromised dependencies, exposed secrets, and unsafe build practices.

  • Implement SBOMs, signed builds, provenance checks, and reproducible-build practices.

  • Design secure-by-default configurations for cloud and self-hosted deployments, including authentication, IAM, secrets management, and key rotation.

  • Review cloud infrastructure, network boundaries, access controls, and production deployment patterns.

IT security and incident response
  • Strengthen employee identity, device, SaaS, and internal access controls.

  • Build monitoring and anomaly detection for suspicious API, model, authentication, and routing activity.

  • Lead security incident response, vulnerability assessment, remediation, post-mortems, and stakeholder communication.

  • Establish formal vulnerability intake, CVE triage, disclosure, and remediation processes.

  • Maintain threat models as LiteLLM’s product and architecture evolve.

What we’re looking for
  • A strong security generalist who can work across application security, IT, CI/CD, cloud infrastructure, and the software supply chain.

  • Deep application-security expertise, including manually auditing production Python code and working with engineers to remediate vulnerabilities.

  • Strong understanding of authentication, authorization, tenant isolation, SSRF, injection, deserialization, secrets management, and common web and API vulnerabilities.

  • Experience using and configuring tools such as Semgrep, Bandit, CodeQL, Burp Suite, and other SAST or DAST tooling.

  • Previous experience at an early-stage security startup during its 0→1 journey.

  • Experience securing containers, GitHub Actions, build pipelines, packages, and software dependencies.

  • Familiarity with SBOMs, Sigstore, Cosign, Snyk, Grype, Trivy, or equivalent tooling.

  • Strong knowledge of OAuth2, JWT, mTLS, IAM, and high-throughput API authentication.

  • Familiarity with prompt injection, LLM data exfiltration, tool abuse, and the OWASP Top 10 for LLM Applications.

  • Experience with incident response, CVSS scoring, vulnerability management, CVE triage, and coordinated disclosure.

  • Experience competing in CTFs during college or independently pursuing vulnerability research, reverse engineering, bug bounties, or security projects.

  • A genuine interest in security outside your day job—you regularly explore new attack techniques, build security projects, or contribute to the security community.

  • Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience.

Why join LiteLLM?
  • Work on application-security problems at the intersection of AI, APIs, and developer infrastructure.

  • Secure an open-source product used by enterprises around the world.

  • Work directly with engineers and influence how security is incorporated into product development.

  • Take broad technical ownership in a fast-moving environment.

  • Competitive salary and health, dental, and vision benefits.

About LiteLLM

LiteLLM is a Python SDK and Proxy Server that enables seamless access to more than 100 LLM APIs through the OpenAI format.

Ready to secure the infrastructure powering enterprise AI? Apply now.

Similar Jobs

11 Hours Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
Senior level
Senior level
Fintech • News + Entertainment • Software • Database • Financial Services
Own and improve Octus’s enterprise security technology across endpoints, identity, SaaS, email, DLP, AI tools, cloud, and applications. Responsibilities include managing security platforms, hardening systems, tuning SIEM detections, responding to incidents, driving remediation, supporting audits and client reviews, assessing vendor risk, automating workflows, and mentoring teammates. The role requires broad hands-on cybersecurity expertise across Mac and Windows environments, identity platforms, secure web gateways, DLP, compliance frameworks, scripting, and REST APIs.
Top Skills: 1PasswordAbnormal SecurityAtlassianAWSBashChatgptCisspClaudeGdprGeminiGiacGoogle SecopsGoogle WorkspaceIntuneJamf ProMcp ServersMicrosoft DefenderMicrosoft Entra IdNetskopeNist CsfOktaPowershellPythonRest ApisSecurity+SlackSnykSoc 2Wiz
4 Days Ago
Remote
USA
200K-260K Annually
Senior level
200K-260K Annually
Senior level
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3 • Infrastructure as a Service (IaaS)
Build and operate central security systems, automation, tooling, and controls across cloud infrastructure, identity, access, products, partners, and vendors. Develop AI-assisted security workflows, lead external assessments through verified remediation, identify and validate vulnerabilities, guide engineering teams, and participate in incident response. The role requires production security engineering experience, strong programming skills, cloud security expertise, and fintech, payments, or crypto experience.
Top Skills: Ai AgentsBlockchainCloud InfrastructureCustodyGoIdentity And Access ManagementLlm ApplicationsMultisig ControlsOnchain MonitoringPythonRustSmart ContractsTypescript
5 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Security • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Conduct application security assessments, threat modeling, code reviews, and manual penetration testing across web applications, APIs, cloud services, appliances, and AI-enabled features. Coordinate external penetration tests, validate vulnerabilities, track remediation, and verify fixes. Improve SAST, SCA, secrets detection, container scanning, SBOM, supply-chain, and CI/CD security workflows while advising Engineering on secure design and risk prioritization.
Top Skills: Ci/CdCloud ServicesContainer ScanningCyclonedxKubernetesLinuxOwaspPenetration TestingSastSbomScaSecrets DetectionSpdxThreat Modeling

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account