Apollo is the only AI sales tool you need to sell, scale, and succeed.
Apollo.io Logo

Apollo.io

Staff Backend Engineer, AI Infra

Reposted 13 Days Ago
Easy Apply
Remote
Hiring Remotely in United States
166K-260K Annually
Senior level
Easy Apply
Remote
Hiring Remotely in United States
166K-260K Annually
Senior level
As a Staff Data Engineer, you will maintain and operate a data platform for ML workflows and analytics, develop data APIs, implement monitoring systems, and define data models while collaborating across teams.
The summary above was generated by AI

Apollo.io is the leading go-to-market solution for revenue teams, trusted by over 500,000 companies and millions of users globally, from rapidly growing startups to some of the world's largest enterprises. Founded in 2015, the company is one of the fastest growing companies in SaaS, raising approximately $250 million to date and valued at $1.6 billion. Apollo.io provides sales and marketing teams with easy access to verified contact data for over 210 million B2B contacts and 35 million companies worldwide, along with tools to engage and convert these contacts in one unified platform. By helping revenue professionals find the most accurate contact information and automating the outreach process, Apollo.io turns prospects into customers. Apollo raised a series D in 2023 and is backed by top-tier investors, including Sequoia Capital, Bain Capital Ventures, and more, and counts the former President and COO of Hubspot, JD Sherman, among its board members.

Daily Adventures and Responsibilities
  • Lead design and implementation of highly scalable, reliable LLM infrastructure that interfaces with multiple providers (Anthropic, OpenAI, GCP)
  • Architect and build unified abstractions and frameworks for the organization's AI platform needs including:
    • Provider API abstractions, authentication systems, and sophisticated usage policies
    • Advanced provider routing with circuit breakers, retries, and graceful fallbacks
    • Implement guardrails, content filters, and standardized prompt templating systems
    • Design comprehensive observability for latency, cost, and quality metrics across AI systems
  • Drive critical technical decisions across engineering organization for AI infrastructure adoption
  • Lead development of core AI platform services from architecture to production, including developing robust async worker patterns and task orchestration systems
  • Define and implement CI/CD best practices: establish pre-commit standards, reduce test flakiness, optimize test execution, harden GitHub Actions, and implement preview environments
  • Architect cloud infrastructure and Kubernetes deployments with focus on security, scalability and cost efficiency
  • Establish SLOs/SLIs and implement monitoring systems with Sentry, alert policies, metrics, logs, and dashboards
  • Collaborate with cross-functional leadership to drive platform adoption and de-risk major launches
  • Mentor engineers on platform best practices and guide architectural decisions across teams
Competencies
  • Strategic thinking with ability to influence and align engineering decisions across the organization
  • Exceptional communication skills for collaborating with engineering leadership, product, and business stakeholders
  • Self-motivated with demonstrated ability to lead complex, multi-team initiatives
  • Excellent analytical skills to evaluate and solve complex technical challenges
  • Strong technical leadership with proven track record of mentoring engineers
  • Demonstrated experience establishing engineering best practices and systems thinking
  • Exceptional attention to detail and commitment to high-quality deliverables
  • Ability to navigate ambiguity and drive technical clarity in complex problem spaces
  • Proficiency in leveraging AI tools to enhance productivity and engineering workflows
Skills & Relevant Experience

Required:

  • 8+ years of experience in platform engineering, distributed systems, or AI infrastructure
  • Proven track record of designing and implementing large-scale, production-grade systems
  • Experience leading technical initiatives that span multiple teams and organizations
  • Deep understanding of software architecture principles and design patterns
  • Strong knowledge of cloud platforms, container orchestration, and microservices
  • Bachelor's degree in Computer Science, Engineering, or related technical field

Preferred:

  • Experience building production AI/ML infrastructure and platforms
  • Expertise with Python, FastAPI, and modern async programming patterns
  • Strong background in Kubernetes, infrastructure as code, and cloud-native architectures
  • Experience with observability systems, performance optimization, and reliability engineering
  • Knowledge of security best practices for AI systems and data handling

The listed Pay Range reflects base salary range, except for sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commission/sales bonus targets and annual base salary for the role. This pay range may be inclusive of several career levels at Apollo and will be narrowed during the interview process based on a number of factors, including the candidate’s experience, qualifications, and location. Applicants interested in this role and who are not located in the US may request the annual salary range for their location during the interview process.

Additional benefits for this role may include equity; company bonus or sales commissions/bonuses; 401(k) plan; at least 10 paid holidays per year, flex PTO, and parental leave; employee assistance program and wellbeing benefits; global travel coverage; life/AD&D/STD/LTD insurance; FSA/HSA and medical, dental, and vision benefits.

Annual Pay Range
$166,000$260,000 USD
We are AI Native

Apollo.io is an AI-native company built on a culture of continuous improvement. We’re on the front lines of driving productivity for our customers—and we expect the same mindset from our team. If you're energized by finding smarter, faster ways to get things done using AI and automation, you'll thrive here.

Why You’ll Love Working at Apollo

At Apollo, we’re driven by a shared mission: to help our customers unlock their full revenue potential. That’s why we take extreme ownership of our work, move with focus and urgency, and learn voraciously to stay ahead.

We invest deeply in your growth, ensuring you have the resources, support, and autonomy to own your role and make a real impact. Collaboration is at our core—we’re all for one, meaning you’ll have a team across departments ready to help you succeed. We encourage bold ideas and courageous action, giving you the freedom to experiment, take smart risks, and drive big wins.

If you’re looking for a place where your work matters, where you can push boundaries, and where your career can thrive—Apollo is the place for you. 

Learn more here!

Top Skills

Airflow
Fastapi
Hadoop
Kafka
Python
Spark

Similar Jobs at Apollo.io

Yesterday
Easy Apply
Remote
United States
Easy Apply
Mid level
Mid level
Artificial Intelligence • Enterprise Web • Information Technology • Productivity • Sales • Software • Database
The Campaign Program Specialist will lead integrated campaigns, manage creative processes, coordinate with teams, and support measurement and reporting.
Top Skills: AsanaNotion
Yesterday
Easy Apply
Remote
United States
Easy Apply
Mid level
Mid level
Artificial Intelligence • Enterprise Web • Information Technology • Productivity • Sales • Software • Database
As a Campaign Program Coordinator, you'll support campaign planning, execution, and measurement, coordinate with teams, manage project timelines, and assist in digital event logistics.
Top Skills: HubspotZoom
Yesterday
Easy Apply
Remote
2 Locations
Easy Apply
156K-195K Annually
Senior level
156K-195K Annually
Senior level
Artificial Intelligence • Enterprise Web • Information Technology • Productivity • Sales • Software • Database
As a Senior Backend Engineer, you will develop scalable backend endpoints, mentor team members, and lead the software development lifecycle while collaborating with cross-functional teams.
Top Skills: AnsibleDockerElasticsearchKubernetesMongoDBNode.jsReactRedisReduxRubyRuby On RailsTerraform

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account