Sequen AI Logo

Sequen AI

Staff, Rust Engineer - Core Infrastructure

Reposted One Month Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Design, build, and optimize production-grade Rust systems for low-latency model serving and real-time data ingestion. Implement high-throughput backend APIs, caching, and memory-efficient components. Debug distributed systems, establish benchmarking and monitoring, and collaborate with Applied Scientists to translate ML advances into scalable runtime systems.
The summary above was generated by AI
Senior Staff Systems Engineer, Rust Eng.
 

About the Company:

 

Sequen AI is leading the charge for building frontier ranking models for search and recommendations. Sequen AI's technology specializes in designing end-user behavior for large consumer enterprises. We are a small, highly technical team at an early stage, focused on turning recent advances in AI into systems that are reliable, useful, and capable in practice. The problems we are working on are often ambiguous, with meaningful real-world constraints and impact. If you are interested in building blistering fast, memory-safe backend architectures and shaping how frontier AI models serve production traffic at enterprise scale, we would like to meet you.

 

About the Role:

 

We are looking for a Core Systems Engineer with a deep mastery of Rust to design, build, and optimize Sequen’s underlying model serving infrastructure and real-time performance engines. This role sits at the absolute core of our technical strategy. You will be responsible for ensuring our frontier ranking and recommendation APIs process petabyte-scale data and compute complex inference logic with ultra-low latency. You will replace high-overhead bottlenecks with elegant, production-grade Rust systems, building a reliable foundation that scales alongside our rapid enterprise customer growth.

 

Responsibilities:

 
 
  • Optimize Real-Time Infrastructure: Write high-performance, memory-safe, and concurrent production code in Rust. Optimize model serving infrastructure to achieve ultra-low inference latency under heavy concurrent request loads. Build low-latency data ingestion systems, microservices, and network protocols to process real-time behavioral streams.

  • Develop Core Architectural Tooling: Design and maintain robust, high-throughput backend APIs and SDKs. Implement customized abstractions, caching layers, and memory management profiles to maximize hardware efficiency. Migrate data-heavy bottlenecks from higher-overhead languages into highly optimized Rust components.

  • Ensure Reliability and Scale: Own the end-to-end lifecycle of core backend infrastructure components. Debug complex distributed system deadlocks, race conditions, and production bottlenecks across cloud environments. Establish rigorous performance benchmarking, regression testing, and real-time system monitoring.

  • Collaborate on Product Evolution: Partner directly with Applied Scientists to translate recent neural network and ranking model breakthroughs into highly scalable runtime realities. Define best practices for building secure, scalable, and deterministic system architectures across our entire engineering organization.

Qualifications:

 
 
  • 6 to 8+ years of experience in Software Engineering, Systems Programming, Infrastructure Engineering, or similar.

  • Strong professional experience writing and deploying production-grade Rust code in high-scale systems.

  • Deep understanding of Rust-specific primitives, including ownership, lifetimes, concurrency models, and asynchronous runtimes like Tokio.

  • Experience building robust backend systems, custom APIs, and event-driven architectures.

  • Experience debugging, profiling, and operating high-throughput production systems under strict real-world constraints.

  • Comfort with ambiguity, a strong sense of technical ownership, and an ability to balance engineering speed with quality.

 

Preferred Skills:

 
 
  • Experience working with cloud platforms like AWS, GCP, or Azure and container orchestration tools like Docker and Kubernetes.

  • Experience implementing machine learning model inference optimizations, vector search databases, or large-scale data pipelines.

  • Background in early-stage startups or fast-moving, high-growth technical environments.

 

Pay range and compensation package:

 
 

At this stage, the efficiency and speed of our core infrastructure directly dictate how our product performs for global-scale consumer enterprises. You will have a blank canvas to architect core systems, work with bleeding-edge AI workflows, and fundamentally define the technical scalability of the company.

 
 

Similar Jobs

30 Minutes Ago
Easy Apply
Remote or Hybrid
USA
Easy Apply
165K-235K Annually
Senior level
165K-235K Annually
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Provides technical leadership for Zscaler Zero Trust Browser solutions across the sales lifecycle. Leads executive briefings, technical workshops, proof-of-value evaluations, deployments, and architecture discussions. Develops technical collateral, demos, test plans, and reference architectures while articulating browser security controls such as threat prevention, monitoring, DLP, private application access, and privileged remote access. Partners with sales and engineering to support customer outcomes, product enhancements, and successful technical wins.
Top Skills: Ai/MlBrowser ExtensionsDnsHTTPIn-Browser DlpLarge Language Models (Llms)Privileged Remote Access (Pra)Ssl/TlsZero Trust BrowserZero Trust ExchangeZscaler Client ConnectorZscaler Internet Access (Zia)Zscaler Private Access (Zpa)
30 Minutes Ago
Remote or Hybrid
Senior level
Senior level
Beauty • Enterprise Web • Fintech • Payments • Software
Own the technical direction of the web platform, including shared frontend frameworks, component libraries, tooling, build pipelines, and developer workflows. Architect scalable reusable components, establish frontend standards for accessibility, performance, and design systems, and champion AI-assisted development practices using tools such as Cursor and GitHub Copilot. Identify systemic issues, improve engineering velocity, and provide cross-functional technical leadership across product teams.
Top Skills: Core Web VitalsCursorGithub CopilotReactTypescript
30 Minutes Ago
Remote or Hybrid
Senior level
Senior level
Beauty • Enterprise Web • Fintech • Payments • Software
Staff Backend Engineer responsible for architecting AI-powered products, integrating production LLM systems, validating designs through proof-of-concepts, and setting technical direction for high-innovation teams. The role combines architecture, planning, technical leadership, hands-on coding, roadmap development, technical debt reduction, and cross-functional collaboration with Product, Design, and Engineering leadership. Candidates will help establish scalable backend architecture and raise engineering quality across the organization.
Top Skills: Ai ModelsAWSKotlinKubernetesLlmsTypescript

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account