BJAK Logo

BJAK

Backend Engineer, AI Systems

Posted 6 Hours Ago
Remote
Hiring Remotely in United States
Entry level
Remote
Hiring Remotely in United States
Entry level
Build and operate the inference and orchestration backend powering AI interactions across mobile and desktop applications. Responsibilities include designing production AI services, optimizing latency and throughput, managing caching, batching and streaming, and maintaining monitoring, logging, alerting, and incident response systems. The role requires reliable APIs, distributed-systems debugging, and scalable integration with LLMs, embeddings, and multimodal models.
The summary above was generated by AI
About ActAI

There are over 5 billion users using basic applications today such email, notes, tasks, calendar and they're not AI-native. Our mission is to build proactive applications for anyone in the world, who are not used to complex prompting. We aim to bring intelligence to conversations, errands, organising and workflows, with minimal to no prompting.

Our first application is an agent-first mobile communication app. We believe building applications that users use daily for communication, coordination and collaboration needs will help integrate AI into their lives. The net effect is to eliminate misinformation, achieve low coordination costs, enable high quality tasks and collaboration at scale with minimal or little prompting.

 
Role

As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience.

You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.

 
Focus
  • Build and operate backend systems that serve AI-powered features in production.

  • Design inference pipelines, orchestration layers, and service boundaries around models.

  • Own production concerns: monitoring, logging, alerting, and incident response.

  • Optimize latency and throughput across inference, caching, batching, and streaming.

 
Ideal Experiences
  • Strong backend engineering fundamentals in production environments.

  • Experience running high-throughput, low-latency services.

  • Familiarity with AI inference patterns (LLMs, embeddings, multimodal).

  • Comfortable debugging distributed systems under load.

  • Bias toward shipping and learning from production behavior.

 
Outcomes
  • Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput.

  • APIs are stable, clear, and support seamless integration with frontend and ML systems.

  • Production incidents are quickly detected, diagnosed, and resolved, minimizing user impact.

  • Iterative improvements based on real usage continuously increase system performance and reliability.

 
Tech Stack
  • Python

  • NodeJs

  • Pytorch

  • OpenAI / Anthropic / open-source LLMs

  • SQl & noSQL

  • Kubernetes

  • Docker

 
How We Work

The best products today in the world were built by small, world class teams. We are a high talent density and hands-on team. We make decisions collectively, move at rapid speed, striking a balance between shipping high quality work and learning. Joining our team requires the ability to bring structure, exercise judgment, and execute independently. Our goal is to put in hands of our users a truly magical product

 
Interview process

If there appears to be a fit, we'll reach to schedule 3, but no more than 4 interviews.

Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite.

We value transparency and efficiency, so expect a prompt decision. If you've demonstrated the exceptional skills and mindset we're looking for, we'll extend an offer to join us. This isn't just a job offer; it's an invitation to be part of a team that's bringing AI to have practical benefits to billions globally.

Similar Jobs

23 Minutes Ago
Remote or Hybrid
133K-199K Annually
Senior level
133K-199K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Own product execution for Dynatrace Bindplane across roadmap planning, requirements, prioritization, delivery, customer discovery, and launch activities. Partner with engineering, design, product marketing, sales, support, and customer success to deliver OpenTelemetry-based observability capabilities for SREs, platform engineers, and security teams. Lead beta programs, validate opportunities through customer and usage data, manage risks, and represent the product externally.
Top Skills: Ai-Assisted DevelopmentAWSAzureDockerGoogle Cloud PlatformKubernetesOpentelemetry
An Hour Ago
Remote or Hybrid
USA
140K-220K Annually
Senior level
140K-220K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Develop and operate a large-scale internal cloud management platform. Build APIs, UIs, CI/CD pipelines, and developer productivity tools using Go and TypeScript. Maintain Temporal and Argo Workflows pipelines, integrate development tooling, improve SDLC efficiency, support SOC 2 compliance, and collaborate with engineering, security, infrastructure, and SRE teams. Participate in on-call operations and apply AI technologies to improve workflows and decision-making.
Top Skills: AlertmanagerArgo CdArgo WorkflowsCi/CdDebianDockerGoGoreleaserGrafanaHelmJavaScriptJenkinsKubernetesKustomizeLinuxPrometheusPulumiPypiTemporalTerraformTypescript
An Hour Ago
Remote or Hybrid
225K-225K Annually
Senior level
225K-225K Annually
Senior level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Partner Engineer leads technical discovery, solution design, and delivery quality for strategic integrations on Square’s platform. The role serves as a technical lead and escalation point, identifies integration patterns to improve platform capabilities, partners with Product, and coaches Solutions Engineers. The position requires 20% domestic travel and may be telecommute.
Top Skills: Square Platform

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account