The Senior Backend Engineer will design and implement infrastructure for an AI system, solve complex data-related problems, and ensure system scalability and security.
Role Overview
The Role
Required Skills
Benefits
We're seeking a Senior Backend Engineer to join our fast-paced team to design, develop, and implement new infrastructure for Littlebird, our personalized AI teammate for Mac and Android (Windows soon!). We’re building personal AI; a thought partner that connects dots in your work and helps you think. Check out the recent TechCrunch news on our $11M seed funding and what users are saying about the product.
We're an async-first team that values craft and ownership. Our engineers live at the intersection of genuine research curiosity and production discipline: you'll push the frontier in areas like realtime data, search, and inference, then wrestle those ideas into systems that are fast, lean, and built to scale.
You will architect the system that allows our agent to reason, remember, and evolve. You'll develop core infrastructure that turns messy, unstructured user data into a coherent world model.
Some of the hard problems you'll solve:
- Build AI Memory: Our current memory systems will continue to scale. You'll lead the charge to design and implement our next-generation memory system This means solving hard problems in:
- Scale Our Data & Retrieval Pipelines: As we grow, you'll be responsible for ensuring our data ingestion, hybrid search, and re-ranking pipelines are fast, reliable, and cost-effective.
- Security: Ensure our infrastructure is highly secure and observable, with a focus on speed and cost
- Graph-based Retrieval: How do you query a graph efficiently to provide the agent with rich, structured context, moving beyond simple semantic search?
- Deep experience building and scaling data-intensive backend systems in Python or Go.
- Strong system-design skills and experience working with distributed systems.
- A clear mental model for data structures and their trade-offs. You like to think deeply about how to represent complex information.
- Hands-on experience with RAG pipelines, even if you're a little frustrated with their limitations.
- Production experience with modern cloud infrastructure, observability tooling, and PostgreSQL
- A pragmatic approach. You know when to build for the long term and when to ship a clever solution that works now.
- Remote-friendly work environment
- Collaborative team culture
- Opportunity to shape infrastructure decisions
- Competitive compensation packages including stock and health benefits, paid time off, and parental leave. 401k options for all US-based employees.
- Flexible working hours across multiple time zones
- We love to hear when birds chirp!
Similar Jobs
Big Data • Fintech • Mobile • Payments • Financial Services
Build and operate Affirm’s AI Platform, including LLM and MCP gateways, agent runtimes, evaluation services, and observability systems. Design secure, highly available backend infrastructure with identity, quota, routing, caching, failover, cost attribution, and governance controls. Own technical projects from design through launch and on-call, establish engineering standards, collaborate across security and infrastructure teams, and mentor engineers while supporting production AI workloads at scale.
Top Skills:
AWSAws BedrockChatgptClaudeKotlinKubernetesLitellmMcpMySQLPython
Big Data • Fintech • Mobile • Payments • Financial Services
Architect and operate Affirm’s large-scale Amazon EKS compute platform, including cluster lifecycle, node management, autoscaling, shared components, infrastructure automation, workload safety policies, observability, cost and capacity optimization, and self-service workflows. The role drives technical strategy, mentors engineers, partners cross-functionally, and participates in on-call incident response.
Top Skills:
Amazon EksArgocdAWSCi/CdCluster AutoscalerCorednsEc2GitopsGoIamInfrastructure As CodeKarpenterKube ProxyKubernetesMetrics ServerOpa/GatekeeperPythonSpaceliftTerraformVpcVpc Cni
Cloud • Digital Media • News + Entertainment • On-Demand
Build and operate Philo’s ML and LLM infrastructure, including AWS and Kubernetes platforms, GPU scheduling, model serving, inference optimization, monitoring, evaluation, experimentation, and CI/CD. The role establishes infrastructure best practices, reliability, security, scalability, and Infrastructure as Code while supporting recommendation, video classification, and agent workloads. It also involves collaborating with engineers and vendors to deploy, instrument, and manage production systems.
Top Skills:
AirflowAlbAmazon BedrockAnthropicAWSC++CloudFormationCloudwatchDagsterDatadogDnsDockerDvcElasticacheElbElkFeastFluentdGitlabGoGrafanaHTTPIamInfluxdbJavaScriptJenkinsKubeflowKubernetesLakefsLinuxLitellmMetaflowMlflowNlbNvidia TritonOpenaiPgvectorPineconePrometheusPythonRagRayRdsRoute 53RubySqsTcp/IpTectonTensorrt-LlmTerraformTgiTickTypescriptVllmVpcWeaviateWeights & Biases
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
