The Senior Backend Engineer will design and implement infrastructure for an AI system, solve complex data-related problems, and ensure system scalability and security.
Role Overview
The Role
Required Skills
Benefits
We're seeking a Senior Backend Engineer to join our fast-paced team to design, develop, and implement new infrastructure for Littlebird, our personalized AI teammate for Mac and Android (Windows soon!). We’re building personal AI; a thought partner that connects dots in your work and helps you think. Check out the recent TechCrunch news on our $11M seed funding and what users are saying about the product.
We're an async-first team that values craft and ownership. Our engineers live at the intersection of genuine research curiosity and production discipline: you'll push the frontier in areas like realtime data, search, and inference, then wrestle those ideas into systems that are fast, lean, and built to scale.
You will architect the system that allows our agent to reason, remember, and evolve. You'll develop core infrastructure that turns messy, unstructured user data into a coherent world model.
Some of the hard problems you'll solve:
- Build AI Memory: Our current memory systems will continue to scale. You'll lead the charge to design and implement our next-generation memory system This means solving hard problems in:
- Scale Our Data & Retrieval Pipelines: As we grow, you'll be responsible for ensuring our data ingestion, hybrid search, and re-ranking pipelines are fast, reliable, and cost-effective.
- Security: Ensure our infrastructure is highly secure and observable, with a focus on speed and cost
- Graph-based Retrieval: How do you query a graph efficiently to provide the agent with rich, structured context, moving beyond simple semantic search?
- Deep experience building and scaling data-intensive backend systems in Python or Go.
- Strong system-design skills and experience working with distributed systems.
- A clear mental model for data structures and their trade-offs. You like to think deeply about how to represent complex information.
- Hands-on experience with RAG pipelines, even if you're a little frustrated with their limitations.
- Production experience with modern cloud infrastructure, observability tooling, and PostgreSQL
- A pragmatic approach. You know when to build for the long term and when to ship a clever solution that works now.
- Remote-friendly work environment
- Collaborative team culture
- Opportunity to shape infrastructure decisions
- Competitive compensation packages including stock and health benefits, paid time off, and parental leave. 401k options for all US-based employees.
- Flexible working hours across multiple time zones
- We love to hear when birds chirp!
Similar Jobs
Artificial Intelligence • Machine Learning • Software • Defense
Design, build, and improve scalable backend systems that collect hard-to-access OSINT; build pipelines and ETL for messy data; collaborate with product and mission teams; mentor engineers and ensure reliable data delivery for DoD workflows.
Top Skills:
AWSDatabasesDistributed SystemsETLPythonTemporalWeb Scraping
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Design and implement secure, scalable backend services for speech inference and audio processing. Optimize networking, transcoding, latency, memory, and distributed compute orchestration. Measure and improve system performance, debug complex networking/scheduling/HPC issues, customize services for customers, and partner with Product to deliver features end-to-end.
Top Skills:
Audio TranscodingCC++CnnGitPythonRnnRustSpeech ProcessingTorchTransformersUnix-Style Systems
Big Data • Fintech • Mobile • Payments • Financial Services
Build, operate, and extend data platform and application-layer services enabling secure, self-service data applications at scale. Implement provisioning, CI/CD, access control, integrations, observability, automation, and incident response while contributing to semantic layer and AI-ready tooling roadmaps.
Top Skills:
BigQueryBuildkiteCi/CdContainerized ApplicationsDatabricksDockerEvent-Driven FrameworksGithub ActionsLlmOauthOidcPythonRest ApisSecrets ManagementSemantic LayerSnowflakeSQLWebhooks
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
