Memory Bridge Logo

Memory Bridge

Sr. Backend Engineer

Posted 10 Hours Ago
Remote
Hiring Remotely in United States
800M-1200M Annually
Senior level
Remote
Hiring Remotely in United States
800M-1200M Annually
Senior level
Design and own backend infrastructure for a privacy-first AI memory platform. Responsibilities include multi-tier memory storage, secure multi-tenant isolation, real-time APIs, caching, LLM integrations, retrieval systems, synchronization, monitoring, deployment pipelines, and production reliability. The role requires close collaboration with ML engineering and product teams while owning architecture, infrastructure, testing, security, and operational troubleshooting.
The summary above was generated by AI

ما به سراغ یکی از چالش‌برانگیزترین مسائل هوش مصنوعی رفته‌ایم: اینکه چطور می‌توان با کمترین خدشه‌ به حریم خصوصی کاربران، حافظه‌ای بی‌نقص برای مدل‌های زبانی بزرگ فراهم کرد.

اگر شما توسعه‌دهنده‌ی بک‌اندی هستید که عاشق طراحی سیستم‌های ماژولار، سریع، و قابل‌اعتمادید، و دلتان می‌خواهد کدی بنویسید که در دل یک محصول واقعی زندگی می‌کند، ما مشتاق آشنایی با شما هستیم. ما به‌دنبال کسی هستیم که هم از معماری داده لذت ببرد، هم بتواند با تیم ماشین لرنینگ همکاری نزدیک داشته باشد، و هم وقتی لازم است خودش تصمیم بگیرد و جلو برود.

At Memory Bridge, we're tackling one of the hardest problems in AI: giving large language models perfect memory while preserving user privacy.

We're looking for an exceptional Backend Developer who understands that building a real-time memory layer for AI isn't just about connecting APIs—it's about architecting systems that can handle personal memories with low latency while maintaining bulletproof privacy guarantees. You'll design and build the infrastructure that powers our multi-tier memory system, privacy enforcement layer, and cross-platform integrations.

This is a rare opportunity to join our team as the founding backend engineer, where your architectural decisions will directly shape how AI systems store, protect, and retrieve human memories. If you're a systems thinker who gets excited about distributed storage, real-time data pipelines, and privacy-first architecture, we should talk.

About You

  • The ideal candidate has built production backend systems that handle sensitive user data, understanding the delicate balance between performance and privacy. You've architected APIs that serve real-time requests, designed data models that scale, and implemented security measures that protect user information by default.

  • You're comfortable working across the stack when needed—from optimizing database queries to configuring deployment pipelines. You understand that in a startup, backend engineering means owning the full lifecycle of your services.

  • You thrive in collaborative environments and can work effectively with ML engineers to ensure smooth integration between backend services and ML pipelines.

  • You understand when to introduce complexity and when to keep things lean

  • You like working in small teams where decisions move fast and ownership is shared.

  • You love building resilient APIs with proper retries, circuit breakers, and fallback strategies.

Key Responsibilities

  • Design and implement the core backend architecture supporting multi-tier memory storage (working, episodic, semantic), with appropriate data models and access patterns for each tier

  • Build the privacy enforcement layer that ensures memory filtering happens before retrieval, implementing user-defined trust tiers and data sensitivity classifications with practical security measures

  • Develop high-performance APIs that handle real-time prompt augmentation, including intelligent caching strategies and query optimization

  • Architect secure multi-tenant data isolation ensuring one user's memories never leak to another, using proven patterns and appropriate encryption

  • Implement robust integration pipelines for LLM providers (OpenAI, Anthropic, etc.) with proper error handling, retry logic, and graceful degradation

  • Collaborate closely with the ML engineer on the hybrid retrieval system, providing backend support for vector search, keyword search, and graph queries

  • Design the cross-platform synchronization system that keeps memory consistent across browser extensions and desktop applications

  • Set up monitoring, logging, and alerting systems to ensure production reliability—you'll own what you build

  • Work with PM to translate product requirements into technical architecture that balances features with system constraints

  • Own deployment pipeline and basic infrastructure

Requirements (Must-haves)

  • 4–6+ years of experience building robust backend systems

  • Expert-level Python development with strong architectural pattern

  • Deep understanding of asynchronous programming patterns and event-driven architectures

  • Proven ability to design and operate scalable RESTful APIs with proper versioning and documentation

  • Advanced PostgreSQL skills (query optimization, indexing strategies, understanding of ACID properties)

  • Experience with MongoDB or similar document stores for flexible data structures

  • Practical security knowledge: implementing authentication (JWT/OAuth), encryption at rest and in transit, and secure coding practices

  • Experience with Redis or similar caching solutions for performance optimization

  • Solid understanding of message queues for async processing

  • Strong testing practices across unit, integration, and end-to-end testing

  • Proficiency with Docker for containerized development and deployment

  • Experience with CI/CD pipelines and automated deployment processes

  • Comfort with owning production systems and debugging complex issues

  • Experience with Infrastructure as Code (Terraform)

Nice-to-Have Skills

  • Direct experience with LLM provider APIs and their quirks

  • Background in building memory systems, caching layers, or real-time data pipelines

  • Experience with observability platforms (Datadog, Prometheus/Grafana)

  • Knowledge of event streaming architectures

  • Experience with GitHub Actions for CI/CD automation

  • Basic understanding of ML concepts to better collaborate with ML engineers

  • Experience with browser extension backends

Tech Stack & Tools

Core

  • Python – Primary backend language for agentic services

  • FastAPI – Our choice for HTTP server

  • Git/GitHub – Version control and collaboration

  • GitHub Actions – CI/CD automation and deployment pipelines

Databases & Caching

  • PostgreSQL – Primary database for user data and relational queries

  • MongoDB – Document store for flexible memory structures

  • Redis – Caching layer and session management

  • Vector database integration – Supporting infrastructure for ML features

Messaging & Integration

  • RabbitMQ or Kafka – For async processing and event-driven architecture

  • REST APIs – Primary integration pattern

Infrastructure & DevOps

  • Docker & Docker Compose – Containerization and local development

  • Basic cloud deployment – Scripted deployments, not over-engineered

  • Monitoring basics – Logging, metrics, and alerting (specific tools flexible)

Security & Integration

  • Authentication – JWT and OAuth 2.0 basics

  • HTTPS/TLS – Standard encryption in transit

  • Environment-based secrets management – Not necessarily a complex vault system

  • Rate limiting – Basic protection against abuse

How To Apply

At Memory Bridge, we believe that diverse perspectives and experiences make us better, which is why we have a non-standard application process designed to promote inclusion and equity. We're looking for the best fit for each of our roles, regardless of the type of companies in your background, so we encourage you to apply even if your skills and experiences don't exactly match the job description. All we ask is that you answer a few in-depth questions in our application that would typically be asked at the start of an interview process. This helps speed things up by letting us get to know you and your skillset a bit better right out of the gate. Please be sure to answer each question; the updated resume is essential.

Education is not a requirement for our roles; however, if you receive an offer, you will need to include your most recent educational experience as part of our background check process.

Memory Bridge is an equal-opportunity employer and we're excited to work with talented and empathetic people of all identities. Memory Bridge does not discriminate based on someone's identity in any aspect of hiring or employment, as required by law and in line with our commitment to Diversity, Inclusion, Belonging, and Equity. Our code of conduct provides a beacon for the kind of company we strive to be, and we celebrate our differences because those differences are what allow us to make a product that serves a global user base. Memory Bridge will consider all qualified applicants, including those with criminal histories, consistent with applicable laws.

The anticipated application window is 30 days from the date the job is posted, unless the number of applicants requires it to close sooner or later, or if the position is filled.

How We Work

We are a remote-native company, intentionally designed for deep work and focused execution. We hire the best minds, wherever they are, and empower them to solve some of the hardest problems in AI. Our culture thrives on asynchronous communication, radical transparency, and a commitment to sustainable performance—not burnout.

If you're obsessed with building the infrastructure layer that will power the future of personalized AI and want to solve hard problems at the intersection of performance, privacy, and scale, we want to hear from you.

Similar Jobs

5 Hours Ago
Remote or Hybrid
165K-250K Annually
Senior level
165K-250K Annually
Senior level
Cloud • Digital Media • News + Entertainment • On-Demand
Build and operate Philo’s ML and LLM infrastructure, including AWS and Kubernetes platforms, GPU scheduling, model serving, inference optimization, monitoring, evaluation, experimentation, and CI/CD. The role establishes infrastructure best practices, reliability, security, scalability, and Infrastructure as Code while supporting recommendation, video classification, and agent workloads. It also involves collaborating with engineers and vendors to deploy, instrument, and manage production systems.
Top Skills: AirflowAlbAmazon BedrockAnthropicAWSC++CloudFormationCloudwatchDagsterDatadogDnsDockerDvcElasticacheElbElkFeastFluentdGitlabGoGrafanaHTTPIamInfluxdbJavaScriptJenkinsKubeflowKubernetesLakefsLinuxLitellmMetaflowMlflowNlbNvidia TritonOpenaiPgvectorPineconePrometheusPythonRagRayRdsRoute 53RubySqsTcp/IpTectonTensorrt-LlmTerraformTgiTickTypescriptVllmVpcWeaviateWeights & Biases
14 Hours Ago
In-Office or Remote
225K-235K Annually
Senior level
225K-235K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Design, build, and ship scalable backend features for Confluence Cloud AI automation and search. Develop RESTful microservices using object-oriented programming languages and work with relational and NoSQL databases in a distributed environment. Collaborate with engineering, architecture, product, and design teams; participate in Agile ceremonies; review code; and ensure reliability, security, performance, testing, documentation, monitoring, and error reporting.
Top Skills: Backend ServicesDistributed SystemsMonitoring And Error ReportingNosql DatabasesObject-Oriented Programming LanguagesRdbmsRestful Microservices
3 Days Ago
Easy Apply
Remote
United States
Easy Apply
173K-255K Annually
Senior level
173K-255K Annually
Senior level
Big Data • Fintech • Mobile • Payments • Financial Services
Build and operate Affirm’s AI platform, including LLM and MCP gateways, agent runtimes, evaluation services, and governance controls. Design highly available backend systems, manage identity, quotas, routing, caching, reliability, observability, and security for AI workloads. Own projects from design through launch and on-call, establish engineering standards, collaborate across teams, mentor engineers, and help scale AI systems into production.
Top Skills: AWSAws BedrockChatgptClaudeKotlinKubernetesLitellmMcpMySQLPython

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account