Develop and maintain a scalable internal LLM agent framework, including backend services, APIs, databases, integrations, observability, reliability, and parallel processing. Build automated LLM evaluation pipelines, adapt the framework for customer use cases, and collaborate with ML/NLP teams. The role requires strong production Python experience, async programming expertise, cross-service debugging, product judgment, and adaptability in a fully remote European team.
Description
We are now expanding our team and are looking for a skilled, goal-oriented backend developer to help us grow. You'll work on services, APIs, databases, and integrations with external systems, collaborating closely with a small, hands-on, technically strong team that moves fast and makes decisions without unnecessary bureaucracy.
Requirements- 6+ years of production experience with Python
- At least 2 years of hands-on experience with async Python (FastAPI, aiohttp, or similar frameworks) in production
- Ability to debug issues across service boundaries
- Strong product mindset, understanding the "why" behind requests and making technical decisions that align with product and business goals.
- Able to navigate ambiguity, adapt quickly to changing priorities, and deliver results despite evolving requirements and limited upfront specifications.
- Open to using AI tools in daily development and troubleshooting
Nice to have:
- Experience with AI Tracing Tools like LangSmith
- Develop and maintain the internal LLM agent framework with focus on scalability, processing, and parallelism
- Ensure system observability and reliability using metrics, tracing and monitoring tools
- Adapt the framework for specific customer use cases and collaborate closely with ML/NLP teams
- Build and support automated LLM evaluation pipelines
- Design backend services using Python () and modern cloud-native architecture.
- The team has built award-winning AI products for tech corporations: devices, voice assistants, products that are actually in the world
- Cutting-edge tech stack: Speech Technologies, NLP, Generative AI (LLMs, diffusion models), voice-first agentic architecture with privacy-first and on-premises deployment
- High engineering bar and real ownership: the team cares about what actually works in production, not what looks good in a demo, and you'll see the impact of your work directly
- Fast career progression: a senior-heavy team and a high volume of real problems means you grow faster than you would anywhere else
- Startup pace with enterprise stability: real clients, real revenue, no bureaucracy
- Fully remote across Europe
- 21 vacation days + public holidays + 5 sick days
- Private English lessons via Preply
- Company-paid subscriptions to top AI tools (ChatGPT, Claude, Cursor, and others)
Similar Jobs
Big Data • Fintech • Mobile • Payments • Financial Services
Architect and operate Affirm’s large-scale Amazon EKS compute platform, including cluster lifecycle, node management, autoscaling, shared components, infrastructure automation, workload safety policies, observability, cost and capacity optimization, and self-service workflows. The role drives technical strategy, mentors engineers, partners cross-functionally, and participates in on-call incident response.
Top Skills:
Amazon EksArgocdAWSCi/CdCluster AutoscalerCorednsEc2GitopsGoIamInfrastructure As CodeKarpenterKube ProxyKubernetesMetrics ServerOpa/GatekeeperPythonSpaceliftTerraformVpcVpc Cni
Big Data • Fintech • Mobile • Payments • Financial Services
Build and operate Affirm’s AI platform, including LLM and MCP gateways, agent runtimes, evaluation services, and governance controls. Design highly available backend systems, manage identity, quotas, routing, caching, reliability, observability, and security for AI workloads. Own projects from design through launch and on-call, establish engineering standards, collaborate across teams, mentor engineers, and help scale AI systems into production.
Top Skills:
AWSAws BedrockChatgptClaudeKotlinKubernetesLitellmMcpMySQLPython
Big Data • Fintech • Mobile • Payments • Financial Services
Build and lead development of high-availability backend services for Affirm’s card loan platform. Design scalable APIs, data models, microservices, and event-driven systems supporting real-time loan attribution, approvals, origination, and refunds. Drive technical strategy, troubleshoot complex performance issues, collaborate with cross-functional teams, and mentor engineers while ensuring long-term system robustness and scalability.
Top Skills:
AWSAzureDockerEvent-Driven ArchitectureGCPKotlinKubernetesMicroservicesNoSQLPythonRestful ApisSQL
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
