Senior Software Engineer, Backend (Applied AI)

Role

We are looking for a backend-oriented Senior Software Engineer with applied AI experience to help build the systems that power SmarterDx’s clinical AI products.
This role sits at the intersection of backend engineering, machine learning, and product development. You’ll build production applications that combine traditional software systems with machine learning and increasingly LLM-driven capabilities. You’ll work closely with Data Scientists and other Product engineers to turn models, experiments, and emerging AI techniques into reliable product experiences used by healthcare teams.
The ideal candidate has strong backend engineering fundamentals and has previously built and operated LLM-heavy applications in production. You don’t need to be an ML infrastructure specialist, but you should be comfortable working directly with models, understanding their behavior and limitations, and designing the application architecture around them. Experience with traditional machine learning is valuable, particularly if you have more recently worked on applications powered by LLMs, multimodal models, or other modern AI systems.

**This role is fully remote within the US**

What You’ll Do

• Design, build, and launch backend services and product capabilities that incorporate LLMs, machine learning models, and other AI systems
• Build production-grade workflows around model inference, structured outputs, tool use, retrieval, agentic workflows, and other LLM application patterns
• Partner closely with Data Scientists to take models and experimental approaches from exploration into reliable, maintainable production systems
• Develop evaluation, observability, and feedback mechanisms to understand and improve AI system performance in production
• Design systems that gracefully handle the probabilistic and non-deterministic behavior of AI models
• Work with clinical and operational data across structured and unstructured formats, including documents and images
• Collaborate across engineering, product, data science, and clinical disciplines to understand users and rapidly iterate on new ideas
• Design and improve the backend architecture that supports SmarterDx’s applications at scale
• Protect patients’ privacy and security through secure coding and data-handling practices
• Research and advocate for improved techniques, architectures, and development practices as the applied AI ecosystem evolves
• Support SmarterDx’s applications and AI systems in production

What You Bring

• 5+ years of software development experience, with significant experience building backend and cloud-based systems
• Expertise in Python and/or TypeScript, with strong software engineering fundamentals
• Experience building LLM-powered applications that have been deployed to production
• Experience integrating models into larger software systems rather than working exclusively on model training or ML infrastructure
• Experience collaborating closely with Data Scientists, Machine Learning Engineers, or research-oriented teams
• Experience designing APIs, services, data models, and asynchronous or event-driven workflows
• Experience working with Postgres or a similar relational database
• Experience building cloud-native distributed systems
• Familiarity with evaluating, debugging, and monitoring AI systems in production
• Strong judgment around reliability, testing, observability, and failure handling in systems that incorporate probabilistic model outputs
• Experience working in a security-conscious environment
• Excellent communication and cross-functional collaboration skills
• Bachelor’s or Master’s in Computer Science, Engineering, or a related field, or equivalent experience

Nice To Haves

• Experience with both traditional machine learning models and modern generative AI / LLM applications
• Experience with LLM application frameworks or orchestration tools such as LangChain or LangGraph
• Experience with LLM observability and evaluation platforms such as Langfuse, Braintrust, or similar tools
• Experience building retrieval-augmented generation, tool-calling, agentic, or multi-step AI workflows
• Experience with computer vision, multimodal models, document understanding, or OCR pipelines
• Experience designing evaluation datasets, automated evaluations, human-in-the-loop workflows, or model feedback loops
• Experience at a scale-up or rapid-growth technology company
• Experience in health tech, particularly with clinical data or hospital billing systems
• Experience working with Kubernetes
• Experience with HL7 / FHIR and other EHR-related technologies
• Experience with Snowflake
• Experience with Datadog

Our Stack

Python, TypeScript, React, Kubernetes, Postgres, DBOS, AWS, Terraform, Snowflake, Datadog, Braintrust, EasyLLM

Compensation

$190K to $230K base salary

#LI-DNI