Design and build backend systems and APIs for AI-driven products, ensuring scalability, reliability, and integration of ML models while collaborating with engineering and product teams.
The Role
We’re looking for a Senior Software Engineer to build and scale the backend systems that power our AI agent. This role sits at the intersection of backend engineering, machine learning, and product, and is focused on turning AI capabilities into reliable, production-ready systems.
You won’t be training models, but you will make them work in the real world. You’ll build APIs, services, and data systems that connect LLMs and ML models to user-facing experiences, ensuring performance, reliability, and scalability.
What You’ll Do- Design and build APIs and backend services that power AI-driven product experiences
- Develop systems that integrate LLMs and ML models into production workflows
- Build and maintain data pipelines supporting training, inference, and evaluation
- Partner closely with ML Engineers, Data Scientists, and Product to ship end-to-end features
- Improve system performance, reliability, and scalability across services
- Contribute to experimentation and feedback loops that improve model and product performance
- Debug complex production issues and drive root cause resolution
- Raise the bar on code quality, system design, and engineering standards
- AI-powered features are reliably delivered through scalable, well-architected backend systems
- ML and LLM capabilities are seamlessly integrated into product experiences with strong performance and uptime
- Clear, maintainable APIs and services enable fast iteration across engineering and product teams
- Systems are designed with strong observability, enabling rapid debugging and improvement
- Engineering decisions consistently balance speed, quality, and long-term scalability
- 5+ years of experience in software engineering, with strong backend focus
- Strong proficiency in Python and experience building production-grade systems
- Experience designing APIs and service-oriented architectures
- Experience working with ML/AI systems in production environments (LLMs, ranking, recommendations, or similar)
- Familiarity with databases (SQL and/or NoSQL) and data-intensive systems
- Experience with cloud platforms (AWS, GCP, or Azure) and modern infrastructure
- Exposure to containerization and orchestration (Docker, Kubernetes)
- Ability to operate in ambiguity and take ownership of loosely defined problems
- Strong product mindset with focus on real user outcomes
- Clear communication and ability to collaborate across engineering, ML, and product
The expected base salary range for this role is $200,000–$225,000 USD and will vary based on skills, experience, role level, and geographic location. Final compensation will be determined by considering these factors alongside overall role scope and responsibilities.
In addition to base salary, Wizard offers:
- Equity in the form of stock options
- Medical, dental, and vision coverage
- 401(k) plan
- Flexible PTO and company holidays
- Fully remote work within the United States
- Periodic company offsites and team gatherings
Wizard is committed to fair, transparent, and competitive compensation practices.
Similar Jobs
Information Technology
Design, develop, and operate Python-based backend microservices for a real-time AI-powered voice platform. Build and consume REST APIs, integrate SIP/WebRTC/LiveKit and third-party systems, containerize services, maintain CI/CD, and deploy on AWS while collaborating with AI, frontend, and DevOps teams.
Top Skills:
Aws EcsBitbucket PipelinesCloudwatchDockerDocker ComposeGoogle CalendarLivekitMicrosoft CalendarPythonRest ApisS3Secrets ManagerSipWebrtcZoho Crm
.png){kind=logo}
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Design and implement high-performance C++ systems for machine learning, computer vision, and 3D modeling. Apply research, optimize algorithms, manage source control with Git, deploy and test on cloud using Unix-based systems, and work with large-scale geospatial datasets to generate 3D content.
Top Skills:
3D ModelingBashC++Cloud PlatformCmakeComputer GraphicsComputer VisionDvcsGeospatial DataGitLinuxMachine LearningmacOSMercurialPythonUnix ShellUnreal Engine
Agency • Information Technology
Design, build, test, and maintain backend applications using FastAPI and SQLAlchemy. Implement database schemas, integrate front-end components, optimize for performance and scalability, debug issues, participate in code reviews, and collaborate on feature design. Maintain clean, testable code and stay current with best practices.
Top Skills:
FastapiGitMySQLOraclePytestPythonSQLSqlalchemy
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
