Design and build production-grade AI systems, translating real-world problems into scalable AI-driven solutions while mentoring engineers and shaping technical strategy.
Conversica is seeking a Staff AI Software Engineer to design, build, and scale production-grade AI systems that deliver direct customer and business value. This senior individual contributor role emphasizes pragmatic, product-focused, customer-driven thinking, with a focus on translating real-world problems into reliable, maintainable, and scalable AI-driven solutions.
This role operates with a high degree of autonomy and technical influence, shaping AI and systems architecture, engineering standards, and best practices across the organization.
Key Responsibilities
- Design, implement, and ship AI-driven features and systems into production environments
- Own technical decision-making for AI architecture, data modeling, and system integration
- Partner closely with Product, Engineering, and other stakeholders to translate business needs into scalable technical solutions
- Identify and address reliability, scalability, performance, and observability challenges in AI systems
- Establish and evolve best practices for applied AI engineering, including agent evaluation, interpretability, and reliability, data layer design, monitoring, explainability, and continuous improvement
- Mentor and guide other engineers, raising the bar on AI engineering quality and decision-making
- Contribute to technical strategy and roadmap discussions related to AI capabilities and overall platform evolution
What You’ll Build
- Agentic system design: orchestration, tool use, state/memory, multi-step workflows
- Evals + quality: harnesses, regression tests for prompts/agents, online/offline metrics, iteration loops
- Guardrails: hallucination mitigation, grounding, HITL review, safe degradation paths
- Production operations: cost/latency tradeoffs, caching, rate-limits, fallbacks, observability, incident response
- Retrieval + data foundations: RAG choices, indexing, freshness, data quality constraints, data layer design
Qualification & Experience
- Equivalent of 8+ years of professional software engineering experience, with significant focus on applied AI.
- Proven experience deploying LLM-powered systems/applications in production environments
- Strong proficiency in Python, and experience building production LLM applications (agents/tool use, retrieval, evals, monitoring)
- Experience working with large datasets and navigating real-world data quality challenges
- Strong system design, problem-solving, and architectural decision-making skills
- Experience designing agent architectures, tool interfaces, and orchestration patterns
- Desire to continually follow and experiment with cutting edge AI technologies and tooling for use across all phases of the software development lifecycle (i.e. during design, analysis, coding, deployment, QA, etc.)
- Strong background in modern cloud-based architectures.
Preferred / Nice-to-Have Experience
- Experience applying AI solutions in a B2B SaaS environment
- Experience interacting with data from Marketing Automation Platforms (MAPs), Customer Resource Management Systems (CRMs), and Customer Data Platforms (CDPs)
- Experience deploying AWS infrastructure, and production use of Terraform, EKS, Postgres, MySQL, Datadog, and GitLab
What We Value
- We care about what you’ve built, not where you learned it. If you’ve shipped strong software, led technical decisions under ambiguity, contributed to open source, written thoughtful technical work, or built impressive projects with modern LLM tooling - put that front and center. Show us what you've built, what problems you've wrestled with, and how you reason about tradeoffs in systems that combine LLMs with real-world constraints.
Conversica is a remote-first company building AI-powered solutions that help businesses engage customers more effectively. You’ll work alongside thoughtful product and engineering partners, influence the direction of applied AI across the platform, and help turn emerging AI capabilities into durable, customer-ready systems.
This is a full-time, exempt position. Our compensation reflects the cost of labor across several U.S. geographic markets and is based on role scope, experience, and job-related skills. Conversica offers comprehensive health, dental, and vision benefits, PTO, holiday pay, 401(k), and equity.
Top Skills
AWS
Datadog
Eks
Gitlab
MySQL
Postgres
Python
Terraform
Similar Jobs
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Lead the technical evolution of software development by embedding AI into the workflow, designing intelligent ecosystems, and enhancing developer productivity.
Top Skills:
AIAWSCi/CdContainer OrchestrationGCPLlm
Security • Software • Cybersecurity • Automation
This role involves defining AI architecture, improving system quality, leading teams, and building production-ready AI systems at Drata.
Top Skills:
AirflowChromaFaissLlmsOrchestration SystemsPineconePythonRagTemporalTypescriptVector Databases
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Lead design, implement, and deploy scalable AI agents and infrastructure. Drive technical strategy, mentor engineers, collaborate cross-functionally, perform system and code reviews, and resolve architectural and performance challenges.
Top Skills:
AndroidAWSAzureC++DockerGCPJavaKotlinKubernetesLarge Language Models (Llms)Multi-Agent SystemsPythonReinforcement Learning
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

.png)

