Smarsh Logo

Smarsh

Senior Software Engineer, Python + AI Platform

Posted 8 Days Ago
Remote
Hiring Remotely in US
195K-260K Annually
Senior level
Remote
Hiring Remotely in US
195K-260K Annually
Senior level
Design, build, and scale Python backend services and agentic LLM workflows for a multi-tenant, regulated enterprise platform. Productionize LLM integrations (Bedrock), ensure security/compliance, implement async orchestration, optimize data layers (Postgres, vector search/RAG), and add observability, real-time eventing, and typed API contracts. Collaborate cross-functionally and drive architecture to production.
The summary above was generated by AI
Who are we?

Smarsh empowers its customers to manage risk and unleash intelligence in their digital communications. Our growing community of over 6500 organizations in regulated industries counts on Smarsh every day to help them spot compliance, legal or reputational risks in 80+ communication channels before those risks become regulatory fines or headlines.  Relentless innovation has fueled our journey to consistent leadership recognition from analysts like Gartner and Forrester, and our sustained, aggressive growth has landed Smarsh in the annual Inc. 5000 list of fastest-growing American companies since 2008.

Smarsh is hiring a senior backend/platform engineer to build and scale agentic AI systems for enterprise use. You will build fast-moving, early-stage Python services that integrate AI capabilities into a production agentic platform. Your scope spans workflow execution, scale, reliability, and platform hardening as we grow.

This is not a generic backend role. The focus is building and designing agentic systems, shipping working software, and solving hard platform problems in a fast-moving AI-native environment. You will join a small, high-velocity cross-functional group and own problems end to end, designing and building from scratch, making fast architectural calls, and driving ideas from whiteboard to working system with a small, high-agency team.

What will you do?

    • Drive backend development for AI workflows as part of a collaborative team. Build and evolve Python/FastAPI services powering core agentic workflows and platform capabilities.
    • Productionize LLM integrations. Implement systems around Bedrock usage, quotas, retries, failover, cost controls, model configuration, and approval constraints.
    • Design for security and compliance. Address customer data handling, tenant isolation, auditability, observability, and secure processing for regulated workloads. Apply auditable data design patterns to ensure AI outputs are traceable, reproducible, and built to withstand regulatory scrutiny.
    • Build for scale. We're a nimble team, but our enterprise customers process data at petabyte scale. Help the platform grow to meet that bar through async job orchestration, performance tuning, and data-layer optimization.
    • Support multi-tenant architecture. Contribute to tenant-aware services, role-based access, SSO integration, and admin/reporting capabilities.
    • Improve platform reliability. Add monitoring, tracing, alerting, and operational tooling for LLM pipelines, workflow execution, and report generation.
    • Build real-time capabilities. Design and implement real-time event delivery and pub/sub patterns to support live workflow state, notifications, and agent feedback loops.
    • Contribute to technical decisions. Partner on shared services decisions, platform architecture, and integration boundaries across the stack.
    • Work across ambiguity. Translate evolving product requirements and non-functional requirements into practical technical solutions with product, architecture, legal, and security stakeholders.
    • Champion code quality. Drive strong typing, automated testing, and continuous integration practices that keep the team fast and safe.
    • Design typed API contracts. Own the API surface as a product contract: designing clean, schema-driven APIs that support typed client generation and reliable integration across services.

What will you bring?

    • Strong Python backend engineering. 7+ years professional software development, including 5+ years building Python services in production. Deep experience with APIs, async processing, background jobs, and workflow orchestration.
    • Cloud-native backend experience. AWS experience, ideally with services relevant to secure enterprise workloads (compute, storage, networking, CI/CD, identity, secrets, encryption).
    • Production distributed systems. Proven ability to productionize complex backend systems with reliability, observability, retries, throughput, failure handling, and performance tuning.
    • Data-intensive system design. Strong knowledge of PostgreSQL, large-scale data processing patterns, indexing, query tuning, and batch/stream tradeoffs. Experience with retrieval-augmented generation (RAG), vector search, and embedding-based systems is required (not a plus).
    • Security and compliance mindset. Experience with multi-tenant systems, RBAC, audit logging, secure data handling, and regulated environments.
    • Strong ambiguity handling. Ability to work from partial requirements and shape implementation around product and non-functional requirement constraints.
    • Agentic workflow engineering. Hands-on experience building LLM-driven workflows: tool-calling, state machines, human-in-the-loop approval patterns, checkpoint/resume, and multi-step agent orchestration. Familiarity with frameworks like LangGraph or equivalent.
    • AI-native engineering. Experience working on or alongside AI-native engineering teams, where AI agents are first-class participants in the development workflow, not just productivity tools. Includes hands-on prompt engineering, eval design, and LLM cost optimization: caching strategies, token efficiency, and model selection tradeoffs.
    • Product mindset. Bias for shipping, learning from real usage, and making pragmatic tradeoffs grounded in customer problems.
    • Strong Pluses
      • LLM / AI platform experience. Bedrock, OpenAI, Anthropic, LangChain/LangGraph, prompt workflows, evals, tool-calling systems. Experience integrating external AI services safely and reliably.
      • Identity and access. SSO/SAML/OIDC, enterprise auth patterns.
      • Graph-shaped data and entity resolution. Experience with graph-backed data models, entity deduplication, mention linking, and building systems that reason over connected, structured records.
      • Observability stack. OpenTelemetry, tracing, metrics, alerting, cost/usage dashboards.
      • Regulated communications or compliance domain. Background in systems that handle sensitive communications, audit trails, or data subject to legal or regulatory review is a meaningful differentiator.
      • Infrastructure as code. Terraform, feature flags, canary deployments, release strategies.

About our culture

Smarsh hires lifelong learners with a passion for innovating with purpose, humility and humor. Collaboration is at the heart of everything we do. We work closely with the most popular communications platforms and the world’s leading cloud infrastructure platforms. We use the latest in AI/ML technology to help our customers break new ground at scale. We are a global organization that values diversity, and we believe that providing opportunities for everyone to be their authentic self is key to our success. Smarsh leadership, culture, and commitment to developing our people have all garnered Comparably.com Best Places to Work Awards. Come join us and find out what the best work of your career looks like.

Similar Jobs

3 Minutes Ago
Remote or Hybrid
CA, USA
85K-128K Annually
Mid level
85K-128K Annually
Mid level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Pre-sales specialist for NG Identity Security responsible for driving sales in California, delivering technical demos and proofs of value, advising customers, collaborating with sales, product and engineering teams, shaping go-to-market strategy, and expanding product adoption.
Top Skills: Adaptive ShieldAICrowdstrike FalconMicrosoft 365SalesforceSspm
5 Minutes Ago
Remote or Hybrid
US
96K-150K Annually
Senior level
96K-150K Annually
Senior level
Information Technology
Manage, maintain, and improve secure government cloud, hybrid, and multi-cloud infrastructure (Azure Gov/Azure GCC High, AWS GovCloud, GCP). Provide 24x7 operational support, incident/change management, advanced troubleshooting, compliance with FedRAMP/NIST/DISA/CIS standards, automation/IaC development, capacity and performance management, and technical guidance to improve architecture, security, and service delivery.
Top Skills: Amazon Web ServicesAutomationAws GovcloudAzure Gcc HighAzure GovernmentBackupCis BenchmarksDatabasesDisa StigsEnterprise StorageFedrampGCPGoogle Cloud PlatformIacIdentity And Access ManagementInfrastructure As CodeItilLinuxAzureMonitoringNist 800-53Nist Cybersecurity FrameworkObservabilityService ManagementUnixVirtualizationWindows
5 Minutes Ago
Remote or Hybrid
IL, USA
16-16 Hourly
Internship
16-16 Hourly
Internship
Information Technology
Serve as a campus liaison between CDW sales, university administration, and technology partners. Build and maintain campus relationships, research technology trends, educate stakeholders on CDW solutions, and work 15–25 hours/week while completing paid training and receiving ongoing mentorship.

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account