Bot Auto Logo

Bot Auto

Senior Software Engineer, Workflow Platforms

Reposted 3 Hours Ago
In-Office or Remote
Hiring Remotely in CA
Senior level
In-Office or Remote
Hiring Remotely in CA
Senior level
The Senior Software Engineer, Workflow Platforms will architect, build, and operate orchestration platforms for machine learning, data pipelines, and CI/CD at Bot Auto, ensuring reliability and efficiency.
The summary above was generated by AI
Company Introduction

At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a start-up and the wisdom of seasoned experts, Bot Auto boasts a team that has achieved numerous world-firsts and unparalleled innovations. United by a shared vision, we create miracles and propel the future of transportation. Join us and transform your dreams into reality.

We are seeking a highly skilled and motivated Senior Software Engineer, Workflow Platforms to architect, build, and operate the workflow orchestration platforms that power Bot Auto's engineering and autonomy workloads. From simulation and machine learning training to data pipelines and CI/CD, our teams depend on reliable, scalable workflow systems to move fast. In this role, you will own one or a hybrid of orchestration platforms (such as Argo Workflows and Airflow), operate them at scale, and develop the internal platforms and abstractions built on top of them that make running complex workloads simple, observable, and cost-efficient.

Key Responsibilities
  • Architect, deploy, and operate workflow orchestration platforms (e.g., Argo Workflows, Airflow, or a hybrid) supporting simulation, machine learning and model training, data pipelines, CI/CD, and other general-purpose workloads.
  • Build internal platforms, abstractions, SDKs, and self-service tooling on top of orchestration engines to make authoring, running, and monitoring workflows simple and reliable for engineers.
  • Operate workflow platforms at scale on Kubernetes across cloud (AWS) and on-prem data center environments, handling scheduling, autoscaling, GPU and heterogeneous resources, and cross-cluster orchestration.
  • Ensure reliability, performance, and cost efficiency of workloads through observability, queuing and prioritization, retries, and resource optimization.
  • Partner with ML, simulation, data, and infrastructure teams to understand workload requirements and deliver fit-for-purpose pipelines.
  • Integrate workflow platforms with storage, data streaming and event systems, artifact and model registries, and CI/CD tooling.
  • Establish best practices, templates, and documentation for workflow authoring and operations; mentor engineers across the company.
  • Handle user-impacting issues promptly with clear communication — mitigate in the short term and follow up with durable long-term solutions.
Required Qualifications
  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
  • 5+ years of hands-on experience in platform engineering, infrastructure, DevOps, or SRE roles
  • Significant experience with workflow orchestration platforms such as Argo Workflows, Airflow, or comparable systems
  • Strong software development skills in one or more languages: Python, Go, Java, or JavaScript/TypeScript
  • Solid understanding of Kubernetes and distributed systems
Preferred Qualifications
  • Expert-level experience operating Argo Workflows, Airflow, and/or other engines (e.g., Prefect, Dagster, Temporal, Kubeflow Pipelines, Flyte)
  • Experience orchestrating ML training, simulation, or large-scale data and batch workloads, including GPU scheduling
  • In-depth Kubernetes experience (EKS, GKE, AKS, RKE2/Rancher) and cross-cluster orchestration
  • IaC tools proficiency, including Terraform, Pulumi, OpenTofu, or Ansible
  • Experience with data streaming and event platforms, including NATS JetStream, Kafka, Pulsar, or RabbitMQ
  • Familiarity with observability stacks: Prometheus, Grafana, Loki, OpenTelemetry, or comparable
  • Demonstrated ability to optimize workload cost and performance without compromising reliability

Similar Jobs

3 Hours Ago
Remote
USA
Entry level
Entry level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Rubrik invites engineers to join their talent community to be part of a team dedicated to data security, innovation, and inclusion. Candidates should be motivated to tackle challenges and contribute to product development.
3 Hours Ago
Remote
USA
Entry level
Entry level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Rubrik invites individuals to join their talent community to stay connected and explore employment opportunities, fostering inclusion and equal opportunity.
3 Hours Ago
Remote
204K-276K Annually
Expert/Leader
204K-276K Annually
Expert/Leader
Artificial Intelligence • Cloud • Consumer Web • Productivity • Software • App development • Data Privacy
Lead design and implementation of shared, reusable data models and a certified metrics layer. Standardize pipeline patterns, CI/CD, and governance; modernize orchestration and observability; partner with Data Science, Infrastructure, and Product to deliver reliable analytics pipelines and enable AI-native data development.
Top Skills: AirflowAtlanDatabricksDatabricks Metric ViewsDbtDbt MetricflowDelta LakeGreat ExpectationsMonte CarloPythonSpark SqlSQLUnity Catalog

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account