SHIELD Logo

SHIELD

Staff Software Engineer, Perception (R5421)

Posted 3 Hours Ago
Be an Early Applicant
In-Office
Boston, MA, USA
Senior level
In-Office
Boston, MA, USA
Senior level
Lead development of advanced computer vision, vision-language, and vision-language-action models for autonomous systems. Design training data pipelines, fine-tuning workflows, evaluation frameworks, and deployment infrastructure. Optimize models for embedded hardware using ONNX and TensorRT, translate research into production capabilities, solve perception challenges, collaborate across autonomy and platform teams, and mentor engineers.
The summary above was generated by AI

Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit www.shield.ai. Follow Shield AI on LinkedIn, X, Instagram, and YouTube. 

 

The Hivemind Solutions Perception team develops the next generation of perception capabilities for autonomous systems by combining state-of-the-art machine learning with the proven foundations of computer vision. The team advances how autonomous platforms understand and interpret the world by developing vision, vision-language (VLM), and vision-language-action (VLA) models that tackle core perception challenges such as object understanding, scene interpretation, and mission-relevant environmental awareness. Working at the intersection of research and production, our engineers build the data pipelines, supervised fine-tuning (SFT) workflows, evaluation frameworks, and deployment infrastructure needed to transform cutting-edge AI research into reliable, mission-ready perception capabilities.

 

In this role, you'll lead the technical development of advanced machine learning solutions that define the future of perception for autonomous systems. You'll own the team's most challenging technical problems, drive architecture and model development across multiple efforts, and influence how foundation models are adapted, evaluated, and deployed for real-world autonomy. Working closely with researchers, perception engineers, autonomy engineers, and platform teams, you'll bridge cutting-edge AI research with scalable production systems while mentoring engineers and raising the technical bar across the organization.

What You'll Do:

  • Model Development – Design, train, fine-tune, and maintain state-of-the-art vision, vision-language, and vision-language-action models that improve perception and decision-making for autonomous systems. 

  • Data Pipelines & Model Training – Build scalable data pipelines, supervised fine-tuning (SFT) workflows, and evaluation loops that continuously improve model performance on mission-relevant tasks. 

  • Model Deployment & Optimization – Deploy and optimize machine learning models for embedded hardware using technologies such as ONNX, TensorRT, and hardware-accelerated inference frameworks. 

  • Perception & Autonomy Applications – Apply modern machine learning techniques to solve challenging perception and autonomy problems across aerial and other autonomous systems operating in complex, real-world environments. 

  • Research-to-Production – Translate cutting-edge machine learning research into production-ready capabilities by balancing model performance, robustness, computational efficiency, and operational reliability. 

  • Cross-functional Collaboration – Partner closely with perception, autonomy, platform, and software engineering teams to integrate machine learning capabilities into mission-ready autonomous systems. 

  • Model Evaluation & Validation – Develop benchmarks, testing methodologies, and evaluation frameworks to measure model performance, identify failure modes, and guide future improvements. 

  • Continuous Improvement – Improve training infrastructure, developer tooling, deployment workflows, and model lifecycle management to accelerate experimentation and production delivery. 

Required Qualifications:

  • Typically requires a minimum of 7 years of related experience with a Bachelor’s degree; or 6 years and a Master’s degree; or 4 years with a PhD; or equivalent work experience.

  • Expertise of machine learning fundamentals. 

  • Experience training an deploying ML models for computer vision in a production setting. 

  • Strong understanding of 3D vision problems/algorithms. 

  • Experience with machine learning frameworks such as PyTorch and TensorFlow. 

  • Demonstrated expertise in deploying models using TensorRT and ONNX. 

  • Proficiency in C++ and Python. 

  • Strong analytical and problem-solving skills, with the ability to translate research into practical applications. 

  • Ability to obtain a SECRET clearance 

Preferred Qualifications:

  • Experience with developing autonomous systems for defense customers. 

  • Experience with training/finetuning vision-language models, vision-language-action models, and/or world models.  

  • Contributions to open-source projects in machine learning or computer vision. 

  • Track record of publications in leading computer vision and robotics conferences and journals (e.g., CVPR, ICCV/ECCV, RAL, ICRA).

#LI-DS5

#LD

 

Full-time regular employee offer package:

Pay within range listed + Bonus + Benefits + Equity

 

Temporary employee offer package:

Pay within range listed above + temporary benefits package (applicable after 60 days of employment)

 

Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.

 

###

 

Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know. 

Similar Jobs

23 Seconds Ago
Hybrid
145K-180K Annually
Entry level
145K-180K Annually
Entry level
Fintech • Mobile • Payments • Software • Financial Services
Build and operate highly available backend services for Wise’s North America Account products. Own projects end to end, from customer problem discovery through implementation, rollout, measurement, and ongoing reliability improvements. Develop resilient distributed systems using Java, Spring Boot, microservices, databases, and APIs while balancing customer experience, compliance, security, and technical quality. Collaborate cross-functionally, improve engineering practices, and mentor teammates.
Top Skills: APIsAsynchronous ProcessingDistributed SystemsJavaMicroservicesObservabilityRelational DatabasesSpring Boot
A Minute Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
227K-272K Annually
Expert/Leader
227K-272K Annually
Expert/Leader
eCommerce • Healthtech • Kids + Family • Retail • Social Media
Own and evolve AWS infrastructure, Kubernetes, Terraform, CI/CD, developer tooling, observability, security defaults, backup recovery, and incident response. Build reliable automation and self-service workflows, establish SLOs and actionable alerting, support engineers across environments, lead platform initiatives, improve security and reliability practices, and mentor engineers serving millions of users.
Top Skills: Amazon EksAmazon RdsAWSCircleCICronitorDatadogGithub ActionsKubernetesMySQLPagerdutyRedisRubyRuby On RailsSentrySidekiqTerraform
6 Minutes Ago
In-Office
78K-162K Annually
Senior level
78K-162K Annually
Senior level
Other • Utilities
Leads business analysis and data-driven decision support across teams. Develops dashboards, reports, self-service tools, and standardized reporting structures. Applies SQL, quantitative modeling, data visualization, and advanced analytics to identify insights, prioritize resources, improve business performance, and enhance customer experiences. Manages stakeholders and analytical projects while delivering recommendations to enterprise leadership.
Top Skills: GoPower BIPythonRSQLTableau

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account