SHIELD Logo

SHIELD

Staff Deep Learning Engineer, State Estimation (R5785)

Posted 3 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in USA
Mid level
Remote
Hiring Remotely in USA
Mid level
Develop deep learning and 3D computer vision models for state estimation and vision-based navigation in GPS-denied autonomous systems. Responsibilities include data curation, annotation strategy, reproducible training workflows, model evaluation, geometric integration, failure analysis, and deployment optimization for onboard compute. The role partners with state estimation, software, systems, deployment, and flight-test teams to deliver tested components for the Hivemind SDK.
The summary above was generated by AI

Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit www.shield.ai. Follow Shield AI on LinkedIn, X, Instagram, and YouTube. 

 
Job Description:
 

Join Shield AI’s Hivemind SDK State Estimation & Vision team to build deep learning capabilities that help autonomous systems understand their motion and localize in the world when GPS is unavailable or unreliable.

You will work at the intersection of deep learning, 3D computer vision, and geometric estimation, developing learned components for vision-based navigation. You will own the model development pipeline—from selecting tools, defining annotation needs, and cleaning data through training, evaluation, integration support, and deployment recommendations.

Hands-on experience with Deep Learning and 3D computer vision and geometry is required; prior experience specifically in vision-based navigation is optional.

What you'll do:

  • Develop and evaluate models for tasks such as feature detection and matching, visual correspondence, depth estimation, relative pose estimation, and image-to-map localization.

  • Combine learned visual representations with geometric methods to improve localization accuracy, robustness, and recovery under challenging conditions.

  • Own data preparation and supervision strategies, including dataset curation, annotation requirements, labeling tools, automated quality checks, and coverage analysis.

  • Select and integrate deep learning tools and build reproducible training workflows, including experiment tracking, configuration management, and dataset and model versioning.

  • Design evaluations that measure both model performance and downstream localization outcomes across changes in lighting, viewpoint, altitude, terrain, weather, and sensor characteristics.

  • Analyze failures and use controlled experiments to prioritize improvements to data, supervision, models, and integration.

  • Partner with state estimation engineers to integrate learned measurements and confidence estimates into VIO and terrain-relative navigation systems.

  • Profile models against onboard compute, memory, and latency constraints, and work with deployment engineers on optimization and runtime validation.

  • Deliver tested, documented components and interfaces for Hivemind SDK, collaborating with software, systems, and flight test teams.

Required qualifications:

  • M.S. in Aerospace Engineering, Electrical Engineering, Robotics, Computer Science, or a related field; minimum 4+ years of related professional work experience with an M.S. degree, or 2+ years with a Ph.D.

  • Hands-on experience designing, training, debugging, and evaluating models using PyTorch or an equivalent framework, including architecture selection, loss design, optimization, and augmentation that preserves geometric consistency.

  • Strong foundations in camera models, coordinate transformations, projective geometry, and multi-view geometry, with practical experience in one or more fields: vision-based navigation, visual geolocation, Structure from Motion (SfM), SLAM, 3D reconstruction, depth estimation or similar fields. Expertise in every area is not required.

  • Strong Python skills and experience writing maintainable, reusable software. Demonstrated ability to take a computer vision capability from problem definition and raw data through training, evaluation, and integration readiness.

  • Experience building pipelines for sensor data ingestion, cleaning, filtering, deduplication, and dataset versioning.

  • Ability to select and integrate development tools and build reproducible training workflows, including configuration management, experiment tracking, checkpointing, and GPU performance troubleshooting.

  • Experience designing benchmarks, preventing data leakage across related sequences or locations, analyzing performance across operating conditions, and connecting model metrics to downstream geometric or localization accuracy.

  • Ability to profile inference latency and memory use, document model interfaces and preprocessing, assess accuracy–compute tradeoffs, and advise deployment engineers on export, precision, and runtime optimization.

  • Ability to communicate assumptions, experimental findings, and design tradeoffs clearly and translate research into working software.

Preferred qualifications:

  • Experience with aerial imagery, geospatial data, elevation maps, or matching observations across viewpoint, lighting, season, or sensor modality

  • Experience with model export, quantization, TensorRT, ONNX, or deployment on embedded compute platforms.

  • Experience validating perception or robotics systems on physical platforms.

  • Relevant publications, open-source contributions, or demonstrated delivery of production computer vision systems, familiar with methods including:

    • feature correlation, correlation or cost volumes, and matching methods for correspondence, stereo, optical flow, or localization.

    • learning priors over scene geometry, depth, motion, or appearance to improve estimation under sparse, ambiguous, or degraded observations.

    • applying diffusion models or flow matching to computer vision, geometric inference, or conditional generation.

  • Experience in aerospace and / or defense industry.

You do not need every nice-to-have to succeed in this role. We welcome engineers with strong Deep Learning and 3D vision foundations who are excited to develop expertise in state estimation and navigation to apply.

#LI-KC3

#LD

 

Full-time regular employee offer package:

Pay within range listed + Bonus + Benefits + Equity

 

Temporary employee offer package:

Pay within range listed above + temporary benefits package (applicable after 60 days of employment)

 

Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.

 

###

 

Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know. 

Similar Jobs

17 Minutes Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
227K-272K Annually
Expert/Leader
227K-272K Annually
Expert/Leader
eCommerce • Healthtech • Kids + Family • Retail • Social Media
Own and evolve AWS infrastructure, Kubernetes, Terraform, CI/CD, developer tooling, observability, security defaults, backup recovery, and incident response. Build reliable automation and self-service workflows, establish SLOs and actionable alerting, support engineers across environments, lead platform initiatives, improve security and reliability practices, and mentor engineers serving millions of users.
Top Skills: Amazon EksAmazon RdsAWSCircleCICronitorDatadogGithub ActionsKubernetesMySQLPagerdutyRedisRubyRuby On RailsSentrySidekiqTerraform
25 Minutes Ago
Remote or Hybrid
Pennsylvania, USA
159K-268K Annually
Senior level
159K-268K Annually
Senior level
Automotive • Hardware • Internet of Things • Mobile • Software • App development • PropTech
Principal technical authority for the myQ Residential experience, owning mobile architecture, real-time client-to-server communication, distributed services, and multi-year technical direction. The role leads architecture decisions, reliability and observability improvements, cross-team system design, technical standards, incident analysis, mentoring, hiring, and AI-assisted development practices. It requires extensive mobile, real-time systems, cloud, and technical leadership experience for consumer-scale connected-device products.
Top Skills: AndroidAWSAzureBleCross-Platform Mobile FrameworksiOSIso 27001MqttWebsocketsWi-Fi
30 Minutes Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Drive new-business revenue for ServiceNow’s SaaS offerings within the Business Services vertical. Responsibilities include enterprise account and territory planning, prospect research, C-suite relationship development, account strategy, client advising on IT roadmaps, coordinating specialists and partners, negotiating deals, and achieving sales quotas.
Top Skills: AISaaS

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account