NVIDIA Logo

NVIDIA

Senior System Software Engineer - Data Platform Observability

Posted 2 Days Ago
In-Office or Remote
Hiring Remotely in Austin, TX
184K-288K Annually
Senior level
In-Office or Remote
Hiring Remotely in Austin, TX
184K-288K Annually
Senior level
Lead design and implementation of a scalable observability and data platform: high-performance telemetry ingestion, data governance and policy enforcement, modern UX/APIs, cost-optimized tiered storage, and automation for lifecycle and pipeline orchestration. Collaborate with cross-functional teams to provide operational and strategic data for debugging, performance, and reliability.
The summary above was generated by AI

NVIDIA’s Hardware Infrastructure organization is seeking a Senior System Software Engineer to lead the evolution of our next-generation Data & Observability Platform. We serve and collaborate directly with NVIDIA’s rapidly growing AI, HW, and SW engineering and research teams across the company. We are looking for a Full-Stack technical lead who is not afraid to dig deep into infrastructure. You will be the technical anchor for our Observability stack, driving the transition to a modern tooling that is best fit for our customers and use cases. You will build the centralized platform that thousands of NVIDIA engineers rely on to visualize chip telemetry, debug distributed pipelines, and ensure platform reliability.

What you’ll be doing:

  • Architect High-Performance Ingestion: Design and build centralized telemetry pipelines capable of handling massive scale. You will solve global latency challenges by implementing modern, push-based edge collection architectures to replace legacy proxy models.

  • Build Policy Enforcement Systems: Design and implement the technical infrastructure for data governance,  policy engines, access control enforcement points,  secure credential management, and audit logging. Looking for someone who has built governance controls into a platform, not just administered them.

  • Focus on User Experience: Develop a modern, web interface and APIs  that unify distinct observability signals into a seamless, consolidated user experience.

  • Optimize Storage & Cost: Implement cost-effective tiered storage architectures. You will define strategies for routing high-volume data to cold storage solutions to reduce costs while maintaining multi-year data retention.

  • Drive Platform Automation: Architect workflow orchestration systems to automate platform maintenance, data lifecycle management, and complex pipeline operations.

  • Work in a diverse team to provide operational and strategic data to empower our engineers and researchers to improve performance, productivity, and efficiency to continuously improve quality, workloads, and processes through better observability.

What we need to see:

  • BS or MS in Computer Science, Electrical Engineering, or related field (or equivalent experience).

  • 8+ years of full-stack software development experience with a focus on Data Platforms or Infrastructure Tools.

  • Strong Full-Stack Fluency: Proficiency in high-performance backend systems programming and modern frontend web frameworks for building responsive user interfaces (Python, JS, Java, Rust, Go, React, or similar).

  • Observability Expertise: Experience with observability platforms such as Apache Spark, Elastic/Open Search, Grafana, Prometheus, and other similar open-source tools. Hands-on experience operating and extending the Grafana Ecosystem or ELK stack at scale. You understand the internals of time-series databases and inverted indexes.

  • Infrastructure-as-Code: Experience deploying complex stateful services on Kubernetes using Helm, Terraform, or Ansible.

  • Streaming & Storage: Familiarity with event streaming and modern data lake formats 

Ways to stand out from the crowd:

  • Experience writing Custom Grafana data source Plugins or backend plugins in Go.

  • Background with migrating legacy monoliths to microservices or Vector-based pipelines.

  • Experience with OpenTelemetry (OTEL) collector configuration, writing custom processors, or instrumentation SDKs.

  • Background in Data Governance, including implementation of Policy-as-Code or compliance frameworks in a regulated environment.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 15, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Similar Jobs

24 Minutes Ago
Remote
10 Locations
90K-120K Annually
Senior level
90K-120K Annually
Senior level
Productivity • Software • App development • Automation
Own and improve global HR operations across employee lifecycle, HRIS data quality, leave and benefits administration, workflow automation, reporting, compliance tracking, and cross-functional process optimization.
Top Skills: AdpAPIsExcelHrisPower AutomatePower BIServicenowWorkato
25 Minutes Ago
Remote or Hybrid
TX, USA
Mid level
Mid level
Financial Services
Lead end-to-end process change in Fraud Consumer Protection Services: discover current-state issues, design future-state workflows with controls, assess people/process/technology impacts, manage stakeholders and delivery cadence, and use LLM/GenAI responsibly to accelerate documentation and analysis.
Top Skills: Generative AiLlm
41 Minutes Ago
Easy Apply
Remote
USA
Easy Apply
140K-162K Annually
Senior level
140K-162K Annually
Senior level
Big Data • Healthtech • HR Tech • Machine Learning • Software • Telehealth • Big Data Analytics
Own end-to-end GTM enablement for Client Management: design and run onboarding, training, certification, change management, and rollouts. Collaborate with cross-functional teams, manage enablement content (LMS, Drive), and track KPIs like ramp time, retention, and client satisfaction to drive adoption and growth.
Top Skills: Google DriveLms

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account