Collective Health Logo

Collective Health

Lead Data Engineer

Posted 16 Days Ago
In-Office
3 Locations
168K-210K Annually
Senior level
In-Office
3 Locations
168K-210K Annually
Senior level
Lead the development of scalable data solutions, mentor junior staff, optimize data pipelines, and ensure data governance and security.
The summary above was generated by AI

At Collective Health, we’re transforming how employers and their people engage with their health benefits by seamlessly integrating cutting-edge technology, compassionate service, and world-class user experience design.

We deliver a connected healthcare experience for over 600,000 members and 70+ companies nationwide who want the best for their employees. Our data engineering team is pivotal in this mission, constructing and managing scalable, high-performance data pipelines and architectures that drive analytics, operational workflows, and machine learning applications.

As a Lead Data Engineer, you will drive the development of robust, scalable, and efficient data solutions, collaborating closely with cross-functional teams. You will provide thought leadership on data architecture, mentor junior engineers, and optimize our data ecosystem for performance and reliability.

What you'll do:
  • Architect Scalable Data Solutions - Design, develop, and optimize large-scale data pipelines using Spark (PySpark, Scala), Databricks, and distributed data processing frameworks.
  • Advance Data Modeling & Architecture - Lead the design and evolution of data models to support analytical, operational, and machine-learning requirements.
  • Enhance Data Performance & Reliability - Improve data processing performance, scalability, and reliability, while ensuring data quality and governance.
  • Drive Cross-Functional Collaboration - Partner with Product, Engineering, Data Science, and Analytics teams to deliver high-impact data solutions that generate actionable business and clinical insights.
  • Mentor & Provide Technical Leadership - Guide junior and mid-level engineers, conduct code reviews, and establish best practices in data engineering.
  • Ensure Data Governance & Security - Implement robust security, privacy, and compliance measures for sensitive healthcare data, ensuring adherence to industry regulations.
  • Influence Data Strategy - Provide input on data infrastructure decisions, emerging technologies, and process improvements.
To be successful in this role, you'll need:
  • 8+ years of data engineering experience in fast-paced, data-driven environments.
  • Expertise in building scalable ETL pipelines with Spark (PySpark or Scala) and SQL.
  • Deep understanding of data architecture, schema design, and dimensional modeling for analytics and machine learning.
  • Proficiency in distributed systems such as Spark, Databricks, or Snowflake.
  • Experience with event-driven architectures and streaming platforms like Kafka or Kinesis.
  • Excellent communication skills – ability to collaborate cross-functionally and translate complex technical concepts into business impact.
  • Mentorship experience – experience guiding engineers and fostering a collaborative, inclusive team culture.
  • Security-first mindset – familiarity with data privacy, encryption, and compliance in healthcare or other regulated industries is a plus.
Pay Transparency Statement 

This is a hybrid position based out of one of our offices: San Francisco, CA, Plano, TX, or Lehi, UT. Hybrid employees are expected to be in the office two days per week. #LI-hybrid 

The actual pay rate offered within the range will depend on factors including geographic location, qualifications, experience, and internal equity. In addition to the salary, you will be eligible for stock options and benefits like health insurance, 401k, and paid time off. Learn more about our benefits at https://jobs.collectivehealth.com/benefits/.

San Francisco, CA Pay Range
$168,000$210,000 USD
Lehi, UT Pay Range
$134,500$168,000 USD
Plano, TX Pay Range
$147,800$185,500 USD
Why Join Us?
  • Mission-driven culture that values innovation, collaboration, and a commitment to excellence in healthcare
  • Impactful projects that shape the future of our organization
  • Opportunities for professional development through internal mobility opportunities, mentorship programs, and courses tailored to your interests
  • Flexible work arrangements and a supportive work-life balance

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. Collective Health is committed to providing support to candidates who require reasonable accommodation during the interview process. If you need assistance, please contact [email protected].

Privacy Notice

For more information about why we need your data and how we use it, please see our privacy policy: https://collectivehealth.com/privacy-policy/.

Top Skills

Databricks
Kafka
Kinesis
Pyspark
Scala
Snowflake
Spark
SQL

Similar Jobs

10 Days Ago
In-Office
40 Locations
150K-224K Annually
Senior level
150K-224K Annually
Senior level
Legal Tech • Software
Lead the development of a data platform, enhancing data processing and query engines while mentoring team members and managing production issues.
Top Skills: DaskDockerHadoopJavaKubernetesPythonScalaSpark
16 Days Ago
In-Office or Remote
Provo, UT, USA
Junior
Junior
Information Technology
As a Data Engineer, you'll develop and optimize ETL processes, build reporting systems, and ensure data integrity using SQL Server technologies in a collaborative environment.
Top Skills: .NetC#CSSDhtmlDtsETLJavaScriptMicrosoft Sql ServerSql Server Reporting ServicesSsisT-SqlXML
An Hour Ago
Hybrid
Hill Air Force Base, UT, USA
119K-201K Annually
Senior level
119K-201K Annually
Senior level
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
The Senior Systems Engineer will assess and review requirements for the Sentinel weapon system, ensuring compliance and documenting discrepancies while collaborating with internal stakeholders.
Top Skills: DodafDoorsSysml

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account