HarbourVest Partners Logo

HarbourVest Partners

Lead Data Engineer

Posted 11 Days Ago
In-Office
Boston, MA
Expert/Leader
In-Office
Boston, MA
Expert/Leader
The Lead Data Engineer will transform data infrastructure using Microsoft data stack and Azure, lead technical teams, design models, and implement solutions.
The summary above was generated by AI

Job Description Summary

For over forty years, HarbourVest has been home to a committed team of professionals with an entrepreneurial spirit and a desire to deliver impactful solutions to our clients and investing partners. As our global firm grows, we continue to add individuals who seek a collaborative, open-door culture that values diversity and innovative thinking.

In our collegial environment that’s marked by low turnover and high energy, you’ll be inspired to grow and thrive. Here, you will be encouraged to build on your strengths and acquire new skills and experiences.

We are committed to fostering an environment of inclusion that promotes mutual respect among all employees. Understanding and valuing these differences optimizes the potential of both the individual and the firm.

HarbourVest is an equal opportunity employer.

This position will be a hybrid work arrangement, which translates to 2-3 days minimum per week in the office.

The data architect will work toward the transformation of our firm’s data infrastructure, primarily using the Microsoft data stack on prem and in Azure.

The resource joining us will partner with product owners, data owners, project managers, business users, data engineers, and infrastructure engineers to form complete end-to end-solutions. The resource will enjoy working in an evolving, fast-paced environment, and bring a work style marked by high energy, flexibility, quick learning, and collaboration.

The ideal candidate is someone who has:
  • Successful track record delivering on data-platform projects of significant scale and complexity, involving modern data platform implementations (data lakes, data lakehouses, logical data warehouses, etc.)
  • Expertise in developing, presenting, and implementing data models aligned with the needs of business applications
  • Confidence and skill in building and communicating data-flow schematics understandable to both business and technical teams
What you will do:
  • Partner with cloud engineers to design and implement the Azure-based and Snowflake-based resources supporting development, QA, UAT, and production environments
  • Analyze business and technical requirements as basis for delivering sophisticated conceptual, logical, and physical data models
  • Prepare data-flow schematics at multiple levels of detail, indicating the pros and cons of alternative design patterns
  • Design and build data validations, transformations, normalizations, reports and extracts, and integration processes, using Azure and Snowflake data stacks
  • Create and implement CI/CD pipelines
  • Organize work and adhere to thorough work tracking, using Agile techniques
  • Coordinate and contribute to the technical work of a team of 4-6 resources, including contractors
What you bring :
  • Advanced SQL and Python knowledge
  • Proficiency in Azure Data Environment (Synapse, Databricks, Data Factory, Azure DevOps), plus related capabilities in Snowflake
  • In-depth experience with data modeling tools and knowledge of sophisticated data modeling techniques/approaches
  • Highly collaborative attitudes and work style; welcoming the inputs of others
  • Confidence and skill to document work items and explain deliverables, to enhance overall team productivity
  • Capability to balance demands of scope, schedule, and budget
  • Demonstrable experience as a technical leader
Education Preferred:
  • Bachelor's degree
Experience
  • 10-12 Years

#LI-Hybrid

Top Skills

Azure
Azure Devops
Data Factory
Databricks
Python
Snowflake
SQL
Synapse
HQ

HarbourVest Partners Boston, Massachusetts, USA Office

One Financial Center, , MA , US, Boston, MA, United States, 02111

Similar Jobs

8 Days Ago
Hybrid
4 Locations
176K-241K Annually
Mid level
176K-241K Annually
Mid level
Fintech • Machine Learning • Payments • Software • Financial Services
As a Lead Data Engineer, you'll develop and support technical solutions, work on data-driven projects using various technologies, and collaborate with Agile teams.
Top Skills: AWSCassandraEmrGCPGurobiHadoopHiveJavaKafkaMapreduceAzureMongodbMySQLNoSQLPythonRdbmsRedshiftScalaSnowflakeSpark
An Hour Ago
Hybrid
4 Locations
205K-257K Annually
Senior level
205K-257K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
The Senior Lead Data Engineer at Capital One will lead teams in developing data solutions, leveraging cloud technologies and machine learning to drive transformation in financial empowerment.
Top Skills: AWSEmrGCPGurobiHadoopHiveJavaKafkaLinuxMapreduceAzureMySQLNoSQLPythonRedshiftScalaSnowflakeSparkUnix
13 Days Ago
Hybrid
Boston, MA, USA
141K-176K
Senior level
141K-176K
Senior level
Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Responsible for leading data science projects, building models, and enhancing customer engagement through data analysis and collaboration with teams.
Top Skills: PythonRSQL

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account