PA Consulting Logo

PA Consulting

Senior Data Engineer

Posted 7 Hours Ago
Be an Early Applicant
Hybrid
Boston, MA, USA
155K-180K Annually
Senior level
Hybrid
Boston, MA, USA
155K-180K Annually
Senior level
The Senior Data Engineer will manage and optimize data infrastructure, develop automated data pipelines, and ensure system reliability to drive healthcare advancements.
The summary above was generated by AI
Company Description

We believe in the power of ingenuity to build a positive human future. 

As strategies, technologies, and innovation collide, we create opportunity from complexity.

Our diverse teams of experts combine innovative thinking and breakthrough technologies to progress further, faster. Our clients adapt and transform, and together we achieve enduring results.

We are over 4,000 strategists, innovators, designers, consultants, digital experts, scientists, engineers, and technologists. And we have deep expertise in consumer and manufacturing, defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. 

Our teams operate globally from offices across the UK, Ireland, US, Nordics, and Netherlands.

PA. Bringing Ingenuity to Life

Job Description

Your day to day

We’re an innovation and transformation consultancy that believes in the power of ingenuity to build a positive-human future in a technology-driven world. Our diverse teams of experts combine innovative thinking with breakthrough-technologies to progress further, faster.

Are you ready to harness the power of data to drive advancements in healthcare? Are you passionate about both developing new capabilities and ensuring the optimization and reliability of existing data systems? Are you passionate about designing, building, and operating data infrastructure that plays a pivotal role in improving patient outcomes and shaping the future of medicine?

If you're seeking a rewarding career at the intersection of healthcare and technology, we invite you to be part of our dynamic team. This is a unique, multi-year, project-based opportunity to build and grow a clinical data registry platform over many years working with a dedicated team of collaborators and customers.

As a Data Engineer for our cutting-edge medical data registry, you'll be at the forefront of managing, optimizing, and expanding our data infrastructure, enabling critical insights that can positively impact patient outcomes. This role provides a dynamic mix of innovative new development—enhancements, optimizations, and Proofs of Concept—alongside meaningful hands‑on ownership of production pipelines, data flows, and platform operations.

You will contribute to system improvements while also owning the monitoring, troubleshooting, tuning, and day-to-day reliability of the existing data ecosystem. If you're excited about leveraging your data engineering skills to make a difference in the world of healthcare, we want to hear from you.

Qualifications

Qualifications

At least 8 years of industry working experience as a data engineer

  • Advanced SQL and Python
  • Expertise in the design and construction of Big Data Lakes and Data Warehouses capable of ingesting, standardizing, and serving billions of data rows spanning diverse datasets ranging from tens to hundreds
  • Experience building dynamic, metadata driven pipelines and analyses
  • Experience maintaining and supporting production data systems, including pipeline monitoring, troubleshooting, and delivering long‑term reliability and optimization enhancements
  • Building and managing fully automated data pipelines (ETL, ELT, ELTL) including:
    • Designing and building data interfaces to source systems
    • Combining and transforming data into the appropriate format for storage
    • Developing data sets for analytics purposes
    • Developing pipelines that can handle common issues/errors in a robust and automated way
    • Implementing data quality checks, observability, and cost/performance optimization
  • Cloud experience in Azure, AWS or GCP
  • Ability to balance enhancement work with operational responsibilities in a production environment

Preferred qualifications

  • Spark / PySpark experience highly preferable
  • Working in Agile and DevOps environments
  • Basic Python, Bash, or PowerShell for automation
  • Data modelling – Kimball, Data Vault, Star/Snowflake schema, Query-first etc.
  • Data visualisation in Power BI, Tableau, Qlik or similar
  • Architecting Data Platforms - designing BI/MI/Analytics solutions using Big Data, Relational or Streaming technologies
  • Experience with monitoring/observability tools (logging, alerting, pipeline health dashboards)
  • One or more of the following certifications:
    • Microsoft Certified: Azure Data Engineer Associate
    • AWS Certified Data Analytics - Specialty
    • GCP Professional Data Engineers

Additional Information

Life At PA encompasses our peoples' experience at PA. It's about how we enrich peoples’ working lives by giving them access to unique people and growth opportunities and purpose led meaningful work.

We are currently operating a discretionary hybrid working model which is designed to help you plan your work and your life. We want our people to come into the office at least two days a week.

Our purpose guides how we work with our clients and our teams, and support our communities, to deliver insight and impact, solving the world’s most complex challenges. We're focused on building a workplace that values human difference and diverse mindsets, and a culture of inclusion and equality that unlocks the potential in our people so everyone can be their best self.

Find out more about Life at PA here.

We are dedicated to supporting the physical, emotional, social and financial well-being of our people. Check out some of our extensive benefits:

The salary range for this role is between $155,000k - $180,000k

Benefits 

  • Group medical insurance 

  • Health Savings Account with company match 

  • Teladoc and informed Nurse line resources 

  • Long term care plan 

  • Group dental insurance 

  • Vision plan 

  • 401(k) Savings Plan with company profit sharing contribution 

  • Commuter and Parking tax-savings benefit 

  • 15 days paid vacation days with the opportunity to buy five additional days 

  • 10 paid Holidays plus 10 paid sick days 

  • Company and Voluntary income protection benefits 

  • Gym and health incentive reimbursement 

  • Pet and legal insurance Plans 

  • Employee Assistance Plan 

  • Annual performance-based bonus 

We’re committed to advancing equality. We recruit, retain, reward and develop our people based solely on their abilities and contributions and without reference to their age, background, disability, genetic information, parental or family status, religion or belief, race, ethnicity, nationality, sex, sexual orientation, gender identity (or expression), political belief veteran status, or other by any other range of human difference brought about by identity and experience. We welcome applications from underrepresented groups.

Adjustments or accommodations - Should you need any adjustments or accommodations to the recruitment process, at either application or interview, please contact us on [email protected]

#LI-JS1

Top Skills

AWS
Azure
Big Data Lakes
Data Warehouses
Elt
ETL
GCP
Power BI
Pyspark
Python
Qlik
Spark
SQL
Tableau

Similar Jobs

An Hour Ago
Hybrid
Boston, MA, USA
150K-450K Annually
Senior level
150K-450K Annually
Senior level
AdTech • Big Data • Digital Media • Software
The Senior Data Engineer will design and optimize large-scale batch and streaming data pipelines using Scala and Spark, oversee the data engineering lifecycle, and engage in technical discussions to improve system efficiency.
Top Skills: AirflowAws Ec2Aws EcsAws KinesisAws RdsAws S3DockerJavaJenkinsScalaSparkTerraform
4 Days Ago
Hybrid
Boston, MA, USA
114K-197K Annually
Senior level
114K-197K Annually
Senior level
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
The Senior Data Engineer will design and maintain data pipelines, develop workflows in Snowflake on AWS, and enhance CI/CD practices in a collaborative environment.
Top Skills: AWSPythonSnowflakeSQL
6 Days Ago
Hybrid
Boston, MA, USA
106K-197K Annually
Senior level
106K-197K Annually
Senior level
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
The Senior Data Engineer will enhance and modernize GRS financial data, build and support data pipelines, and collaborate with teams to provide data solutions. Responsibilities include optimizing data cubes, utilizing ETL tools, and mentoring others.
Top Skills: AWSErwinIdmcPostgresPower BIPythonSnowflakeSQLSQL ServerSsasSsrs

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account