Paul Hastings Logo

Paul Hastings

Senior Data Engineer

Posted Yesterday
In-Office
Boston, MA, USA
126K-195K Annually
Senior level
In-Office
Boston, MA, USA
126K-195K Annually
Senior level
Designs, builds, and maintains scalable Azure data pipelines and ELT frameworks using Databricks, SQL, Python, and PySpark. Implements Azure DevOps CI/CD, monitoring, security, infrastructure automation, and production support. Collaborates with BI teams on Power BI datasets, documents data solutions, participates in Agile delivery, and mentors junior engineers. The role requires strong data modeling, structured and semi-structured data expertise, performance tuning, and data governance awareness.
The summary above was generated by AI

Paul Hastings is a leading international law firm that provides innovative legal solutions to many of the world's top financial institutions and Fortune Global 500 companies. With a strong presence throughout the U.S., Asia, Europe, Latin America, and the Middle East, we have the global reach and extensive capabilities to provide personalized service wherever our clients’ needs take us. As one of the world’s leading law firms, we seek dynamic individuals who share our commitment to service, innovation, and professional growth.



Job TitleSenior Data Engineer

LocationBoston, Chicago, Dallas, Houston, Los Angeles, New York, San Francisco, Washington, D.C.

Regular/TemporaryRegular

Job Description SummaryWe have an opening for a Senior Data Engineer.
The Senior Data Engineer is responsible for designing, building and maintaining modern data pipelines and data integration solutions in the Azure Cloud. This role enables enterprise analytics by delivering clean, timely and well-structured data to platforms such as Power BI. The Senior Data Engineer collaborates closely with architects, analysts, and business stakeholders to deliver scalable, secure and efficient data solutions using Azure Databricks, and Azure DevOps.

Job Description

In this capacity, the Senior Data Engineer will:


  • Design, build and manage scalable data pipelines using Azure Databricks;
  • Develop ELT frameworks for ingesting and transforming structured and semi-structured data from on-prem and cloud sources – including cloud based API’s;
  • Implement robust DevOps pipelines for code versioning, testing, deployment and monitoring using Azure DevOps;
  • Ensure pipeline performance, reliability and observability using tools like Azure Monitor and Log Analytics;
  • Collaborate with BI teams to support Power BI datasets and ensure optimal data model performance;
  • Automate environment setup, configuration and permissions using infrastructure-as-code where possible;
  • Write modular, testable code in SQL, Python or PySpark and manage version control with Git;
  • Support production operations, root cause analysis and performance tuning;
  • Understand data sources and data relationship models.
  • Maintain technical documentation for pipelines, data mappings and deployment processes;
  • Work as part of an Agile delivery team, participating in sprints, retrospectives and code review; and
  • Mentor junior data engineers and promote best practices in CI/CD, version control, and release management.

Proficiencies:


  • Advanced proficiency in Azure Databricks;
  • Experience building and managing CI/CD pipelines in Azure DevOps for data solutions;
  • Strong SQL and ELT experience; familiarity with schema design (e.g., star, snowflake, denormalized);
  • Hands-on expertise with PySpark and Databricks notebooks, including Delta Lake workflows;
  • Familiarity with Git, branching strategies and repository management within Azure Repos;
  • Understanding of data security and privacy best practices in Azure (RBAC, managed identities, encryption);
  • Experience with Power BI dataflows, datasets and refresh configuration (preferred);
  • Familiarity with data cataloging and governance tools (e.g., Microsoft Purview) a plus; and
  • Experience with Agile tools such as Azure Boards or JIRA.

Qualifications:


  • Bachelor’s degree in Computer Science, Engineering or related field (required);
  • 7+ years of data engineering or BI development experience;
  • 3+ years building data solutions in Microsoft Azure Cloud;
  • 2+ years using Azure DevOps for automated builds, releases and pipeline orchestration;
  • Proven experience working with structured and semi-structured data (Parquet, JSON, Avro); and
  • Experience in professional services, legal, or financial environments preferred.

The salary wage range for Boston that we expect to pay for this position is a minimum of $134,500 and a maximum of $194,750 annually. The actual pay wage may vary based on experience or other relevant factors.


The salary wage range for Washington, DC that we expect to pay for this position is a minimum of $125,800 and a maximum of $182,450 annually. The actual pay wage may vary based on experience or other relevant factors.


The salary wage range for Los Angeles that we expect to pay for this position is a minimum of $125,800 and a maximum of $182,450 annually. The actual pay wage may vary based on experience or other relevant factors.


The salary wage range for San Francisco that we expect to pay for this position is a minimum of $134,500 and a maximum of $194,750 annually. The actual pay wage may vary based on experience or other relevant factors.


The salary wage range for New York that we expect to pay for this position is a minimum of $134,500 and a maximum of $194,750 annually. The actual pay wage may vary based on experience or other relevant factors.

Employees will be provided with an excellent career opportunity in a collaborative environment, in addition to a generous total compensation package with the opportunity to earn bonuses based on individual contribution and firm profitability.

The actual salary offered will depend on a variety of factors, including without limitation, the qualifications of the individual applicant for the position, years of relevant experience, level of education attained, certifications or other professional licenses held, and if applicable, the location in which the applicant lives and/or from which they will be performing the job. This role is exempt meaning it is not overtime pay eligible.

Eligible employees can participate in the Firm’s comprehensive benefits program, which include the following:


  • Medical, Dental, Vision, Life/AD&D, Long Term Care, and Short- and Long-Term Disability

  • Flexible Spending Accounts and Health Savings Account

  • Healthcare Concierge and Advocacy

  • Lifestyle Spending Account

  • Voluntary 401(k) Plan and Profit Sharing

  • 10 Paid Holidays per year and a generous PTO Program

  • Family Support including Paid Parental Leave, Fertility Benefits, Breast Milk Shipping, Back-up Child Care, Elder Care, and Tutoring

  • Wellbeing programs (Employee Assistance Program, Relationship Support, Mental Health, Menopause and Midlife Health and Well-Being Events)

  • Retirement Plan Consulting

  • Anniversary Bonus Program

  • Professional Development Programs

  • Transportation and Commuter Benefits

  • International Travel Insurance

  • Critical Illness, Hospital Indemnity and Accident Insurance

  • Auto/Home/Pet Insurance

  • Prepaid Legal Insurance

  • Employee Discounts

  • And More!


The Firm fosters an open and inclusive work environment that enables us to provide clients with the innovative thinking of teams rich in talent, experience and creativity. We regularly host programs intended to increase cultural competencies and address key topics related to community, opportunity and inclusion. Learn more about our Global Inclusion initiatives here: Global Inclusion

Paul Hastings is an equal opportunity employer. Pursuant to applicable local law, we will consider qualified applicants with criminal histories in a manner consistent with the requirements of the relevant fair chance ordinance.

Similar Jobs

9 Days Ago
Remote or Hybrid
United States
165K-235K Annually
Senior level
165K-235K Annually
Senior level
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Build and maintain Databricks-based data platforms, including ingestion, transformation, storage, governance, data modeling, and serving pipelines. Establish medallion architecture standards, canonical data models, quality controls, lineage, schema evolution, and reliable batch or incremental processing. Improve pipeline observability, scalability, idempotency, and recoverability while moving curated data to systems such as ClickHouse. Collaborate across application and analytics teams to create durable, governed production datasets.
Top Skills: Amazon AuroraAmazon RdsApache AirflowSparkBigQueryCdcClickhouseCloud Object StorageDatabricksDelta LakeIamOpenmetadataPostgresSnowflakeUnity Catalog
13 Days Ago
Remote or Hybrid
United States
Senior level
Senior level
AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech • SEO
Build and support scalable data platforms and pipelines, leading migrations such as Snowflake to BigQuery and transitioning reporting to Looker. Responsibilities include data architecture, ETL/ELT, API and marketing integrations, data quality, production troubleshooting, warehousing, performance optimization, and platform modernization. The role partners with analytics and business teams, owns projects through production, documents solutions, and provides technical guidance.
Top Skills: AWSAzureBigQueryConfluenceDraw.IoGCPGitJIRAKafkaLookerLucidchartMiroModeNotionPower BIPythonSnowflakeSparkSQLTableauTalend
10 Days Ago
Hybrid
92K-154K Annually
Senior level
92K-154K Annually
Senior level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Designs, builds, and optimizes enterprise data pipelines, architectures, and applications supporting financial consolidation, planning, forecasting, reporting, and analytics. Develops ETL/ELT workflows, data models, quality checks, dashboards, and integrations across cloud and relational platforms. Manages projects, partners with Finance and technology teams, improves processes, mentors junior staff, contributes to Agile planning, and evaluates emerging AI and data technologies. Rotational after-hours on-call availability may be required.
Top Skills: Amazon KinesisAmazon RedshiftApache AirflowAWSAzure SynapseClaudeDagsterDbtGitGithub CopilotInformaticaKafkaMicrosoft 365 CopilotMySQLPostgresPower BIPyTorchScikit-LearnSnowflakeSnowflake CortexSQLSQL ServerTableauTensorFlow

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account