Top Data Engineer Jobs in Boston, MA

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).

Build and maintain centralized pricing data infrastructure, scalable workflows, and data pipelines; integrate AI capabilities; deliver pricing tools, reporting, and governance to support data-driven pricing and budgeting across the firm.

Lead design and implementation of scalable cloud data lakes, warehouses, and marts. Build ELT/ETL pipelines, apply Data Vault 2.0 and dimensional modeling, implement data quality, lineage, observability, and governance. Optimize Snowflake/Databricks/Synapse platforms, champion CI/CD and DataOps, mentor engineers, and enable AI/ML-ready data products through collaboration with architecture and product teams.

Build and maintain data pipelines, applications, workflows, and governance within Palantir Foundry. Apply industrial engineering and operations research methods to analyze depot, MRO, and supply chain processes, integrate ERP/MRO data into models, run capacity/throughput analyses, deliver decision‑support briefings, and support adoption of advanced analytics and digital engineering. Coordinate with stakeholders and support business development activities.

Lead Data Engineer responsible for designing data models, implementing data solutions, managing data pipelines, and collaborating with teams to drive technical initiatives.

Design, build, and optimize scalable Azure data platforms and lakehouse architectures. Develop ETL/ELT pipelines (PySpark/Spark SQL), enable Power BI datasets, implement CI/CD and IaC, ensure data governance/quality with Purview, support cloud migrations and production operations while collaborating with stakeholders and agile teams.

Lead design and delivery of scalable, secure cloud data pipelines and products. Translate requirements into architecture, apply advanced data modeling (Data Vault 2.0/dimensional), embed data quality, observability, security, and DataOps/CI-CD practices, optimize performance and cost, mentor engineers, and enable AI/ML-ready datasets within an agile DevSecOps model.

Design, build, and operate scalable cloud data pipelines and platforms (Azure preferred). Implement DevSecOps, CI/CD, automated testing, monitoring, performance tuning, and production readiness. Mentor engineers, drive operational excellence, and translate requirements into robust technical designs. Apply healthcare domain knowledge and collaborate in agile teams to deliver secure, reliable data products.

The Data Engineer will build and maintain data platforms, deploy pipelines, monitor transformations, and collaborate with Data Scientists and DevOps.

The Data Engineer I will build and maintain data pipelines, contribute to platform code, and integrate data sources while growing alongside senior engineers in a production-focused role.

Design, build, and optimize scalable Azure data platforms and lakehouse architectures. Develop ETL/ELT pipelines (PySpark, ADF, Fabric), enforce data governance and quality, enable Power BI reporting, lead cloud migration and CI/CD, and provide production support and performance tuning across enterprise data systems.

Support a Department of State implementation by assessing data policies and architecture, developing data pipelines, cleaning and integrating datasets (using Palantir Foundry), and producing analyses and visualizations. Create governance documentation, catalog data fidelity issues, coordinate with non-technical users, and recommend improvements to meet analytical and mission goals.

Build, maintain, and test data pipelines and ETL/ELT processes using Python and SQL; integrate Kafka streams; model data in Snowflake; implement CI/CD (GitHub Actions), logging, observability, and on-call support. Collaborate with senior engineers and application teams to enable self-service data ingestion and improve pipeline reliability and data preview capabilities.

Lead design and delivery of Databricks Lakehouse pipelines (Bronze/Silver/Gold) as a hands-on engineer. Build production SQL/Python/Spark pipelines, own Gold schema, implement data quality and alerts, onboard external data, manage contractors, and partner with decision intelligence and software teams to supply features for AI models and decisioning.

Design, build, and maintain cloud-based ELT data pipelines and analytics-ready datasets using Snowflake, dbt, and integration tools (Fivetran/Airbyte). Implement CDC and incremental loading, optimize Snowflake performance, enforce data quality and monitoring, create dimensional models for reporting, enable CI/CD for dbt projects, and collaborate with analytics and stakeholder teams to support reporting and advanced analytics.

Design, build, and maintain scalable data pipelines, data lakes, and databases; ingest and map customer financial datasets; monitor pipeline reliability; translate business requirements into data flows and analytical insights to ensure high-quality, usable data.

As a Data Engineer, you will design and maintain data pipelines, support DoD systems, and ensure data quality and compliance.

The role involves engineering modern data platforms, focusing on data ingestion, transformation, and storage while utilizing Azure services and MS Fabric, supporting an investment management firm.

Build and support high-performance data solutions, design and operate ETL pipelines and data warehouses, monitor production analytics tools, troubleshoot system issues, collaborate with product teams, and support TechOps for analytics infrastructure.

Lead design and hands-on delivery of a next-generation data platform and pipelines (batch, ELT, near-real-time) powering BI, experimentation, and ML. Own platform architecture, data modeling, governance, observability, and mentor engineers while modernizing legacy systems and driving AI-first data engineering practices across cross-functional teams.

Lead architecture and delivery of a cloud-native, petabyte-scale data platform: define technical roadmap, mentor engineers, build ETL/ELT pipelines, enable real-time streaming, implement Iceberg table format, optimize Snowflake/Redshift/Athena compute, and integrate observability with Splunk.

Design, build, and optimize scalable AWS-based data pipelines, data lakes, and warehouses. Migrate legacy systems, enforce data quality/security/governance, implement ETL/ELT and big-data solutions, adopt CI/CD and IaC, collaborate with stakeholders, and provide technical leadership and troubleshooting.

Lead end-to-end data engineering on GCP: design scalable data platforms and architectures (lake/lakehouse/warehouse), build and optimize BigQuery/Spark pipelines, ensure data quality/security, enable ML workflows with Data Science, mentor engineers, and own delivery and performance.

Design, build, modernize, and maintain operational and analytical data capabilities for Wealthscape Reporting, Analytics and Insights. Perform solution design, data analysis, ETL development, and production rollouts using Snowflake, AWS, cloud databases, and CI/CD pipelines. Collaborate across teams in a fast-paced financial services environment.

Design, build, and maintain ETL/ELT data pipelines and orchestration using Airflow, Python, and PySpark. Develop custom connectors, implement DataOps and CI/CD for data workflows, monitor and troubleshoot pipelines, validate data quality, and document processes while collaborating with cross-functional teams and supporting large-scale distributed data systems.