Top Data Engineer Jobs in Boston, MA

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).

Build and support high-performance data solutions, design and operate ETL pipelines and data warehouses, monitor production analytics tools, troubleshoot system issues, collaborate with product teams, and support TechOps for analytics infrastructure.

Lead design and hands-on delivery of a next-generation data platform and pipelines (batch, ELT, near-real-time) powering BI, experimentation, and ML. Own platform architecture, data modeling, governance, observability, and mentor engineers while modernizing legacy systems and driving AI-first data engineering practices across cross-functional teams.

Lead architecture and delivery of a cloud-native, petabyte-scale data platform: define technical roadmap, mentor engineers, build ETL/ELT pipelines, enable real-time streaming, implement Iceberg table format, optimize Snowflake/Redshift/Athena compute, and integrate observability with Splunk.

Lead end-to-end data engineering on GCP: design scalable data platforms and architectures (lake/lakehouse/warehouse), build and optimize BigQuery/Spark pipelines, ensure data quality/security, enable ML workflows with Data Science, mentor engineers, and own delivery and performance.

Design, build, and optimize scalable AWS-based data pipelines, data lakes, and warehouses. Migrate legacy systems, enforce data quality/security/governance, implement ETL/ELT and big-data solutions, adopt CI/CD and IaC, collaborate with stakeholders, and provide technical leadership and troubleshooting.

Design, build, modernize, and maintain operational and analytical data capabilities for Wealthscape Reporting, Analytics and Insights. Perform solution design, data analysis, ETL development, and production rollouts using Snowflake, AWS, cloud databases, and CI/CD pipelines. Collaborate across teams in a fast-paced financial services environment.

Design, build, and maintain scalable data pipelines on AWS using EMR, Spark, and PySpark. Optimize EMR clusters and Spark jobs, implement ETL/ELT processes, ensure data quality, automate ingestion, and collaborate with data scientists and analysts. Document infrastructure, participate in code reviews, and monitor performance and costs.

Design, build, and maintain operational and analytical data platform capabilities using Java Spring Batch, Python, AWS, Oracle, and Snowflake. Deliver end-to-end development, production rollout, and support; improve financial product data quality, modeling, and SQL performance; collaborate with business partners and squads.

Design, build, and maintain ETL/ELT data pipelines and orchestration using Airflow, Python, and PySpark. Develop custom connectors, implement DataOps and CI/CD for data workflows, monitor and troubleshoot pipelines, validate data quality, and document processes while collaborating with cross-functional teams and supporting large-scale distributed data systems.

Build and maintain ingestion pipelines, Python services, and dbt models on AWS and Snowflake. Own operational on-call responsibilities, migrate pipelines to Airflow, contribute to CI/CD, collaborate with BI/Analytics, and mentor junior teammates.

Design, build, and maintain scalable data pipelines, lakes, and infrastructure using Databricks, Spark, Python, and AWS. Collaborate with ML engineers, data scientists, and analysts to deliver data products, ensure data quality and governance, implement DevOps/SDLC practices, mentor junior engineers, and evaluate new data technologies.

Design, build, and maintain scalable batch and real-time data pipelines and platform components. Produce curated datasets, ensure data quality, observability, and lineage, and collaborate cross-functionally to deliver data products that support analytics, experimentation, and ML.

Build and maintain data pipelines, applications, workflows, and governance in Palantir Foundry. Apply industrial engineering and operations research methods to analyze depot/MRO capacity, throughput, and bottlenecks, integrate ERP/MRO data into simulation models, deliver decision-support briefings, and support platform monitoring, automations, and client engagement.

Build, optimize, deploy, and support cloud-based SQL Server and analytics lakehouse solutions in Azure. Troubleshoot performance, implement data protection and governance, create data pipelines, mentor junior engineers, and collaborate with product, compliance, and clinical teams to support real-time clinical workflows and regulatory reporting.

Design, build, and optimize scalable AWS-based data pipelines and ETL to produce analytics-ready datasets. Support AI infrastructure and inference initiatives, collaborate with architects and engineers, develop high-performance data processing solutions, and manage projects through full lifecycle while improving reliability and operational efficiency.

Lead design, implementation, and migration of the enterprise data warehouse from BigQuery to Databricks. Build scalable ETL/ELT pipelines, data models, governance, quality monitoring, and performance optimizations while partnering with cross-functional teams and mentoring colleagues.

Build, operate, and optimize large-scale data pipelines and warehouse schemas. Own Airflow orchestration, AWS-based data security (Lake Formation), automated data quality, and production incident resolution. Partner with stakeholders, mentor engineers, and drive DataOps best practices for performance, cost efficiency, and governance.

Develop and optimize SQL-based data solutions and ETL/ELT pipelines using DBeaver. Troubleshoot data quality and performance, validate data prior to production, document transformations, and collaborate with application owners and business stakeholders. Support testing, deployments, and knowledge transfer in a healthcare data environment.

Lead product vision and backlog for card servicing experiences; collaborate with UX, architects, and vendors; model architecture with UML; implement CI/CD; ensure API integrations, security, compliance, and testing; use analytics and tooling to measure progress and performance.

Design, build, and optimize Snowflake-based data warehouses and dbt transformation pipelines. Develop scalable ETL/ELT ingestion, tune SQL and warehouse performance, implement data quality/testing (dbt tests), and maintain CI/CD and version-controlled data workflows while collaborating with analysts, data scientists, and stakeholders.

Operate and own real-time, petabyte-scale streaming pipelines (Pub/Sub/Kafka, Dataflow/Beam), integrate LLMs/Vertex AI enrichment, build monitoring/alerting, respond to incidents, ensure data integrity, and collaborate with Product and Analysts to improve observability and reliability.

Lead graph data engineering to design, implement, and scale Neo4j-based graph platforms. Build graph models, ingestion pipelines (batch and streaming), integrate graphs with analytics/ML, establish governance, and enable graph-driven business use cases like fraud detection and Customer 360.

Lead design, build, and operate real-time, Flink-based streaming data platforms. Develop low-latency, stateful pipelines, enforce event schemas/contracts, ensure fault tolerance and observability, mentor engineers, and partner with architecture and compliance teams to deliver resilient streaming solutions for banking use cases.

Lead architecture and implementation of a large-scale analytics stack: design foundational pipelines, establish modeling/orchestration standards, integrate AI-assisted engineering tools, translate business questions into version-controlled data models, partner with stakeholders to define metrics and data contracts, migrate logic into maintainable pipelines, and optimize cloud warehouse performance for scale.