Top Data Engineer Jobs in Boston, MA

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

The role involves architecting and improving data systems, defining governance standards, optimizing performance, and mentoring engineers in data engineering.

The role involves managing data infrastructure, building data pipelines, providing analytics to inform business decisions, and shaping AI workflows in the organization.

The Data Engineer role involves developing and maintaining data pipelines for forecasting in commercial real estate, ensuring data integrity and supporting analytics teams.

Build and maintain cloud cost monitoring, alerting, and optimization tooling. Develop automation, cost allocation/tagging, data pipelines, dashboards, and integrations with billing APIs. Support FinOps processes, implement cost guardrails, troubleshoot cost systems, participate in on-call rotation, and collaborate with senior engineers and product teams to drive cost-efficient infrastructure and reporting.

Lead the evolution of data platform by designing scalable pipelines, improving data processes, mentoring teams, and modernizing data architecture.

Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.

The Data Engineer will develop data pipelines, support automation, and collaborate within an Agile team to manage complex data sets, ensuring performance and reliability in data processing.

The Data Engineer will modernize and stabilize the data platform, optimize ELT/ETL pipelines, ensure data quality, and collaborate on AI architecture.

Own SQL and dbt-based data modeling and data quality for clinical and claims datasets. Author and refactor dbt models/tests, triage DQ alerts, design monitors, optimize SQL performance, and collaborate with Data Engineering and stakeholders to ensure trusted production datasets.

Build and maintain low-latency, highly available distributed data systems and services to deliver high-quality data for product, analytics, and ML. Partner with data scientists and product teams to design scalable, observable, multi-tenant data products using batch and real-time processing frameworks. Ensure 24x7 reliability, monitoring, and operational excellence while owning end-to-end delivery.

Build scalable, privacy-focused data frameworks and ETL pipelines using big-data technologies (Spark, Presto, Flink, Kafka, Hive). Ensure appropriate handling of personal data, support privacy and legal needs, partner cross-functionally, and lead system design while mentoring teammates.

Design, build, and own large-scale batch and streaming data pipelines and core Ads data products. Collaborate with analytics, data science, and engineering teams to model, transform, govern, and deliver high-quality ad datasets for analysis, ML, and reporting while ensuring privacy compliance.

Build and maintain scalable batch and real-time data pipelines, model data to power analytics and ML, and operate distributed data systems. Collaborate with business, engineering, and data science teams to ensure data quality, documentation, and debugging while adopting new technologies and working in an ambiguous, fast-changing environment.

Lead and mentor a data engineering team to design, build, test, and support cloud-based, real-time data platforms and distributed microservices using modern big data, streaming, and data warehousing technologies to deliver scalable customer and enterprise experiences.

Lead design, develop, test, deploy and support cloud-based data engineering solutions. Work across Agile teams on distributed, real-time and batch data platforms, mentor engineers, and optimize code and data pipelines using big data, streaming, and cloud data warehousing technologies.

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).

Build and maintain centralized pricing data infrastructure, scalable workflows, and data pipelines; integrate AI capabilities; deliver pricing tools, reporting, and governance to support data-driven pricing and budgeting across the firm.

Lead design and implementation of scalable cloud data lakes, warehouses, and marts. Build ELT/ETL pipelines, apply Data Vault 2.0 and dimensional modeling, implement data quality, lineage, observability, and governance. Optimize Snowflake/Databricks/Synapse platforms, champion CI/CD and DataOps, mentor engineers, and enable AI/ML-ready data products through collaboration with architecture and product teams.

Build and maintain data pipelines, applications, workflows, and governance within Palantir Foundry. Apply industrial engineering and operations research methods to analyze depot, MRO, and supply chain processes, integrate ERP/MRO data into models, run capacity/throughput analyses, deliver decision‑support briefings, and support adoption of advanced analytics and digital engineering. Coordinate with stakeholders and support business development activities.

Lead Data Engineer responsible for designing data models, implementing data solutions, managing data pipelines, and collaborating with teams to drive technical initiatives.

Design, build, and optimize scalable Azure data platforms and lakehouse architectures. Develop ETL/ELT pipelines (PySpark/Spark SQL), enable Power BI datasets, implement CI/CD and IaC, ensure data governance/quality with Purview, support cloud migrations and production operations while collaborating with stakeholders and agile teams.

Lead design and delivery of scalable, secure cloud data pipelines and products. Translate requirements into architecture, apply advanced data modeling (Data Vault 2.0/dimensional), embed data quality, observability, security, and DataOps/CI-CD practices, optimize performance and cost, mentor engineers, and enable AI/ML-ready datasets within an agile DevSecOps model.

Design, build, and operate scalable cloud data pipelines and platforms (Azure preferred). Implement DevSecOps, CI/CD, automated testing, monitoring, performance tuning, and production readiness. Mentor engineers, drive operational excellence, and translate requirements into robust technical designs. Apply healthcare domain knowledge and collaborate in agile teams to deliver secure, reliable data products.

The Data Engineer will build and maintain data platforms, deploy pipelines, monitor transformations, and collaborate with Data Scientists and DevOps.