Top Data Engineer Jobs in Boston, MA

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Designs, builds, tests, and documents scalable data solutions and pipelines for CMS healthcare fraud, waste, and abuse initiatives. Responsibilities include data warehouse development, CI/CD deployment, orchestration, data quality, governance, AWS-based automation, testing, architecture support, and technical leadership. The role partners with analysts and business stakeholders, leads project initiatives, improves workflow automation, and ensures requirements and milestones are met.

Build PFA’s data organization and own its data platform, architecture, pipelines, integrations, schemas, and data-quality processes. Develop predictive analytics, AI-enabled workflows, reporting layers, dashboards, and executive insights from fragmented healthcare data. Establish engineering standards involving Python, SQL, Git, testing, and maintainable software design. Partner with product, engineering, and business leaders to address data gaps and translate strategic needs into scalable technical solutions.

Build and support scalable data platforms and pipelines, leading migrations such as Snowflake to BigQuery and transitioning reporting to Looker. Responsibilities include data architecture, ETL/ELT, API and marketing integrations, data quality, production troubleshooting, warehousing, performance optimization, and platform modernization. The role partners with analytics and business teams, owns projects through production, documents solutions, and provides technical guidance.

Develop and maintain data engineering solutions using Informatica Data Management Cloud, Control-M, Snowflake, and SQL. Responsibilities include sourcing, transforming, cleansing, ingesting, analyzing, and visualizing data; building automated workflows and scalable ETL processes; supporting data architecture and deployments; and delivering reusable code for large datasets. The role requires collaboration with technical and business partners, troubleshooting, mentoring, and managing multiple priorities.

Design and lead scalable, secure, highly available database infrastructure for multi-terabyte SQL Server environments. Set technical direction for data architecture, performance, real-time pipelines, security, and growth. Troubleshoot complex production issues, optimize queries and indexes, guide cross-functional projects, mentor engineers, review changes, reduce technical debt, and evaluate emerging technologies. Monitor database health using Splunk, Datadog, and Grafana while influencing engineering and Site Reliability strategy.

Develops and maintains data pipelines, datasets, schemas, models, databases, and data flows. Analyzes raw and structured data, improves data quality, builds reporting and data dictionaries, and collaborates with analysts, scientists, and stakeholders. The role supports data security, compliance, visualization, and reporting while modernizing legacy technologies. Requires a flexible schedule supporting 24/7/365 operations and the ability to obtain and maintain a security clearance.

Configure and maintain Adobe Experience Platform and Real-Time CDP data pipelines, XDM schemas, datasets, identity resolution, Profile enablement, segmentation readiness, and destination activation. Validate data quality, troubleshoot ingestion and identity issues, manage sandboxes, and implement privacy, consent, governance, and access controls. Partner with architects, data engineers, consultants, analysts, data scientists, and marketing teams to support reporting, personalization, and machine learning readiness.

Own production data ingestion pipelines for healthcare and benefits data, including normalization, mapping, validation, reconciliation, observability, and secure handling of sensitive information. Unify census data processes, scale the platform, improve identity matching, and build automation and TypeScript tooling. The role requires strong Python and SQL skills, production orchestration experience, reliable testing and data-quality practices, and effective communication with technical and nontechnical stakeholders.

Build and maintain Databricks data pipelines, ETL/ELT processes, SQL transformations, and Power BI dashboards for HR and People Analytics. Ensure data quality, optimize models and reporting performance, troubleshoot issues, document solutions, and collaborate with HR stakeholders and technical teams to deliver scalable workforce analytics.

Design, build, and operate high-throughput data pipelines supporting billing and cost attribution. Drive Spark optimization, latency reduction, sharding, cross-datacenter reliability, and new billing capabilities. Investigate billing accuracy issues with Finance and Product teams, participate in on-call rotation, and improve engineering standards and operational excellence.

Build and own trusted data products, dimensional models, semantic layers, and dbt transformations that support analytics, experimentation, machine learning, reporting, and decision-making. Partner with cross-functional teams to translate business needs into scalable datasets, improve data quality and governance, establish engineering standards, and drive self-service analytics. Mentor engineers and analysts while leveraging AI tools to improve development, documentation, and quality.

Design, build, and operate WHOOP’s data platform infrastructure, including lakehouse, warehouse, and streaming systems. Improve performance, reliability, cost efficiency, observability, and developer experience across AWS-based data systems. Develop internal tools, APIs, automation, CI/CD, and infrastructure-as-code practices. Partner with data, ML, analytics, and software engineering teams to support scalable workflows, governance, and production excellence while using AI-assisted development tools effectively.

Build and operate data-intensive web products and APIs, extend high-throughput ETL pipelines and scrapers, ensure reliability/observability, design self-scaling services, participate in code review, and collaborate across product, data, and infrastructure teams to meet production SLAs.

Build scalable, secure data pipelines, models, platforms, and governance systems that enable AI applications to access trusted enterprise data. Partner with analytics, marketing, and product teams to translate requirements into technical solutions, independently deliver projects through production, and support sensitive-data security and access controls. Preferred experience includes LLM architectures, cloud data platforms, infrastructure as code, regulated environments, and technical leadership.

Design and scale lakehouse architecture, streaming and batch pipelines, and reliable data platforms using Kafka, Spark, Airflow, Iceberg, Databricks, and related technologies. Build Medallion-layer data systems, manage open table formats, optimize distributed queries, monitor platform reliability, resolve data quality issues, and collaborate with analysts, data scientists, and product teams.

Build and maintain scalable ETL/ELT pipelines and data foundations using Databricks, dbt, and AWS. Transform raw structured and unstructured data into reliable datasets for product analytics and data science, including telemetry, streaming data, and feature engineering. Develop dashboards in Tableau and Databricks, optimize workflows, and collaborate with Product, Engineering, analytics, and data science stakeholders to support product health, adoption, and performance insights.

Design, build, and maintain scalable batch and streaming data pipelines, cloud infrastructure, and the Enterprise Data Hub. Partner with stakeholders to productionize ingestions, ensure data quality, implement metadata/catalog solutions, mentor junior engineers, and support analytics and ML workloads using cloud and big-data tooling.

Design and optimize Snowflake data warehouses, dbt transformation models, and scalable ETL/ELT pipelines. Develop ingestion utilities, improve SQL and warehouse performance, establish data quality and governance controls, and maintain CI/CD workflows using Git. Collaborate with analysts, data scientists, and business stakeholders across manufacturing, supply chain, and operations. The role also supports modern DataOps practices and may involve orchestration tools and cloud platforms.

Build and maintain scalable ETL/ELT pipelines using Azure Data Factory, Snowflake, dbt, and SQL. Develop data models, transformations, tests, and documentation; ingest data from APIs, databases, files, and enterprise applications; optimize performance; ensure data quality; troubleshoot failures; and support production deployments and monitoring.

Design, build, and maintain Keboola-based data pipelines integrating multiple business systems to deliver accurate, scalable data for supply chain, logistics, and transportation analytics; collaborate with analysts and engineers; support documentation, governance, and pipeline automation.

Designs, builds, tests, maintains, and optimizes large-scale data pipelines, ETL processes, ingestion workflows, and cloud data storage. Develops Databricks data engineering and AI/ML pipelines, Azure Data Lake solutions, Power BI dashboards, and CI/CD automation. Ensures data quality, security, scalability, cost efficiency, and reusable engineering practices while collaborating with distributed technical teams.

Build, model, and maintain scalable BigQuery-based data solutions on GCP. Implement performant data models, storage partitioning/clustering, ETL improvements, data validation, and documentation. Collaborate with architects, data scientists, and engineers to deliver governed, high-quality data for reporting and AI initiatives.

Designs, builds, deploys, and maintains scalable data architectures, databases, ETL/ELT pipelines, API integrations, and cloud data solutions in AWS GovCloud. Migrates on-premises databases to cloud platforms, optimizes data models and performance, implements governance and security controls, and supports reporting and analytics. Collaborates with architects, data scientists, and stakeholders while documenting systems and conducting integration, validation, cost, and risk assessments.

Designs, builds, and maintains cloud data pipelines and ETL/ELT processes supporting VA healthcare analytics. Responsibilities include patient matching, record linkage, data harmonization, quality management, documentation, performance optimization, and pipeline support. Collaborates with analysts and stakeholders to develop scalable solutions and Power BI reports using Databricks SparkSQL. The role requires federal healthcare data experience, strong SQL or Spark SQL skills, and the ability to obtain a VA Public Trust clearance.