Top Data Engineer Jobs in Boston, MA

Designs, builds, administers, and supports cloud data architectures, databases, schemas, metadata repositories, ETL processes, and analytic models. Leads data quality, governance, troubleshooting, testing, automation, reporting, dashboards, and infrastructure design. Collaborates with Agile teams to translate business requirements into technical capabilities and supports decision-making for Audit and business management. The role is full-time onsite at an eligible Federal Reserve location and requires extensive security screening.

Lead design and implementation of enterprise data architecture and cloud-based data solutions. Manage large data engineering projects, develop data models and pipelines, ensure governance and security compliance, advise clients strategically, and build high-performing inclusive teams.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Configure and maintain Adobe Experience Platform and Real-Time CDP data pipelines, XDM schemas, datasets, identity resolution, Profile enablement, segmentation readiness, and destination activation. Validate data quality, troubleshoot ingestion and identity issues, manage sandboxes, and implement privacy, consent, governance, and access controls. Partner with architects, data engineers, consultants, analysts, data scientists, and marketing teams to support reporting, personalization, and machine learning readiness.

Design, build, and operate high-throughput data pipelines supporting billing and cost attribution. Drive Spark optimization, latency reduction, sharding, cross-datacenter reliability, and new billing capabilities. Investigate billing accuracy issues with Finance and Product teams, participate in on-call rotation, and improve engineering standards and operational excellence.

Leads the design, development, and ownership of scalable data systems, ELT pipelines, data models, and Snowflake architectures supporting analytics, experimentation, machine learning, and business decisions. Partners cross-functionally to deliver reliable, governed data solutions; improves quality, observability, testing, documentation, and operational practices; mentors engineers; and shapes technical direction through automation, technology evaluation, and AI-enabled engineering.

Build and own trusted data products, dimensional models, semantic layers, and dbt transformations that support analytics, experimentation, machine learning, reporting, and decision-making. Partner with cross-functional teams to translate business needs into scalable datasets, improve data quality and governance, establish engineering standards, and drive self-service analytics. Mentor engineers and analysts while leveraging AI tools to improve development, documentation, and quality.

Design, build, and operate WHOOP’s data platform infrastructure, including lakehouse, warehouse, and streaming systems. Improve performance, reliability, cost efficiency, observability, and developer experience across AWS-based data systems. Develop internal tools, APIs, automation, CI/CD, and infrastructure-as-code practices. Partner with data, ML, analytics, and software engineering teams to support scalable workflows, governance, and production excellence while using AI-assisted development tools effectively.

Build, model, and maintain scalable BigQuery-based data solutions on GCP. Implement performant data models, storage partitioning/clustering, ETL improvements, data validation, and documentation. Collaborate with architects, data scientists, and engineers to deliver governed, high-quality data for reporting and AI initiatives.

Build and optimize Alteryx workflows and data ingestion processes; extract, transform, normalize, and integrate enterprise data from multiple sources. Automate repetitive processing, ensure data quality, troubleshoot integrations, document workflows, and deliver datasets and analytical insights for internal business stakeholders. The role may also develop Tableau visualizations and use Python, PowerShell, or Bash scripting.

Designs, builds, administers, and troubleshoots cloud data architectures, databases, schemas, metadata repositories, ETL processes, and analytic models. Ensures data integrity and quality, develops SQL queries and reports, leads testing and automation improvements, and supports dashboards, governance, data sharing, and metric collection. Collaborates with Agile teams to translate business requirements into technical infrastructure designs and decision-support capabilities using AWS, Java, Python or Scala, GitLab, and Terraform.

Designs, builds, and maintains scalable ETL/ELT pipelines and finance data models using Snowflake, AWS, dbt Core, Python, and SQL. Develops Medallion architecture data marts, integrates ERP systems, and partners with stakeholders on financial workflows. Implements data governance, RBAC, automated quality testing, observability, documentation, CI/CD, and secure deployments. Monitors Snowflake costs and optimizes queries while supporting Oracle EBS integrations and the migration to Workday.

Build scalable, secure data pipelines, models, platforms, and governance systems that enable AI applications to access trusted enterprise data. Partner with analytics, marketing, and product teams to translate requirements into technical solutions, independently deliver projects through production, and support sensitive-data security and access controls. Preferred experience includes LLM architectures, cloud data platforms, infrastructure as code, regulated environments, and technical leadership.

Design, build, and maintain high-throughput data processing services, focusing on streaming and batch data systems to enhance player experiences.

Design, build, and own the full data platform (ingestion, modeling, CI/CD, orchestration, observability, and BI). Implement streaming and batch pipelines for IoT data, enable governed self-service, enforce data governance/privacy/security, evolve AI access patterns, and provide technical leadership and mentorship to data engineers and data scientists to deliver production-ready analytics and ML capabilities.

Build scalable cloud data infrastructure and pipelines to transform transactional and financial data into reporting-ready datasets. Ensure accuracy, traceability, governance, and observability; partner with cross-functional teams, mentor engineers, and leverage AI-assisted tools to improve engineering productivity and enable AI-powered applications.

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.

Design and lead scalable data engineering solutions across Databricks and Microsoft Azure. Define enterprise data modeling standards, architect pipelines and integrations, establish engineering best practices, troubleshoot complex platform issues, and guide modernization and cloud migration initiatives. Provide technical leadership and mentorship while ensuring data platforms meet security, quality, governance, reliability, performance, and maintainability standards.

Develop and maintain automated data pipelines, API-driven workflows, and data integrations using Python, SQL, Databricks, and data lake architectures. Improve data quality through validation, schema design, and provider data mapping across diverse sources. Build analytics-ready datasets for predictive analysis, Power BI reporting, and GIS-based access analyses. Document data flows and technical configurations, support knowledge transfer, and collaborate with analysts, product owners, contractors, and government stakeholders.

Builds and maintains scalable data pipelines, ETL infrastructure, data warehouses, and analytics tools. The role assembles complex datasets, automates processes, optimizes data delivery architecture, and supports cross-functional data initiatives. Collaborates with executive, product, data, and design stakeholders to resolve technical issues and improve analytics systems. Requires proficiency in SAS, Python, Java, MATLAB, SQL, NoSQL, Hadoop, MapReduce, Hive, Presto, UNIX, and Linux, with JavaScript, R, and basic machine learning preferred.

Design, build, and maintain Keboola-based data pipelines integrating multiple business systems to deliver accurate, scalable data for supply chain, logistics, and transportation analytics; collaborate with analysts and engineers; support documentation, governance, and pipeline automation.

Designs, develops, and maintains data pipelines, ETL processes, integrations, and complex data models. Supports analytics teams by sourcing and transforming business data for reporting and AI tools. Responsibilities include database modeling, SQL performance tuning, production support, data infrastructure development, requirements gathering, testing, deployment, stakeholder collaboration, and mentoring. The role works with relational and cloud data warehouses, data lakes, BI tools, and diverse data sources.

Build and maintain enterprise data pipelines and infrastructure supporting natural-language querying, semantic search, knowledge graphs, and GraphRAG for the SEC. Responsibilities include onboarding data sources, processing XBRL and financial filing data, managing metadata and lineage, validating data quality, monitoring pipeline health, resolving integration issues, and using AWS data services. The role also requires compliance with federal security standards and collaboration with the Data Architect.

Build and operate large-scale data pipelines, web-scraping systems, and data-collection tools for AI datasets. Maintain analytical databases, optimize queries, troubleshoot pipeline and data-quality issues, manage containerized workloads across Kubernetes and Linux infrastructure, and support CI/CD workflows. The role also involves documenting technical processes, researching improvements, and developing scalable APIs in a fully remote environment.