Top Data Engineer Jobs in Boston, MA

Design, build, and support scalable cloud data platforms, pipelines, and applications. Responsibilities include data modeling, architecture, distributed processing, relational and NoSQL databases, data security, observability, and real-time workloads. The role collaborates with product and engineering teams, establishes reusable engineering patterns, communicates technical concepts, and mentors data professionals while delivering resilient solutions.

Build and architect scalable cloud data platforms, pipelines, and applications using technologies such as Python, Spark, Databricks, and Snowflake. Lead large-scale data initiatives, make architectural decisions, establish engineering patterns, and ensure platform resilience and operational efficiency. Collaborate with product, engineering, analytics, and data science teams while mentoring engineers and communicating technical concepts to stakeholders. Evaluate data platform choices and deliver solutions supporting machine learning, distributed systems, and evolving enterprise data needs.

Lead large-scale data engineering initiatives, designing scalable cloud data platforms, pipelines, and architectures. Use Python, Spark, SQL, Databricks, Snowflake, AWS, relational and NoSQL databases to deliver resilient data solutions. Mentor engineers, analysts, and data scientists; establish engineering standards; evaluate platform choices; and collaborate with product and software teams to support enterprise data transformation and AI capabilities.

Leads enterprise-scale data architecture across batch, streaming, warehouse, lakehouse, transactional, AI, and vector-store use cases. Establishes data quality, governance, lineage, observability, access-control, and reliability standards. Defines AI-enabled data engineering patterns, mentors engineers, resolves complex architecture issues, and influences cross-functional roadmaps. Requires hands-on technical leadership and 15+ years of software, data engineering, or architecture experience.

Designs reusable data ingestion and transformation components, automates data quality, governance, testing, lineage, and deployment workflows, and improves pipeline observability and reliability. The role supports monitoring, incident response, cloud and container integrations, infrastructure as code, documentation, reusable datasets, and Agile platform improvements. Candidates need five or more years of data engineering experience plus expertise in orchestration, distributed processing, storage, scripting, automation, and version control.

Implements data pipelines and platform features, automates validations and operational tasks, supports CI/CD and infrastructure-as-code changes, monitors platform reliability, assists with migrations and performance tuning, and maintains technical documentation. The role also contributes to data quality, incident response, cloud configuration, and incremental platform improvements. This is a hybrid position with potential urgent IT incident support responsibilities.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, implementing security and compliance controls, developing dbt data models, cataloging assets in OpenMetadata, automating with Python, and mentoring engineers. The role requires extensive infrastructure and data engineering experience, cloud expertise, container orchestration, and eligibility for CJIS clearance.

Build and operate production data pipelines, models, and data products supporting finance, accounting, treasury, compliance, and regulatory reporting. Partner cross-functionally to define requirements, model on-chain and internal data, and ensure data reliability through reconciliation, quality checks, monitoring, and alerting. Use SQL, Python, cloud data warehouse, Airflow, dbt, and AI tooling. Mentor engineers, review technical work, document systems, and communicate data concepts to technical and non-technical audiences.

Build and operate scalable data pipelines and models on Snowflake and AWS for Global Liquid Markets investment products. Responsibilities include integrating market and vendor data, implementing automated testing and governance standards, developing AI-powered engineering workflows, collaborating with product and business stakeholders, contributing to the data roadmap, mentoring engineers, and participating in code reviews. The role requires strong communication, architecture, agile delivery, data engineering, and responsible AI skills.

Design, build, test, and support scalable cloud data solutions and pipelines. Develop data platforms using Python, Spark, SQL, Databricks, Snowflake, relational and NoSQL databases, and cloud technologies. Establish reusable data engineering patterns, security controls, and operational standards. Collaborate with product managers, engineers, analysts, and data scientists; communicate technical outcomes; mentor data professionals; and deliver resilient, high-performance financial data products.

Designs and maintains enterprise data pipelines and Microsoft Fabric solutions across CRM, finance, billing, and legal systems. Manages SQL Server administration, performance tuning, security, backups, high availability, disaster recovery, and data governance. Develops transformations using T-SQL, Python, and PySpark, implements monitoring and validation, and collaborates with application, infrastructure, and security teams. The role requires five years of data engineering, data warehousing, and SQL Server DBA experience, with a hybrid schedule and occasional on-call support.

Design and optimize Databricks ETL/ELT pipelines on Azure using PySpark, SQL, Delta Lake, and Kafka. Build CDC and near-real-time processing solutions, ingest data from diverse sources, implement data quality controls, and apply SCD Type 1 and Type 2 modeling. Automate workflows with Databricks Workflows and GitHub-based CI/CD while collaborating in an Agile environment.

Build and support enterprise data ingestion, transformation, modeling, and integration solutions using Microsoft Fabric and Azure data services. Develop batch, API, file, database, and event-driven pipelines; create dimensional and curated data models; write and optimize SQL; resolve data-quality and pipeline issues; and support production workloads. Collaborate in Agile engineering processes using GitHub, Azure DevOps, CI/CD, code reviews, and reusable development standards.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Build and architect scalable cloud data platforms, pipelines, and applications. Design distributed, real-time, and batch data solutions using Python, Spark, SQL, Databricks, Snowflake, relational and NoSQL databases. Establish reusable engineering patterns, data security controls, and operational standards. Collaborate with product managers, software engineers, analysts, and data scientists while mentoring team members and communicating technical outcomes to stakeholders.

Lead the design and evolution of BJ’s Databricks Lakehouse, building batch and real-time pipelines, integrating digital and operational data, and establishing data quality, governance, CI/CD, and cost optimization. Develop AI-powered analytics and Databricks agents, own the digital data roadmap, and mentor a distributed engineering team while partnering with product and business leaders.

Build and scale programmable data infrastructure supporting Vesalius Therapeutics’ human cellular biology platform. The role contributes to large-scale genetics, genomics, stem cell, cellular phenotyping, and artificial intelligence initiatives designed to uncover causal biology and identify therapeutic intervention points.

Build and operate laboratory data infrastructure supporting Benchling, sample tracking, APIs, web applications, instrument integrations, and analysis-ready data. Develop integrations across automation platforms, instruments, LIMS/ELNs, imaging systems, databases, and downstream pipelines. Create scientist-facing tools, investigate data discrepancies, and apply robust software engineering practices. Partner across scientific, automation, IT, and data teams while independently owning laboratory systems and planning for future platform needs.

Designs, builds, and optimizes enterprise Databricks Lakehouse pipelines and data products using Spark, Delta Lake, SQL, and Python. Leads complex data initiatives, production support, governance, CI/CD, workflow orchestration, monitoring, and modernization of legacy SQL Server solutions. Partners with stakeholders, optimizes performance and cost, mentors engineers, and drives engineering standards across Azure data platforms.

Design and modify data solutions using Databricks and Palantir Foundry; build data models and reports from ERP and legacy-system datasets; define and execute tests; and translate stakeholder reporting needs into technical specifications. The role requires SQL, Python, PySpark, database architecture, cloud architecture, software engineering practices, independent execution, documentation, and collaboration. It supports an Army client in a hybrid Arlington, Virginia environment and requires an active Secret clearance.

Maintains and monitors Azure Databricks data pipelines, troubleshoots data issues, collaborates with stakeholders on data requirements, documents processes, performs backups and disaster recovery drills, and supports data access and usage. The role requires extensive data engineering experience, Azure expertise, incident management knowledge, and strong problem-solving skills.

Build and maintain reliable data pipelines, computed tables, and scalable data models using SparkSQL and PySpark. Integrate IoT, product, customer, external, unstructured, and ML-related data into a central data lake for analytics, causal inference, model training, and dashboards. Ensure high data quality and uptime while collaborating with data science, analytics, AI/ML, and engineering teams.

Lead the reverse-engineering and migration of legacy ETL pipelines from SAP BusinessObjects Data Services and JD Edwards into dbt and Databricks architectures. Build automated data validation, maintain SQL Server write-back mechanisms, collaborate with client stakeholders, and lead and mentor a small engineering team. The role requires hands-on expertise in SQL, Python, Spark, orchestration, cloud platforms, and legacy ERP and ETL migrations.

Designs, builds, tests, and maintains scalable data infrastructure and ETL/ELT pipelines for mission partners. Uses AWS Glue, Glue Catalog, and Step Functions to integrate, migrate, transform, and validate data. Develops data models, schemas, queries, and production-ready datasets while collaborating with analytics and business teams. The role may also support AI/ML pipelines, data governance, DevOps workflows, Databricks, and real-time streaming architectures.

Architects, builds, tests, and maintains scalable data infrastructure and ELT/ETL pipelines using AWS Glue, Glue Catalog, and Step Functions. Performs data modeling, SQL querying, data migration, schema optimization, validation, and data quality improvements. Partners with analytics and business teams to transform raw data into production-ready datasets. The role may also support AI/ML pipelines, governance, access controls, DevOps workflows, and real-time data architectures.