Top Data Engineer Jobs in Boston, MA

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.

Design and lead scalable data engineering solutions across Databricks and Microsoft Azure. Define enterprise data modeling standards, architect pipelines and integrations, establish engineering best practices, troubleshoot complex platform issues, and guide modernization and cloud migration initiatives. Provide technical leadership and mentorship while ensuring data platforms meet security, quality, governance, reliability, performance, and maintainability standards.

Develop and maintain automated data pipelines, API-driven workflows, and data integrations using Python, SQL, Databricks, and data lake architectures. Improve data quality through validation, schema design, and provider data mapping across diverse sources. Build analytics-ready datasets for predictive analysis, Power BI reporting, and GIS-based access analyses. Document data flows and technical configurations, support knowledge transfer, and collaborate with analysts, product owners, contractors, and government stakeholders.

Builds and maintains scalable data pipelines, ETL infrastructure, data warehouses, and analytics tools. The role assembles complex datasets, automates processes, optimizes data delivery architecture, and supports cross-functional data initiatives. Collaborates with executive, product, data, and design stakeholders to resolve technical issues and improve analytics systems. Requires proficiency in SAS, Python, Java, MATLAB, SQL, NoSQL, Hadoop, MapReduce, Hive, Presto, UNIX, and Linux, with JavaScript, R, and basic machine learning preferred.

Build and maintain enterprise data pipelines and infrastructure supporting natural-language querying, semantic search, knowledge graphs, and GraphRAG for the SEC. Responsibilities include onboarding data sources, processing XBRL and financial filing data, managing metadata and lineage, validating data quality, monitoring pipeline health, resolving integration issues, and using AWS data services. The role also requires compliance with federal security standards and collaboration with the Data Architect.

Build and operate large-scale data pipelines, web-scraping systems, and data-collection tools for AI datasets. Maintain analytical databases, optimize queries, troubleshoot pipeline and data-quality issues, manage containerized workloads across Kubernetes and Linux infrastructure, and support CI/CD workflows. The role also involves documenting technical processes, researching improvements, and developing scalable APIs in a fully remote environment.

The Principal Data Engineer will lead the design and development of scalable data platforms, optimize data pipelines, and collaborate with multiple teams to enhance data solutions.

As the first in-house Data Engineer, you will own the data infrastructure, build and maintain data pipelines, and collaborate with teams to ensure quality data access and insights.

Build, maintain, and support production data pipelines and platform capabilities using Snowflake, dbt, Airflow or Cloud Composer, APIs, files, and cloud services. Responsibilities include ETL/ELT development, data modeling, testing, deployment, monitoring, troubleshooting, optimization, documentation, and data quality. The role partners with analytics, data science, finance, risk, marketing, product, and engineering teams, while supporting reliable, scalable, and cost-effective data systems and emerging AI data workflows.

Designs and maintains scalable cloud data architectures, pipelines, ETL processes, data warehouses, databases, and data models. Ensures data quality, accuracy, security, availability, and consistency across sources. Develops SQL queries for analytics and reporting, and documents pipelines, schemas, architectures, and models. The role requires expertise with Python, Java, Scala, R, SQL, relational and NoSQL databases, cloud platforms, and Snowflake.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Lead design and delivery of scalable data pipelines and APIs for Digital Risk Protection. Mentor engineers, align and ingest multiple data streams (including graph data), productize analytics and LLM outputs, and drive DRP technical projects with stakeholders to enable data-driven intelligence.

Designs and manages scalable data pipelines, contracts, transformation layers, and analytics models. The role focuses on data governance, observability, lineage, configuration validation, and collaboration with product engineering teams. It requires processing large datasets, integrating cloud and on-premises industrial technologies, and implementing streaming and message-queuing solutions, ideally in cybersecurity or industrial environments.

Build and operate cloud data capabilities, including ingestion pipelines, transformations, data models, curated data products, and data-quality controls. Use Snowflake, dbt, SQL, and Python to deliver governed data for analytics, applications, automation, and AI workflows. Implement testing, CI/CD, documentation, lineage, access controls, monitoring, incident resolution, and performance optimization. Collaborate with engineering, analytics, governance, security, and business teams in an Agile, product-oriented environment with active AI-assisted development.

Design and operate scalable, cloud-native data pipelines and orchestration systems for imaging, biomarker, and healthcare data. Build Databricks and distributed processing workflows, integrate DICOM data into data lakes, and implement validation, observability, monitoring, and fault tolerance. Collaborate with data science, AI, R&D, product, and data management teams to deliver secure, compliant, reliable data for analytics and machine learning.

Own and maintain the companys data infrastructure and pipelines. Design, build, and monitor ETL/ELT workflows and data architecture; integrate SaaS sources; enforce data quality, standards, and governance; partner with stakeholders to deliver analytics-ready data and meet data availability SLAs.

Designs and operates an AWS-native lakehouse supporting analytics, reporting, visualization, and AI/ML. Builds batch and streaming ingestion pipelines using Python and PySpark, Apache Iceberg data structures, governance and metadata services, quality controls, security, observability, and CI/CD automation. Optimizes performance, scalability, reliability, and cost while collaborating with cross-functional technical teams and documenting architecture, operations, and secure configurations.

Designs and maintains data warehouses, semantic models, metrics layers, pipelines, dashboards, and certified datasets. Establishes KPI governance, data security, row-level access controls, quality standards, and observability. Builds Sigma, Power BI, and Databricks dashboards, supports self-service analytics, resolves BI issues, and enables AI/ML use cases. Collaborates with architecture, engineering, analysts, and business stakeholders to define requirements, document solutions, train users, and drive BI adoption.

Design, build, and operate scalable data platforms and pipelines ingesting radar sensor data. Implement ingestion, transformation, enrichment, aggregation, and publishing workflows across relational, NoSQL, time-series, and lake/warehouse systems. Optimize PostgreSQL performance, ensure data quality, observability, and collaborate with engineering, product, and infrastructure teams to enable AI and analytics.

Lead the design and evolution of the enterprise data platform, establish standards, mentor teams, and collaborate across departments to deliver high-quality data products.

Design, build, and maintain scalable data pipelines, data lakes, and databases; ingest and map customer financial datasets; monitor pipeline reliability; translate business requirements into data flows and analytical insights to ensure high-quality, usable data.

Lead Data Engineer responsible for designing, developing, testing, and supporting cloud-based data solutions for Risk Tech. Collaborate with Agile teams to build distributed, real-time data and streaming systems using big data tools, data warehouses, RDBMS/NoSQL, and mentor engineering peers while ensuring performance and code quality.

Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.

Design, build, test, and maintain cloud-based data pipelines using Azure, Databricks, Cosmos DB, Delta Lake, and Spark. Develop ETL frameworks, data quality validations, data warehousing solutions, and high-throughput libraries. Troubleshoot pipelines and DevOps deployments, analyze semi-structured data, and contribute across the software development lifecycle within an agile team. The role requires onsite work four days weekly and supports financial-industry products.

As the founding engineer of the Data Intelligence team, you will design semantic layers, develop AI tooling, and automate data processes to drive business insights.