Top Senior Data Engineer Jobs in Boston, MA

Design, build, test, and maintain cloud-based data pipelines using Azure, Databricks, Cosmos DB, Delta Lake, and Spark. Develop ETL frameworks, data quality validations, data warehousing solutions, and high-throughput libraries. Troubleshoot pipelines and DevOps deployments, analyze semi-structured data, and contribute across the software development lifecycle within an agile team. The role requires onsite work four days weekly and supports financial-industry products.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Staff Data Engineer responsible for setting technical direction, architecting scalable data platforms, leading cross-functional initiatives, improving reliability and performance, and enabling AI-assisted analytics and development. The role includes hands-on development with Python, SQL, cloud data warehouses, orchestration, infrastructure as code, Kubernetes, Kafka, and streaming pipelines, along with mentoring, technical advocacy, documentation, code reviews, and on-call troubleshooting.

Designs, builds, and maintains secure data pipelines, ETL processes, data warehouses, and quality controls. Collects, validates, cleanses, and analyzes data; develops SQL queries, Tableau dashboards, and AWS-based solutions; investigates data integrity issues; documents standards; and partners with stakeholders to deliver technical solutions using Agile and DevOps practices.

Build and deliver Azure and Microsoft Fabric data solutions for clients. Responsibilities include developing data pipelines with Azure Databricks, Data Factory, Synapse Analytics, and Fabric; writing SQL, Python, and PySpark; supporting data integration, testing, deployments, troubleshooting, CI/CD, and infrastructure management. The role involves consulting with client stakeholders, collaborating with architects and developers, and delivering modern data platforms and reporting solutions.

Designs and optimizes scalable data infrastructure, including ETL pipelines, data integrations, BI solutions, validation, cleansing, workflow optimization, and troubleshooting. The role supports clinical and operational teams by integrating data from clinical systems, APIs, warehouses, and external sources while ensuring data quality and performance. Collaboration across departments and delivery of data-driven insights are key responsibilities.

Design and maintain Snowflake-based data platforms, cloud-native data lakes, and scalable ETL/ELT pipelines for asset-backed finance analytics. Orchestrate workflows with Dagster and AWS services, ensure data reconciliation and integrity, and support migration from legacy systems. Contribute to project planning, Jira backlog management, testing, cutover planning, and cross-functional go-live readiness.

Design and maintain Snowflake data pipelines and data lake architectures for asset-based finance analytics. Develop ETL/ELT workflows, validate and reconcile financial data, migrate legacy systems, and translate quantitative finance logic into scalable architectures. Support project execution through requirements breakdown, planning, testing, cutover, and go-live readiness. Collaborate across engineering, quantitative analytics, and stakeholder teams.

Design, build, and operate production data pipelines and shared data foundations using SQL, Python, PySpark, Databricks, and cloud technologies. Develop data models, ingestion and transformation workflows, resilient processing, observability, data-quality controls, and secure customer-aware data flows. Collaborate with engineering and product teams, evaluate architecture and tooling, support analytics and application services, contribute to testing and documentation, and mentor other engineers.

Designs Azure-based data models, simulations, test environments, automated testing frameworks, and performance validation solutions for healthcare data pipelines. Develops test data generators, validates ETL and HL7 FHIR transformations, supports data quality and reliability, and collaborates with engineers and architects on design and code reviews. The role also provides technical guidance on testing architecture, CI/CD, infrastructure as code, resiliency, and large-scale cloud data processing.

Design, build, and maintain scalable batch and streaming data pipelines using Databricks, PySpark, Python, SQL, Spark, and Delta Lake. Develop transformations, orchestration workflows, data models, validation processes, and curated data products. Troubleshoot performance and quality issues, apply governance and security practices, document solutions, and collaborate with architects, data scientists, DevOps teams, analysts, and clients.

Designs, builds, and maintains Snowflake-based enterprise data warehouse solutions, including data architecture, ETL/ELT pipelines, security, deployment, data quality, modeling, and performance optimization. Partners with integration, analytics, governance, business intelligence, and architecture teams. Supports production operations, resolves ingestion and transformation issues, develops AWS-to-Snowflake scripts, documents implementations, and translates business requirements into scalable data solutions.

Build and own scalable data platforms and ingestion pipelines using BigQuery, dbt, and modern ingestion tools. Design batch and CDC workflows, improve reliability and observability, implement governance and access controls, and support analytics and AI agents. Develop Python services and internal tooling, contribute to architecture and lakehouse experiments, collaborate with stakeholders, and mentor engineers. The role requires strong SQL, Python, cloud infrastructure, testing, CI/CD, and AI-assisted development experience.

Leads the design, development, and optimization of scalable data pipelines and analytics platforms. Builds ETL/ELT workflows using Databricks and Spark, integrates and transforms source data into curated models, manages SQL Server data, and maintains documentation and lineage. Collaborates with product, analytics, and engineering teams to deliver reliable data solutions. Applies responsible AI practices and delivers projects independently within established timelines.

Build and maintain secure data pipelines and integrations across business platforms, laboratory systems, analytical instruments, and messy data sources. Own schema design, orchestration, monitoring, quality controls, documentation, and compliant data isolation for export-controlled information. Create a unified lakehouse foundation supporting analytics, dashboards, machine learning, R&D, manufacturing, and operations. Partner with scientists and technical teams to integrate HPLC, GC, Invert Bio, APIs, spreadsheets, PDFs, and semi-structured records.

Own and evolve UJET’s data platform, including MySQL CDC replication to BigQuery, dbt transformations, Terraform infrastructure, pipelines, data quality, observability, and Looker models. Build reliable, analytics-ready datasets and trusted metrics for internal and customer-facing reporting. Partner with Analytics, Finance, Product, and Engineering to deliver scalable data solutions, improve platform reliability, optimize performance and costs, and establish development standards and guardrails.

Own and evolve WorkOS’s internal data platform, including ingestion, orchestration, Snowflake, dbt models, data governance, reverse ETL, semantic views, and AI-enabled data workflows. Ensure pipeline reliability, freshness, security, and scalability while partnering with Product, Finance, RevOps, GTM, Engineering, and Security. Build monitoring, runbooks, CI/CD gates, access controls, masking policies, and infrastructure automation across AWS and Kubernetes.

Design, build, and operate scalable batch and streaming data pipelines, lakehouse and warehouse models, and data services. Own datasets end to end, improve Snowflake, Iceberg, Spark, and Flink performance and reliability, implement governance and observability, and support graph-serving data models. Partner with product and engineering teams, participate in on-call, review code and designs, and mentor junior engineers.

Build and operate reliable data systems and products supporting clinical operations, drug evaluation, business development, analytics, machine learning, and AI agents. Responsibilities include designing pipelines, canonical data models, data contracts, warehouse transformations, quality and observability practices, governance for regulated data, and incident response. The role partners closely with Product Engineering and Data Science, uses AI-assisted development, contributes to architecture, and mentors other engineers.

Design, build, deploy, and maintain AWS-based data and AI/ML infrastructure for enterprise agentic AI platforms. Develop data lake pipelines, observability systems, agent-enablement tooling, and production MLOps/LLMOps capabilities. Own features end-to-end, contribute to architecture and design decisions, optimize reliability, scalability, security, and cost, and collaborate with AWS Professional Services, client teams, and junior engineers.

Build and operate production pipelines for legal records from PACER, court systems, opinions, PDFs, scans, XML, and HTML. Develop LLM-assisted extraction workflows, validate data quality, optimize SQL, and support RAG and semantic search products. Manage AWS S3 and RDS systems within security guardrails while collaborating with engineering teams. The role requires strong Python and SQL skills, legal data experience, document extraction expertise, and autonomous problem-solving with large, messy datasets.

The Senior Data Engineer will design, implement, and manage data pipelines for real-time analytics and ML training datasets, ensuring efficient data flow and quality in a hybrid environment.

Build and maintain scalable data pipelines, models, and cloud infrastructure supporting business performance analysis. Collaborate with data scientists, ML engineers, product teams, and business stakeholders to translate requirements into technical solutions. Develop self-service data tooling, optimize Snowflake and AWS environments for scale and cost, and support deployment through CI/CD and DevOps practices. The role also involves data integration, modeling, documentation, and ensuring data integrity across global entities.

Build and own Snout’s data foundation, including PostgreSQL and dbt warehouses, ingestion pipelines, dimensional models, data quality, documentation, and reliable rebuilds. Reconcile data from veterinary practice-management systems, support LLM/AI tooling, translate stakeholder needs into technical plans, and establish the foundation for a future data team and analyst.

Design, develop, and operate large-scale data ingestion, transformation, enrichment, and processing pipelines across cloud, hybrid, and on-premises environments. Build distributed services using Java, Python, and Kafka; optimize data models and platform performance; deploy applications on Kubernetes; support infrastructure automation and CI/CD; troubleshoot production systems; and collaborate with customers and solution architects on implementations.