Designs, builds, and operates scalable enterprise data platforms supporting ingestion, processing, storage, governance, analytics, and AI/ML. Responsibilities include developing batch and real-time pipelines, lakehouse and warehouse architectures, orchestration, infrastructure automation, CI/CD, monitoring, security, cost optimization, and observability. The role partners with data, ML, DevOps, security, and application teams, troubleshoots complex platform issues, establishes reusable engineering standards, contributes to architecture strategy, and mentors engineers.
Job Summary
We are looking for an experienced Senior Data Platform Engineer to design, build, and operate scalable, secure, and highly reliable enterprise data platforms.
The role focuses on developing the foundational data infrastructure, platforms, frameworks, and services that enable data engineering, analytics, AI/ML, and business intelligence teams to efficiently ingest, process, store, govern, and consume data.
The ideal candidate will have strong hands-on experience with cloud data platforms, data engineering, distributed systems, data pipelines, data lakes/lakehouses, orchestration, streaming, DevOps, and platform engineering.
Key Responsibilities
- Design, develop, and maintain enterprise-grade data platforms.
- Build scalable data ingestion and processing frameworks for batch and real-time workloads.
- Develop reusable platform components and services for data engineering and analytics teams.
- Design and implement data lake, data warehouse, and lakehouse architectures.
- Build high-performance and reliable data pipelines using modern data engineering technologies.
- Develop frameworks for data ingestion from databases, APIs, SaaS applications, files, events, and streaming sources.
- Implement data processing using distributed computing technologies.
- Build and manage data orchestration and workflow automation.
- Establish platform standards for reliability, scalability, security, monitoring, and operational excellence.
- Automate infrastructure provisioning and platform deployment using Infrastructure as Code.
- Implement CI/CD pipelines for data platform components and data workloads.
- Optimize data processing, storage, compute, and cloud infrastructure costs.
- Implement platform monitoring, logging, alerting, and observability.
- Work closely with Data Architects, Data Engineers, ML Engineers, Data Scientists, DevOps, Security, and application teams.
- Support AI/ML teams by providing reliable and scalable AI-ready data infrastructure.
- Define and implement data platform security, access control, encryption, and governance.
- Troubleshoot complex platform, pipeline, performance, and infrastructure issues.
- Establish reusable engineering patterns, libraries, templates, and best practices.
- Mentor engineers and contribute to technical architecture and platform strategy.
Compensation, Benefits and Duration
Minimum Compensation: USD 38,000
Maximum Compensation: USD 133,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full-time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Similar Jobs
Fintech • Information Technology • Software
Own the vision, roadmap, and execution for SentiLink’s identity resolution and internal data platform initiatives. Lead cross-functional efforts involving engineering, data science, analytics, and product teams to improve data quality, reliability, scalability, and usability. Translate ambiguous technical needs into requirements, prioritize competing demands, manage dependencies, define success metrics, and communicate progress, risks, and tradeoffs across the organization.
Top Skills:
BigQueryDatabricksSnowflakeSpark
Artificial Intelligence • Productivity • Software • Automation
Leads growth design for Zapier’s top-of-funnel experiences, owning visitor-to-lead journeys, conversion rate optimization, SEO, information architecture, and high-velocity A/B experimentation. Designs lead-capture workflows, extends web and email design systems, uses AI tools to accelerate prototyping and variant generation, and partners with marketing, brand, engineering, revenue operations, and data teams. Mentors designers and establishes growth design practices focused on acquisition, conversion, activation, and measurable business outcomes.
Top Skills:
A/B TestingClaudeCmsCRMCursorFigmaFigma AiMultivariate TestingSeoV0
.png)
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Leads IT product strategy and delivery using data-driven analysis and business acumen. Oversees complex project lifecycles, aligns technical teams with business stakeholders, manages budgets and timelines, and ensures quality delivery. Coaches and mentors Product Managers, prioritizes initiatives, delegates work, and drives cross-functional alignment across product development and implementation.
Top Skills:
AgileConfluenceJIRAKibanaAzurePostmanRest ApiSaaSSalesforceSoap ApiSQLSwaggerUi/Ux DesignVisio
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
