Key Responsibilities:
Design, develop, and manage complex Airflow DAGs for data workflows, ETL/ELT pipelines, and task automation.
Integrate Airflow with various data sources (e.g., databases, APIs, cloud storage) and targets.
Optimize and monitor pipeline performance and troubleshoot failures in a timely manner.
Collaborate with data engineers, analysts, and platform teams to support end-to-end data solutions.
Implement best practices for code quality, testing, version control, and deployment.
Maintain documentation and provide technical mentorship to junior engineers.
Required Skills:
3+ years of hands-on experience with Apache Airflow in production environments.
Strong programming skills in Python.
Solid understanding of data engineering concepts, including ETL/ELT processes, workflow orchestration, and data validation.
Experience with SQL and relational databases (e.g., PostgreSQL, MySQL).
Familiarity with cloud platforms (e.g., AWS, GCP, Azure) and their storage and compute services.
Knowledge of containerization tools like Docker and orchestration with Kubernetes (a plus).
Compensation, Benefits and Duration
Minimum Compensation: USD 36,000
Maximum Compensation: USD 126,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Similar Jobs
What you need to know about the Boston Tech Scene
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

