The Data Engineer develops and maintains software for public transit, focusing on data processing, testing, and delivering scalable solutions while collaborating with team members.
As the Data Engineer in the Technology’s Innovation Department LAMP team, you will be building and maintaining data pipelines to support analysis of transit and other types of data.
Principal duties and responsibilities:
- As a Data Engineer on our LAMP team, you will play a pivotal role in shaping the architecture and flow of transit data across systems. In this role, you will architect data solutions using modern engineering principles, ensuring scalability and reliability. Your competency in data modeling will be crucial for designing structures that support our business logic and analytical needs. Your analytical skills will be put to use tuning logic to optimizing data processing and retrieval performance.
- This role demands a blend of technical acumen in data engineering tools and practices, strategic thinking for technology selection, and the interpersonal skills to collaborate effectively within the team and broader organization. Your contributions will directly impact the efficiency and effectiveness of our data-driven strategies, making this a critical and rewarding position in our department.
Minimum experience and required skills:
- Proficient with Python
- Proficient with SQL and query optimization
- Experience with data management on local environments
- Experience with automated testing, including continuous integration (CI)
- Experience with Git workflows (such as pull requests) and code reviewing
- Experience with data pipeline architecture and deployment
- Experience with data modeling
- Experience with data quality analysis
- Ability to translate business requirements into technology
- Strong communication skills
- Strong analytical thinking and debugging abilities
- Attention to detail
Preferred experience and skills:
- Knowledge of transit data standards (such as GTFS, GTFS-RT, TODS, TIDES)
- Experience with Terraform / Infrastructure as Code tools
- Experience with AWS data tools and resource management
- Experience with cross-language data platforms like Arrow
Location:
This role can be 100% remote or hybrid.
As a contracted role for the MBTA, we are only able to employ people living in the following states - ME, MA, NH, RI, and VT.
At this time, we are only able to hire US residents who will reside in the US for the duration of their employment
Compensation:
Pay rate range is $75 - $98 per hour (W-2), up to 1880 hours per year.
Top Skills
Aws Glue
Elixir
Power BI
Python
Ruby
Spark
SQL
Tableau
Terraform
MBTA Boston, Massachusetts, USA Office
10 Park Plaza, Boston, MA, United States, 02116
Similar Jobs
Artificial Intelligence • Healthtech • Analytics • Biotech
The Field Engineer I will perform installations, troubleshooting, and repairs on medical equipment, assist senior engineers, and manage customer relations.
Top Skills:
Active DirectoryInformation TechnologyMicrosoft CertificationsNetworkingSQL Server
Security • Cybersecurity
The Engineer will support design projects, conduct facility assessments, develop technical documentation, and interface with clients. Responsibilities include project planning, document standards compliance, and troubleshooting engineering issues.
Top Skills:
AutocadCost Estimating SoftwareEngineering Computer Scheduling Software
Insurance
The AWS Services Managing Engineer leads engineers in developing AWS cloud services, mentors teams, and collaborates with product managers on infrastructure roadmaps.
Top Skills:
AnsibleAWSAzureCloudFormationGCPTerraform
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
