Designs, builds, tests, documents, and maintains large-scale data pipelines across platforms and sources. Performs ETL and ELT, develops data quality and governance processes, supports anomaly detection, and ensures database security and compliance. Collaborates with architects, analysts, and stakeholders to translate business needs into technical solutions. The role also mentors junior engineers, oversees projects, and works with cloud platforms, relational databases, SQL, Python, Spark, and large-scale processing engines.
The Sr Data Engineer will design and manage data systems, pipelines, and management tools. They will oversee junior data engineers, recommend and deploy data models, and lead projects involving data collection and storage systems. This role will design, build, document, test, and maintain critical data pipelines from large volumes of data from internal and external data sources cross different platforms.PRIMARY RESPONSIBILITIES:
- Collaborate with data architect, analysts, and stakeholders to identify and document needs/requirements for data pipelines and process automation
- Design, build, document, test, and maintain data pipelines using industry best practices
- Performs ETL, ELT operations in accordance with enterprise data governance and security standards
- Develop data quality and governance process to ensure the accuracy and quality of the data through inspection, validation, processing, anomaly detection
- Detail oriented and proactive in taking measures to avoid or mitigate issues.
- Excellent understanding of computer systems, integrations, databases, and data storage systems.
- Understanding of agile data engineering concepts and processes
- Ability to capture and document business processes and requirements and work with colleagues to create functional requirements.
- Ability to work with clients to translate business needs to technical solutions
- Ability to provide guidance, mentoring, and training for peers
- Exceptional interpersonal skills and ability to effectively communicate with teams across the entire organization.
- Demonstrates the organization’s core values, exuding behavior that is aligned with the firm’s culture
- Proficiency in Microsoft Office Suite (Word, Excel, PowerPoint, Outlook)
- Ability to learn any other appropriate program or software system used by the firm as necessary
- 5-7 years of relevant experience required
- BA/BS in relevant discipline required
- Vast experience with multiple development methodologies
- Experience of building large, complicated data pipelines cross different platforms, data sources, data structures
- Experience of working with relational databases such as SQL Server, Oracle, etc., and SQL scripting
- Experience of cloud platforms (like AWS, Azure, GCP) and its ETL tools and techniques of sourcing, maintaining, and updating data, data warehousing, data cleansing & transformation, etc.
- Programming experience in Python, Spark, and other similar languages
- Advanced programming knowledge and experience with large-scale processing engines are required, as well as a deeper understanding of database security and compliance tools.
- This position description is intended to describe the level of work required of the person performing in the role and is not a contract. The essential responsibilities are outlined; other duties may be assigned as needs arise or as required to support the organization. All requirements may be subject to reasonable accommodation to applicants and colleagues who need them for medical or religious reasons.
#LI-RL1
IND1
Click here for some insight into our culture!
The Baldwin Group will not accept unsolicited resumes from any source other than directly from a candidate who applies on our career site. Any unsolicited resumes sent to The Baldwin Group, including unsolicited resumes sent via any source from an Agency, will not be considered and are not subject to any fees for any placement resulting from the receipt of an unsolicited resume.
Similar Jobs
Information Technology
Drives growth of CDW’s security portfolio among state and local government customers. Builds executive relationships with CIOs and CISOs, leads security opportunities from discovery through close, and positions broad security solutions across identity, cloud, risk, compliance, threat management, and secure infrastructure. Partners with sales teams, solution architects, delivery teams, vendors, and public-sector stakeholders to develop integrated solutions, manage procurement cycles, coordinate events, and maintain accurate forecasts. Regional travel is required as needed.
Top Skills:
Cloud SecurityEndpoint SecurityIdentity And Access ManagementRisk And ComplianceSecure InfrastructureThreat And Vulnerability Management
Information Technology
Leads medium- to large-scale technology projects and programs from planning through delivery, managing scope, schedules, budgets, risks, quality, profitability, and client relationships. Serves as a trusted technology consulting partner, coordinates cross-functional and third-party teams, supports presales, ensures Statement of Work commitments, and applies formal and Agile methodologies. Coaches project managers, improves PMO processes, and uses Jira, Azure DevOps, and Microsoft Project to drive successful outcomes.
Top Skills:
AgileAzure DevopsCloudInfrastructureItilJIRAMS OfficeMicrosoft ProjectSecurity
Information Technology
Leads Google and ISV partner relationships, manages cadence meetings and business reviews, maintains partner sales portals and joint pipelines, promotes cloud capabilities, supports partner opportunities, coordinates marketing events, tracks ROI, and communicates program updates internally. The role is fully remote, national, and requires up to 50% travel.
Top Skills:
DevOpsGCPIaasSaaSSalesforce
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
