Senior Data Engineer for OPENLANE, Inc. in Carmel, IN will participate daily in Agile ceremonies to help design, plan, build, test, develop, and support Openlane large enterprise data products and platforms consisting of ADF ETL pipelines and Postgres, DynamoDB, Elastic search, and Snowflake databases; plan and design data schemas; Will work with a team in a shared services delivery model supporting seven lines of business, including front-end customer facing products, B2B portals, mobile applications, business analytics, and data science initiatives. Work with Azure Cloud or AWS, Work with product, data science, analytics, and engineering teams to learn project data needs and define project scope; Conduct Gap Analysis and Data Validation; design and planning of data services solutions on the Data Platform; building and delivery of Azure Data Factory (ADF), Python, Docker, and Kubernetes feed framework data pipeline jobs and services; Manage SQL, Github / Azure DevOps (CI/CD); contribute to the Data Engineering team delivery framework including building of re-usable code, implementing industry best practices, and maintain a common delivery framework; monitoring, maintenance, documentation, and incident resolution of scheduled production data jobs supporting internal and external customers data needs. May work remotely anywhere in the US.
Requirements:
Bachelor’s degree in Computer Science, Software Engineering, Mechanical Engineering, Engineering Management, or related field, and 5 years of progressive experience as a Data Engineer or related occupation in data engineering.
Must possess a minimum of 5 years of experience with the following: SQL and Python development including data warehousing. Must possess a minimum of 3 years of experience with each of the following: Planning and designing data schemas; Azure Cloud or AWS; Gap Analysis and Data Validation; Github / Azure DevOps (CI/CD); Azure Data Factory (ADF), Docker, and Kubernetes; and working with large enterprise data such as Postgres, DynamoDB, Elastic search, or Snowflake. May work remotely anywhere in the U.S.
#LI-DNI
Top Skills
Similar Jobs
What you need to know about the Boston Tech Scene
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
