Onebridge Logo

Onebridge

Sr. Data Engineer - Databricks

Posted 2 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
The Sr. Data Engineer - Databricks designs and maintains scalable data solutions using Apache Spark and Databricks, ensuring data quality and performance for analytics and reporting.
The summary above was generated by AI

Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly skilled Sr. Data Engineer – Databricks to join our innovative and dynamic team. 

Sr. Data Engineer – Databricks | About You 

As a Sr. Data Engineer – Databricks, you are responsible for designing, building, and maintaining scalable data solutions that enable analytics, reporting, and data-driven decision making across the organization. You bring deep experience working with modern data platforms and enjoy transforming complex data into reliable, high-quality datasets. You thrive in collaborative environments, partnering with analytics, engineering, and business teams to deliver impactful data pipelines. You are comfortable working in cloud-based ecosystems and consistently apply best practices in data engineering, data governance, and performance optimization. You take ownership of data solutions from design through deployment and ongoing optimization. 

Sr. Data Engineer – Databricks | Day-to-Day 

  • Design, develop, and maintain robust and scalable data pipelines using Apache Spark and cloud-native data services. 
  • Build, optimize, and support ETL/ELT workflows to enable analytics, reporting, and downstream applications. 
  • Implement and manage data solutions using Databricks, Delta Lake, and Unity Catalog. 
  • Ensure data quality, reliability, and performance across large-scale and complex datasets. 
  • Collaborate with cross-functional teams to gather data requirements and translate them into effective technical solutions. 
  • Apply data engineering best practices related to scalability, security, monitoring, and maintainability. 
  • Support the continuous improvement of data architecture, pipeline performance, and operational stability in a cloud environment. 

Sr. Data Engineer – Databricks | Skills & Experience 

  • 7+ years of experience in data engineering or a related technical role. 
  • Strong hands-on experience with Databricks and Apache Spark are required. 
  • Experience working with Delta Lake and Unity Catalog for data management and governance. 
  • Solid understanding of data pipeline design, ETL/ELT patterns, and data modeling concepts. 
  • Experience working with cloud data platforms such as Azure, AWS, or GCP. 
  • Proven ability to design scalable, reliable, and high-performing data solutions. 
  • Strong problem-solving skills and the ability to work effectively in collaborative, fast-paced environments. 

Similar Jobs

Yesterday
Remote
USA
70-81 Hourly
Senior level
70-81 Hourly
Senior level
Healthtech • HR Tech • Information Technology • Professional Services
The role involves building and maintaining financial data pipelines in Databricks, bridging Snowflake, and ensuring data accuracy for finance reporting.
Top Skills: Cloud-Based Data Engineering PlatformsDatabricksPysparkSnowflakeSparkSQL
2 Days Ago
In-Office or Remote
Senior level
Senior level
Sales
Design and implement Lakehouse solutions and data pipelines, optimize Databricks environments, and integrate AI applications while delivering exceptional results for clients.
Top Skills: Ai/Bi DashboardsSparkAWSAzureDatabricksDatabricks SqlDelta LakeGCPLookerMlflowMosaic AiPower BISnowflakeTableauUnity Catalog
8 Days Ago
Remote
United States
7-7 Annually
Senior level
7-7 Annually
Senior level
Information Technology • Software • Consulting
The Senior Data Engineer will design and build data pipelines on Azure Databricks, ensuring data security and governance while collaborating with clients and vendors on projects.
Top Skills: Azure DatabricksDelta LakeEltETLPyspark

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account