MeridianLink Logo

MeridianLink

Data Engineer

Reposted 20 Days Ago
Remote
Hiring Remotely in US
95K-120K Annually
Mid level
Remote
Hiring Remotely in US
95K-120K Annually
Mid level
Design, build, and maintain scalable batch and near-real-time data pipelines and data products using Databricks and Spark. Integrate internal/external sources, implement data models, ensure data quality, support BI (Sisense), CI/CD, and collaborate with analysts, scientists, and stakeholders to enable analytics and decision-making.
The summary above was generated by AI

We are seeking an accomplished Data Engineer to join our rapidly growing team. This role is responsible for designing, building, and evolving scalable data pipeline architecture to ensure reliable, high-quality data delivery across the organization. The ideal candidate is a hands-on engineer with strong experience building and maintaining data pipelines, and a passion for delivering robust data solutions that enable analytics and business decision-making.

The Data Engineer will partner with data architects, data analysts, data scientists, and cross-functional stakeholders to deliver trusted data assets supporting a wide range of business initiatives. They will ensure efficient and reliable data delivery across multiple teams, systems, and products in a dynamic environment. This role offers the opportunity to evolve and enhance a modern data platform by improving existing pipelines or redesigning them for greater scalability, performance, and maintainability. The successful candidate will apply modern software engineering practices, including AI-assisted development tools, to improve productivity, code quality, and delivery speed while maintaining strong engineering standards.

RESPONSIBILITIES

• Design, develop, and maintain scalable data pipelines and data products for

internal and external consumers.

• Build and optimize batch and near real-time data ingestion, transformation, and

delivery processes.

• Integrate data from internal and external sources to support business, reporting,

and analytics requirements.

• Collaborate with data architects, analysts, data scientists, and business

stakeholders to deliver scalable data solutions and support Sisense dashboards

and analytics assets.

• Design and implement data models that support reporting, analytics, and

operational use cases.

• Ensure data quality, reliability, and performance through monitoring, validation,

automated testing, and troubleshooting.

• Write maintainable, well-documented, and testable code; participate in code

reviews; and leverage AI-assisted development tools to improve quality and

efficiency.

• Support CI/CD, infrastructure automation, technical documentation, and

continuous improvements to data architecture, tooling, and engineering practices

QUALIFICATIONS

• 2–4 years of professional experience in Data Engineering, Data Warehousing, or

related roles.

• Strong hands-on experience with Python and SQL for building scalable data

pipelines and transformation logic.

• Experience with Apache Spark, Parquet, and Azure Databricks, including

Databricks workflows, Delta Lake, Delta Sharing, and Unity Catalog.

• Strong SQL expertise including performance tuning, indexing, partitioning, query

optimization, and stored procedure development.

• Solid understanding of ETL/ELT methodologies, data warehousing principles,

and modern data engineering best practices.

• Experience designing and implementing data models to support analytics,

reporting, and operational use cases.

• Experience supporting or working with BI tools such as Sisense (or similar

platforms).

• Experience with CI/CD pipelines and version control practices (e.g., GitLab,

Jenkins, or equivalent).

• Experience working in fast-paced product environments with an emphasis on

delivery, maintainability, and minimizing technical debt.

• Strong communication skills with the ability to collaborate across technical and

non-technical stakeholders

BONUS QUALIFICATIONS

• Experience building lightweight data applications or internal tools using any of

the following frameworks such as Streamlit, Dash, Flask, Gradio, Shiny, or

Node.js.

• Ability to navigate ambiguity, prioritize effectively, and adapt to changing

business needs.

• Prior experience in financial services or regulated environments is a plus

Similar Jobs

6 Hours Ago
Remote or Hybrid
Pennsylvania, USA
79K-185K Annually
Senior level
79K-185K Annually
Senior level
Digital Media • Information Technology • News + Entertainment
Design, build, and maintain large-scale data pipelines and lake architectures on AWS using Spark/Databricks. Ensure data quality, lineage, observability, and TDD-based testing. Support self-service analytics, semantic layers, and cross-functional stakeholders while providing production support and documentation.
Top Skills: Apache IcebergSparkAWSDatabricksDatabricks Delta Live Tables (Dlt)Delta LakeKubernetesLookerPysparkPythonSnowflakeSQLTabTeradata
Yesterday
Remote or Hybrid
120K-180K Annually
Senior level
120K-180K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architect, deploy, and operate core data platform services (Airflow, Superset, Terraform). Build CI/CD pipelines, automate with Python, manage cloud infrastructure, implement security and compliance, develop dbt data models, catalog assets in OpenMetadata, and mentor junior engineers.
Top Skills: Apache AirflowApache SupersetAWSAzureCi/CdDbtDockerGCPIamKubernetesOciOpenmetadataPythonSQLTerraform
2 Days Ago
In-Office or Remote
124K-207K Annually
Senior level
124K-207K Annually
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Design, build, and maintain scalable data architecture and pipelines to support medical analytics and predictive models. Partner with product and data leads, prepare datasets, automate data delivery, mentor colleagues on standards, and evaluate tools to improve analytics productivity and stability.
Top Skills: Adobe AnalyticsAdobe LaunchApache AirflowBrighttagCharles ProxyCSSData WarehousingDatabricksDataiku (Dss Data Science Studio)DrupalDynamic Tag ManagerEnsightenGoogle AnalyticsGoogle Tag ManagerHTMLInfrastructure As CodeJavaScriptJqueryKafkaMatomo/PiwikOmniture SitecatalystPiwik ProSignalTealium Iq

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account