v4c.ai Logo

v4c.ai

Databricks QA Engineer

Posted 3 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
70-80 Hourly
Senior level
Remote
Hiring Remotely in United States
70-80 Hourly
Senior level
Own quality strategy and release sign-off for enterprise Databricks data platforms. Build Python and PySpark test suites with pytest, validate ingestion and Medallion transformations, implement data quality rules, test Delta Lake and ELT workflows, and maintain CI quality gates that block failed releases. Partner with data engineers and customers to improve automation coverage and prevent production data errors.
The summary above was generated by AI
About V4C

V4C is a pure-play Databricks partner, and in under two years we have earned 850+ Databricks certifications across 325+ customers and been named Databricks' 2026 Partner of the Year (C&SI Emerging).

As a Databricks QA Engineer on our data engineering team you will own the quality gate for enterprise data platforms, working directly with customers. You will work on live enterprise data platforms alongside one of the most heavily Databricks-certified delivery teams in the market.

The Role

This is a QA role for people who understand data engineering, not general software QA pointed at a data project. You will validate Lakehouse pipelines, which means reasoning about row counts, schema drift, late-arriving data, and silent transformation errors no UI will ever surface. Our approach is automation-first: suites in Python and PySpark, running in CI, blocking promotion when they fail. You own release sign-off, which makes you the last person between a customer and bad data in production. 

Responsibilities

  • Own test strategy and release sign-off on engagements, including documented test plans covering scope, risk, and coverage
  • Build and maintain automated test suites in Python and PySpark (pytest), integrated into CI pipelines
  • Validate data pipelines end to end: ingestion, Medallion layer transformations, Delta Lake tables, and ELT workflows
  • Implement data quality rules as code, including Lakeflow expectations and reusable validation frameworks
  • Run regression validation after code changes and maintain CI quality gates that block merge or promotion on failure
  • Partner with engineers to identify automation candidates and raise the coverage bar across the practice

Requirements
  • 5+ years in QA automation or test engineering, including meaningful time testing data pipelines rather than applications alone
  • A data engineering background: you can read a pipeline, reason about a transformation, and write the SQL to verify it
  • Expert-level SQL
  • Experience with Medallion architecture, Delta Lake, and ELT-based data platforms
  • Experience building automated suites that run in CI and gate deployment
  • Demonstrable hands-on experience working on Databricks or similar platforms

Preferences

  • Healthcare or life sciences experience preferred but not required
  • Existing Databricks certification(s)
  • Hands-on experience with Unity Catalog, Lakeflow pipelines, or Databricks Asset Bundles
  • Experience with Azure DevOps pipelines, or equivalent CI tooling (GitHub Actions, GitLab CI)
  • Familiarity with contract-based data validation standards such as ODCS
  • Experience using LLM agents or MCP-connected tooling to run validations, triage failures, or draft defect reports
  • Consulting or client-facing background

Benefits

Pay Rate: $70 – $80 per hour (1099 independent contractor).

This is a contract engagement rather than a salaried employee role. Where a rate lands within the range depends on depth of data-pipeline testing experience and automation capability. Open to contractors anywhere in the United States.

Similar Jobs

An Hour Ago
Remote or Hybrid
United States
246K-329K Annually
Senior level
246K-329K Annually
Senior level
Artificial Intelligence • Big Data • Software • Analytics • Business Intelligence • Big Data Analytics
Own and improve Hex’s production infrastructure across cloud computing, networking, databases, CI/CD, observability, security, and single-tenant environments. Projects may include Kubernetes and AWS operations, infrastructure automation, PostgreSQL scaling, deployment systems, cost optimization, workload isolation, and customer-facing connectivity features. The role requires end-to-end ownership, on-call participation, technical writing, and the ability to turn ambiguous infrastructure problems into shippable solutions.
Top Skills: AWSCi/CdDatadogDnsDynamoDBEksElasticacheGoIamKubernetesLancedbMskNode.jsPostgresPrivatelinkPythonRdsRedisRustTerraformTlsTypescriptVpc
An Hour Ago
Remote or Hybrid
200K-500K Annually
Expert/Leader
200K-500K Annually
Expert/Leader
Artificial Intelligence • Big Data • Cloud • Information Technology • Machine Learning • Software
Lead and scale Nexthink’s U.S. federal sales organization, owning pipeline, forecasting, quota attainment, strategic agency opportunities, partner and contract-vehicle strategy, and federal go-to-market execution. Recruit and coach sales leaders and account executives, build repeatable sales processes, navigate procurement and FedRAMP requirements, and collaborate cross-functionally to expand SaaS adoption across civilian, DoD, and intelligence agencies.
Top Skills: ApmCloud-Native PlatformsEndpoint CybersecurityFedrampGsa ScheduleItsmMeddpiccObservabilitySaaSVdi
An Hour Ago
Remote or Hybrid
CA, USA
100K-148K Annually
Senior level
100K-148K Annually
Senior level
Gaming
Designs and implements live game content, events, systems, and features for a mobile game. Responsibilities include balancing events using mathematical models, analyzing player feedback and metrics, improving design tools and pipelines, collaborating across disciplines, documenting user experiences, prototyping new event types, and leading creative brainstorming. The role requires strong systems, narrative, content, game-balancing, communication, and mobile gaming expertise, plus Unity experience and either two shipped games or five years of Live Ops experience.
Top Skills: Unity

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account