Worldly Logo

Worldly

Senior Data Engineer

Posted One Month Ago
Remote
Hiring Remotely in United States
135K-165K Annually
Senior level
Remote
Hiring Remotely in United States
135K-165K Annually
Senior level
Own and evolve Worldly’s production data lake, Postgres warehouse, CDC and streaming pipelines, dbt transformations, orchestration, BI access controls, and graph integrations. Maintain reliable, governed analytics infrastructure using Iceberg, Trino, Dagster, Terraform, and AWS. Support production generative AI workflows involving embeddings, similarity search, extraction, and classification. Responsibilities include data quality, monitoring, security, incident response, disaster recovery, schema governance, and collaboration with data science and analytics stakeholders.
The summary above was generated by AI
Senior Data Engineer

Location: Remote - US

About Worldly
Worldly is the world's most comprehensive impact intelligence platform — delivering real data to businesses on impacts within their supply chain. Worldly is trusted by 40,000 global brands, retailers, and manufacturers to provide the single source of ESG intelligence they need to accelerate business and industry transformation.

Through strategic and meaningful customer relationships, Worldly provides key insights into supplier performance, product impact, trends analysis, and compliance. When a company wants to change how business is done, we enable that systemic shift.

Backed by a dedicated global team of individuals aligned by values, Worldly proudly operates as a public benefit corporation with backing from mission-aligned investors. Want to learn more? Read our story.

About the Opportunity

Worldly is hiring a hands-on data engineer with a passion for sustainability to join our dynamic team. You will take on a primary role in building, operating, maintaining, and evolving the systems that support our internal analytics and power our customer-facing analytics platforms.

In this role, you will:

  • Own our production data lake — a CDC-fed, medallion (bronze/silver/gold) lake on Apache Iceberg, queried through Trino — as well as our independent Postgres data warehouse.

  • Play a core role in integrating our graph database with the warehouse, lake, and primary databases, including migrating legacy pipelines onto a single, governed integration layer.

  • Apply generative AI and embeddings-based techniques already running in production (e.g., entity matching, document extraction) to keep expanding what our data can do.

What You'll Do

Data Warehouse & Data Lake

  • Operate and evolve our Postgres data warehouse (schema, performance, access controls) and build analytics-ready datasets from it.

  • Own the lake end-to-end: CDC ingestion (source database → message bus → streaming writer → Iceberg bronze/silver/gold), the Trino query layer, and the table catalog.

  • Own pipeline health — latency SLAs, schema-drift detection, source reconciliation — and the GitOps/Terraform infrastructure and backup/DR posture underneath it.

  • Bring consistent schemas, documented lineage, and clear ownership to a data estate that's grown quickly through acquisitions.

Orchestration, Transformation & Reporting

  • Maintain and evolve our Dagster-orchestrated dbt pipelines: sensor-triggered and scheduled builds, data quality tests, branch-based versioning for curated releases.

  • Operate our BI/reporting layer, including per-user, policy-based data access enforced at the query engine (not just the dashboard), and consistent metric definitions across dashboards.

Graph Integration

  • Own pipelines integrating the graph database with the warehouse, lake, and primary databases, working within canonical data models and a single write path.

  • Partner with data science to migrate legacy direct-to-graph services onto that shared path, and to evolve relational structures into graph-native models.

GenAI/NLP Enablement

  • Support and extend production genAI workflows — embeddings/similarity search, LLM-based extraction and classification — and keep our data infrastructure "AI-ready."

We'd Like to See

  • 5+ years in data engineering, analytics engineering, or data platform engineering.

  • Advanced SQL and relational database experience (Postgres, MongoDB).

  • Hands-on graph database experience in production, including integrating graph models with warehouses and lakes — core, not peripheral, to this role.

  • Experience with open table formats and medallion lake architectures (e.g., Apache Iceberg) and distributed SQL engines (e.g., Trino, Presto).

  • Experience with streaming/CDC pipelines (e.g., Kafka or Pulsar, Debezium, Flink or similar).

  • Strong Python skills for pipelines, automation, and operational tooling.

  • Experience with dbt orchestrated by a modern scheduler (e.g., Dagster, Airflow).

  • AWS infrastructure experience (EKS, VPC, IAM, S3) via infrastructure-as-code (e.g., Terraform), plus CI/CD, GitOps (e.g., ArgoCD), and Docker.

  • Experience with analytics data modeling, metric definitions, and automated monitoring/data-quality controls.

  • Experience operating production data systems: incident triage, root-cause analysis, runbooks, reliability improvements.

  • Comfortable working with cross-functional/analytics stakeholders (Jira/Confluence, Agile).

  • Familiarity with data security practices (PII protection, encryption, access management).

It Helps If You Have

  • Experience with BI tooling supporting per-user, policy-based data access (e.g., Superset with SSO impersonation).

  • Experience with policy-based access control (e.g., OPA) and identity platforms (e.g., Keycloak).

  • Familiarity with multi-region data residency (e.g., separate EU/China data handling).

What We Can Offer You

  • Medical, Dental, and Vision Insurance are offered through multiple PPO options. Worldly covers 90% of employee premiums and 60% of spouse/dependent premiums.

  • Company-sponsored 401k with up to 4% match for US employees.

  • Incentive Stock Options.

  • 100% Parental Paid Leave.

  • Unlimited PTO.

  • 12 paid company holidays.

Life at Worldly
Our team is motivated to transform the way products are made. By helping our customers succeed in a new era of sustainable production, we can build technology that makes a difference on a planetary level.

Our team represents over 15 countries and brings unique experiences from technology to farming to the table. Surround yourself with kind, enthusiastic, and dedicated people who put collaboration and growth at the center of our shared goals.

Benefits and Perks

  • Earn a competitive salary and performance-based bonuses. Get healthcare, retirement matching, and equity for US employees.

  • Use the office stipend to get the supplies you need—combat Zoom fatigue with no-meeting Fridays.

  • Flexible time off. Take the time you need to recharge. Our culture encourages team members to explore and rest to be their best selves.

  • We're remote, not lonely. Join the culture committee, coffee chats, or a variety of other interest groups.

Travel Notice
Roles at Worldly may require occasional travel to support business needs, including but not limited to team collaboration, customer engagement, or company events.

Equity Statement
We believe reflecting the diversity of those we strive to serve is essential. True innovation happens when everyone has room at the table, including the tools, resources, and opportunity to excel. We're dedicated to building a culturally and experientially diverse team that leads and works with empathy and respect.

Compensation Overview
Annual Base Rate (USD): $135,000 - $165,000
10% Annual Bonus
Incentive Stock Option Package
Work-From-Home Stipends

*Final compensation figures will be determined based on a wide variety of factors, including experience and location. These factors will be evaluated and considered by Worldly throughout the entirety of this process.

Similar Jobs

7 Days Ago
In-Office or Remote
Boston, MA, USA
153K-205K Annually
Senior level
153K-205K Annually
Senior level
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
Build and operate production data pipelines, models, and data products supporting finance, accounting, treasury, compliance, and regulatory reporting. Partner cross-functionally to define requirements, model on-chain and internal data, and ensure data reliability through reconciliation, quality checks, monitoring, and alerting. Use SQL, Python, cloud data warehouse, Airflow, dbt, and AI tooling. Mentor engineers, review technical work, document systems, and communicate data concepts to technical and non-technical audiences.
Top Skills: Apache AirflowBlockchainCloud Data WarehouseDbtPythonSQL
23 Days Ago
Easy Apply
Remote or Hybrid
USA
Easy Apply
150K-250K Annually
Senior level
150K-250K Annually
Senior level
Fintech • Software • Financial Services
Own data pipelines into and out of the warehouse, dbt models, data integrity, governance, identity resolution, reverse ETL, and quality monitoring across growth, lifecycle, and brokerage data. Partner with product, marketing, and operations teams to establish data contracts, ensure accurate and timely business metrics, and support regulated financial data requirements.
Top Skills: AirflowArgo WorkflowsChange Data CaptureDatadogDbtFivetranKubernetesPythonReverse EtlSegmentSnowflakeSQL
15 Hours Ago
In-Office or Remote
165K-242K Annually
Senior level
165K-242K Annually
Senior level
Cloud • Information Technology • Machine Learning
Designs and operates enterprise-scale data platforms, including batch and streaming pipelines, transformation and orchestration workflows, analytical data warehouses, telemetry systems, data catalogs, semantic layers, and AI-supporting data interfaces. The role requires production monitoring, incident support, architectural decision-making, and collaboration with engineering, analytics, data science, and business stakeholders.
Top Skills: Apache AirflowAWSDagsterDbtGoGoogle Cloud PlatformJavaAzurePythonScalaSQL

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account