Afresh Logo

Afresh

Data Engineer

Reposted 23 Days Ago
Easy Apply
Remote or Hybrid
2 Locations
Senior level
Easy Apply
Remote or Hybrid
2 Locations
Senior level
As a Staff Data Engineer, you will design and implement ETLs for large datasets, improve customer data integration, and mentor team members.
The summary above was generated by AI

Afresh is on a mission to eliminate food waste and make fresh food accessible to all. Our first A.I.-powered solution optimizes ordering, forecasting, and store operations for fresh food departments in brick-and-mortar grocers. With our Fresh Operating System, regional and national grocery retailers have placed $1.6 billion in produce orders across the US and we've helped our partners prevent 34 million pounds of food from going to waste. Working at Afresh represents a one-of-a-kind opportunity to have massive social impact at scale by leveraging uncommonly impactful software – we hope you'll join us!

About the Role

We’re looking for a Data Engineer who’s excited to work at the intersection of food waste, large-scale data processing, and applied AI. In this role, you’ll help shape how customer data flows through our platform, improving how we ingest, transform, and operationalize real-world datasets to drive down food waste for grocery chains.

You’ll work closely with other data engineers, product engineers, and AI/ML engineers to design and implement reliable, efficient ETL pipelines and streamline how we integrate with new customers. You’ll contribute to the development of new features that support our expanding product lines. Your work will have a direct and visible impact on our ability to onboard customers more easily/quickly and power our machine learning grocery solution.

What You’ll Do

  • Build and maintain robust data pipelines that ingest, transform, and validate complex customer data using PySpark, Python, and dbt to process billions of records from customer datasets, ensuring data is accurate, reliable, and ready for downstream use.
  • Help improve integrations with new customers, making the process faster and more repeatable through thoughtful tooling.
  • Contribute to the adoption of cutting-edge AI tooling (e.g., LLM-assisted data cleaning, semantic validation, and anomaly detection).
  • Collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features.
  • Identify and implement optimizations to improve ETL runtime and data processing scalability, reducing the time and effort required for integrations.
  • Solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal we need.
  • Learn and grow by pairing with other engineers, participating in design reviews, and taking on bigger and bigger projects.

Skills and Experience

  • 2+ years of experience building ETLs or data workflows with Python, PySpark, SQL, or similar tools.
  • Comfortable working with messy, incomplete, or inconsistent datasets—and turning them into something structured and usable.
  • Experience in identifying areas where tooling or automation can simplify workflows and reduce manual effort.
  • Experience or strong interest in platforms like Databricks, Snowflake, and dbt.
  • Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions.
  • Attention to detail and pride in delivering robust, maintainable solutions.
  • Collaborative and communicative — you work well across teams and aren't afraid to ask questions.
  • Learning mindset — hungry to grow your skills and move fast.

We encourage all highly-qualified candidates to apply, even if they don’t meet every listed qualification.

We encourage you to apply even if you don’t meet every requirement.


Salary Band in US:

Salary Band in CAN:

About Afresh
Founded in 2017, Afresh is working on the #1 solution to curb climate change: reducing food waste. By combining human insight and transformative technology, we're helping grocers provide fresher food to customers at more affordable prices.
Afresh sits at an incredible intersection of positive social impact, rocket ship financial growth, and cutting-edge technology. Our best-in-class AI research has been published in top journals including ICML, and we've raised over $148 million in funding from investors including former co-CEO of Whole Foods Market Walter Robb and Eric Schmidt's Innovation Endeavors.

Fresh is the past, present, and future of our food system – the waste we create today will impact our planet for years to come. Join us as we continue to build a vibrant, diverse, and inclusive team that embodies our company’s values of proactivity, kindness, candor, and humility.
Afresh provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity/expression, marital status, pregnancy or related condition, or any other basis protected by law.

Here at Afresh, many of our employees work remotely provided that they reside in one of the following states: AR, CA, CO, FL, GA, IL, KY, MA, MI, MT, MO, NV, NJ, NY, NC, OR, PA, TX, WA, WI. However, there may be key roles that will require a candidate/employee to be local to our San Francisco, CA office. In which case this requirement will be included in the job posting details under "Skills and experience" for reference. 

Top Skills

Databricks
Dbt
Pyspark
Python
Snowflake
SQL

Similar Jobs

4 Days Ago
Remote or Hybrid
United States
70K-150K
Senior level
70K-150K
Senior level
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
As a Senior Data Engineer, you'll design and maintain scalable data pipelines, optimize data storage, and support AI initiatives in the insurance domain.
Top Skills: BigQueryGoogle Cloud PlatformObject StoragePub/SubPythonScalaSparkSQL
3 Hours Ago
Remote or Hybrid
United States
106K-196K Annually
Senior level
106K-196K Annually
Senior level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
As a Senior Data Engineer, you will design and build scalable data solutions for AI and analytics products, collaborating with engineers and product management. You will also lead project initiatives, engineer data pipelines, and ensure data quality and security.
Top Skills: AirflowAWSCloudbeesDbtFeastJenkinsKafkaPythonQlikShell/BashSnowflakeSQLTableau
2 Days Ago
Remote
USA
152K-179K Annually
Junior
152K-179K Annually
Junior
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
The Software Engineer will design and implement foundational backend infrastructure, manage projects, mentor team members, and maintain cloud provisioning services, while delivering high-quality, well-tested code.
Top Skills: GoTerraform

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account