As a Data Engineer, you will architect and implement data ingestion, transformation, and validation processes to ensure high-quality data for ML models and reporting tools.
About Butter Payments:
At Butter Payments, we’re on a mission to eliminate involuntary churn and make recurring payments seamless. Every year, billions of dollars are lost due to failed payments. Butter leverages machine learning, deep financial data partnerships, and behavioral insights to ensure the right payments go through at the right time—without friction. We're backed by world-class investors like Atomic, Norwest Venture Partners, SpringTride, Transpose Platform, and we're growing fast.
The Problem Statement:
You will work closely with Software Engineering, Machine Learning Engineers and Data Analysts. You help ingest, organize and enable Butter to continue to deliver value on the data we collect. We make sure it arrives in a timely manner, is organized and usable, and is of a high quality. Key to all the work Butter does.
Problem Expanded:
We ingest 3rd-party data from multiple payment providers, such as Stripe, clean it and normalize it for our schema and machine learning pipelines.
We're seeking to build transformation and validation layers as far upstream as possible to ensure a smooth flow of data through our system. The transformation layer will make the data easier to work with for our reporting products and ML models, while the validation layer will ensure the data conforms to our expectations. For example: Is it null, NULL, or 'null'? Is 342 a valid country abbreviation code?
As we expand our product offering and ingest data from additional companies and 3rd-party providers the complexity of the challenge will evolve over time, keeping the problem fresh.
Scope:
You'll get to architect our system and lay the foundation for the future from both a technology and a system design perspective.
No longer will data show up without being tested and structured, as you'll create a system that checks its worst tendencies. You'll work closely with our ML and Eng team to ensure the design meets their requirements and that data properly flows through the system.
Philosophies:
- You strongly believe that action creates information.
- You want to work on a small team and have lots of responsibility.
- You look forward to being scrappy and enjoy overcoming challenges.
Requirements:
- 5+ years of experience delivering value through data at an early stage, high growth startup (ideally within the payments industry)
- Prior experience with cloud environments such as AWS or GCP
- Strong Data Modeling experience, and familiarity with different approaches (Intermediate and up)
- Strong SQL skills
- Strong Python skills
- Prior experience with workflow orchestration tools (Prefectm, Airflow, Dagster)
- Experience with distributed systems workflows (Temporal, AWS Step functions)
- Experience with cloud OLAP providers and optimization (Snowflake, Redshift, BigQuery)
- Experience with Kafka pub/sub patterns and data ingestion
- Experience with data transformation patterns and common tools (dbt)
We are focused on building a diverse and inclusive workforce. If you’re excited about this role, but do not meet 100% of the qualifications listed above, we encourage you to apply.
--------
Butter Payments is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics or any other basis forbidden under federal, state, or local law. Butter considers all qualified applicants in accordance with the San Francisco Fair Chance Ordinance.
Please review our CCPA policies here.
Top Skills
Airflow
AWS
BigQuery
Dagster
Dbt
GCP
Kafka
Prefect
Python
Redshift
Snowflake
SQL
Temporal
Similar Jobs
Marketing Tech • Real Estate • Software • PropTech • SEO
Lead the architecture and development of robust data pipelines and backend services for MLS data, integrating AI solutions and ensuring data quality.
Top Skills:
AirflowApache KafkaAWSEmrFlinkGraphQLJavaKubernetesPythonRestSparkSQL
Insurance • Software
The Senior Data Engineer will lead MLOps efforts to streamline model delivery and data processing, implementing automation throughout the machine learning lifecycle and enhancing collaboration between data scientists and engineers.
Top Skills:
AWSCi/CdDockerKafkaMlflowPythonSagemakerSnowflakeTerraform
Artificial Intelligence • Information Technology • Marketing Tech • Software • SEO
In this full stack role, you will build features around data pipelines and LLMs, create web APIs, and work on analytics tools ensuring data quality and processing capabilities.
Top Skills:
BeamCeleryDuckdbFlinkGcp DataflowGoogle BigqueryGoogle Cloud TasksInngestLlmsPandasPolarsPostgresReactResqueSnowflakeSparkSpark SqlTemporal
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
