Easy Apply
Easy Apply
Seeking a Staff Data Engineer to architect scalable data systems, mentor engineers, and enable analytics for AI initiatives using PySpark.
About Us
Wizard is the top-performing AI Shopping Agent, delivering the best products from across the web with unmatched accuracy, quality, and trust.
The RoleWe are seeking a Staff Data Engineer with deep expertise in PySpark to join our data team. This is a hands-on technical role for someone passionate about building scalable data systems, mentoring engineers and shaping data strategy. You’ll architect systems that power high performance batch and real time data processing, enable advanced analytics and accelerate our AI initiatives.
Key Responsibilities- Design and evolve scalable, distributed data infrastructure across cloud platforms
- Build and maintain real time and batch data processing pipelines supporting analytics and AI/ML workloads
- Develop and manage integrations with third party e-commerce platforms to expand our data ecosystem
- Ensure data availability, reliability and quality through monitoring and automated auditing
- Partner with engineering, AI and product teams on data solutions for business critical needs
- Mentor and support data engineers, establishing best practices and code quality standards
- 5+ years of software development and data engineering experience with demonstrated ownership of production grade data infrastructure
- Bachelor's degree in Computer Science or a related field, or equivalent practical experience.
- Deep expertise scaling Spark in production (Databricks, EMR, etc)
- Strong understanding of distributed computing and modern data modeling for scalable systems
- Proficient in Python with experience implementing software engineering best practices
- Hands-on experience with both relational (MySQL / PostgreSQL) and NoSQL (MongoDB, DynamoDB, Cassandra) databases
- Strong communicator with experience influencing cross functional stakeholders
- Experience working in early-stage, high-growth environments
- Familiarity with MLOps pipelines and integrating ML models into data workflows.
- Passionate about problem-solving with a proactive approach to finding innovative solutions.
The expected base salary range for this role is $208,000 – $235,000 USD, and will vary based on skills, experience, role level, and geographic location. Final compensation will be determined by considering these factors alongside overall role scope and responsibilities.
In addition to base salary, Wizard offers:
- Equity in the form of stock options
- Medical, dental, and vision coverage
- 401(k) plan
- Flexible PTO and company holidays
- Fully remote work within the United States
- Periodic company-wide offsites and team gatherings
Wizard is committed to fair, transparent, and competitive compensation practices.
Top Skills
Cassandra
Databricks
DynamoDB
Emr
MongoDB
MySQL
Postgres
Pyspark
Python
Spark
Similar Jobs
Healthtech • Software • Telehealth
The Principal Product Manager will drive product vision, development, and commercialization for new group practice offerings, focusing on market research, partnership strategies, and collaboration with cross-functional teams.
Top Skills:
Agile Development MethodologiesSaaS
Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The Data Exchange Senior Associate manages the implementation of electronic interfaces for various products, ensuring quality data exchange and providing consultative solutions to clients and internal partners.
Top Skills:
JclMicrosoft AccessExcelTso
AdTech • Artificial Intelligence • Cloud • Digital Media • Marketing Tech • Analytics • Consulting
The Client Success Director drives retention and growth for top brand accounts, curating sales narratives, leading high-stakes negotiations, and ensuring clients leverage their tech stack for optimal business outcomes.
Top Skills:
Adobe AnalyticsAnalyticsCloud-Based SolutionsData ScienceDigital MediaGa4Programmatic Media
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
