Data Scientist II - Experimentation

At Chewy, it is our mission to become the most trusted and convenient online destination for pet parents and our partners - vets and service providers - alike. Our success is measured by the happiness of the people and pets we serve, not simply by the amount of pet supplies we deliver. That's why we continue to think of outside-the-Chewy-box ways to delight, surprise, and thank our loyal pet lovers!
Our Opportunity:
Chewy is looking for a Data Scientist II to join the Experimentation Platform (A/B testing). Our platform supports 100+ active internal users across multiple teams and organizations, enabling rigorous A/B testing to drive new customer experiences. In this role, you'll be instrumental in establishing an experimentation culture founded on core principles of statistical rigor and effective methodology design. This is a high-impact, high-visibility position that plays a critical role in how Chewy measures and implements customer-facing changes. You'll work cross-functionally with teams across the business, gaining exposure to diverse domains and influencing decision-making at the highest levels. Join a collaborative, fast-paced team where you'll tackle new challenges daily, contribute to meaningful outcomes, and grow alongside a platform that's central to Chewy's core business strategy.
What You'll Do:

• Employ statistical methods to address common pitfalls like peeking, multiple comparisons, p-hacking.
• Apply statistical methodologies to design and analyze online experiments (e.g., A/B/n tests, holdouts).
• Help develop and maintain diagnostic systems for experiment quality (e.g., bias detection, data quality alerts, Session Ratio Mismatch).
• Develop relevant surrogate metrics for faster and more accurate experimentation considering full customer journey and tradeoffs.
• Build out and operationalize causal inference models to calculate annualized incremental lift on output metrics such as revenue. Create models to measure long-term impact using high value actions.
• Support experimentation platform users with guidance on test setup, metric selection, and hypothesis framing.
• Ensure quality of data and computation by developing monitoring and alerting mechanisms to catch spillovers and bias and provide guidance on step-wise identification of root-causes.
• Define and operationalize experimentation best practices, statistical and scientific methodologies and scalable frameworks for creating, monitoring, and learning from experiments.
• Build AI agents to help optimize experiment workflows and knowledge retrieval.

What You'll Need:

• Bachelor's degree in a quantitative field (e.g., Statistics, Mathematics, Data Science, Economics, Computer Science) or related experience.
• 3+ years Data Science experience.
• 3+ years of experience with A/B testing, preferably within an e-commerce environment.
• 3+ years of experience with causal inference techniques or modeling long-term treatment effects (Diff-in-diff, Propensity Score Matching, Causal Forest, etc...).
• Strong foundational knowledge in statistics (e.g., hypothesis testing, confidence intervals, variance reduction).
• Advanced object-oriented programing in Python.
• Advanced knowledge of SQL.
• Experience communicating insights to non-technical audiences.
• Familiarity with using LLMs and AI Agents to automate data and analytical workflows.

The specific salary offered to a candidate may be influenced by a variety of factors including but not limited to the candidate's relevant experience, education, and work location. In addition, this position is eligible for 401k and a new hire and annual equity grant.
We offer different types of insurance, such as medical/Rx, vision, dental, life, disability, hospital indemnity, critical illness, and accident. We offer parental leave, family services benefits, backup dependent care, flexible spending accounts, telemedicine, pet adoption reimbursement, employee assistance program, and many discounts including 10% off pet insurance and 20% off at Chewy.com.
Salaried-exempt team members have unlimited PTO, subject to manager approval. Team members will receive six paid holidays per year. Team members may be eligible for paid sick and family leave in compliance with applicable state and local regulations.
Pay Range
$120,500-$193,500 USD
Chewy is committed to equal opportunity. We value and embrace diversity and inclusion of all Team Members. If you have a disability under the Americans with Disabilities Act or similar law, and you need an accommodation during the application process or to perform these job requirements, or if you need a religious accommodation, please contact [email protected].
If you have a question regarding your application, please contact [email protected].
To access Chewy's Customer Privacy Policy, please click here. To access Chewy's California CPRA Job Applicant Privacy Policy, please click here.