At Klaviyo, we value the unique backgrounds, experiences and perspectives each Klaviyo (we call ourselves Klaviyos) brings to our workplace each and every day. We believe everyone deserves a fair shot at success and appreciate the experiences each person brings beyond the traditional job requirements. If you’re a close but not exact match with the description, we hope you’ll still consider applying. Want to learn more about life at Klaviyo? Visit careers.klaviyo.com to see how we empower creators to own their own destiny.
Why You Should Join the Test Frameworks and Tooling Team
Engineering confidence is our primary product. We are not testers, but rather infrastructure architects building the sophisticated automation and CI/CD frameworks that make deploying to production a non-event. As the Lead for this team, you will define the technical roadmap for our automated guardrails and repository standards, empowering every engineer in the company to ship at terminal velocity with total confidence. By architecting the foundational tools that guarantee production readiness, you will play a pivotal role in driving Sev-1 incidents toward zero and ensuring our organization can move fast without the fear of breaking things.
What You'll Achieve: Key Responsibilities
As the technical leader for this team, you will drive the evolution of our testing ecosystem and mentor other engineers in the craft of quality engineering:
- Define Architectural Vision: Lead the long-term strategy for our integration and E2E testing frameworks across both backend and frontend stacks. You will ensure these systems are not just reliable, but world-class in their ease of adoption.
- CI/CD Strategy: Architect how we execute tests within our CI system. You will focus on radically optimizing feedback loops so that engineers receive actionable, high-fidelity results in minutes.
- Set Engineering Standards: Establish the "golden paths" for our repositories. You will define the benchmarks for unit testing, code quality metrics, and systemic reliability that all teams will follow.
- Scalable Tooling & Coverage: Design and build the next generation of tools that simplify complex testing scenarios. You will lead efforts to backfill testing gaps at scale through advanced data mocking and service isolation.
- AI-Driven Quality Strategy: Spearhead our efforts to leverage AI within the testing lifecycle. You will identify and implement AI-powered solutions for automated regression detection, flaky test analysis, and intelligent test generation.
- Cross-Functional Leadership: Act as a consultant to feature teams to solve their most complex stability challenges. You will use root-cause analysis from major incidents to propose and implement pillar-wide safety improvements.
- Operational Excellence: Oversee the health and performance of our entire CI/CD pipeline, taking ultimate responsibility for the stability of the environment that hundreds of engineers rely on daily.
- You’ve already experimented with AI in work or personal projects, and you’re excited to dive in and learn fast. You’re hungry to responsibly explore new AI tools and workflows, finding ways to make your work smarter and more efficient.
- High-Leverage Leadership: You are not just building features; you are building the platform that defines the developer experience for the entire company.
- Innovation at the Edge: You will have the autonomy to experiment with emerging technologies like AI and LLMs to solve the age-old problems of flakiness and slow feedback loops.
- Pillar-Wide Influence: As a Lead, your decisions on testing standards and infrastructure will directly impact the speed and quality of every shipping team in the organization.
Who You Are:
- Seasoned Technical Leader: You have 7+ years of software engineering experience with a history of leading complex, high-impact technical projects. You are a hands-on lead who stays close to the code while steering the broader vision.
- Master of Root-Cause Analysis: You don't just fix symptoms; you hunt down systemic failures. You excel at debugging deep-stack issues and transforming those lessons into automated preventions.
- Full-Stack Architect: You are comfortable designing systems across the stack. Whether it is a React-based quality dashboard or a Python service for data seeding, you understand how to build for scale.
- AI Visionary: You are passionate about the intersection of AI and Software Quality. You have a clear perspective on how AI can automate the mundane parts of testing and accelerate the SDLC.
- Extreme Ownership: You take pride in the end-to-end health of the platform. You are proactive in identifying technical debt and are a relentless advocate for engineering excellence.
- CI/CD Expert: You have deep experience with modern CI/CD tools and a sophisticated understanding of how to integrate automated testing into high-frequency deployment pipelines.
Technologies we use (not exhaustive):
- Backend: Python, Django, Go
- Frontend: React, TypeScript, JavaScript
- Testing Frameworks: Playwright, Cypress, Pytest, Jest
- Infrastructure and CI: AWS, Kubernetes, Terraform, Helm, Buildkite
- Data: MySQL, Redis, Kafka
- AI Tools: Integration with Claude, Cursor, Copilot, or internal AI enablement frameworks
Massachusetts Applicants:
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Our salary range reflects the cost of labor across various U.S. geographic markets. The range displayed below reflects the minimum and maximum target salaries for the position across all our US locations. The base salary offered for this position is determined by several factors, including the applicant’s job-related skills, relevant experience, education or training, and work location.
In addition to base salary, our total compensation package may include participation in the company’s annual cash bonus plan, variable compensation (OTE) for sales and customer success roles, equity, sign-on payments, and a comprehensive range of health, welfare, and wellbeing benefits based on eligibility.
Your recruiter can provide more details about the specific salary/OTE range for your preferred location during the hiring process.
Get to Know Klaviyo
We’re Klaviyo (pronounced clay-vee-oh). We empower creators to own their destiny by making first-party data accessible and actionable like never before. We see limitless potential for the technology we’re developing to nurture personalized experiences in ecommerce and beyond. To reach our goals, we need our own crew of remarkable creators—ambitious and collaborative teammates who stay focused on our north star: delighting our customers. If you’re ready to do the best work of your career, where you’ll be welcomed as your whole self from day one and supported with generous benefits, we hope you’ll join us.
AI fluency at Klaviyo includes responsible use of AI (including privacy, security, bias awareness, and human-in-the-loop). We provide accommodations as needed.
By participating in Klaviyo’s interview process, you acknowledge that you have read, understood, and will adhere to our Guidelines for using AI in the Klaviyo interview Process. For more information about how we process your personal data, see our Job Applicant Privacy Notice.
Klaviyo is committed to a policy of equal opportunity and non-discrimination. We do not discriminate on the basis of race, ethnicity, citizenship, national origin, color, religion or religious creed, age, sex (including pregnancy), gender identity, sexual orientation, physical or mental disability, veteran or active military status, marital status, criminal record, genetics, retaliation, sexual harassment or any other characteristic protected by applicable law.
Top Skills
Klaviyo Boston, Massachusetts, USA Office
We're in the heart of the Financial district with easy access to public transportation and a short walk from South Station. We also have hubs in Denver, London and Sydney.
Similar Jobs at Klaviyo
.png)
What you need to know about the Boston Tech Scene
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
