Cro Metrics Logo

Cro Metrics

Web Quality Assurance Analyst

Sorry, this job was removed at 03:12 p.m. (EST) on Thursday, Jul 10, 2025
Remote
Hiring Remotely in USA
Remote
Hiring Remotely in USA

Similar Jobs

2 Hours Ago
Remote or Hybrid
67 Locations
55K-187K
Mid level
55K-187K
Mid level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
As a Senior Associate, you will lead AI/ML projects, conduct model validation, mentor teammates, and align technology with business strategies.
Top Skills: MlopsPythonPyTorchTensorFlow
2 Hours Ago
Remote or Hybrid
64 Locations
99K-232K Annually
Senior level
99K-232K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead data architecture strategies, mentor team members, leverage team strengths, collaborate with stakeholders, drive technology adoption, and uphold ethical standards.
Top Skills: AWSAws CloudformationAzureAzure Resource ManagerDockerGCPPythonSQLTerraform
2 Hours Ago
In-Office or Remote
3 Locations
Mid level
Mid level
Aerospace • Artificial Intelligence • Hardware • Robotics • Security • Software • Defense
As a Senior Software Engineer, you will design and implement software solutions for military systems, focusing on integration and data processing in complex environments.
Top Skills: C++GoJavaJavaScriptPythonRust
About Cro Metrics

At Cro Metrics, we’re on a mission to redefine growth for organizations and brands through unparalleled digital experiences that inspire action and deliver results. With transformative experimentation as our guide, we bridge bold ideas with practical solutions to create lasting impact.

We are a growth optimization agency that partners with mission-driven and high-growth companies to scale through data-driven experimentation. Our expertise spans A/B testing, personalization, and full-funnel digital strategy—empowering clients to make smarter decisions that drive measurable results.

Our fully remote team of strategists, analysts, engineers, and designers works across industries including eCommerce, fintech, nonprofit, and hospitality. We believe in autonomy, collaboration, and innovation as we help our clients grow smarter and faster.

About the Role

As a Web Quality Assurance Analyst for Cro Metrics, you will serve as a partner to a team of engineers, program managers, and growth strategists. You’ll be the last line of defense before an A/B test is launched on the client’s website for the world to experience. This is not a “check‑the‑box” QA tester role — you’ll need to be comfortable analyzing many different websites across a wide range of complexities, navigating the technical ins and outs of various web experimentation tools, and ensuring all issues are addressed before your final stamp of approval.

This Web QA position is also a launchpad into other paths at Cro Metrics, including Program Management and Growth Strategy. We invest heavily in teammates who show a strong desire to learn, stretch, and grow—pairing you with mentors and dedicating regular professional‑development time so you can chart your next step inside the organization.

Key Responsibilities

  • Partnering closely with the Engineering and Account teams to interpret needs, implement A/B tests, and deliver timely results to clients.

  • Manually performing cross browser, functional, visual, and smoke testing daily across a wide variety of websites, and diving deep into each A/B test to ensure reliable functionality of the web experimentation tools.

  • Perform QA execution on all low or medium levels of complexity more independently with little to no guidance.

  • Perform QA execution on higher levels of complexity, escalations, and troubleshooting with guidance from more senior team members. 

  • Ensuring all A/B test issues are identified, understood, and resolved or addressed with the team through regular written check ins, video chats, and retrospectives.

  • Documenting learnings and observations regularly to help disseminate information the team needs to succeed.

  • Continuously expanding your experimentation knowledge through self‑study, mentorship, and cross‑functional collaboration.

What Makes a Great Quality Assurance Analyst

This is a high communication role, and while no specific experience is required, it can get technical at times as you navigate and troubleshoot A/B tests, dev tools, web technologies, etc. You must be capable of learning new technical concepts quickly and regularly, and be able to communicate with both technical and non-technical stakeholders.

  • Growth mindset — You’re motivated by curiosity, eager to acquire new skills, and view this role as the first step toward a longer career here (think Program Management or Growth Strategy).

  • Empathy — You put yourself in the end user’s shoes, communicate with kindness, and collaborate effectively across disciplines.

  • 1+ year quality assurance experience in a professional environment focused on websites or web application or 2+ years customer service experience or other experience in a high communication role. 

  • Technically-minded — Although no prior experience in experimentation is required, the position can get fairly technical when it comes to the web functionality, experimentation, and tools, resembling a Tier 2 IT Support role.

  • Critical thinking — You can analyze a problem, ask probing questions, and iterate on your own processes.

  • Attention to detail — You have high attention to visual detail, can communicate clear and specific step by step instructions, and leave no stone unturned.

  • High communication — You enjoy writing (a lot), collaborative problem solving, providing clear plans of action, and jumping on a video call.

Nice to haves
  • Experience with Jira, Slack, or Zoom.

  • Experience working fully remotely. (REWORD - Self starter, self motivation)

  • Technical focus in schooling (e.g., Code School, CS Degree).

  • Knowledge of User Experience concepts.

  • Knowledge of Agile concepts.

Benefits & Perks
  • 401(k) with 100% match up to 4%

  • Medical, dental, and vision insurance with 90%+ employer contribution

  • HSA, HRA, FSA, wellness and pet care benefits

  • 4 weeks PTO (5 weeks after 3 years) + paid bereavement and parental leave

  • Professional development support with customized career planning

  • Laptop and gear of your choice

  • Fully remote work culture with welcome packages, surprises, and an annual retreatAccess to group performance coaching sessions

Compensation Range: 45-65K + Benefits

What you need to know about the Boston Tech Scene

Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.

Key Facts About Boston Tech

  • Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
  • Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
  • Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
  • Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account