Help Us Shape the Future of AI at Descript!
Are you obsessed with quality, detail-oriented to a fault, and fascinated by the world of AI? Perfect—because we’re on the hunt for a QA pro to make sure our groundbreaking AI-powered products are as reliable and polished as they are revolutionary. At Descript, we’re not just changing how content creators work with audio and video—we’re making magic 🌟. And we need someone like you to help make sure that magic happens, every time.
This is your chance to dive into the fast-paced world of AI technology, take quality to the next level, and put your stamp on tools that creators will actually love using.
This role can be remote in the US or based in the SF Bay Area.
What You'll Do
- Build scalable processes for evaluating AI models—both quantitatively and qualitatively—so we can stay ahead of the game.
- Work hand-in-hand with our brilliant AI Research team to create test plans, run experiments, and identify areas for improvement or inconsistencies in model behavior.
- Set the gold standard for model quality by creating baselines, benchmarks, and rating systems.
- Keep everything organized with clear test plans, documentation, and bug reports that your future self (and team) will thank you for.
- Tap into internal and external resources to gather the data we need to refine and perfect our models.
- Be the go-to expert for working with third-party service providers to ensure they meet our sky-high quality standards.
- Continuously improve testing tools and methodologies.
- Share the QA love by mentoring others and collaborating across teams to make sure everything works beautifully together.
What You Bring
- 2+ years experience leading evaluation of AI models.
- 2+ years experience as a test lead on a team, product area, or feature.
- 5+ years QA experience.
- Experience working with AI Research teams.
- Ability to collaborate effectively with cross-functional teams and stakeholders.
- Bachelor’s degree in Computer Science, Engineering, or equivalent relevant experience.
Nice to Haves
- Experience evaluating AI speech or video models.
- Experience writing SQL queries.
- Experience using Python for scripting.
The base salary range for this role is $140,000-$181,000. Final offer amounts will carefully consider multiple factors, including prior experience, expertise, and location, and they may vary from the amount above.
Descript is building a simple, intuitive, fully-powered editing tool for video and audio — an editing tool built for the age of AI. We are a team of 150 — with a proven CEO and the backing of some of the world's greatest investors (OpenAI, Andreessen Horowitz, Redpoint Ventures, Spark Capital).
Descript is the special company that's in possession of both product market fit and the raw materials (passionate user community, great product, large market) for growth, but is still early enough that each new employee has a measurable influence on the direction of the company.
Benefits include a generous healthcare package, catered lunches, and flexible vacation time. Our headquarters are located in the Mission District of San Francisco, CA. We're looking to hire people who are local and able to join us at the office when needed. We're flexible, and you're an adult—we don't expect or mandate that you're in the office every day. But we do believe there are valuable and serendipitous moments of discovery and collaboration that come from working together in person.
Descript is an equal opportunity workplace—we are dedicated to equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. We believe in actively building a team rich in diverse backgrounds, experiences, and opinions to better allow our employees, products, and community to thrive.
Top Skills
Similar Jobs
What you need to know about the Boston Tech Scene
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
