Help Us Shape the Future of AI at Descript!
Are you obsessed with quality, detail-oriented to a fault, and fascinated by the world of AI? Perfect—because we’re on the hunt for a QA pro to make sure our groundbreaking AI-powered products are as reliable and polished as they are revolutionary. At Descript, we’re not just changing how content creators work with audio and video—we’re making magic 🌟. And we need someone like you to help make sure that magic happens, every time.
This is your chance to dive into the fast-paced world of AI technology, take quality to the next level, and put your stamp on tools that creators will actually love using.
What You'll Do
- Work hand-in-hand with our brilliant AI team to create test plans, run experiments, and identify areas for improvement or inconsistencies in model behavior.
- Set the gold standard for model quality by creating baselines, benchmarks, and rating systems.
- Build scalable processes for evaluating AI models—both quantitatively and qualitatively—so we can stay ahead of the game.
- Keep everything organized with clear test plans, documentation, and bug reports that your future self (and team) will thank you for.
- Tap into internal and external resources to gather the data we need to refine and perfect our models.
- Be the go-to expert for working with third-party service providers to ensure they meet our sky-high quality standards.
- Continuously improve testing tools and methodologies.
- Share the QA love by mentoring others and collaborating across teams to make sure everything works beautifully together.
What You Bring
- Bachelor’s degree in Computer Science, Engineering, or equivalent relevant experience.
- 5+ years QA experience.
- 2+ years experience leading evaluation of AI models.
- 2+ years experience as a test lead on a team, product area, or feature.
- Experience working with AI research teams.
- Ability to collaborate effectively with cross-functional teams and stakeholders.
Nice to Haves
- Experience evaluating AI speech or video models.
- Experience writing SQL queries.
- Experience using Python for scripting.
The base salary range for this role is $140,000-$181,000. Final offer amounts will carefully consider multiple factors, including prior experience, expertise, and location, and they may vary from the amount above.
