About the Role
Anthropic is seeking a Data Operations Manager to join our growing Human Data Operations team. In this role, you'll work across multiple research teams to scope, execute, and manage a portfolio of human data projects that directly contribute to improving our AI models. You'll be responsible for efficiently collecting high-quality human feedback data that helps our researchers build more capable, safer, and more helpful AI systems.
As a Data Operations Manager, you'll serve as a key interface between research teams and our human data collection resources, ensuring our projects are executed with speed, quality, and efficiency.
At Anthropic, we believe that AI systems should be safe, beneficial, and aligned with human values. As a Human Data Operations Associate, you'll play a critical role in developing the human feedback data that helps shape these systems. If you're passionate about AI safety and excited to contribute to cutting-edge research while solving complex operational challenges, we'd love to hear from you.
Responsibilities
- Project Management: Manage end-to-end human data collection projects across multiple research teams, from scoping and planning to execution and quality control
- Operations Support: Work closely with researchers to understand their data needs, translate requirements into clear project specifications, and provide regular updates on project progress
- Project Execution: Write clear labeling instructions, review data, balance quality/diversity/volume requirements, and improve processes for efficiency
- Vendor Coordination: Manage day-to-day relationships with external vendors and contractors for human data projects, ensuring they deliver high-quality results on time
- Quality Oversight: Implement systematic quality controls and verification processes to ensure data usability and trustworthiness
- Task Development: Create clear, effective task instructions and training materials for human data workers
- Continuous Improvement: Identify opportunities to improve efficiency, quality, and cost-effectiveness in our human data collection processes
- Data Analysis: Create project dashboards, data analysis reports, and analyze project metrics to provide insights to researchers and the Human Data Operations team
- Cross-functional Collaboration: Partner with researchers, engineering teams, and other stakeholders to optimize human data collection processes
You may be a good fit if you
- Exceptional project management skills with demonstrated ability to handle multiple complex projects simultaneously
- Are extremely detail-oriented with strong organizational skills with the ability to analyze information line-by-line
- Have excellent written and verbal communication skills, with the ability to translate technical requirements into clear instructions
- Experience with data collection, labeling, or analysis in technical environments
- Demonstrate strong problem-solving abilities and can navigate ambiguity effectively
- Are responsive and reliable, with a bias toward action and getting things done
- Have experience with data analysis and can work with tools like SQL, Python, Tableau, spreadsheets, or similar
- Are comfortable working in a fast-paced environment with shifting priorities
- Care about developing safe, beneficial AI systems
Strong candidates may also have
- Experience with human data collection and labeling specific to large language models
- Knowledge of data collection, annotation, or labeling practices
- Experience managing vendor relationships or external contractors
- Experience implementing quality control systems for data collection
- Background in a research-oriented organization, working with researchers and engineers
- Experience with prompt engineering or working with large language models
