About the Role
As Director of Agents Research you will lead teams focused on developing LLM-based autonomous systems for real-world applications. In this hands-on technical leadership role, you'll oversee research initiatives and collaborate with engineering teams to bring innovations to production.
You'll play a key role in advancing our hybrid model-in-the-loop system, which currently processes tens of millions of data points for frontier labs and industry leaders monthly, with plans to scale to billions. Your expertise will drive R&D strategy across critical areas including:
- Agent architecture development and scaffolding
- Data collection workflows and management
- Performance evaluation frameworks
- Testing environments and benchmarking
- Browser and SWE agent development
Leveraging Scale's unique position as a leader in frontier data, you'll drive the development of autonomous agents capable of handling complex tasks, ensuring our solutions meet high performance and scalability standards.
Responsibilities
- Lead cutting-edge research in AI agent architectures and autonomous systems development.
- Design scalable evaluation frameworks to measure and optimize agent performance across billions of tasks.
- Transform research breakthroughs into production-ready ML solutions through close collaboration with engineering.
- Drive thought leadership in AI agent research through publications and industry engagement.
- Build and mentor a high-performing research team focused on pushing technological boundaries.
Qualifications
- PhD in computer science, ML, or AI or equivalent experience.
- 5+ years leading technical research teams.
- Strong publication record in top ML conferences.
- Deep expertise in large-scale model training and deployment.
- Successful track record building and managing high-performing research teams.
- Advanced proficiency in PyTorch, TensorFlow, or Jax.
