Annotation Team Lead, Multilingual (Arabic, Japanese, Korean)

Cohere • Full-time • Toronto • 15h ago

Why this role?

The Annotation Team Lead is responsible for building and managing Cohere’s team of annotators and reviewers who develop and deliver high-quality training data critical to the development of Cohere's flagship models. You will join a small and effective team who support Cohere’s data collection efforts.

We are currently expanding and building upon our Multilingual projects. We are looking for Annotation Team Leads who have native proficiency in one of the following languages: Chinese, French, German, Italian, Japanese, Korean, Arabic, or Portuguese.

As an Annotation Team Lead for Multilingual, you will:

People Manage 60 annotators with support of your Ops Lead. You will directly oversee 60 annotators, serving as their first POC. You will guide this group, enabling and enhancing annotator task quality and throughput. You will be responsible for data quality from your annotators and oversee human data projects/sprints. You will review the quality of annotator tasks on a monthly basis, providing regular feedback to annotators, and support performance management where annotators are not meeting the quality bar.
Own Data Quality and Delivery in your Pods and Direct Task Flow. You are accountable for the data produced by your pods. Efficiently and expertly prioritize and allocate tasks to annotators, ensuring timely completion of tasks through effective task batching.
Refine Annotation Processes. Drive execution, iteration, and refinement of annotation processes, supporting task documentation and supporting the Operations Lead in achieving strategic goals.
Support Communication with Engineering teams. Provide weekly progress updates, facilitate task understanding and onboarding, and conduct monthly performance reviews with quality assessments.
Support Recruitment of Pod Members. Conduct resume review, phone screens to help identify annotation contractors.
Write and Deliver Training. Onboarding/training new team members

You might be a good fit if you:

Speak more than one language natively and have experience with our multilingual tasks.
Have some experience in people management/team lead style roles.
Have experience in data labelling.
You can motivate, coach, and have tough people conversations too.
Are an organized person with a keen eye for metrics and analytics. You excelled in annotation and can identify great task completion.
Adaptable and work with shifting priorities well.
Have the flexibility to work on-call on weekends occasionally (1-2 times a month)