Start date: TBC
End Date: TBC
Location: Remote
Type of contract: Freelance
Languages required: English
Hourly Rate: Include the rate you are comfortable with on your CV.
About Prolific
Prolific is not just another player in the AI space. We are building the biggest pool of quality human data in the world. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.

The Role
We are seeking a Queue Lead to join a high-priority initiative in partnership with a leading AI company. This is an operational, hands-on role, you will own day-to-day execution for one or more annotation queues on a live AI training/eval program: managing throughput, running quality calibrations, tracking contributor performance, and building out reporting systems that keep stakeholders informed in real time.
You will have experience running queues and quality on AI data programs. The selected candidate will be able to speak to specific projects, calibration processes they’ve built,



and contributor performance systems they’ve run.

What you'll be doing
Queue Operations & Task Management
• Own work queues: intake, triage, prioritization, task assignment, and SLA delivery
• Monitor task queue and backlog control
• Identify and troubleshoot bottlenecks (unclear policy, tooling issues, supply gaps)

Quality Assurance & Performance Management
• Monitor quality at project and individual annotator or contributor level.
• Perform QA tasks such as making corrections, providing annotator feedback, flagging systematic confusion and suggestions to team lead.
• Manage annotator or contributor performance by performing tasks like unassigning underperformers, identifying and retaining high-performers.

Reporting & Dashboards
• Build and maintain dashboards to track throughput, disagreement rates, defect or rework rates, and contributor performance.
• Turn raw queue data into clear, actionable repor

📌 Queue Lead (Colombia)
🏢 Prolific
📍 Colombia