About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About The Role

We are looking for an experienced Technical Program Operations Lead to own the production systems behind large-scale AI and software-engineering data programs. You will turn complex research requirements into predictable delivery across quality, throughput, contributor performance, timelines, and cost.

Programs may include coding datasets, repository-level tasks, agentic trajectories, reinforcement-learning environments, benchmarks, code reviews, and rubric-based evaluations. This is an operations leadership role with a strong technical bar, requiring the ability to inspect code, understand tests, analyze quality signals, and improve workflows at scale.

Key Responsibilities

• Own end-to-end program delivery across scope, timelines, quality, throughput,



contributor performance, and cost.
• Design and manage workflows for coding datasets, agentic trajectories, RL environments, benchmarks, and rubric-based evaluations.
• Identify operational bottlenecks and improve workflows through better instructions, sequencing, incentives, review systems, and capacity planning.
• Define contributor requirements and partner with talent teams to source, assess, onboard, train, and ramp distributed software engineers.
• Build team-lead and reviewer structures for programs involving 100-1,000+ contributors.
• Own quality-control systems and analyze datasets to identify trends, systematic errors, and root causes.
• Act as a primary customer contact for AI labs, communicating progress, risks, quality trends, and recovery plans.
• Translate research objectives into practical task specifications and challenge requirements when they may not produce the intended evalu

📌 Technical Program Operations Lead (Colombia)
🏢 Gramian Consulting
📍 Colombia