EPAM is a leading integral provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

We are building a self-serve Enterprise AI Gateway that standardizes how every team uses large language models with strong governance. As a Lead AI OPS Engineer, you will design automation-first onboarding, controls, and observability for access, cost, and logging across the platform. Join a small, fast-moving team and apply now.

Responsibilities

Design self-service onboarding for teams and agents, from initial request through to functional access
Automate key provisioning, rotation,



and permission updates
Tune rate limits and quotas as adoption and usage increase
Deploy and configure models including Vertex AI endpoints, vendor fallbacks, and Model Armor
Operate MCP servers behind the gateway under the same governance rules as models
Develop Python extensions that integrate the gateway with other enterprise systems
Maintain the full platform as code using Terraform, Helm, and Jenkins
Monitor and protect production health across availability, latency, and cost with alerting
Assist teams using the platform and convert recurring questions into automation

Requirements

Proven 5+ years of experience using Python for automation, extensions, and integrations
Solid 5+ years of SRE experience with a track record of keeping production systems reliable
Deep expertise in Kubernetes, preferably on GKE
Hands-on experience with Google Vertex AI, especially endpoints for model serving and Model

📌 Lead AI OPS Engineer (Colombia)
🏢 EPAM Systems
📍 Colombia