EPAM is a leading integral provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

We are looking for a Senior AI OPS Engineer to help build an Enterprise AI Gateway from scratch. It is the one door every team in the company goes through to use large language models. It is also how we keep AI under control at this scale: who can use which models, what it costs and what gets logged. The aim is that it runs itself, with onboarding of teams, agents and MCP servers, along with keys, permissions, limits and guardrails, handled by automation rather than tickets. Very little of it exists yet,



so you will shape it from the very first design decision. The team is small and focused, so decisions do not take long and your work is visible. We are looking for someone who automates by default, and who cares about the governance side of AI as much as the models themselves.

Responsibilities

Build self-service onboarding for teams and agents, from request to working access
Automate key provisioning, rotation and permission changes
Adapt rate limits and quotas as usage grows
Roll out and configure models: Vertex AI endpoints, vendor fallbacks, Model Armor
Run MCP servers behind the gateway, under the same rules as models
Write Python extensions that connect the gateway to other enterprise systems
Manage the whole platform as code with Terraform, Helm and Jenkins
Keep production healthy: availability, latency and cost, watched by alerts
Support the teams using it, and turn every re

📌 Senior AI OPS Engineer (Colombia)
🏢 EPAM Systems
📍 Colombia