Job Description

As an Agentic AI Operations Engineer, you will support and operate the Generative AI and Agentic AI solutions that power our enterprise AI platform. Working under the guidance of senior architects and engineers, you will help deploy AI pipelines and agentic applications in production, ensuring they run reliably, securely. This is a hands-on operational role focused on keeping our AI systems healthy and improving.

You will report to the Engineering Manager.

Main Responsibilities

Agentic AI Application & Pipeline Operations:
- Deploy, configure, and maintain AI Agents that use Tools and Skills, including supporting MCP clients and servers within established frameworks.
- Operate and support Retrieval-Augmented Generation (RAG) pipelines. These pipelines include data ingestion, document processing, and promoting generation (e.g., Azure OpenAI or Gemini embeddings). Additionally, help maintain integrations with vector and NoSQL databases.
- Maintain the Azure Infrastructure that supports the AI Agents (Postgres, Redis, Grafana / Monitoring, Kubernetes Services,



Application Gateway)
- Configure / Maintain a Service Mesh to support the AI Architecture

Monitor & Performance Support:
- Monitor model serving layers and data processing pipelines, identifying and escalating performance issues to maintain low latency and efficient resource use across the cloud environment.
- Implement and tune observability (logging, metrics, alerting) and respond to incidents to keep AI services available and reliable.
- Implement Grafana Dashboards for the existing infrastructure and usage

Security & Compliance Operations:
- Apply and uphold established security and data governance policies in daily operations, including PII filtering and guarded conversation frameworks.
- Support audits and compliance checks for AI products in production.

Infrastructure Automation & CI/CD:
- Use Terraform to provision and manage Azure infrastructure-as-code within existing standards.
-

📌 Agentic AI Operations Engineer (Medellín)
🏢 Accreditation Council for Graduate Medical Education
📍 Medellín