We are seeking a Senior Backend Developer to join our AI Pods team, building robust AI-powered API services and agentic workflows.

This role focuses on language model interaction with internal systems, vector databases, and external tools via orchestration frameworks, treating LLMs as components in a secure, scalable distributed system.

Responsibilities

Design and build backend API services and LLM orchestration layers

Own API contracts and service reliability end-to-end, ensuring AI edge cases fail gracefully

Integrate LLMs using rigorous systems engineering, bake in evaluation, observability, fallback handling, and cost awareness

Implement and maintain complex RAG pipelines, including document ingestion, chunking, embedding, and retrieval optimization

Develop and connect agent tools using Lang

Chain, Lang

Graph, and potentially MCP (Model Context Protocol)Build reliable, reusable orchestration frameworks and logic for downstream developer consumption

Ensure security, privacy, enterprise-grade observability, and test coverage across all backend workflows

Contribute to architecture decisions and engineering standards within the pod

Collaborate with frontend engineers, data engineers, and infrastructure teams

Requirements3+ years of backend engineering experience, focused on microservices and distributed systems

Proficiency in Python for high-performance backend services and cloud-native APIsFamiliarity with AWS, Docker, and ECS/EKSKnowledge of RESTful APIsUnderstanding of secure coding practices and strong auth/authz fundamentals





English proficiency at B2 level or higher

Nice to have1+ years of hands-on experience with AI SDKs (OpenAI, Anthropic/Claude, AWS Bedrock, or equivalent) in production

Practical experience with vector databases (Amazon Kendra, Open

Search), embedding strategies, and retrieval systems

Hands-on experience with Lang

Chain, Llama

Index, or Lang

Graph

Familiarity with AI evaluation tooling or real-time APM (Lang

Smith, Langfuse, Arize)Skills in React and Type

Script

Experience deploying to EKS environments at scale

Understanding of agent interoperability patterns (MCP)Knowledge of identity/security domain (IAM, CIAM)Flexibility to use secondary languages such as Java, Node.js, or GoWe offer

International projects with top brands

Work with integral teams of highly skilled, diverse peers

Healthcare benefits

Employee financial programs

Paid time off and sick leave

Upskilling, reskilling and certification courses

Unlimited access to the Linked

In Learning library and 22,000+ courses

General career opportunities

Volunteer and community involvement opportunitiesEPAM Employee Groups

Award-winning culture recognized by Glassdoor, Newsweek and Linked

InEPAM is an Equal Opportunity Employer.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law. #J-18808-Ljbffr

📌 Senior Backend Developer, AI Pods (Colombia)
🏢 EPAM Systems
📍 Colombia