We are looking for a Senior Data Engineer to build and evolve a next-generation analytics platform with a strong focus on Databricks-based data products. You will combine hands-on delivery, technical leadership, and architecture to enable trusted, scalable, and AI-enabled data capabilities.

Responsibilities

- Design scalable data ingestion and transformation frameworks for analytics use cases
- Build batch, near real-time, and streaming pipelines using Databricks and Apache Spark
- Define Databricks best practices for Medallion layers, performance, and operations
- Deliver end-to-end data products from raw ingestion through governed consumption layers
- Develop trusted analytical datasets and semantic models for reporting and self-service
- Implement data quality, lineage, monitoring, and observability across pipelines
- Lead proof-of-concepts and evaluate new capabilities within the Databricks ecosystem
- Enable AI-assisted engineering patterns and reusable accelerators for faster delivery
- Coordinate with engineering and analytics stakeholders to align on delivery plans
- Mentor engineers and promote consistent platform standards across teams

Requirements

- 3+ years of data engineering experience with modern data platforms
- Strong leadership skills to drive engineering standards and mentor other engineers
- Proven project delivery experience building enterprise analytics solutions end to end
- Advanced Apache Spark and PySpark skills for large-scale processing
- Advanced Databricks skills in production environments, including performance tuning




- Strong SQL skills for transformation logic and analytics-ready datasets
- Solid data architecture knowledge, including Lakehouse and Medallion patterns
- Hands-on CI/CD and data engineering SDLC experience using Git-based workflows
- Strong data governance skills covering security, quality, and operational controls
- Excellent communication skills to lead technical discussions with cross-functional teams
- Upper-Intermediate English proficiency (B2) for effective collaboration

Nice to have

- Data Architecture experience designing scalable Lakehouse patterns
- Data Solution Architecture experience translating business needs into platform designs
- Scala experience for Spark-based pipeline development

We offer

- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Integral career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn

EPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.

📌 Senior Data Engineer (Colombia)
🏢 EPAM Systems
📍 Colombia