Overview

We are seeking a highly experienced Databricks Data Engineer to design, develop, and optimize large-scale data platforms supporting critical business functions within a financial services environment. The successful candidate will play a key role in building and enhancing a modern data ecosystem based on Databricks, leveraging a Medallion Architecture (Bronze, Silver, Gold, Publish) to deliver trusted, scalable, and business-ready data products.

This role requires deep expertise in Big Data technologies, including Hadoop, Hive, Spark, Databricks, and modern data engineering practices, with a strong focus on data modeling, pipeline development, performance optimization, and data quality.

Main Responsibilities

- Design, build, and maintain scalable data pipelines using Databricks and Apache Spark.
- Develop and support Medallion Architecture data layers (Bronze, Silver, Gold, Publish).
- Implement incremental data ingestion, transformation, and reconciliation processes.
- Develop reusable frameworks and best practices for data engineering and pipeline orchestration.
- Design and optimize large-scale ETL/ELT workflows for structured and semi-structured data.
- Integrate data from multiple enterprise source systems while ensuring data governance and security standards.
- Implement data quality controls, monitoring, validation, and operational alerting.
- Collaborate with architects,



business stakeholders, analysts, and engineering teams to define scalable data solutions.
- Troubleshoot and optimize Spark workloads for performance, scalability, and cost efficiency.
- Support enterprise data initiatives within customer, application, account, and other business domains.

Key Requirements

- 7+ years of experience in Data Engineering, Big Data, or related fields.
- 5+ Years of experience fully focused in Databricks (Must)
- Fluent conversational English required, with strong verbal and written communication skills. (Must - B2 onwards)
- Extensive experience with Hadoop ecosystem technologies, including: Hadoop / Hive / Spark
- Proven experience building enterprise-scale ETL/ELT pipelines .
- Strong understanding of Data Warehouse concepts , dimensional modeling, and SCD Type 2.
- Experience working with Medallion Architecture and modern Lakehouse platforms.
- Advanced SQL development and performance tuning skills.
- Experience handling large-volume datasets in distributed computing environments.
- Knowledge of data quality, reconciliation, monitoring, and operational support practices.
- Experience with data security, sensitive data handling, and data tokenization.
- Strong problem-solving and analytical skills.
- Ability to work effectively in Agile delivery environments.

📌 Databricks Data Engineer (Colombia)
🏢 EXL
📍 Colombia