02 sep
|
Scotiabank
|
Bogotá
ID de la solicitud: 271763
Gracias por tu interés en ScotiaTech, el nuevo e creativo centro tecnológico de Scotiabank en Bogotá.
Únete a un equipo ganador que promueve la creatividad y la innovación en un entorno cambiante, donde siempre estamos comprometidos con el logro de resultados, en una cultura inclusiva, diversa y de alto desempeño.
Purpose
The Data Engineer Specialist designs, develops, and maintains data pipelines and infrastructure on Microsoft Azure and Azure Databricks to support the creation of scalable data products for International Banking. Reporting to the Senior Data Engineer, this role focuses on implementing robust, efficient, and secure lakehouse-based data solutions that enable data-driven decision-making and support business objectives across International Banking markets, while contributing to the migration and rationalization of legacy workloads onto the Azure Databricks target platform.
Accountabilities
Build, test, and maintain data pipelines and ETL/ELT processes on Azure and Azure Databricks (Delta Lake, medallion architecture)
to ensure reliable and efficient data flow for data products.
Collaborate with the Senior Data Engineer and cross-functional teams (Data Scientists, Product Owners, Architecture, and Platform Engineering) to understand requirements and deliver high-quality data solutions aligned with international business goals.
Implement data models, schemas, and transformations (dimensional and Data Vault patterns) to support analytics and reporting needs.
Ensure data quality, integrity, and performance by monitoring and optimizing data pipelines, including performance tuning and cost optimization (FinOps) of Spark workloads.
Adhere to and help apply data governance, security, and compliance standards within Azure environments, including Unity Catalog, role-based access control, data lineage, encryption, and key management.
Troubleshoot and resolve issues in data pipelines to minimize downtime and ensure operational eff
📌 Data Engineer Specialist- ScotiaTech (Bogotá)
🏢 Scotiabank
📍 Bogotá