14 sep
|
ScotiaTech
|
Colombia
14 sep
ScotiaTech
Colombia
Scotiatech is a world-class engineering group We are seeking to modernize bank technology by delivering a trustworthy, unique, and top-quality service.
We want you to be part of a Team that is always in personal and professional growth, for this reason we are looking for our new Data Engineer Specialist.
What will you do?
- Build, test, and maintain data pipelines and ETL/ELT processes on Azure and Azure Databricks (Delta Lake, medallion architecture) to ensure reliable and efficient data flow for data products.
- Collaborate with the Senior Data Engineer and cross-functional teams (Data Scientists, Product Owners, Architecture, and Platform Engineering) to understand requirements and deliver high-quality data solutions aligned with international business goals.
- Implement data models, schemas, and transformations (dimensional and Data Vault patterns) to support analytics and reporting needs.
- Ensure data quality, integrity, and performance by monitoring and optimizing data pipelines, including performance tuning and cost optimization (FinOps) of Spark workloads.
- Adhere to and help apply data governance, security, and compliance standards within Azure environments, including Unity Catalog, role-based access control, data lineage, encryption, and key management.
- Troubleshoot and resolve issues in data pipelines to minimize downtime and ensure operational efficiency, performing root-cause analysis where needed.
- Contribute to the adoption of best practices and tools for data engineering, including documentation, automated testing, and DevOps/DataOps practices.
- Support the migration and rationalization of legacy workloads (including existing Google Cloud Platform estates) onto the Azure Databricks target platform, minimizing business and regulatory risk.
- Stay updated on modern Azure and Databricks data engineering trends and tools to enhance pipeline capabilities.
What do we offer you?
- Growth opportunities
- Diverse, dynamic and multicultural environment
📌 Data Engineer Specialist (Colombia)
🏢 ScotiaTech
📍 Colombia