Postúlate en Kit Empleo: kitempleo.com.co/empleo/1aml5b
Job Description
As a Senior Data Engineer, you’ll be part of a team which works with big data & cloud technologies such as Spark, (Scala & Pyspark), Python, Databricks, Airflow, Hive etc.
- Responsible for maintaining & assembling data pipelines that consume large datasets, runs the complex data transformations that are needed to generate the facts for the clients.
- Responsible for integrating finished models into the pipelines that also helps in building the insights for the customer.
- Use your spark skills to optimize spark code (including data science models).
- Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using Azure, Databricks and RDMBS technologies.
- Write and maintain documentation for features you work on & transition them to L2 support.
- Ability to write highly efficient code in terms of performance / memory utilization.
Qualifications
- Minimum 10 years of experience as Data engineer.
- Experience modeling or manipulating large amounts of data is a must.
- Proven experience working as a data engineer.
- Highly proficient in using the spark framework (python and/or Scala).
- Extensive knowledge of Data Warehousing concepts, strategies, methodologies.
- Programming experience in Python, SQL, Scala.
- Hands‑on experience of building data pipelines using Apache Spark (preferably in Databricks), Airflow.
- Hands‑on experience designing and delivering solutions using Azure including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake.
Nice to Have
- Experience with CI/CD & DevSecOps is a plus.
- Experience with Demographic, Retail business is a huge plus.
- Databricks & Azure Big Data Architecture Certification would be plus.
Soft Skills
- Must be team oriented person with strong collaboration, prioritization, and adaptability skills.
- Ability to learn the application from documents & KT videos with some support from the team.
- Understands the dynamics & dependencies between
Postúlate en Kit Empleo: kitempleo.com.co/empleo/1aml5b
📌 Senior Data Engineer (Bogotá)
🏢 Nabla
📍 Bogotá