02 oct
|
Aditi Consulting
|
Bogotá
02 oct
Aditi Consulting
Bogotá
We are looking for a Data & AI Architect to design and own scalable data platforms and AI-enabled pipelines, transforming complex data into trusted, production-ready products.
This is a hands-on architecture role: you will make high-level technical decisions while continuing to design, code, review, and establish best practices.
? Key Responsibilities
- Architect scalable, secure, and observable Lakehouse platforms (Bronze → Silver → Gold).
- Design and manage production-grade data pipelines using Databricks Lakeflow, Spark/PySpark, and Delta Lake.
- Establish data quality, validation, governance, lineage, and observability across the data lifecycle.
- Design and deliver AI/GenAI solutions, including RAG systems and agentic AI pipelines.
- Lead architectural decisions, technical design reviews, POCs, and reusable engineering patterns.
- Design data ingestion and validation across APIs, telemetry, CDC, and other sources.
- Mentor engineers and contribute to hiring and technical development.
? Required Qualifications
- 8–12 years of experience in Data Engineering, with experience progressing into Architecture roles.
- Strong Python and advanced SQL skills.
- Hands-on experience with Databricks, Lakeflow, Spark/PySpark, Delta Lake, and Lakehouse architectures.
- Experience with AWS or Azure.
- Experience with orchestration tools such as Airflow, Dagster, or Prefect.
- Strong experience in data quality engineering, validation, and CI/CD for data pipelines.
- Experience designing RAG systems and working with vector databases such as Pinecone, Weaviate, FAISS, or Milvus.
- Strong understanding of distributed systems and data governance.
- Experience hiring, mentoring, and developing engineering teams.
? Nice to Have
- Snowflake/Cortex.
- LangChain, LangGraph, MCP, or agentic AI patterns.
- AI governance frameworks such as NIST AI RMF, EU AI Act, or ISO/IEC 42001.
- Power BI/DAX and regulated or clinical data experience.
- Bilingual English and Spanish.
Must-Have
System-level data thinking — the ability to design, govern, and ensure data quality across the entire lifecycle, from data capture to AI consumption in production.
#26-03825
📌 AI Data Engineer (Bogotá)
🏢 Aditi Consulting
📍 Bogotá