02 sep
|
Aditi Consulting
|
Bogotá
02 sep
Aditi Consulting
Bogotá
Summary:
Design and own data platforms and AI-enabled pipelines that turn raw, messy, real-world data into trustworthy products. You work end to end — from the instruments that capture data, through declarative pipelines and quality gates, to the RAG and agentic-AI workloads that sit on top — holding the line on data quality and governance so that everything built on this data can be trusted.
This is a hands-on architect role: you make high-level decisions, define reference patterns, and still write code.
Our operating belief — AI moves the data. Quality earns the trust. The hardest part of AI at enterprise scale is not the model — it is the data discipline underneath it.
Responsibilities:
Architect scalable, secure, and observable data platforms across Lakehouse (Bronze to Silver to Gold) and serving layers aligned to business goals
Design and integrate data collection instruments and enforce validation at the point of data capture
Build declarative, production-grade pipelines using Databricks Lakeflow Declarative Pipelines and orchestrate them reliably
Stand up and enforce auditable data-quality gates that control promotions and releases
Design and deliver AI and GenAI workloads, including RAG systems and agentic pipelines with human-in-the-loop controls
Define and enforce data and AI governance including lineage, access control, and responsible AI guardrails
Make high-level architectural decisions, lead design reviews and proofs of concept, and define reusable best practices
Own staffing, interviewing, mentoring, and teaching through pairing, reviews, and documentation
Design and manage data ingestion across multiple capture mechanisms including APIs, telemetry, CDC, surveys, and regulated systems
Implement validation at source including constraints, logic, vocabularies, and consistency checks
Define data dictionaries, schemas, metadata, and conformed models aligned with industry standards
Own end-to-end data quality as an engineering discipline including incide
📌 Data Engineer (Bogotá)
🏢 Aditi Consulting
📍 Bogotá