15 oct
|
Aditi Consulting
|
Bogotá
15 oct
Aditi Consulting
Bogotá
Aditi Consulting
Reimagine your reality
Summary:
A leading client is growing its Data & AI practice and is hiring a Senior Data Engineer who operates at Solutions Architect level. You will design and own data platforms and AI-enabled pipelines that turn raw, real-world data into trustworthy products. The scope covers data collection and validation at the point of capture, declarative Databricks pipelines, auditable data-quality gates, and RAG and agentic AI workloads grounded in governed data. You will set reference architecture, stay hands-on, and help staff, mentor, and teach other engineers. Location, work model, contract type, and start date are not specified in the brief.
Responsibilities:
• Design and own data platforms and AI-enabled pipelines across the full data lifecycle, from raw data to trusted data products
• Design data collection instruments (forms/surveys, event instrumentation, APIs, CDC, and EDC/eCRF in clinical contexts) with validation at the point of capture
• Build declarative, production-grade pipelines on Databricks using Lakeflow Declarative Pipelines (DLT),
Spark/PySpark, and Delta Lake
• Stand up auditable, code-first data-quality gates following a profile → reconcile → validate → govern discipline
• Deliver RAG and agentic-AI workloads grounded in governed data, using vector databases and orchestration frameworks
• Set reference architecture and best practices, and make high-level technical decisions while remaining hands-on
• Enforce data and AI governance, including lineage, access control, and responsible-AI guardrails
• Staff, interview, mentor, and teach engineers, and communicate trade-offs to technical and executive stakeholders.
Required Qualifications:
• 8-12+ years in data engineering, with a progression from hands-on engineering to architecture
• Strong Python, advanced SQL, and solid NoSQL experience
• Databricks experience with Lakeflow Declarative Pipelines (formerly DLT), Spark/PySpark, and Delta Lake, plus lakehouse and
📌 SR Data Engineer (Bogotá)
🏢 Aditi Consulting
📍 Bogotá