10 ago
|
AspenView Technology Partners
|
Bogotá
10 ago
AspenView Technology Partners
Bogotá
Build the Future with AspenView Technology Partners
At AspenView, we are passionate about transforming the way organizations approach technology. We specialize in creating high-performing, nearshore IT teams to help North American clients innovate faster and more efficiently.
As we continue to grow, we’re looking for exceptional people to join our team and help drive impactful change across industries.
Role Overview
We are seeking a skilled Data Engineer – Databricks to design, build, and optimize high-
throughput, production-grade data pipelines on the Databricks Lakehouse platform.
In this role, you will implement Medallion Architecture patterns (Bronze, Silver, Gold layers) to
process structured and unstructured healthcare data—including Electronic Health Records
(EHR/Epic), FHIR streams, claims data, and clinical research datasets. You will work closely
with data architects, clinical analysts, and cloud engineers to build secure, HIPAA-compliant
ETL/ELT pipelines using PySpark, Delta Lake, and Databricks Workflows.
Key Responsibilities
Lakehouse Pipeline Engineering: Design, develop, and maintain automated ETL/ELT
data pipelines on Databricks utilizing PySpark, Delta Lake, and Databricks
Workflows or Delta Live Tables (DLT).
Data Architecture Implementation: Implement Medallion Architecture principles to
clean, transform, and aggregate raw clinical/operational datasets into analytics-ready
models for BI reporting and predictive analytics.
Healthcare Data Integration: Ingest and normalize healthcare data sources, including
Epic EHR databases (Clarity/Caboodle), FHIR/HL7 data feeds, and third-party claims
systems.
Data Governance & Security: Enforce row/column-level access control and data
lineage using Databricks Unity Catalog, ensuring strict compliance with HIPAA,
HITRUST, and internal data governance protocols for Protected Health Information
(PHI).
Performance Tuning & Optimization: Optimize compute cluster utilization, SQL query
per
📌 Data Engineer – Databricks (Bogotá)
🏢 AspenView Technology Partners
📍 Bogotá