22 ago
|
Source Meridian
|
Medellín
22 ago
Source Meridian
Medellín
We’re looking for a Senior Data Engineer to join Source Meridian.:
About Source Meridian:
Source Meridian is a development software company that works to solve the industry’s most challenging problems in healthcare practices. We are laser focused on specific technologies in the healthcare and life science industries: Healthcare technology, artificial intelligence, and healthcare interoperability.
About the role:
We're growing a data engineering team for a US-based client whose entire data platform runs on Databricks on AWS. The immediate priority is building out and scaling their data ingestion layer — bringing in data from a wide range of source systems reliably, efficiently, and in a way that holds up as the platform grows. You'll work closely with two client-side teams: The DBA team, who own data governance and are the authority on source systems, access, and data stewardship.
What You'll do:
- Design, build, and maintain ingestion pipelines into Databricks from a variety of source systems.
- Build and optimize Spark workloads in Python — batch and streaming.
- Model and structure data in Delta Lake following medallion-style patterns (bronze / silver / gold).
- Partner with the DBA team on governance, access, and data quality expectations, and with the Data & Analytics team so ingested data actually serves their reporting and strategy needs.
- Monitor, troubleshoot, and tune pipelines for reliability, cost, and performance.
- Document pipelines, data contracts, and design decisions so the work is maintainable by the team.
Required Qualifications:
- 5+ years of experience as a Data Engineer
- Strong, demonstrable Databricks experience. Someone who knows the platform well in production, not just conceptually. Delta Lake, workflows/jobs, clusters and compute
- configuration, Unity Catalog.
- Advanced Python for data engineering.
- Strong Apache Spark — including an understanding of how to diagnose and fix performance problems, not just write working code.
- AWS f
📌 Senior Data Engineer (Medellín)
🏢 Source Meridian
📍 Medellín