About the Role
We partner with integral enterprises to design and build large-scale data platforms that power the products and operations at the center of their business. This engagement supports a major US consumer goods company that is moving its SAP data into Databricks.

The client has defined an ingestion architecture for SAP source data landing in Databricks. The question now is whether that architecture holds up as a repeatable delivery method for the SAP data domains that come next. Your job is to put it to work against real SAP data and find out.

What You'll Do
• Build ingestion pipelines for SAP source data landing in Databricks, following the client-defined ingestion architecture.
• Work with SAP table structures, relationships, and business objects to land data correctly and completely.
• Implement incremental and change-data-capture patterns for SAP sources, and validate that deltas are applied accurately.
• Transform landed SAP data into clean, usable Delta tables using PySpark, SQL, and Databricks declarative pipelines.




• Reconcile Databricks outputs against SAP to confirm completeness and accuracy.
• Identify gaps, performance issues, and failure points in the ingestion architecture, and propose practical improvements.
• Document reusable patterns, configurations, and runbooks so the approach can be repeated for subsequent SAP data domains.
• Work directly with the client's engineering and data teams in their tools and environments, adapting to their priorities as they shift.

What We're Looking For
• 5+ years in data engineering, including production pipelines on Databricks.
• Hands-on experience extracting and modeling SAP data from ECC or S/4HANA, including familiarity with core SAP tables and modules such as finance, sales, materials, or supply chain.
• Experience with SAP extraction approaches, such as ODP or BW extractors, SLT, SAP Datasphere, or third-party replication tools.
• Experience implementing incremental and CDC ingestion patterns.
• S

📌 Data Engineer (Colombia)
🏢 Lumenalta
📍 Colombia