Agile Engine is seeking a Senior Data Engineer to design and operate batch and streaming data pipelines on Databricks using PySpark, Delta Lake, and Databricks Workflows. You will migrate legacy ETL workloads to a governed Lakehouse, modeling a medallion architecture that powers analytics and AI use cases.
The role requires strong SQL and Python, with experience in Unity Catalog governance and collaboration with Dev Ops and analytics teams to ensure performance, security, and data quality.