AgileEngine is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, leveraging a medallion architecture across bronze, silver, and gold layers. AI tools like Claude and Copilot speed development.
You will migrate legacy workloads, ensure data parity, and collaborate across DevOps and analytics teams to deliver scalable data platforms with strong governance.