AgileEngine, LLC. is seeking a Middle Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will design batch and streaming pipelines with PySpark and Delta Lake, leveraging a medallion architecture for analytics and ML consumers, and migrate legacy workloads with minimal disruption. You’ll use Claude and GitHub Copilot to accelerate development, write clean Python/SQL, and collaborate with DevOps and analytics teams to ensure governance, quality, and