AgileEngine is seeking a Middle Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture for analytics and ML workloads.
You will leverage Claude and GitHub Copilot to accelerate development, write robust Python/SQL, and ensure data quality and governance across pipelines.