AgileEngine is seeking a Middle Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will design batch and streaming pipelines with PySpark and Delta Lake, and implement a medallion architecture across bronze, silver, and gold layers.
This role also uses AI tools like Claude and GitHub Copilot to speed up development, emphasizes data quality, governance with Unity Catalog, and collaboration with DevOps, platform, and analytics engineers.