AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you
ABOUT THE ROLE
We are looking for a Senior Software Engineer to design scalable data processing systems using Spark and EMR. This person builds batch and distributed pipelines, working closely with AI and product teams to operationalize model-enabled use cases and prepare data for intelligent workflows. Strong architecture sense and comfort in data-intensive environments matter here.
WHAT YOU WILL DO
- Design and develop scalable data processing solutions using Spark and EMR.
- Build and maintain batch and distributed data pipelines.
- Collaborate with engineering, AI, and product teams to operationalize data-driven and model-enabled use cases.
- Develop software components for data transformation, feature preparation, and AI workflow integration.
- Optimize pipeline performance, cost efficiency, and production reliability.
- Troubleshoot data and application issues across development and production environments.
- Contribute to architecture discussions, documentation, and engineering standards.
- Ensure solutions align with data quality, governance, and security expectations.
MUST HAVES
- 4+ years of software engineering or data engineering experience.
- Strong experience with Spark and distributed data processing.
- Experience with Amazon EMR or similar cloud-based data processing platforms.
- Proficiency in Java, Python, or related programming languages.
- Exposure to AI or machine learning workflows, model integration, or data preparation for intelligent systems.
- Strong understanding of scalable data architecture and performance optimization.
- S