We're growing our team and seeking a Lead Data Software Engineer to join us.

This opportunity suits someone who finds fulfillment in building robust data frameworks that drive critical organizational decisions.

You'll be embedded in a team that places high value on clean, rigorously tested code paired with disciplined engineering methods.

If large-scale data challenges motivate you, this role offers significant room for professional development and impactful work

Responsibilities

Design and assemble scalable data pipelines that support consistent, dependable data movement across various platforms

Construct and maintain ingestion processes that draw data from numerous distinct source systems

Deliver clean, efficient, rigorously tested code built on strong software engineering foundations

Collaborate with teams spanning different functions to grasp data requirements and translate them into functioning technical solutions

Track the performance of data pipelines, intervening proactively to address problems and sustain overall system reliability

Take part in code review activities to help uphold quality standards and distribute knowledge across the broader team

Identify and resolve data quality issues to protect the accuracy and consistency of datasets

Support ongoing improvements to data architecture approaches and engineering best practices

Produce documentation detailing technical processes and solutions, supporting knowledge transfer and onboarding of new team members

Function within an agile setup, contributing to sprint planning and other regular team rituals

RequirementsA minimum of 5 years of applicable hands-on experience

At least one year spent leading and overseeing development teams





Strong working knowledge of PySpark and Spark SQL for building and handling large-scale data processes

Experience constructing and managing Lakeflow pipelines and Jobs to enable data orchestration

Capable in applying Auto Loader and JDBC/CDC ingestion techniques, including work with sources such as DB2 and SQL Server

Solid background with Delta Lake and Unity Catalog, supporting data storage and governance functions

Background upholding data quality standards and conducting source reconciliation to guarantee reliable, accurate data

Experience crafting unit tests via pytest to verify code accuracy and dependability

Working familiarity with Git and Asset Bundles for overseeing version control and deployment processes

Upper-intermediate English language skills or higher (B2)Nice to have

Background involved in Data

Stage migration projects

Experience pulling data from Dynamics 365/Dataverse

Possession of a Databricks certification

We offer

International projects with top brands

Work with global teams of highly skilled, diverse peers

Healthcare benefits

Employee financial programs

Paid time off and sick leave

Upskilling, reskilling and certification courses

Unlimited access to the Linked

In Learning library and 22,000+ courses

Integral career opportunities

Volunteer and community involvement opportunitiesEPAM Employee Groups

Award-winning culture recognized by Glassdoor, Newsweek and Linked

InEPAM is an Equal Opportunity Employer.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law. #J-18808-Ljbffr

📌 Lead Data Software Engineer (Colombia)
🏢 EPAM Systems
📍 Colombia