Job Description

Insight General is looking for a senior data engineer who will be responsible for architecting end-to-end data-platform solutions covering ingestion, storage, transformation, and data-product delivery. You will be ingesting data from enterprise source systems and engineering applications and loading it into their data platforms to deliver foundational data products that will serve across the firm. You should have experience with both architecture and deep engineering experience as well as designing scalable systems you have personally built yourself and shipping them into production. You will be owning pipelines end-to-end and applying google cloud AI services and using LLMs to classify, summarize and transform unstructured data. This is a 3-month contract extending yearly in Colombia or Brazil.

Skills and Requirements

Senior-level data engineering experience with a strong architecture mindset and a proven record of designing systems and personally building systems for productionExperience with dbt, ETL/ELT design, data modeling, Git, and CI/CDExperience building CIM semantic layersStrong experience with Google Cloud Platform: BigQuery, Google Cloud Storage, Cloud IAM, Dataflow and Apache Beam, Cloud Composer and Airflow, Pub/Sub, Vertex AI, and Cloud Functions or Cloud RunEnd-to-end ownership of pipelines,



from source-system connectivity and technical design through production reliabilityExperience processing unstructured and multimodal data and using LLMs to classify, summarize, extract, and transform unstructured content into structured dataStrong Python and SQL skills, including the BigQuery SQL dialectExperience with medallion architecture and bronze, silver, and gold data layersDimensional modeling experience for downstream BI and AI use casesHands-on experience with GCS lifecycle policies and cost optimizationExperience with uniform bucket-level access, IAM conditions, VPC Service Controls, and audit loggingExperience extracting structured information from engineering drawings

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].

#J-18808-Ljbffr

📌 Senior Data Engineer, Data Extraction (Colombia)
🏢 Insight Global
📍 Colombia