Key Responsibilities

Translate business requirements into maintainable technical solutions
Design resilient and cost-efficient architectures on cloud platforms
Develop robust scrapers (proxy rotation, CAPTCHA handling, authentication, DOM change tolerance)
Design and implement REST APIs with authentication, pagination, and security best practices
Orchestrate and monitor data pipelines (scheduling, retries, alerts, logging, metrics)
Normalize and transform data (ETL/ELT) and design storage schemas
Reduce downtime when target sources change (self-healing capabilities)
Elevate quality and performance standards (profiling, optimization, automation)
Ensure compliance with Terms of Service, copyright, robots.txt, and data protection regulations
Promote best practices (security, versioning, CI/CD, documentation)
Conduct unit and integration testing; validate data quality
Implement observability: structured logging, metrics, and traces
Create technical documentation and participate in code reviews
Collaborate with stakeholders and clients (Spanish/English)

Requirements

Must Have:





✓Advanced Python (async, error handling, typing, packaging)
✓Web scraping tools: Requests/HTTPX, Playwright/Selenium, BeautifulSoup/lxml, CSS/XPath selectors
✓API development with FastAPI (or equivalent), authentication (tokens, OAuth), pagination
✓Git (PRs, code review) and CI/CD (GitHub Actions/GitLab CI)
✓SQL (PostgreSQL/MySQL) and NoSQL (MongoDB/Redis); modeling and performance optimization
✓Docker; orchestration and deployment concepts (K8s desirable)
✓Observability (structured logging, metrics, traces, and alerts)
✓Cloud fundamentals (AWS/Azure/GCP)
✓Advanced English (B2+/C1, oral and written)

Nice To Have

+Messaging/queues (Kafka/RabbitMQ), scheduled tasks (Celery/Arq)
+Data lakes/warehouses (S3/BigQuery/Snowflake) and dbt/Airbyte/Prefect
+Vector DBs/embeddings (FAISS/Pinecone) and LLM ops
+Go/Rust/Node.js for high-performance components
+Security (secrets management, rate limiting, OW

📌 Data Solutions (Bogotá)
🏢 Icebergdata
📍 Bogotá