Design, develop, and maintain data extraction and processing solutions, and API-based backend services with security, scalability, and observability standards; while stabilizing and improving existing scraping products to ensure operational continuity and accelerate deliveries in an expanding team.
Key Responsibilities
- Translate business requirements into maintainable technical solutions
- Design resilient and cost-efficient architectures on cloud platforms
- Develop robust scrapers (proxy rotation, CAPTCHA handling, authentication, DOM change tolerance)
- Design and implement REST APIs with authentication, pagination, and security best practices
- Orchestrate and monitor data pipelines (scheduling, retries, alerts, logging, metrics)
- Normalize and transform data (ETL/ELT) and design storage schemas
- Reduce downtime when target sources change (self-healing capabilities)
- Elevate quality and performance standards (profiling, optimization, automation)
- Ensure compliance with Terms of Service, copyright, robots.txt, and data protection regulations
- Promote best practices (security,



versioning, CI/CD, documentation)
- Conduct unit and integration testing; validate data quality
- Implement observability: structured logging, metrics, and traces
- Create technical documentation and participate in code reviews
- Collaborate with stakeholders and clients (Spanish/English)

Requirements
Must Have:
- Web scraping tools: Requests/HTTPX, Playwright/Selenium, BeautifulSoup/lxml, CSS/XPath selectors
- API development with FastAPI (or equivalent), authentication (tokens, OAuth), pagination
- Git (PRs, code review) and CI/CD (GitHub Actions/GitLab CI)
- SQL (PostgreSQL/MySQL) and NoSQL (MongoDB/Redis); modeling and performance optimization
- Docker; orchestration and deployment concepts (K8s desirable)
- Observability (structured logging, metrics, traces, and alerts)
- Cloud fundamentals (AWS/Azure/GCP)
- Advanced English (B2+/C1, oral and written)

Nice to Have:
- Messaging/

📌 Data Solutions (Bogotá, D.C.)
🏢 Bright Data
📍 Bogotá, D.C.