30 oct
|
Unosquare
|
Colombia
30 oct
Unosquare
Colombia
We are looking for a Web Data Extraction Engineer to build and maintain reliable, scalable web crawlers and scraping solutions for our clients. In this role, you will design extraction pipelines, automate browser interactions, handle dynamic and JavaScript-rendered websites, and ensure data collection systems remain reliable as target websites evolve.
What You'll Do
- Build and maintain crawlers and scrapers for static and dynamic websites
- Extract, normalize, and process data from HTML, DOM structures, and APIs discovered through network inspection
- Automate browser workflows using Playwright, Puppeteer, or Selenium in headless environments
- Manage sessions, cookies, proxies, request headers, throttling, and authentication mechanisms
- Address anti-bot protections responsibly and in compliance with applicable regulations and site terms
- Monitor scraper performance and quickly resolve issues caused by website structure changes
- Develop clean, maintainable, and tested code
- Document extraction logic, data sources, and technical decisions
- Collaborate with teams to ensure reliable and scalable data delivery
Required Qualifications
- 3+ years of experience in software engineering, test automation, or data extraction
- Strong understanding of HTTP protocols, including methods, headers, status codes, cookies, sessions, and authentication
- Solid knowledge of HTML, CSS, DOM manipulation, XPath, and CSS selectors
- Hands-on experience with Playwright and/or Selenium
- Strong programming skills in Python or Node.js
- Experience with Scrapy, BeautifulSoup, httpx, requests, or equivalent libraries
- Experience working with proxies and browser developer tools for network inspection
- Professional English communication skills for direct client interactions
Preferred Qualifications
- Experience with distributed crawling architectures
- Knowledge of Scrapy Cluster, Celery, Kafka, or similar technologies
- Docker and cloud deployment experience (AWS or GCP)
- Experience with PostgreSQL, MongoDB, or S3-based data pipelines
- Familiarity with browser fingerprinting concepts and stealth techniques
- Understanding of robots.txt, Terms of Service, GDPR, and CCPA considerations
📌 Web Scraping Engineer (Colombia)
🏢 Unosquare
📍 Colombia