06 nov
|
Unosquare
|
Colombia
06 nov
Unosquare
Colombia
About the Role
We’re looking for a Web Data Extraction Engineer to build and maintain reliable, scalable web crawlers and scrapers for our clients in the tech industry. You’ll design extraction pipelines, handle dynamic and JavaScript-heavy sites, and keep data flowing as target sites change. All of this is done responsibly and in line with site terms and applicable law.
What You’ll Do
- Build and maintain crawlers and scrapers for static and dynamic (JavaScript-rendered) websites.
- Extract and normalize data from HTML and the DOM, and from APIs found through network inspection.
- Automate browser workflows with Playwright, Puppeteer or Selenium in headless environments.
- Manage proxy rotation, sessions, cookies, headers and request throttling.
- Handle anti-bot measures (rate limiting, fingerprinting, CAPTCHA challenges) responsibly and in line with site terms and applicable law.
- Monitor scrapers, spot breakages when sites change, and fix them quickly.
- Write clean, tested, maintainable code and document data sources and logic.
Required Qualifications
- 3+ years in software engineering, test automation or data extraction.
- A strong understanding of HTTP: methods, headers, status codes, cookies, sessions and authentication.
- Solid HTML/CSS/DOM knowledge: XPath, CSS selectors and parsing strategies.
- Hands-on experience with Playwright and/or Selenium, including headless browsers.
- Proficiency in Python (Scrapy, BeautifulSoup, httpx/requests) or Node.js.
- Experience with proxies (residential/datacenter, rotation) and browser dev tools for network inspection.
- Professional English for direct client communication.
Preferred Qualifications
- Distributed crawling (queues, Scrapy Cluster, Celery, Kafka).
- Docker and cloud deployment (AWS/GCP).
- Data storage and pipelines (Postgres, MongoDB, S3).
- Familiarity with browser fingerprinting and stealth techniques.
- Awareness of scraping compliance (robots.txt, ToS, GDPR/CCPA).
Technical Environment Python · Scrapy · BeautifulSoup · httpx / requests · Node.js · Playwright · Puppeteer · Selenium · HTML / CSS / DOM · XPath · JavaScript · Proxies · Celery · Kafka · Docker · AWS / GCP · Postgres · MongoDB · S3
Core Competencies
Problem solving · Attention to detail · Fast troubleshooting · Responsible, compliance-aware engineering · Clear client communication · Clean, documented code
Why Join Us
At Unosquare you’ll own data pipelines that clients depend on and solve a new technical puzzle every time a site changes, working with modern automation and crawling tools in a collaborative engineering team.
📌 Web Data Extraction Engineer (Scraping & Automation) (Colombia)
🏢 Unosquare
📍 Colombia