Crawlee is a free web scraping & browser
automation library fitting for composing Node.js (and Python) crawlers.
Features
- HTTP requests crawlers, eg. Cheerio
- Browser automation crawlers, eg. Playwright, Puppeteer
- Supports both TypeScript and JavaScript crawlers
- Proxy usage interface
- HTTP requests that mimic browser headers and TLS fingerprints.
- HTML parsers Cheerio and JSDOM are included
Crawlee is developed by Apify, the web scraping and automation platform.