Month: June 2020

Review

DataFlowKit review

Recently we encountered a new service that helps users to scrape the modern web 2.0. It’s a simple, comfortable, easy to learn service – https://dataflowkit.com
Let’s first highlight some of its outstanding features:

Visual online scraper tool: point, click and extract.
Javascript rendering; any interactive site scrape by headless Chrome run in the cloud
Open-source back-end
Scrape a website behind a login form
Web page interactions: Input, Click, Wait, Scroll, etc.
Proxy support, incl. Geo-target proxying
Scraper API
Follow the direction of robots.txt
Export results to Google drive, DropBox, MS OneDrive.

Tags headless, service, web scraping

Challenge Development

Scraping a Javascript-dependent website with puppeteer

Post author By admin
Post date 25.06.2020
No Comments on Scraping a Javascript-dependent website with puppeteer

Support us by purchasing the book (under $5) on this topic.

In today’s web 2.0 many business websites utilize JavaScript to protect their content from web scraping or any other undesired bot visits. In this article we share with you the theory and practical fulfillment of how to scrape js-dependent/js-protected websites.