ProxyMesh is another rotating anonymous proxy server service that lets users stay anonymous with the help of a network of continuously rotated IP proxy servers. This service requires no software to be downloaded but it can be easily used in conjunction with Visual Web Ripper software.
It’s very common to use proxy servers for web data extraction. If you want to stay undetected when you scrape a website, you have to change your IP address periodically. Otherwise it is very easy to detect unusual activity by observing a large number of requests from a single IP address. Visual Web Ripper has a built-in support of proxy servers called Private Proxy Switch.
GSA Captcha Breaker is a CAPTCHA solving software. It uses Optical Character Recognition algorithms for CAPTCHA decoding. Being a standalone program it works independently of any online captcha recognition services (like DeathByCaptcha, BypassCaptcha and etc). This means that once you have paid for the program you don’t need to pay for each recognition anymore, and this allows you to save money when you need to recognize a huge amount of CAPTCHAs.
There is a question I’ve wanted to shed some light upon for a long time already: “What if I need to scrape several URL’s based on data in some external database?“.
Sometimes it is necessary to use external data sources to provide parameters for the scraping process. For example, you have a database with a bunch of ASINs and you need to scrape all product information for each one of them. As far as Visual Web Ripper is concerned, an input data source can be used to provide a list of input values to a data extraction project.
Continuing our research on the most popular scraping software, I decided to compare Mozenda and Visual Web Ripper on a search trends basis. What is the frequency of searches for these products online over time? I used Google Trends for this purpose, and below I share the current statistics and conclusions.
Recently we have encountered the web scrape detection issues in some of our projects. So as we’ve consulted with the Sequentum developers we present to you some points on this topic. Here are a few lines about web scraping detection and how Visual Web Ripper can help deal with this problem.