While we did our CAPTCHA TEST DRIVE we realized that those JavaScript captchas we used for testing (like QapTcha and AJAX FANCY CAPTCHA) can be easily bypassed by sending a couple of simple POST requests.
Author: Igor Savinkin
Continuing our research on the most popular scraping software, I decided to compare Mozenda and Visual Web Ripper on a search trends basis. What is the frequency of searches for these products online over time? I used Google Trends for this purpose, and below I share the current statistics and conclusions.
Debuggex is an online Regex testing tool that allows visualization of Regex match algorithms. The visualization feature is good both for the learners who do some Regex exploration and for the experienced users who might want to track the Regex match forward or back. It is also useful for an instant Regex pattern match by highlighting, thus eliminating the need for pressing any buttons to run Regex patterns. This tool is one of a dozen online Regex testers.
Categories
Fiddler web sniffer Review
The Fiddler web sniffer software is one of several well-known HTTP debugging proxies. It works well, and the proxy nature of the sniffer makes it stand out among other web sniffing tools.
Recently we have encountered the web scrape detection issues in some of our projects. So as we’ve consulted with the Sequentum developers we present to you some points on this topic. Here are a few lines about web scraping detection and how Visual Web Ripper can help deal with this problem.
Categories
Using CAPTCHA for spam protection
A CAPTCHA is a test to tell wether a user is human or a robot. It allows to protect web sites from robot intrusion, while allowing human users to navigate the site normally.
In this post we will scope out CAPTCHA types, services and the tools for CAPTCHA generation. Also we will investigate some CAPTCHA solving software and services and touch on new trends for CAPTCHA and bot protection techniques.
Categories
TEST DRIVE: AJAX
The new Web Scraper Testing Drive Stage is on, the AJAX upload. Here we’ll check if the scrapers are able to extract the AJAX supplied data. This is simply not an easy task for the scraper software.
Categories
TEST DRIVE: Login Form
We now launch the new Web Scraper Test Drive stage with the Login Form Test. The test is to check if the web scrapers are able to pass a login before they touch actual data for scrape. Both form submission via POST, HTTP 302 Redirect outwork and cookie storing performance will be checked for each scraper.
Since we’ve reviewed the Web Scraper Shortcode, we consider now some issues with this Word Press plugin. It is the Word Press plugin for extracting a web page or a part of it and inserting it into a custom Word Press driven page.
Categories
Google Application Engine Review
Google Application Engine (GAE) is a cloud computing platform for developing and hosting web applications in Google-managed data centers.