Categories
SaaS

Web Page Change Tracking

Often, you want to detect changes on some eBay offerings or get notified of the latest items of interest from craigslist in your area. Or, you want to monitor updates on a website (your competitor’s, for example) where no RSS feed is available. How would you do it, by visiting it over and over again? No, now there are handy tools for website change monitoring. We’ve evaluated some tools and would like to recommend the most useful ones that will make your monitoring job easy. Those tools nicely complement the web scraping software, service and plugins.

Categories
Uncategorized

Death By Captcha new feature Recaptcha v3 support

dbc-logo1After a great deal of work, the Death By Captcha developers have finally released their new feature to the world – new Recaptcha v3 Support.

As you may already know, the Recaptcha v3 API is quite similar in many ways to the previous one used to manage tokens (Recaptcha v2). In Recaptcha v3, the system evaluates or scores each user to determine if it’s bot or human, then it uses the score value to decide if it will accept or not the requests from said user. Lower scores are identified as bots. Check this link to verify the API documentation and download client based sample codes.

With very competitive pricing, Death By Captcha is at the cutting edge of solving tools in the market. Check it out –  you can receive free credit for testing from this LINK; ping the service with the promo code below to receive your captchas.

Use the promo code “Scrapepro” and you’ll get 3k Captchas credit for free.

P. S. See the ReCaptcha v2 test results.

Categories
Miscellaneous

Endcaptcha now solving Recaptcha V2!

endcaptchaSo far the latest developments of the services that develop captchas  (google, nucaptcha, etc.) are no match for the captcha bypassers, and Endcaptcha is living proof of it.
Endcaptcha developers have been working hard to make this new feature possible – they’re finally releasing Recaptcha V2 support!

Categories
Uncategorized

Smartproxy Review

Getting precise and localized data is becoming difficult. Advanced proxy networks are the only thing that is keeping some companies running intense data gathering operations.

Residential proxies are in extremely high demand, and there are only a few networks available that can offer millions of IP addresses around the world. 

Smartproxy is one of those networks, rapidly growing to offer the best product in residential and data center proxies.

Categories
Development

Make crawling easy with Real Time Crawler of Oxylabs.io

logo-oxylabs-ioNowadays, it’s hard to imagine our life without search systems. “If you don’t know something, google it!” –  is one of the most popular maxims in our life. But how many people use Google in an optimal way? A lot of developers use google commands to get needed answers as fast as it possible.

Even this is not enough today! Large and small companies need terabytes of data to make their business profitable. It’s necessary to automate the search process and make it reliable to satisfy the user with fresh news, updates or posts. In today’s article we will consider a very helpful tool – Real-Time Crawler (RTC) for the collection of fresh data. Let’s start!

Categories
Review

SquidProxies review

Today we want to share with you about SquidProxies. It is a service offering anonymous HTTP/HTTPS proxies.

SquidProxies offers 2 types of data-center proxy packages, private proxies and shared proxies. The proxies are designated for just about any legal use, and work great to surf to every website. The proxies’ main use are web scraping/web crawling and SEO tools.

Categories
Web Scraping Software

Mozenda web scraping and publishing of data to cloud storage

Mozenda is a cloud web scraping service (SaaS), and we’ve already reviewed it. Since our last review, Mozenda has provided more useful utility features for data extraction. Besides multi-threaded extraction & smart data aggregation, Mozenda allows users to publish extracted data to cloud storage such as Dropbox, Amazon, and Microsoft Azure. In this post we will try to explain the new Mozenda extraction and integration capabilities.

Categories
Development

2captcha service to solve reCaptcha v2.0 (python)

In this post we want to show you the code for an automatic connection to 2captcha service for solving google reCaptcha v2.0. Not long ago, google drastically complicated the user-behavior reCaptcha (v2.0). This online service provides a method for solving it.

Categories
Miscellaneous

Octoparse review

octoparse-logo

Octoparse is a new modern visual web data extraction software. It provides users a point-&-click UI to develop extraction patterns, so that scrapers can apply these patterns to structured websites. Both experienced and inexperienced users find it easy to use Octoparse to bulk extract information from websites – for most of scraping tasks no coding needed! 

Categories
Uncategorized

Reliable rotating proxies for business directories scrape

We’ve already written about suitable proxy servers for web scraping. Now we want to focus our readers on those for the huge/mass quantities data records scrape, particulary from the business directories. When scraping business directories, their web servers can identify repetitive requesting and put you on hold by looking at the IP address that is used for frequent http requests. Proxy rotation web service is the means for repeatedly changing IP address. Thus, target web server can only see the random IP addresses from rotating proxies pool at each request.