Categories
Development

Using Modern Tools such as Node.js, Puppeteer, Apify for Web Scraping (Xing scrape)

I want to share with you the practical implementation of modern scraping tools for scraping JS-rendered websites (pages loaded dynamically by JavaScript). You can read more about scraping JS rendered content  here.

Categories
Development Guest posting

Captcha solving with Java and why you should avoid it

In this blog post we are going to show how you can solve [Re]captcha with Java and some third party APIs, and why you should probably avoid them in the first place.
For the Python code (+ captcha API) see that post.

The post author is Kevin Sahin from ScrapingNinja.co.

Captcha solving

“Completely Automated Public Turing test to tell Computers and Humans Apart” is what captcha stands for. Captchas are used to prevent bots from accessing and performing actions on websites or applications.

The last one is the most used captcha mechanism, Google ReCaptcha v2. That’s why we are going to see how to “break” these captchas.

Categories
Development

Meet Phantombuster – awesome tool for creating own APIs and extend audience via social networks

As you know, huge social networks are very useful instruments to improve business, especially IT-business. Developers, designers, CEO, HR- and Product-managers share some useful information, looking for useful acquaintances, business partners and co-workers. But how does one automatize the process of searching and attracting new people to your resource? With Phantombuster it’s not a problem at all. In our today’s article we will consider how to use the Phantombuster APIs in different areas.

Categories
Development

Protected: Bypass Distil network

This content is password protected. To view it please enter your password below:

The reCAPTCHA verification period has expired. Please reload the page.
Categories
Development Guest posting

Web scraping: How to bypass anti-scrape techniques

Web scraping is a technique that enables quick in-depth data retrieving. It can be used to help people of all fields, capturing massive data and information from the internet.

Categories
Development

New Death By Captcha Node JS and iMacros API examples

The deathbycaptcha.com service, one of the oldest and most consistent services in the captcha solving market, has recently added new Node JS API instructions and examples to solve ReCaptcha v2 challenges. Click the link to check the API details!

Categories
Development Guest posting

Bright Data Proxy Manager with built-in scraping features

Web Data Extraction is critical to the online operations of companies across the globe. With more data being scraped daily, websites implement techniques to block extraction efforts.

Categories
Development

Is there any way to skip CAPTCHA?

 

Is there a way to skip CAPTCHA?

Categories
Challenge Development

How do I get pass dynamic “load more” btn?

Recently I’ve got a question:

How do I get pass the dynamic “load more” button using a Python web scraper?

Categories
Development

Choosing a technology for a web-project

You have an idea for a web-project. You (or your team) have already thought over the concept and the strategy for to becoming successful in the field. Now it’s time to ask the main question – how should this awesome idea be brought to life? The great variety of solutions complicates the decision-making process: classic Java? Modern MEAN? Easy PHP & CMS?