Categories
Legal Miscellaneous

Is this a legal method of acquiring insurance leads?

Recently I received a question on insurance leads: Is this a legal method of acquiring insurance leads [from the web]? Are there any agent testimonials on the efficiency of this type of service? Legality issue in web scraping With the matter of legality in web scraping, there should be a clear approach –  it depends […]

Recently I received a question on insurance leads:

Is this a legal method of acquiring insurance leads [from the web]? Are there any agent testimonials on the efficiency of this type of service?

Legality issue in web scraping

With the matter of legality in web scraping, there should be a clear approach –  it depends on the website and its privacy policy. There could be at least 2 cases:

  1. Public info (prices, inventory info, public offers), i.e. everything that is not protected by copyright and available for scraping.
  2. The copyright protected info –  website Terms of Use or Terms of Service restrictions make copying and therefore web scraping illegal.
The US court of appeals has affirmed that a certain [data] analytic company is lawful to scrape data aggregator’s (LinkedIn’s) public profiles info.

So far I have no insurance agent testimonies on the efficiency of any insurance lead scrape service. The web sites I searched [on the insurance leads] have given me the impression that the customer info they gather is highly secured (not viewable). I doubt that any sites are going to expose insurance leads. In most of them the leads are available by paid subscription plans.

If there are any such websites like insurance leads directories (public insurance quotes), we might develop a scraper that consistently grabs fresh or new info for further analysis. It does save the agent’s time for re-searching, re-visiting and so on. One scraper might work with multiple directory pages for scrape.

The US district court has concluded that moderate scraping, even when against ToS, is legal.

You might find it interesting to read about web page change tracking if you only need to see updates (no data storing applied).

One reply on “Is this a legal method of acquiring insurance leads?”

Igor, it really depends on who you are trying to scrape, the insurance industry can be treated them same way as for example the airline industry is. At the end of the day the information you are trying to scrape and the user from whom you’re taking the information are the 2 most important factors.

Here, check out this article, it talks about some of the things I mentioned – https://www.datahen.com/blog/legal-and-ethical-aspects-of-data-scraping-how-to-get-the-data-you-need-without-violating-the-rules

Leave a Reply

Your email address will not be published. Required fields are marked *


The reCAPTCHA verification period has expired. Please reload the page.

This site uses Akismet to reduce spam. Learn how your comment data is processed.