Web scraping or crawling is the act of fetching data from a third party website by downloading and parsing the HTML code to extract the data you want. It can be done manually, but generally this term refers to the automated process of downloading the HTML content of a page, parsing/extracting the data, and saving it into a database for further analysis or use.
Month: January 2018
Today I was trying to find duplicate rows in db table rows, but besides finding them, I needed to get their indexes in order to address them.