Google web crawlers
 

Hello friends I need to know that How google web crawler works? And what are the features of web crawlers?:confused:

nice post thanks for sharing.

What is nice in that post?
He asks a question, not provide information.

A Search Engine Spider (also known as a crawler, Robot, SearchBot or simply a Bot) is a program that most search engines use to find what�s new on the Internet. Google�s web crawler is known as GoogleBot.

The so called �spider� crawls from one website to another. So there are basically three steps that are involved in the web crawling procedure. First, the search bot starts by crawling the pages of your site. Then it continues indexing the words and content of the site, and finally it visit the links (web page addresses or URLs) that are found in your site.