A Spider is a Google's program visits Web locales and peruses their pages and other critical data keeping in mind the end goal to make for a web index list.

Web search engines and some other sites use Web crawling or spidering software to update their web content or indexes of others sites' web content.