|
Google uses spiders to crawl the web and bring back information about every website and every page. They send out their crawlers at random so the search engine optimizers can't time their SEO updates. Yahoo also has their own set of crawlers that extract links and find pages that have yet to be discovered.
|