Crawler - Crawler or Crawling takes place when there is a successful fetching of unique URIs which can be traced from valid links from other web pages.
Spider- A spider is a program run by a search engine to build a summary of a website’s content (content index). Spiders create a text-based summary of content and an address (URL) for each web page.
Robots - Crawler bots and robots are same. This is an application written in a programming language. This application is used to fetch new and existing websites, a web page from the net. All search engines have their own crawlers.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|