View Single Post
Old 11-14-2016, 01:06 AM   #4
AshokDixit89
Registered User
 
Join Date: Jan 2016
Location: Mumbai, India
Posts: 1,064
Crawler - Crawler or Crawling takes place when there is a successful fetching of unique URIs which can be traced from valid links from other web pages.

Spider- A spider is a program run by a search engine to build a summary of a website’s content (content index). Spiders create a text-based summary of content and an address (URL) for each web page.

Robots - Crawler bots and robots are same. This is an application written in a programming language. This application is used to fetch new and existing websites, a web page from the net. All search engines have their own crawlers.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
AshokDixit89 is offline   Reply With Quote