Site Owners Forums - Webmaster Forums - View Single Post

Shane Watson · 04-07-2013, 10:08 PM

A web crawler also known as a web spider or web robot. A web crawler is a program which browses the world wide web in a methodical, automated manner. This process is called web crawling.

04-07-2013, 10:08 PM	#4
Shane Watson Registered User Join Date: Mar 2013 Location: Sydney Posts: 22	A web crawler also known as a web spider or web robot. A web crawler is a program which browses the world wide web in a methodical, automated manner. This process is called web crawling.