|
Web crawlers/Web spider are mainly used -
1)to create a copy of all your visited pages for later processing by a search engine that will index the downloaded pages to provide fast searches.
2)for automating maintenance tasks on a Web site, such as checking links or validating HTML code.
3)to gather specific types of information from Web pages, such as harvesting e-mail addresses (usually for sending spam)
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|