|
Spiders and crawlers are same . They are search engine software to crawl (scan) the website and to store the website information in the data base. The robots are used to block particular webpage in the website.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|