|
Difference between robot txt and spider are as follows
robot txt is use for the specification of the webpage
spider is use to crawl the webpages.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|