View Single Post
Old 12-15-2016, 12:54 AM   #10
stuartsmithh5
Registered User
 
Join Date: Oct 2016
Posts: 81
Robot.txt file is used to provide instruction to the search engine crawler about the webpages that which page to be crawled and which are not to be crawled.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
stuartsmithh5 is offline   Reply With Quote