Thread: Robot.txt?
View Single Post
Old 12-27-2014, 03:00 AM   #10
Aaliyah Liverpo
Registered User
 
Join Date: Apr 2014
Posts: 3
It help to instruct crawler that which page should be cache on which is not.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Aaliyah Liverpo is offline   Reply With Quote