Thread: What is robots.txt?
View Single Post
Old 03-26-2017, 11:20 PM   #22
justseeservice
Registered User
 
Join Date: Mar 2017
Posts: 25
Robots.txt is provide instructions to the crawlers about the caching and indexing of a website.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
justseeservice is offline   Reply With Quote