Thread: What is robots.txt?
View Single Post
Old 12-03-2012, 05:46 AM   #10
likit
Registered User
 
Join Date: Oct 2012
Posts: 149
Robots.txt is text file that holding the information for search engine crawler about caching and indexing of webpage, Domain..etc
likit is offline   Reply With Quote