Thread: What is robots.txt?
View Single Post
Old 05-07-2013, 12:32 AM   #8
montyalexa
Registered User
 
Join Date: Jan 2011
Posts: 33
Robots.txt is text file, when give permission which URL crawling or n't
montyalexa is offline   Reply With Quote