Thread: What is robots.txt?
View Single Post
Old 12-11-2012, 03:43 AM   #14
stephan07
Registered User
 
Join Date: Dec 2012
Posts: 25
Robot.txt is a simple notepad file through which crawler crawl your website.
stephan07 is offline   Reply With Quote