Site Owners Forums - Webmaster Forums - View Single Post

johnmartin9990 · 03-26-2013, 01:46 AM

Well ... robots.text isa text file in which you difine instruction which page you want to be crawl or not to all robots of search engines.

03-26-2013, 01:46 AM	#33
johnmartin9990 Registered User Join Date: Mar 2013 Posts: 4	Well ... robots.text isa text file in which you difine instruction which page you want to be crawl or not to all robots of search engines.