Site Owners Forums - Webmaster Forums - View Single Post

ankur111 · 03-24-2017, 04:56 AM

Robots.txt is a text file which is used to give instructions to search engine crawler to visit on their website or any particular page.

03-24-2017, 04:56 AM	#6
ankur111 Registered User Join Date: Jun 2016 Location: Van Nuys Posts: 34	Robots.txt is a text file which is used to give instructions to search engine crawler to visit on their website or any particular page.