Site Owners Forums - Webmaster Forums - View Single Post

Williamjohn02 · 03-24-2017, 03:11 AM

Robots.txt is a text file which is used for allow or disallow to any search engine crawlers to visit on their website or any particular page.

03-24-2017, 03:11 AM	#5
Williamjohn02 Registered User Join Date: Mar 2017 Posts: 13	Robots.txt is a text file which is used for allow or disallow to any search engine crawlers to visit on their website or any particular page.