Site Owners Forums - Webmaster Forums - View Single Post

robinmym · 05-27-2017, 09:03 AM

The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots.

http://www.projuktishop.com/

05-27-2017, 09:03 AM	#2
robinmym Registered User Join Date: Feb 2017 Location: Dhaka Posts: 486	The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. http://www.projuktishop.com/