Site Owners Forums - Webmaster Forums - View Single Post - What is the purpose of using robots.txt file in seo?

simonsmith · 11-01-2016, 06:21 AM

This file is used to allow and disallow the robots of all search engines or specific search engines as well as also describing what the page robots allow to visit and index and what is not? All these details we mentioned in Robots.txt file.

11-01-2016, 06:21 AM	#6
simonsmith Registered User Join Date: Nov 2016 Posts: 9	This file is used to allow and disallow the robots of all search engines or specific search engines as well as also describing what the page robots allow to visit and index and what is not? All these details we mentioned in Robots.txt file.