Site Owners Forums - Webmaster Forums - What’s the significance of Robots.txt file in a website?

Site Owners Forums - Webmaster Forums (http://siteownersforums.com/index.php)

- Search Engine Optimization (http://siteownersforums.com/forumdisplay.php?f=16)

- - What’s the significance of Robots.txt file in a website? (http://siteownersforums.com/showthread.php?t=193296)

abhiramshastri

05-09-2017 11:30 PM

What’s the significance of Robots.txt file in a website?

Hlo Friends,
Can anyone tell me, What’s the significance of Robots.txt file in a website?

saket

05-10-2017 12:27 AM

Robots.text file tell the search engine which file is indexed or which is not.

markb

05-10-2017 02:09 AM

robots.txt file is used to give instructions about the site to web robots to crawl which files .

arianagrand

05-10-2017 02:14 AM

Your Robots.txt file is what tells the search engines which pages to access and index on your website on which pages not to.

All times are GMT -7. The time now is 12:20 AM.