Site Owners Forums - Webmaster Forums

Site Owners Forums - Webmaster Forums (http://siteownersforums.com/index.php)
-   Search Engine Optimization (http://siteownersforums.com/forumdisplay.php?f=16)
-   -   What is disallow in robots.txt file? (http://siteownersforums.com/showthread.php?t=205464)

parmodshastri 11-28-2017 09:31 PM

What is disallow in robots.txt file?
 
Hlo Friends,
What is disallow in robots.txt file?

JeniAnderson 11-28-2017 09:44 PM

This term prevents the search engines from indexing any pages or files on the website.

This also keeps the search engines out of your content containing your admin control panel.

Dennydevi 11-28-2017 09:53 PM

This term prevents the search engines from indexing any pages or files on the website.

lmenter123 11-28-2017 11:32 PM

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. ... The "Disallow: /" tells the robot that it should not visit any pages on the site.

jessicajesi 11-28-2017 11:54 PM

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. ... The "Disallow: /" tells the robot that it should not visit any pages on the site.

jessicajesi 12-10-2017 10:59 PM

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. ... The "Disallow: /" tells the robot that it should not visit any pages on the site.


All times are GMT -7. The time now is 07:43 AM.


Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.