Site Owners Forums - Webmaster Forums - txt directives prevents search spiders from crawling the URL?

Site Owners Forums - Webmaster Forums (http://siteownersforums.com/index.php)

- Search Engine Optimization (http://siteownersforums.com/forumdisplay.php?f=16)

- - txt directives prevents search spiders from crawling the URL? (http://siteownersforums.com/showthread.php?t=189137)

americanquality

02-01-2017 12:50 AM

txt directives prevents search spiders from crawling the URL?

Which of the following robots.txt directives prevents search spiders from crawling the URL?

A: Allow: /

B: Disallow:

C: Disallow: /page1

D: Both A & C

sonvi.belani

02-01-2017 02:41 AM

hi,
both A & C are the right ans .
thanks,
sonvi.belani

All times are GMT -7. The time now is 02:04 PM.