|
A robots.txt record is utilized to tell search motors which pages you don't need to be slithered/listed.
There are different reasons you may wish to obstruct certain pages on a site :
- you know certain pages have copy content
- private pages (not for general visibility)
- administrator pages
- test/draft/under development pages
- pages with blunders
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|