|
Robots.txt is by no means mandatory for search engines but generally search engines obey what they are asked not to do. It is important to clarify that robots.txt is not a way from preventing search engines from crawling your site..
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|