|
Also note that robots.txt does not prevent your page from being listed in search results. What it does is stop the bot from crawling your page, but if a third party links to your PDF file from their website, your page will still be listed. If you stop the bot from crawling your page using robots.txt.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|