03-14-2013, 11:39 PM
|
#4 |
|
Registered User
Join Date: Jun 2012
Posts: 239
|
If your site contain such page that you want to index in search engine in that case you add robot text to stop the crawler to visit that and also stop to index that page.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. :: To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Evil bots consuming all my sites traffic even after i disallowed them in robots.txt | Fking | General Discussion | 1 | 12-13-2013 11:27 PM |
| How to edit virtual robots.txt file in wordpress? | geniusoptimizer | PHP / mySQL | 1 | 04-12-2013 12:36 PM |
| The robots.txt file | rubberfender | Yahoo | 0 | 12-02-2012 07:32 PM |
| Does Anyone Know About The Importance Of SEO? | brettlee585 | Search Engine Optimization | 5 | 11-26-2012 05:15 AM |
| Unable to delete robots.txt file | notfake | Yahoo | 0 | 04-29-2012 02:19 AM |
All times are GMT -7. The time now is 02:51 AM.