06-03-2017, 12:55 AM | #16 |
Registered User
Join Date: Jun 2017
Posts: 109
|
you need a robots.txt file only if your site includes content that you don't want search engines to index like Your site Admin Panel.
Golden triangle tour with udaipur and jodhpur | golden triangle tour with mathura | Golden triangle tour with jodhpur | Golden traingle tour ranthambore | Golden triangle tour with Goa | Golden traingle tour with pusjkar and ajmer
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
06-03-2017, 01:29 AM | #17 |
Registered User
Join Date: Jun 2017
Posts: 10
|
How do I place on vB4?
__________________
|
06-05-2017, 12:05 AM | #18 |
Registered User
Join Date: Jun 2017
Location: Tehran, Iran
Posts: 12
|
it is commonly used to tell search engines what parts of your website are open to public and must be published through internet and what parts are not supposed to be reviewed and published by search engines.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
06-05-2017, 04:50 AM | #19 |
Registered User
Join Date: Nov 2016
Posts: 102
|
You need a robots.txt file only if your site includes content that you don't want search engines to index like your site Admin Panel.
One day agra tour
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Robots.txt | jaysh4922 | Search Engine Optimization | 13 | 07-28-2016 05:10 AM |
Crawlers, spider & robots.txt? | jackthomas087 | Search Engine Optimization | 0 | 04-22-2014 03:29 AM |
Evil bots consuming all my sites traffic even after i disallowed them in robots.txt | Fking | General Discussion | 1 | 12-13-2013 11:27 PM |
How to edit virtual robots.txt file in wordpress? | geniusoptimizer | PHP / mySQL | 1 | 04-12-2013 12:36 PM |
Unable to delete robots.txt file | notfake | Yahoo | 0 | 04-29-2012 02:19 AM |