07-27-2018, 01:53 AM
|
#6 |
|
Registered User
Join Date: Jun 2018
Posts: 51
|
Here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Check the website robots file | china-jewels | Bing | 4 | 10-11-2015 08:14 AM |
| What is Spiders, Robots and Crawlers? | anita_singh98 | Search Engine Optimization | 4 | 10-20-2014 04:39 AM |
| Robots exclusion protocols? | jamesranatte | General Discussion | 7 | 12-26-2013 12:01 AM |
All times are GMT -7. The time now is 05:13 PM.