![]() |
#1 |
Registered User
Join Date: Mar 2018
Location: Chennai
Posts: 78
|
What is the X-Robots tag?
hi friends ,
What is the X-Robots tag? |
![]() |
![]() |
![]() |
#2 |
Registered User
Join Date: Jun 2014
Location: India
Posts: 127
|
We use this tag in HTTP header for given permission to google about crawling and indexing.
|
![]() |
![]() |
![]() |
#3 |
Registered User
Join Date: Jun 2018
Location: australia
Posts: 76
|
There are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.
__________________
[B]BUY INSTAGRAM FOLLOWRS AUSTRALIA BUY INSTAGRAM FOLLOWRS CANADA BUY INSTAGRAM FOLLOWERS MALAYSIA |
![]() |
![]() |
![]() |
#4 |
Registered User
Join Date: Jun 2016
Location: Delhi
Posts: 35
|
Using the X-Robots-Tag HTTP header
The X-Robots-Tag can be used as an element of the HTTP header response for a given URL. Any directive that can be used in an robots meta tag can also be specified as an X-Robots-Tag. Here's an example of an HTTP response with an X-Robots-Tag instructing crawlers not to index a page: HTTP/1.1 200 OK Date: Tue, 25 May 2010 21:42:43 GMT (…) X-Robots-Tag: noindex (…) Read more here: https://developers.google.com/search...obots_meta_tag |
![]() |
![]() |
![]() |
#5 |
Registered User
Join Date: Mar 2018
Posts: 166
|
There are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.
|
![]() |
![]() |
![]() |
#6 |
Registered User
Join Date: Jun 2018
Posts: 51
|
Here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.
|
![]() |
![]() |
![]() |
#7 |
Registered User
Join Date: Apr 2018
Posts: 279
|
here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.
|
![]() |
![]() |
![]() |
#8 |
Registered User
Join Date: Mar 2017
Location: Canton, Ohio USA
Posts: 503
|
Here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.
|
![]() |
![]() |
![]() |
#9 |
Registered User
Join Date: Jun 2018
Location: australia
Posts: 76
|
x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.
__________________
[B]BUY INSTAGRAM FOLLOWRS AUSTRALIA BUY INSTAGRAM FOLLOWRS CANADA BUY INSTAGRAM FOLLOWERS MALAYSIA |
![]() |
![]() |
![]() |
#10 |
Registered User
Join Date: Mar 2018
Posts: 166
|
Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.
|
![]() |
![]() |
![]() |
#11 |
Registered User
Join Date: Mar 2018
Posts: 42
|
Here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.
|
![]() |
![]() |
![]() |
#12 |
Registered User
Join Date: Jun 2018
Posts: 30
|
Here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.
|
![]() |
![]() |
![]() |
#13 |
Registered User
Join Date: May 2015
Location: Forum
Posts: 2,517
|
The X-Robots-Tag can be used as an element of the HTTP header response for a given URL. Any directive that can be used in an robots meta tag can also be specified as an X-Robots-Tag.
__________________
█ Cheap VPS | $1 VPS Hosting █ Cheap Windows VPS | Windows Server with Remote Desktop Access █ Cheap Dedicated Server | Servers with Free IPMI Setup |
![]() |
![]() |
![]() |
#14 |
Registered User
Join Date: Jul 2017
Posts: 2,283
|
txt file and meta robots tag, though, in that the X-Robots-Tag is a part of the HTTP header that controls indexing of a page on the whole, in addition to specific elements on a page. According to Google: “Any directive that can be used in a robots meta tag can also be specified as an X-Robots-Tag.
__________________
Villa Plots in Chennai Plots Sale in Kelambakkam Premium Villa Plots in Kelambakkam fastest selling villa plots in chennai Villa Plots in Kelambakkam OMR Residential Plots for Sale in OMR Premium Villa Plots in OMR Villa Plots in Kelambakkam Villa Plots Sale in Kelambakkam Plots Sale in Kelambakkam Residential Plots in Kelambakkam Land for Sale Near Chennai Plots for Sale in Chennai Premium Villa Plots OMR luxury villa plots in ECR Chennai |
![]() |
![]() |
![]() |
#15 |
Registered User
Join Date: Apr 2016
Location: South Korea
Posts: 721
|
txt file and meta robots tag, though, in that the X-Robots-Tag is a part of the HTTP header that controls indexing of a page on the whole, in addition to specific elements on a page. According to Google: “Any directive that can be used in a robots meta tag can also be specified as an X-Robots-Tag
__________________
Buyer discovery | Export Marketing partner | Web Media posting | Skin lightening products | |
![]() |
![]() |
![]() |
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
|
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
Check the website robots file | china-jewels | Bing | 4 | 10-11-2015 08:14 AM |
What is Spiders, Robots and Crawlers? | anita_singh98 | Search Engine Optimization | 4 | 10-20-2014 04:39 AM |
Robots exclusion protocols? | jamesranatte | General Discussion | 7 | 12-26-2013 12:01 AM |