What is the X-Robots tag? - Site Owners Forums

sandy mary · 07-26-2018, 05:27 AM

hi friends ,

What is the X-Robots tag?

bradvictor1 · 07-26-2018, 08:57 AM

We use this tag in HTTP header for given permission to google about crawling and indexing.

buyinstafollowe · 07-26-2018, 11:20 AM

There are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.

ezrankings · 07-26-2018, 10:18 PM

Using the X-Robots-Tag HTTP header
The X-Robots-Tag can be used as an element of the HTTP header response for a given URL. Any directive that can be used in an robots meta tag can also be specified as an X-Robots-Tag. Here's an example of an HTTP response with an X-Robots-Tag instructing crawlers not to index a page:

HTTP/1.1 200 OK
Date: Tue, 25 May 2010 21:42:43 GMT
(…)
X-Robots-Tag: noindex
(…)

Read more here: https://developers.google.com/search...obots_meta_tag

muruganram · 07-27-2018, 12:23 AM

There are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.

stevequill · 07-27-2018, 01:53 AM

Here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.

watson jamare · 07-27-2018, 05:46 AM

here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.

AizaKhan · 07-27-2018, 12:34 PM

Here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.

buyinstafollowe · 07-31-2018, 06:36 AM

x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.

muruganram · 07-31-2018, 10:25 PM

Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.

sherlydinda · 08-10-2018, 12:02 AM

Here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.

benfalcon · 08-10-2018, 04:09 AM

Here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.

RH-Calvin · 09-09-2019, 11:18 PM

The X-Robots-Tag can be used as an element of the HTTP header response for a given URL. Any directive that can be used in an robots meta tag can also be specified as an X-Robots-Tag.

nathanleo · 04-25-2020, 12:02 PM

txt file and meta robots tag, though, in that the X-Robots-Tag is a part of the HTTP header that controls indexing of a page on the whole, in addition to specific elements on a page. According to Google: “Any directive that can be used in a robots meta tag can also be specified as an X-Robots-Tag.

parkbogumm830 · 04-27-2020, 01:50 AM

txt file and meta robots tag, though, in that the X-Robots-Tag is a part of the HTTP header that controls indexing of a page on the whole, in addition to specific elements on a page. According to Google: “Any directive that can be used in a robots meta tag can also be specified as an X-Robots-Tag

07-26-2018, 05:27 AM	#1
sandy mary Registered User Join Date: Mar 2018 Location: Chennai Posts: 78	What is the X-Robots tag? hi friends , What is the X-Robots tag? __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

07-26-2018, 08:57 AM	#2
bradvictor1 Registered User Join Date: Jun 2014 Location: India Posts: 127	We use this tag in HTTP header for given permission to google about crawling and indexing. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

07-26-2018, 11:20 AM	#3
buyinstafollowe Registered User Join Date: Jun 2018 Location: australia Posts: 76	There are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used. __________________ [B] To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

07-26-2018, 10:18 PM	#4
ezrankings Registered User Join Date: Jun 2016 Location: Delhi Posts: 35	Using the X-Robots-Tag HTTP header The X-Robots-Tag can be used as an element of the HTTP header response for a given URL. Any directive that can be used in an robots meta tag can also be specified as an X-Robots-Tag. Here's an example of an HTTP response with an X-Robots-Tag instructing crawlers not to index a page: HTTP/1.1 200 OK Date: Tue, 25 May 2010 21:42:43 GMT (…) X-Robots-Tag: noindex (…) Read more here: https://developers.google.com/search...obots_meta_tag __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

07-27-2018, 12:23 AM	#5
muruganram Registered User Join Date: Mar 2018 Posts: 166	There are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

07-27-2018, 01:53 AM	#6
stevequill Registered User Join Date: Jun 2018 Posts: 51	Here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

07-27-2018, 05:46 AM	#7
watson jamare Registered User Join Date: Apr 2018 Posts: 279	here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used.

07-27-2018, 12:34 PM	#8
AizaKhan Registered User Join Date: Mar 2017 Location: Canton, Ohio USA Posts: 470	Here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

07-31-2018, 06:36 AM	#9
buyinstafollowe Registered User Join Date: Jun 2018 Location: australia Posts: 76	x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used. __________________ [B] To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

07-31-2018, 10:25 PM	#10
muruganram Registered User Join Date: Mar 2018 Posts: 166	Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

08-10-2018, 04:09 AM	#12
benfalcon Registered User Join Date: Jun 2018 Posts: 30	Here are two examples of the x-robots-tag in action: Again, those directives are not contained in the html code. They are in the header response, which is invisible to the naked eye. You need to specifically check the header response to see if the x-robots-tag is being used, and which directives are being used. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

09-09-2019, 11:18 PM	#13
RH-Calvin Registered User Join Date: May 2015 Location: Forum Posts: 2,517	The X-Robots-Tag can be used as an element of the HTTP header response for a given URL. Any directive that can be used in an robots meta tag can also be specified as an X-Robots-Tag. __________________ █ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| $1 VPS Hosting █ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| Windows Server with Remote Desktop Access █ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| Servers with Free IPMI Setup

04-25-2020, 12:02 PM	#14
nathanleo Registered User Join Date: Jul 2017 Posts: 2,060	txt file and meta robots tag, though, in that the X-Robots-Tag is a part of the HTTP header that controls indexing of a page on the whole, in addition to specific elements on a page. According to Google: “Any directive that can be used in a robots meta tag can also be specified as an X-Robots-Tag. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

04-27-2020, 01:50 AM	#15
parkbogumm830 Registered User Join Date: Apr 2016 Location: South Korea Posts: 721	txt file and meta robots tag, though, in that the X-Robots-Tag is a part of the HTTP header that controls indexing of a page on the whole, in addition to specific elements on a page. According to Google: “Any directive that can be used in a robots meta tag can also be specified as an X-Robots-Tag __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \|

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools
Show Printable Version Email this Page
Display Modes	Rate This Thread
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode	Rate This Thread:

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Check the website robots file	china-jewels	Bing	4	10-11-2015 08:14 AM
What is Spiders, Robots and Crawlers?	anita_singh98	Search Engine Optimization	4	10-20-2014 04:39 AM
Robots exclusion protocols?	jamesranatte	General Discussion	7	12-26-2013 12:01 AM