Go Back   Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization
Reload this Page robots meta tag
FAQ Calendar Today's Posts

Notices


Reply
 
Thread Tools Rate Thread Display Modes
Old 08-28-2015, 05:40 AM   #1
zinavoco
Registered User
 
Join Date: Aug 2015
Posts: 2
robots meta tag
If robots meta tag is not included in a website page the effect is
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
zinavoco is offline   Reply With Quote

Old 09-24-2015, 11:06 PM   #2
Rajan007
Registered User
 
Join Date: Sep 2015
Posts: 75
If you want to restrict search engines from crawling some important pages of your website then you need robots.txt. or otherwise you no need to add robots.txt file.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.



To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Rajan007 is offline   Reply With Quote
Old 09-25-2015, 12:34 AM   #3
shanken
Registered User
 
Join Date: Jun 2015
Location: Somerset West
Posts: 368
Quote:
Originally Posted by zinavoco View Post
If robots meta tag is not included in a website page the effect is
Nothing will happen, your page will be visited by robots and spiders and they will index your page as normal.

If you do ad robots meta tag with noindex then your page wont be indexed.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
shanken is offline   Reply With Quote
Old 09-25-2015, 12:38 AM   #4
shanken
Registered User
 
Join Date: Jun 2015
Location: Somerset West
Posts: 368
Quote:
Originally Posted by cpsi View Post
Robot Visit your Website And Collect your Information. If you don't include robot meta tag then google not crawl your website.
Are you sure about that? You use the robots meta tag to stop Goolge from indexing a particular page and to set nofollow link atributes to all links on that page.

You can also use the robots meta tag to only allow certain spiders like Google bot to index your page.

If you dont ad the robots metaa tag then you are basically telling Google to go ahead and index my page.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
shanken is offline   Reply With Quote
Old 09-25-2015, 12:40 AM   #5
shanken
Registered User
 
Join Date: Jun 2015
Location: Somerset West
Posts: 368
Quote:
Originally Posted by manpreetkaur View Post
The robots meta tag lets you utilize a granular, page-specific approach to controlling how an individual page should be indexed and served to users in search results. Place the robots meta tag in the <head> section of a given page, like this:

<!DOCTYPE html>
<html><head>
<meta name="robots" content="noindex" />
(…)
</head>
<body>(…)</body>
</html>
The robots meta tag in the above example instructs all search engine not to show the page in search results. The value of the name attribute (robots) specifies that the directive applies to all crawlers. To address a specific crawler, replace the robots value of the name attribute with the name of the crawler that you are addressing. Specific crawlers are also known as user-agents (a crawler uses its user-agent to request a page.) Google's standard web crawler has the user-agent name Googlebot. To prevent only Googlebot from crawling your page, update the tag as follows:

<meta name="googlebot" content="noindex" />
This tag now instructs Google (but no other search engines) not to show this page in its web search results. Both the name and the content attributes are non-case sensitive.

Search engines may have different crawlers for different properties or purposes. See the complete list of Google's crawlers. For example, to show a page in Google's web search results, but not in Google News, use the following meta tag:

<meta name="googlebot-news" content="noindex" />
If you need to specify multiple crawlers individually, it's okay to use multiple robots meta tags:

<meta name="googlebot" content="noindex">
<meta name="googlebot-news" content="nosnippet">
If competing directives are encountered by our crawlers we will use the most restrictive directive we find.
Best answer of the whole lot.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
shanken is offline   Reply With Quote
Old 09-25-2015, 11:30 PM   #6
rajivdevkk
Registered User
 
Join Date: Sep 2013
Location: Delhi
Posts: 344
meta robots is useful fo crawl and discrawls the site pages.

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">


day picnic delhi ncr | picnic spots in gurgaon
rajivdevkk is offline   Reply With Quote
Old 09-26-2015, 12:52 AM   #7
rajeshhome
Registered User
 
Join Date: Sep 2015
Posts: 33
The robots.txt is a text file webmasters create to instruct robots how to crawl and index pages on their website.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
rajeshhome is offline   Reply With Quote
Old 09-26-2015, 02:24 AM   #8
Martinricky
Registered User
 
Join Date: Aug 2015
Posts: 434
Thanks for sharing informative tips about meta tags, looking forward for more information in this thread
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Martinricky is offline   Reply With Quote
Old 09-27-2015, 11:22 PM   #9
randiv
Registered User
 
Join Date: May 2014
Posts: 105
Nice Information sharing about robots. Thanks.
randiv is offline   Reply With Quote
Old 09-27-2015, 11:26 PM   #10
ramskl
Registered User
 
Join Date: Sep 2015
Posts: 240
You can use a special HTML <META> tag to tell robots not to index the content of a page, and/or not scan it for links to follow.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
ramskl is offline   Reply With Quote
Reply

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
The Sticky for Meta Description, keywords, keyword density, and title tags sinicline Search Engine Optimization 2 01-06-2017 10:22 AM
Check the website robots file china-jewels Bing 4 10-11-2015 08:14 AM
If the meta robots tag has a value of "no index, no follow" what does it mean? poojaseo Search Engine Optimization 0 06-06-2014 03:08 AM
How to add a robots follow meta tag? jamesranatte Search Engine Optimization 1 10-11-2012 10:24 PM
What is Robots meta tag? samlko Search Engine Optimization 2 04-06-2012 12:10 AM


All times are GMT -7. The time now is 02:42 AM.

Contact Us - SiteownersForums.com - Archive - Top

Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.