Go Back   Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization

Notices


Reply
 
Thread Tools Rate Thread Display Modes
Old 01-23-2019, 04:43 AM   #1
sonamsharma
Registered User
 
Join Date: Jul 2013
Posts: 373
What is the role of robot.txt In Seo..?

Hello Friends,

I Want to know that What is the role of robot.txt In Seo..?
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
sonamsharma is offline   Reply With Quote

Old 01-24-2019, 12:14 AM   #2
mausin12991
Registered User
 
Join Date: May 2013
Posts: 109
The robots.txt file is a text file that tells web robots (most often search engines) which pages on your site to crawl. It also tells web robots which pages not to crawl.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
mausin12991 is offline   Reply With Quote
Old 01-24-2019, 12:40 AM   #3
inoxindia
Registered User
 
Join Date: Jan 2018
Posts: 30
The Main purpose of using robots.txt file in website is to index websites all pages by search engine crawler.
Robots.txt is a file in website which gives instruction to search engine crawler which page of website should be indexed and which Web pages should be ignored.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
inoxindia is offline   Reply With Quote
Old 01-24-2019, 03:20 AM   #4
Sojan Babu
Registered User
 
Join Date: May 2017
Posts: 245
Robots.txt file is a text file for restricting bots (robots, search engine crawlers ) from a website or certain pages on the website. Using a robots.txt file and with a disallow direction, we can restrict bots or search engine crawling program from websites and or from certain folders and files.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Sojan Babu is offline   Reply With Quote
Old 01-24-2019, 05:20 AM   #5
wiliamjamesh
Registered User
 
Join Date: Sep 2016
Posts: 617
The asterisk after “user-agent” means that the robots.txt file applies to all web robots that visit the site. The slash after “Disallow” tells the robot to not visit any pages on the site.After all, one of the major goals of SEO is to get search engines to crawl your site easily so they increase your ranking.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
wiliamjamesh is offline   Reply With Quote
Old 02-01-2019, 05:26 AM   #6
Zora2012
Registered User
 
Join Date: Nov 2012
Location: India
Posts: 276
Robots.txt is a file through which you can guide search engines to crawl or not to crawl certain sections of your website.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
- Shopping Cart- PrestaShop, Zencart; CMS - WordPress, Joomla; Custom Development


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
- SEO, Pay Per Click (PPC), SEM, Link Popularity Building, SEO Copywriting, SMO, SMM
Zora2012 is offline   Reply With Quote
Old 02-01-2019, 10:11 AM   #7
dexusmedia
Registered User
 
Join Date: Jan 2018
Location: INDIA
Posts: 15
The robots.txt file, also known as the robots exclusion protocol or standard, is a text file that tells web robots (most often search engines) which pages on your site to crawl. It also tells web robots which pages not to crawl.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
,
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
dexusmedia is offline   Reply With Quote
Old 02-01-2019, 08:50 PM   #8
efusionworld
Registered User
 
Join Date: Dec 2015
Location: 220 West Parkway, Unit 8A, Pompton Plains, New Jersey 07444
Posts: 127
Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
efusionworld is offline   Reply With Quote
Old 02-01-2019, 09:52 PM   #9
albertc99
Registered User
 
Join Date: Jan 2016
Posts: 49
What is the role of robot.txt In Seo..?

The robots.txt is a text file placed at the root of your website. This file is intended to prohibit search engine robots from indexing certain areas of your website. The robots.txt file is one of the first files scanned by spiders (robots) .
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
,
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
,
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
,
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
albertc99 is offline   Reply With Quote
Old 02-11-2019, 10:59 PM   #10
RH-Calvin
Registered User
 
Join Date: May 2015
Location: Forum
Posts: 2,517
Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
| $1 VPS Hosting

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
| Windows Server with Remote Desktop Access

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
| Servers with Free IPMI Setup
RH-Calvin is offline   Reply With Quote
Old 02-20-2019, 04:28 AM   #11
sonamg
Registered User
 
Join Date: Jun 2018
Location: India
Posts: 59
Robots.txt it’s a text file, it's instructed to the search engine which pages on your site to crawl.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
sonamg is offline   Reply With Quote
Old 02-20-2019, 04:57 AM   #12
addyrocker
Registered User
 
Join Date: Aug 2016
Posts: 43
Robots.txt is helpful preconditional text file for robots to understand what page to index and what not to index.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
addyrocker is offline   Reply With Quote
Old 02-21-2019, 04:25 AM   #13
IcodeBreakers
Registered User
 
Join Date: May 2018
Posts: 23
What is the role of robot.txt In Seo?

The robot.txt file is a simple text file that is placed in the website root directory. Basically, it tells the search engine which page on your site to crawl and also tells which page not to crawl.
IcodeBreakers is offline   Reply With Quote
Old 02-26-2019, 02:15 AM   #14
HostechSupport
Registered User
 
Join Date: Oct 2017
Location: India
Posts: 39
Robots.txt file is at the root of the website that involves sectors of your website you don’t want to be attained by search engine crawlers. Webmasters use a robot.txt file to instruct the search engine robots on how to crawl & index the web pages.
HostechSupport is offline   Reply With Quote
Old 02-26-2019, 11:35 PM   #15
vinukum
Registered User
 
Join Date: Feb 2018
Location: Bangalore
Posts: 283
If we want to block some data from search engine then we used this file. This file must be uploaded on root server. This is the first file which is crawled by search engine first.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
vinukum is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
robot.txt Shivam Tripathi Web Promotion 5 12-16-2018 10:11 PM
Why are you applying for this job? (or) Why this role attract you? (or) Pavan Techn General Discussion 0 06-10-2018 10:30 AM
Talk about the role of backlink johnandme Search Engine Optimization 2 05-19-2015 05:12 AM
how to use html5 attribute 'role'? arronmattwills Graphic Design 1 02-01-2014 06:03 AM
The role of keywords for a website sinicline Google 5 08-28-2013 11:14 PM


All times are GMT -7. The time now is 06:37 AM.


Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.