Register on the forum now to remove ALL ads + popups + get access to tons of hidden content for members only!

Go Back   Site Owners Forums - Webmaster Forums > Market Zone - Buy/Sell/Trade/Wanted > The Market

Notices


Reply
 
Thread Tools Rate Thread Display Modes
Old 01-16-2018, 06:38 AM   #1
SAP Online
Registered User
 
Join Date: Jul 2014
Posts: 193
Robot.txt file

If google bot fail to access robot.txt what are its effects of SEO practice ?
SAP Online is offline   Reply With Quote

Old 01-21-2018, 09:03 PM   #2
samaron
Registered User
 
Join Date: Sep 2017
Posts: 314
Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website.
samaron is offline   Reply With Quote
Old 01-22-2018, 01:57 AM   #3
PeterGenesis
Registered User
 
Join Date: Dec 2017
Posts: 298
Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website.
PeterGenesis is offline   Reply With Quote
Old 01-28-2018, 11:53 PM   #4
karthiknagaraja
Registered User
 
Join Date: Oct 2017
Posts: 82
hi,
Search engines may not crawl your websites if roborts.txt are absent
karthiknagaraja is offline   Reply With Quote
Old 02-06-2018, 11:25 PM   #5
GeorgeAlbie
Registered User
 
Join Date: Nov 2017
Posts: 305
In a nutshell. Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. It works likes this: a robot wants to vists a Web site URL, say http://www.example.com/welcome.html.
GeorgeAlbie is offline   Reply With Quote
Old 02-07-2018, 12:37 AM   #6
activesystem123
Registered User
 
Join Date: Jan 2018
Posts: 211
It's the robots.txt file (also called the robots exclusion protocol or standard). This teeny tiny text file is part of every website on the Internet, but most people don't even know about it. It's designed to work with search engines, but surprisingly, it's a source of SEO juice just waiting to be unlocked.
activesystem123 is offline   Reply With Quote
Old 02-14-2018, 12:05 AM   #7
josechan
Registered User
 
Join Date: Feb 2018
Location: India
Posts: 15
Not so important. I got indexed website's page without the Robots.txt.
josechan is offline   Reply With Quote
Old 02-14-2018, 12:39 AM   #8
towing service
Registered User
 
Join Date: Jun 2017
Posts: 229
In a nutshell. Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. It works likes this: a robot wants to vists a Web site URL, say http://www.example.com/welcome.html.
towing service is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
What is robot.txt file and what are the benefits of using it..? AshokDixit89 Search Engine Optimization 8 05-05-2017 04:30 AM
Why We Use robot.txt file In Seo..? ankitasharma123 Search Engine Optimization 9 04-20-2017 12:59 PM
Which pages should be put in robot.txt file? Martinricky Search Engine Optimization 1 07-24-2016 11:15 PM
Apple: a new file system encrypted by nature bolhaw General Discussion 0 06-17-2016 07:25 AM
how can create the Robot.txt file eagleeye dental Search Engine Optimization 0 09-01-2014 09:40 PM


All times are GMT -7. The time now is 08:02 PM.


Powered by vBulletin Copyright © 2013 vBulletin Solutions, Inc.