Register on the forum now to remove ALL ads + popups + get access to tons of hidden content for members only!

Go Back   Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization

Notices


Reply
 
Thread Tools Rate Thread Display Modes
Old 11-28-2017, 10:26 PM   #16
airvente
Registered User
 
Join Date: Aug 2017
Posts: 291
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
airvente is offline   Reply With Quote
Old 11-28-2017, 10:28 PM   #17
ajpowercenter
Registered User
 
Join Date: Jul 2017
Posts: 319
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
ajpowercenter is offline   Reply With Quote
Old 11-28-2017, 10:29 PM   #18
areducation
Registered User
 
Join Date: Aug 2017
Posts: 261
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
areducation is offline   Reply With Quote
Old 11-28-2017, 10:33 PM   #19
lmenter123
Registered User
 
Join Date: May 2017
Posts: 262
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
lmenter123 is offline   Reply With Quote
Old 11-28-2017, 10:33 PM   #20
firstexpres3
Registered User
 
Join Date: May 2017
Posts: 337
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
firstexpres3 is offline   Reply With Quote
Old 11-28-2017, 10:35 PM   #21
chennaisport
Registered User
 
Join Date: Jan 2017
Posts: 491
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
chennaisport is offline   Reply With Quote
Old 11-28-2017, 10:38 PM   #22
crystalsolution
Registered User
 
Join Date: Aug 2017
Posts: 261
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
crystalsolution is offline   Reply With Quote
Old 11-28-2017, 10:55 PM   #23
bsobpromos
Registered User
 
Join Date: Nov 2017
Posts: 132
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
bsobpromos is offline   Reply With Quote
Old 11-28-2017, 10:57 PM   #24
foodmachinex
Registered User
 
Join Date: Jun 2017
Posts: 302
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
foodmachinex is offline   Reply With Quote
Old 11-28-2017, 11:08 PM   #25
jehovahcarental
Registered User
 
Join Date: Oct 2017
Posts: 225
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
jehovahcarental is offline   Reply With Quote
Old 11-28-2017, 11:10 PM   #26
littleparadise
Registered User
 
Join Date: Sep 2017
Posts: 292
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
littleparadise is offline   Reply With Quote
Old 11-28-2017, 11:14 PM   #27
nattukottaichet
Registered User
 
Join Date: Oct 2017
Posts: 234
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
nattukottaichet is offline   Reply With Quote
Old 11-28-2017, 11:16 PM   #28
welcomeforex1
Registered User
 
Join Date: Aug 2017
Posts: 228
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
welcomeforex1 is offline   Reply With Quote
Old 11-28-2017, 11:17 PM   #29
towing service
Registered User
 
Join Date: Jun 2017
Posts: 229
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
towing service is offline   Reply With Quote
Old 11-28-2017, 11:18 PM   #30
sakthibodyworks
Registered User
 
Join Date: Aug 2017
Posts: 223
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.
sakthibodyworks is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
What is the purpose of robots.txt file? sahithya Search Engine Optimization 18 02-27-2018 07:54 AM
What is the purpose of using robots.txt file in seo? SunFineHanger Search Engine Optimization 15 02-26-2018 01:29 AM
Apple: a new file system encrypted by nature bolhaw General Discussion 0 06-17-2016 07:25 AM
How to edit virtual robots.txt file in wordpress? geniusoptimizer PHP / mySQL 1 04-12-2013 12:36 PM
Unable to delete robots.txt file notfake Yahoo 0 04-29-2012 02:19 AM


All times are GMT -7. The time now is 02:02 AM.


Powered by vBulletin Copyright © 2013 vBulletin Solutions, Inc.