Register on the forum now to remove ALL ads + popups + get access to tons of hidden content for members only!

Go Back   Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization

Notices


Reply
 
Thread Tools Rate Thread Display Modes
Old 01-12-2018, 01:20 AM   #1
priyakumari95
Registered User
 
Join Date: Jul 2017
Posts: 92
What is robots.txt

Hello friends,









What is robots.txt.......?
priyakumari95 is offline   Reply With Quote

Old 01-12-2018, 01:22 AM   #2
wellliving
Registered User
 
Join Date: Dec 2015
Location: USA
Posts: 1,173
Hi

robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.

https://www.welllivingshop.com/beddi...mattress-pads/
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
wellliving is offline   Reply With Quote
Old 01-12-2018, 01:52 AM   #3
stellasweety
Registered User
 
Join Date: Mar 2017
Posts: 996
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
stellasweety is offline   Reply With Quote
Old 01-12-2018, 06:24 AM   #4
PeterGenesis
Registered User
 
Join Date: Dec 2017
Posts: 298
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
PeterGenesis is offline   Reply With Quote
Old 01-12-2018, 06:51 AM   #5
AmandaCherry
Registered User
 
Join Date: Nov 2017
Posts: 424
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
AmandaCherry is offline   Reply With Quote
Old 01-12-2018, 08:53 PM   #6
neelseowork
Registered User
 
Join Date: May 2017
Location: Surat
Posts: 323
Quote:
Originally Posted by priyakumari95 View Post
Hello friends,

What is robots.txt.......?

simple searchable question asked here.! well no worries, click to know about robots.txt.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.



To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.



To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
neelseowork is offline   Reply With Quote
Old 01-13-2018, 02:21 AM   #7
charleswesley
Registered User
 
Join Date: Nov 2017
Posts: 279
The robots rejection standard, otherwise called the robots prohibition convention or essentially robots.txt, is a standard utilized by sites to speak with web crawlers and other web robots. The standard determines how to advise the web robot about which zones of the site ought not be prepared or filtered.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
charleswesley is offline   Reply With Quote
Old 01-13-2018, 02:42 AM   #8
manival
Registered User
 
Join Date: Jul 2017
Posts: 433
Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
manival is offline   Reply With Quote
Old 01-14-2018, 02:21 AM   #9
PeterGenesis
Registered User
 
Join Date: Dec 2017
Posts: 298
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
PeterGenesis is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Evil bots consuming all my sites traffic even after i disallowed them in robots.txt Fking General Discussion 2 09-20-2018 03:44 AM
Robots.txt or Meta Robots.txt??? santoshkumar Search Engine Optimization 11 02-14-2017 03:03 AM
Robots.txt jaysh4922 Search Engine Optimization 15 07-29-2016 05:07 AM
How to edit virtual robots.txt file in wordpress? geniusoptimizer PHP / mySQL 1 04-12-2013 12:36 PM
Unable to delete robots.txt file notfake Yahoo 0 04-29-2012 02:19 AM


All times are GMT -7. The time now is 07:32 AM.


Powered by vBulletin Copyright © 2013 vBulletin Solutions, Inc.