Go Back   Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization
Reload this Page What is robots.txt?
FAQ Calendar Search Today's Posts Mark Forums Read

Notices


Reply
Page 4 of 5 « First 23 4 5
 
Thread Tools Rate Thread Display Modes
Old 09-21-2017, 04:22 AM   #46
sandra22
Registered User
 
Join Date: Jul 2017
Posts: 134
The robots.txts helps the website to communicate with the web crawlers
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
sandra22 is offline   Reply With Quote
Old 09-21-2017, 06:00 AM   #47
Hitekschools
Registered User
 
Join Date: Jul 2017
Posts: 228
Generate effective robots.txt files that help ensure Google and other search engines are crawling and indexing your site properly.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.



To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.


software testing tools


To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.



To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Hitekschools is offline   Reply With Quote
Old 09-21-2017, 06:07 AM   #48
uktweedjackets
Registered User
 
Join Date: Aug 2017
Posts: 6
Hello Friends,

The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots.
uktweedjackets is offline   Reply With Quote
Old 09-22-2017, 04:27 AM   #49
Jayasree
Registered User
 
Join Date: Oct 2016
Posts: 252
Robots.txt is a textual content report webmasters create to train web robots (typically search engine robots) how to crawl pages on their internet site.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Jayasree is offline   Reply With Quote
Old 09-22-2017, 04:34 AM   #50
Adya
Registered User
 
Join Date: Jul 2017
Posts: 334
The robots.txt record is fundamentally used to indicate File used to coordinate or to tell web bots what pages and catalogs to file or not list. This document must be set in the root index on the server facilitating your pages.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
 |
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
 |
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
 |
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Adya is offline   Reply With Quote
Old 09-22-2017, 04:39 AM   #51
albertc99
Registered User
 
Join Date: Jan 2016
Posts: 49
Robot.txt is a text file which is uploaded on website directory and k]linked in the HTML code of a website.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
,
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
,
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
,
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
albertc99 is offline   Reply With Quote
Old 09-22-2017, 04:46 AM   #52
Adya
Registered User
 
Join Date: Jul 2017
Posts: 334
Robot.txt is a text file which is uploaded on website directory and linked in the HTML code of a website.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
 |
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
 |
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
 |
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Adya is offline   Reply With Quote
Old 09-22-2017, 04:56 AM   #53
Elizabethezhil
Registered User
 
Join Date: Aug 2017
Posts: 259
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Elizabethezhil is offline   Reply With Quote
Old 09-22-2017, 05:14 AM   #54
mammasseo
Registered User
 
Join Date: Aug 2017
Posts: 60
Robots.txt is a text file webmasters create to instruct web robots (typically search engine robots) how to crawl pages on their website.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
| c
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
mammasseo is offline   Reply With Quote
Old 09-23-2017, 12:50 AM   #55
Jessicajain
Registered User
 
Join Date: Dec 2015
Posts: 153
he robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Jessicajain is offline   Reply With Quote
Old 09-23-2017, 05:13 AM   #56
Hashmicro
Registered User
 
Join Date: Nov 2016
Posts: 515
The robots.txt file is primarily used to specify File used to direct or to tell web bots what pages and directories to index or not index. This file must be placed in the root directory on the server hosting your pages.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
 |
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
 |
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
 |
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Hashmicro is offline   Reply With Quote
Old 09-27-2017, 02:28 AM   #57
wiliamjamesh
Registered User
 
Join Date: Sep 2016
Posts: 617
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
wiliamjamesh is offline   Reply With Quote
Old 09-27-2017, 02:47 AM   #58
Thara
Registered User
 
Join Date: Sep 2017
Posts: 62
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
 |
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
 |
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
Thara is offline   Reply With Quote
Old 09-27-2017, 11:50 PM   #59
ImBoost
Registered User
 
Join Date: Sep 2017
Posts: 119
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots


seo company vapi
ImBoost is offline   Reply With Quote
Old 09-28-2017, 12:07 AM   #60
jamesrobertt
Registered User
 
Join Date: Dec 2016
Posts: 530
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
jamesrobertt is offline   Reply With Quote
Reply
Page 4 of 5 « First 23 4 5

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes Rate This Thread
Linear Mode Linear Mode
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Robots.txt or Meta Robots.txt??? santoshkumar Search Engine Optimization 10 02-14-2017 04:03 AM
Robots.txt jaysh4922 Search Engine Optimization 13 07-28-2016 05:10 AM
Evil bots consuming all my sites traffic even after i disallowed them in robots.txt Fking General Discussion 1 12-13-2013 11:27 PM
How to edit virtual robots.txt file in wordpress? geniusoptimizer PHP / mySQL 1 04-12-2013 12:36 PM
Unable to delete robots.txt file notfake Yahoo 0 04-29-2012 02:19 AM


All times are GMT -7. The time now is 04:39 AM.

Contact Us - SiteownersForums.com - Archive - Top

Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.