Register on the forum now to remove ALL ads + popups + get access to tons of hidden content for members only!

Go Back   Site Owners Forums - Webmaster Forums > General Arena > General Discussion

Notices


Reply
 
Thread Tools Rate Thread Display Modes
Old 09-04-2017, 03:25 AM   #1
luxurycars
Registered User
 
Join Date: Aug 2017
Posts: 61
what is robots.txt file?

what is a robots.txt file:
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
luxurycars is offline   Reply With Quote

Old 09-04-2017, 04:17 AM   #2
malina.smith
Registered User
 
Join Date: Jun 2016
Posts: 60
Solution

I think best answer for your question is Wikipedia https:// en.wikipedia.org/ wiki/ Robots_exclusion_standard , please check it and let us know, if you required any further information.
__________________
█ ktchost.com - Reliable Web Hosting Provider
E-commerce Ready Hosting | Pure SSD Cloud/VPS | Offshore Dedicated Server
█ 24/7 Reliable Tech Support | Monitoring Service | Free Website Builder
malina.smith is offline   Reply With Quote
Old 09-06-2017, 12:06 AM   #3
RenderPlus
Registered User
 
Join Date: Sep 2017
Posts: 22
Robots.txt is a text (not html) file you put on your site to tell search robots which pages you would like them not to visit.
RenderPlus is offline   Reply With Quote
Old 09-06-2017, 10:03 PM   #4
RH-Calvin
Registered User
 
Join Date: May 2015
Location: Forum
Posts: 2,132
Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
| $1 VPS Hosting

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
| Windows Server with Remote Desktop Access

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
| Servers with Free IPMI Setup
RH-Calvin is offline   Reply With Quote
Old 09-06-2017, 10:41 PM   #5
stellasweety
Registered User
 
Join Date: Mar 2017
Posts: 660
Robots.txt is a content record that rundowns pages which contain directions for web indexes robots. The record records site pages that are permitted and refused from internet searcher creeping.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
stellasweety is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
How to edit virtual robots.txt file in wordpress? geniusoptimizer PHP / mySQL 1 04-12-2013 12:36 PM
The robots.txt file rubberfender Yahoo 0 12-02-2012 06:32 PM
Unable to delete robots.txt file notfake Yahoo 0 04-29-2012 02:19 AM


All times are GMT -7. The time now is 09:47 PM.


Powered by vBulletin Copyright © 2013 vBulletin Solutions, Inc.