09-04-2017, 03:25 AM
|
#1 |
|
Registered User
Join Date: Aug 2017
Posts: 60
|
what is robots.txt file?
what is a robots.txt file:
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
|
09-04-2017, 04:17 AM
|
#2 |
|
Registered User
Join Date: Jun 2016
Posts: 66
|
Solution
I think best answer for your question is Wikipedia https:// en.wikipedia.org/ wiki/ Robots_exclusion_standard , please check it and let us know, if you required any further information.
__________________
█ ktchost.com - Reliable Web Hosting Provider █ E-commerce Ready Hosting | Pure SSD Cloud/VPS | Offshore Dedicated Server █ 24/7 Reliable Tech Support | Monitoring Service | Free Website Builder |
|
|
|
|
09-06-2017, 12:06 AM
|
#3 |
|
Registered User
Join Date: Sep 2017
Posts: 21
|
Robots.txt is a text (not html) file you put on your site to tell search robots which pages you would like them not to visit.
|
|
|
|
|
09-06-2017, 10:03 PM
|
#4 |
|
Registered User
Join Date: May 2015
Location: Forum
Posts: 2,517
|
Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
__________________
█ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | $1 VPS Hosting █ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | Windows Server with Remote Desktop Access █ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | Servers with Free IPMI Setup |
|
|
|
|
09-06-2017, 10:41 PM
|
#5 |
|
Registered User
Join Date: Mar 2017
Posts: 651
|
Robots.txt is a content record that rundowns pages which contain directions for web indexes robots. The record records site pages that are permitted and refused from internet searcher creeping.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
|
 |
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Linear Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| How to edit virtual robots.txt file in wordpress? | geniusoptimizer | PHP / mySQL | 1 | 04-12-2013 12:36 PM |
| The robots.txt file | rubberfender | Yahoo | 0 | 12-02-2012 07:32 PM |
| Unable to delete robots.txt file | notfake | Yahoo | 0 | 04-29-2012 02:19 AM |
All times are GMT -7. The time now is 07:44 AM.