09-11-2014, 02:27 AM
|
#1 |
|
Registered User
Join Date: Aug 2014
Posts: 20
|
How to know about robot.txt ?
How to know that a particular site have robot.txt file or not ?
please reply me
__________________
cool top 9 |
|
|
|
09-11-2014, 03:33 AM
|
#2 |
|
Registered User
Join Date: Jul 2014
Location: Athens, Greece
Posts: 461
 |
Just put the link into your browser and check it.
domain.com/robots.txt
__________________
Κατασκευή ιστοσελίδων | κατασκευή Δημιουργία site | Σχεδιασμός ανάπτυξη site | e-shop | Σχεδιασμός ιστοσελίδων |
|
|
|
|
09-11-2014, 03:43 AM
|
#3 |
|
Registered User
Join Date: Dec 2013
Posts: 45
  |
Its very simple. please type in your browser domain.com/robots.txt, its will be opened if robots already installed.
|
|
|
|
|
09-11-2014, 03:57 AM
|
#4 |
|
Registered User
Join Date: Jul 2014
Posts: 75
|
Just put the link in browser
|
|
|
|
|
09-11-2014, 04:39 AM
|
#5 |
|
Registered User
Join Date: Aug 2014
Posts: 20
|
thanks guys for you valuable response
__________________
cool top 9 |
|
|
|
|
09-11-2014, 05:27 AM
|
#6 |
|
Registered User
Join Date: Aug 2014
Posts: 15
|
Robots.txt file is very important for website.In this file website owner decide what part of the website hide /keep from visitor.For find this file present or not use domain name/robots.txt .
|
|
|
|
|
09-11-2014, 05:30 AM
|
#7 |
|
Registered User
Join Date: Sep 2014
Posts: 35
|
Robot.txt is the main thing used by web developers.It is used to restrict some web page in our site when search engine crawling.
Online Marketplace Script | Wanelo clone script | Multi vendor shopping cart Last edited by Andrew paul; 09-15-2014 at 03:45 AM.. |
|
|
|
|
09-16-2014, 12:46 PM
|
#8 |
|
Registered User
Join Date: Dec 2013
Location: Cairo
Posts: 66
|
just type in your browser domain.com/robots.txt u will see it
__________________
مدونة هاى تك للمعلومات |
|
|
|
|
10-06-2014, 04:04 AM
|
#10 |
|
Registered User
Join Date: Sep 2014
Posts: 228
|
robots.txt text file are use generally search engine information allow or not.
__________________
http://fireip.com |
|
|
|
|
10-08-2014, 04:39 AM
|
#11 |
|
Registered User
Join Date: Aug 2014
Posts: 68
|
Robot.txt is the file used to hidden the pages in the website from the crawler or spider.
|
|
|
|
 |
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Linear Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| What is robots.txt? | praveen007 | Search Engine Optimization | 17 | 10-15-2014 04:11 AM |
| how can create the Robot.txt file | eagleeye dental | Search Engine Optimization | 0 | 09-01-2014 09:40 PM |
| how to use robot.txt? | dean1122 | Search Engine Optimization | 11 | 01-05-2013 02:10 AM |
All times are GMT -7. The time now is 10:59 AM.