09-11-2014, 02:27 AM | #1 |
Registered User
Join Date: Aug 2014
Posts: 20
|
How to know about robot.txt ?
How to know that a particular site have robot.txt file or not ?
please reply me
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
09-11-2014, 03:33 AM | #2 |
Registered User
Join Date: Jul 2014
Location: Athens, Greece
Posts: 461
|
Just put the link into your browser and check it.
domain.com/robots.txt
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
09-11-2014, 03:43 AM | #3 |
Registered User
|
Its very simple. please type in your browser domain.com/robots.txt, its will be opened if robots already installed.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
09-11-2014, 03:57 AM | #4 |
Registered User
Join Date: Jul 2014
Posts: 75
|
Just put the link in browser
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
09-11-2014, 04:39 AM | #5 |
Registered User
Join Date: Aug 2014
Posts: 20
|
thanks guys for you valuable response
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
09-11-2014, 05:27 AM | #6 |
Registered User
Join Date: Aug 2014
Posts: 15
|
Robots.txt file is very important for website.In this file website owner decide what part of the website hide /keep from visitor.For find this file present or not use domain name/robots.txt .
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
09-11-2014, 05:30 AM | #7 |
Registered User
Join Date: Sep 2014
Posts: 35
|
Robot.txt is the main thing used by web developers.It is used to restrict some web page in our site when search engine crawling.
Online Marketplace Script | Wanelo clone script | Multi vendor shopping cart Last edited by Andrew paul; 09-15-2014 at 03:45 AM.. |
09-16-2014, 12:46 PM | #8 |
Registered User
Join Date: Dec 2013
Location: Cairo
Posts: 66
|
just type in your browser domain.com/robots.txt u will see it
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
09-16-2014, 10:23 PM | #9 |
Registered User
Join Date: Sep 2014
Posts: 10
|
its very simple.just put your domain name and write /robots.txt.
__________________
Flower Pot Filter To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. , Flower Pot Drainage To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. , |
10-06-2014, 04:04 AM | #10 |
Registered User
Join Date: Sep 2014
Posts: 228
|
robots.txt text file are use generally search engine information allow or not.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
10-08-2014, 04:39 AM | #11 |
Registered User
Join Date: Aug 2014
Posts: 68
|
Robot.txt is the file used to hidden the pages in the website from the crawler or spider.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
What is robots.txt? | praveen007 | Search Engine Optimization | 17 | 10-15-2014 04:11 AM |
how can create the Robot.txt file | eagleeye dental | Search Engine Optimization | 0 | 09-01-2014 09:40 PM |
how to use robot.txt? | dean1122 | Search Engine Optimization | 11 | 01-05-2013 02:10 AM |