|
Notices |
|
Thread Tools | Rate Thread | Display Modes |
05-09-2017, 11:30 PM | #1 |
Registered User
Join Date: Mar 2017
Location: Delhi
Posts: 31
|
What’s the significance of Robots.txt file in a website?
Hlo Friends,
Can anyone tell me, What’s the significance of Robots.txt file in a website?
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
05-10-2017, 12:27 AM | #2 |
Registered User
Join Date: Mar 2016
Location: India
Posts: 37
|
Robots.text file tell the search engine which file is indexed or which is not.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
05-10-2017, 02:09 AM | #3 |
Registered User
Join Date: Apr 2017
Posts: 32
|
robots.txt file is used to give instructions about the site to web robots to crawl which files .
|
05-10-2017, 02:14 AM | #4 |
Registered User
Join Date: Feb 2014
Posts: 197
|
Your Robots.txt file is what tells the search engines which pages to access and index on your website on which pages not to.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
How to create Robots.txt file for my website | rahul47 | Search Engine Optimization | 7 | 11-21-2016 12:18 AM |
Cheap Custom Website Design Packages with Amazing Offer of FREE Domain & FREE Hosting | rf-harris | Post your ad here | 0 | 10-10-2016 07:50 AM |
What is a robots.txt file? | orientation | Search Engine Optimization | 8 | 05-26-2016 11:14 PM |
Benefits Of Creating A Website For Your Business | eook.joc | Graphic Design | 9 | 10-17-2014 02:16 AM |
Don’t exceed maximum file size for robots.txt file | ClaudiaSchayffe | Search Engine Optimization | 3 | 04-02-2012 04:28 AM |