10-08-2016, 04:54 AM
|
#1 |
|
Registered User
Join Date: Jan 2016
Location: Mumbai, India
Posts: 1,064
|
What are the various uses of robots.txt?
What are the various uses of robots.txt?
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
|
10-09-2016, 10:05 AM
|
#2 |
|
Registered User
Join Date: Aug 2016
Posts: 59
|
Robots.txt file is used to guide the search engine automatically to the page you want it to search for and then index the page. Most sites also have the directories and files do not need to search engine robots to visit. Thus creating a robots.txt file can help you in SEO.
The robots.txt file is a very simple format that can be created by the tool Notepad. If you use WordPress robots.txt file would look like this User-agent: * Disallow: / wp- Disallow: / feed / Disallow: / trackback / |
|
|
|
|
10-09-2016, 05:37 PM
|
#3 |
|
Registered User
Join Date: Jun 2016
Posts: 99
|
ok! that was awesome! thanks for posting.
.................................................. .................................................. ............................. (bai viet rat huu ich !) .................................................. .................................................. .............................. bảng giá dây cáp điện cadivi mới nhất cadivi
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
|
|
10-09-2016, 06:59 PM
|
#4 |
|
Registered User
Join Date: Aug 2016
Posts: 67
|
What an great information
__________________
Create Your own Ecommerce Website for FREE here
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
|
|
01-12-2017, 12:32 AM
|
#5 |
|
Registered User
Join Date: Oct 2016
Posts: 580
|
Robots.txt file is used to guide the search engine automatically to the page you want it to search for and then index the page. Most sites also have the directories and files do not need to search engine robots to visit. Thus creating a robots.txt file can help you in SEO.
The robots.txt file is a very simple format that can be created by the tool Notepad. If you use WordPress robots.txt file would look like this User-agent: * Disallow: / wp- Disallow: / feed / Disallow: / trackback /
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
|
 |
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Linear Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Robots.txt | jaysh4922 | Search Engine Optimization | 13 | 07-28-2016 05:10 AM |
| Crawlers, spider & robots.txt? | jackthomas087 | Search Engine Optimization | 0 | 04-22-2014 03:29 AM |
| Evil bots consuming all my sites traffic even after i disallowed them in robots.txt | Fking | General Discussion | 1 | 12-13-2013 11:27 PM |
| How to edit virtual robots.txt file in wordpress? | geniusoptimizer | PHP / mySQL | 1 | 04-12-2013 12:36 PM |
| Unable to delete robots.txt file | notfake | Yahoo | 0 | 04-29-2012 02:19 AM |
All times are GMT -7. The time now is 06:36 PM.