01-02-2016, 03:16 AM | #1 |
Registered User
|
How to add robots.txt?
Hello all, how to add robots.txt to my website http://www.enerco.co.uk
Is it necessary to add robots.txt in my website? Please suggest me, thanks |
01-02-2016, 10:23 AM | #2 |
Registered User
Join Date: Feb 2012
Posts: 94
|
robots.txt file instructs spiders about blocked folders of website
|
01-04-2016, 12:10 AM | #3 |
Registered User
Join Date: Sep 2015
Posts: 75
|
Robots.txt file contains set of instruction, which tells google what to crawl on that particular site.
sample code User Agent: * Allow: / The above code give permission to robots to crawl the entire website. write this code in a notepad and save it as robots.txt and upload it in your server.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
01-04-2016, 12:47 AM | #4 |
Registered User
Join Date: Dec 2015
Posts: 15
|
robots.txt is very important in seo to give instructions about the website for the Google.
Code: User-agent: * Disallow: / |
01-04-2016, 12:54 AM | #5 |
Registered User
Join Date: Dec 2015
Posts: 83
|
i think should update go host @@
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
01-04-2016, 02:10 AM | #6 |
Registered User
Join Date: Oct 2015
Posts: 116
|
Hi, I'm also looking for this information so thanks for sharing it.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
01-04-2016, 06:53 AM | #7 |
Registered User
Join Date: Sep 2015
Location: Bangalore
Posts: 548
|
robots.txt is very important in seo to give instructions about the website for the Google.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
01-04-2016, 12:02 PM | #8 |
Registered User
Join Date: Jan 2016
Posts: 2
|
Save the robots.txt code as a text file. Place the file in the highest-level directory of your site or the root of your domain.
__________________
Hire a professional To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. . |
01-04-2016, 06:39 PM | #9 | ||
Registered User
Join Date: Dec 2015
Posts: 10
|
You can add code to world with file robots.txt:
Quote:
Quote:
__________________
Chia sẻ bí quyết điều trị bệnh To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. ở phụ nữ đang mang thai To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. để ngủ được, địa chỉ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. an toàn hiệu quả To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. là gì và To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. tốt nhất giúp bạn có thể điều trị được To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. hiệu quả, giúp lưu thông máu tốt |
||
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Thread Tools | |
Display Modes | Rate This Thread |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Crawlers, spider & robots.txt? | jackthomas087 | Search Engine Optimization | 0 | 04-22-2014 03:29 AM |
Evil bots consuming all my sites traffic even after i disallowed them in robots.txt | Fking | General Discussion | 1 | 12-13-2013 11:27 PM |
How to edit virtual robots.txt file in wordpress? | geniusoptimizer | PHP / mySQL | 1 | 04-12-2013 12:36 PM |
The robots.txt file | rubberfender | Yahoo | 0 | 12-02-2012 07:32 PM |
Unable to delete robots.txt file | notfake | Yahoo | 0 | 04-29-2012 02:19 AM |