11-21-2016, 12:18 AM
|
#8 |
|
Registered User
Join Date: Aug 2016
Posts: 387
|
Use a text editor to create the robots.txt file and add REP directives to block content from being visited by the bots. The text file should be saved in ASCII or UTF-8 encoding. Create a list of Disallow directives listing the content you want blocked.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| How to find dofollow website to create backlink | James12smith | Search Engine Optimization | 6 | 04-05-2017 02:18 AM |
| What is a robots.txt file? | orientation | Search Engine Optimization | 8 | 05-26-2016 11:14 PM |
| How to Create the Dynamic Static Website? | jamesranatte | Search Engine Optimization | 0 | 06-25-2012 04:02 PM |
All times are GMT -7. The time now is 03:58 AM.