03-06-2018, 11:06 PM
|
#2 |
|
Registered User
Join Date: Sep 2015
Location: UK
Posts: 447
 |
It's a pretty common misconception that the robots.txt will prevent indexing. It's only purpose is actually to prevent crawling, anything disallowed in there is still up for indexing if it's linked to elsewhere. If you want something deindexed, your best bet is the robots meta tag, but make sure you allow crawling of the URLs to give search engine bots an opportunity to see the tag.
|
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Thread Tools | |
| Display Modes | Rate This Thread |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Which is better Robots.txt or Meta Robots Tag | doorhardwareuk | Search Engine Optimization | 0 | 07-10-2017 11:17 PM |
| Which is better Robots.txt or Meta Robots Tag? | mithucarrentals | Search Engine Optimization | 0 | 01-30-2017 04:04 AM |
| Which is better Robots.txt or Meta Robots Tag? | apranajoshi | Search Engine Optimization | 8 | 08-30-2016 01:26 AM |
| Which is better Robots.txt or Meta Robots Tag? | riyakhan | Search Engine Optimization | 3 | 12-14-2015 01:01 AM |
All times are GMT -7. The time now is 03:41 AM.