View Single Post
Old 03-06-2018, 11:06 PM   #2
smmexpertss
Registered User
 
Join Date: Sep 2015
Location: UK
Posts: 447
It's a pretty common misconception that the robots.txt will prevent indexing. It's only purpose is actually to prevent crawling, anything disallowed in there is still up for indexing if it's linked to elsewhere. If you want something deindexed, your best bet is the robots meta tag, but make sure you allow crawling of the URLs to give search engine bots an opportunity to see the tag.
smmexpertss is offline   Reply With Quote