Go Back   Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization

Notices


 
 
Thread Tools Rate Thread Display Modes
Prev Previous Post   Next Post Next
Old 11-27-2012, 02:58 AM   #5
sunitisood16
Registered User
 
Join Date: Nov 2012
Posts: 76
Robots.txt files inform search engine spiders how to interact with indexing your content. If you do not have a robots.txt file, your server logs will return 404 errors whenever a bot tries to access your robots.txt file.
sunitisood16 is offline   Reply With Quote
 


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Evil bots consuming all my sites traffic even after i disallowed them in robots.txt Fking General Discussion 1 12-13-2013 11:27 PM
Robots.txt sameerseo Search Engine Optimization 26 09-28-2012 04:18 AM
robots.txt wheelbarrow001 Google 2 07-27-2012 04:10 AM
Unable to delete robots.txt file notfake Yahoo 0 04-29-2012 02:19 AM
What Is Robots.txt? samlko Search Engine Optimization 13 03-09-2012 02:37 PM


All times are GMT -7. The time now is 02:29 PM.


Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.