Site Owners Forums - Webmaster Forums - Don�t exceed maximum file size for robots.txt file

Site Owners Forums - Webmaster Forums (http://siteownersforums.com/index.php)

- Search Engine Optimization (http://siteownersforums.com/forumdisplay.php?f=16)

- - Don�t exceed maximum file size for robots.txt file (http://siteownersforums.com/showthread.php?t=55893)

ClaudiaSchayffe

03-26-2012 07:11 AM

Don�t exceed maximum file size for robots.txt file

Everyone knows that you shouldn�t exceed the 500kb because the Googlebots will not read anything over that limit, but what strategies can you take to mitigate this? Make the files smaller or make multiples?

mark.harmon345

03-29-2012 04:05 AM

Nice info.......... Thanking you

funeral

03-29-2012 05:30 AM

Well thanks for the tips

shaunmark8

04-02-2012 04:28 AM

It's really nice information ......... thanks dude

All times are GMT -7. The time now is 08:31 PM.