Site Owners Forums - Webmaster Forums

Site Owners Forums - Webmaster Forums (http://siteownersforums.com/index.php)

- Search Engine Optimization (http://siteownersforums.com/forumdisplay.php?f=16)

- - Robot.txt file size (http://siteownersforums.com/showthread.php?t=640962)

Shivam Tripathi

07-18-2018 02:05 AM

Robot.txt file size

Hello all,

Can anyone tell me what is size of the robot.txt file...????

jully45

07-18-2018 02:24 AM

Google currently enforces a size limit of 500 kilobytes

smith1

04-30-2019 04:19 AM

Robots.txt max size is 500KB. As stated on Google's Robots.txt Specifications page, “A maximum file size may be enforced per crawler.

RH-Calvin

04-30-2019 08:30 AM

A maximum file size may be enforced per crawler. Content which is after the maximum file size may be ignored. Google currently enforces a size limit of 500kb.

vinukum

05-01-2019 11:16 PM

there is a limit to robots.txt file in terms of filesize 500 KB as Vipin points out. A maximum file size may be enforced per crawler. Content which is after the maximum file size may be ignored. Google currently enforces a size limit of 500kb.

vashikaransutra

05-02-2019 10:17 PM

Thanks for your interest.

Zora2012

05-08-2019 05:08 AM

A highest file size may be enforced per crawler. Google currently enforces a size limit of 500kb.

sonamg

05-09-2019 12:08 AM

Recently, Google announced the robots.txt file size limit, should be in 500KB.

All times are GMT -7. The time now is 02:17 PM.