Robot.txt file size - Site Owners Forums

Shivam Tripathi · 07-18-2018, 02:05 AM

Hello all,

Can anyone tell me what is size of the robot.txt file...????

jully45 · 07-18-2018, 02:24 AM

Google currently enforces a size limit of 500 kilobytes

smith1 · 04-30-2019, 04:19 AM

Robots.txt max size is 500KB. As stated on Google's Robots.txt Specifications page, “A maximum file size may be enforced per crawler.

RH-Calvin · 04-30-2019, 08:30 AM

A maximum file size may be enforced per crawler. Content which is after the maximum file size may be ignored. Google currently enforces a size limit of 500kb.

vinukum · 05-01-2019, 11:16 PM

there is a limit to robots.txt file in terms of filesize 500 KB as Vipin points out. A maximum file size may be enforced per crawler. Content which is after the maximum file size may be ignored. Google currently enforces a size limit of 500kb.

vashikaransutra · 05-02-2019, 10:17 PM

Thanks for your interest.

Zora2012 · 05-08-2019, 05:08 AM

A highest file size may be enforced per crawler. Google currently enforces a size limit of 500kb.

sonamg · 05-09-2019, 12:08 AM

Recently, Google announced the robots.txt file size limit, should be in 500KB.

07-18-2018, 02:05 AM	#1
Shivam Tripathi Registered User Join Date: Feb 2018 Location: Pune Posts: 64	Robot.txt file size Hello all, Can anyone tell me what is size of the robot.txt file...???? __________________ Modular Office Furniture in India \|Modular Office Furniture Mumbai\|Loose Furniture

07-18-2018, 02:24 AM	#2
jully45 Registered User Join Date: Jun 2018 Location: India Posts: 34	Google currently enforces a size limit of 500 kilobytes __________________ http://www.cotton-bazaar.com/cotton-salwar-suit.html

04-30-2019, 04:19 AM	#3
smith1 Registered User Join Date: Feb 2018 Posts: 462	Robots.txt max size is 500KB. As stated on Google's Robots.txt Specifications page, “A maximum file size may be enforced per crawler. __________________ Cloud Managed Services Cloud Infrastructure Services App Modernization Enterprise Operations Data Analytics cloud migration Cloud Transformation

04-30-2019, 08:30 AM	#4
RH-Calvin Registered User Join Date: May 2015 Location: Forum Posts: 2,517	A maximum file size may be enforced per crawler. Content which is after the maximum file size may be ignored. Google currently enforces a size limit of 500kb. __________________ █ Cheap VPS \| $1 VPS Hosting █ Cheap Windows VPS \| Windows Server with Remote Desktop Access █ Cheap Dedicated Server \| Servers with Free IPMI Setup

05-01-2019, 11:16 PM	#5
vinukum Registered User Join Date: Feb 2018 Location: Bangalore Posts: 283	there is a limit to robots.txt file in terms of filesize 500 KB as Vipin points out. A maximum file size may be enforced per crawler. Content which is after the maximum file size may be ignored. Google currently enforces a size limit of 500kb. __________________ Andhra style Restaurants in Bangalore \| Order Andhra Food Online in Bangalore \| Home Delivery Restaurants Bangalore \| Order Andhra Biryani Online

05-02-2019, 10:17 PM	#6
vashikaransutra Registered User Join Date: Aug 2015 Posts: 279	Thanks for your interest. __________________ Love Problem Solution Baba\|Get Love Back By Vashikaran\|Mohini Vashikaran Mantra\|Love Guru In India\| FAMOUS PANDIT

05-08-2019, 05:08 AM	#7
Zora2012 Registered User Join Date: Nov 2012 Location: India Posts: 276	A highest file size may be enforced per crawler. Google currently enforces a size limit of 500kb. __________________ Shopping Cart Development - Shopping Cart- PrestaShop, Zencart; CMS - WordPress, Joomla; Custom Development Link Popularity Building - SEO, Pay Per Click (PPC), SEM, Link Popularity Building, SEO Copywriting, SMO, SMM

05-09-2019, 12:08 AM	#8
sonamg Registered User Join Date: Jun 2018 Location: India Posts: 59	Recently, Google announced the robots.txt file size limit, should be in 500KB. __________________ mobile app developers in Delhi \| best android application development company Chennai \| iPhone app development companies in Mumbai

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Why We Use robot.txt file In Seo..?	ankitasharma123	Search Engine Optimization	7	04-20-2017 12:59 PM
What is the Size of Disavow link file?	softqubetechno	Search Engine Optimization	2	03-21-2014 05:07 AM