07-17-2018, 06:07 AM
|
#9 |
|
Registered User
Join Date: May 2018
Posts: 11
|
Yes, there is a farthest point to robots.txt document as far as filesize 500 KB as Vipin calls attention to. A most extreme document size might be authorized per crawler. Content which is after the most extreme record size might be overlooked. Google as of now implements a size breaking point of 500kb.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
|
|
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Threaded Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| What is the limit of a robot.txt file? | artijain1900 | Search Engine Optimization | 11 | 05-17-2022 12:48 AM |
| What is the limit of a robot.txt file? | ruhikhan | Search Engine Optimization | 7 | 01-22-2018 04:28 AM |
All times are GMT -7. The time now is 11:06 PM.