10-09-2018, 07:15 AM
A maximum file size may be enforced per crawler. Content which is after the maximum file size may be ignored. Google currently enforces a size limit of 500 kilobytes (KB)
|
What is the limit of a robot.txt file?
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
Users browsing this thread: 1 Guest(s)