![]() |
A robots. txt file tells search engine crawlers which URLs the crawler can access on your site. This is used mainly to avoid overloading your site with requests; it is not a mechanism for keeping a web page out of Google.
|
All times are GMT -7. The time now is 10:15 PM. |
Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.