Thread: robot.txt
View Single Post
Old 05-02-2018, 03:37 AM   #5
multai
Registered User
 
Join Date: Apr 2018
Posts: 59
It is the text file it gives the instructions to the robots about how to crawl the web page...

http://www.multaisolutions.com/ecommerce.html
multai is offline   Reply With Quote