View Single Post
Old 03-20-2017, 12:18 AM   #13
AshokDixit89
Registered User
 
Join Date: Jan 2016
Location: Mumbai, India
Posts: 1,064
Tips to create robot .txt file
Create the file in the high-level directory to your web server.
Robot looks for the " example.com/robot.txt" file
robots.txt to exclude all robots from the entire server, add next
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
AshokDixit89 is offline   Reply With Quote