|
First you can use any webmaster tool on the internet to create it. Website owner uses the robot.txt file to give instruction about their to site to web robots.
All you need to create the file in the high-level directory to your web server.
Robot looks for the " example.com/robot.txt" file
robots.txt to exclude all robots from the entire server, add next.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|