|
Robot.txt files are used to give information to the spiders to visit the website for crawling and indexing.We can use Disallow option which will tell the robot not to visit the website.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|