Robots.txt is text file inserted into the website to contain instructions for search engine robots. The file lists webpages that are allowed and disallowed from search engine crawling. They help to control the search engine robots in your website.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|