|
Robots.txt is a text file which has few lines and this file interacts with all kind of crawlers or spiders like Googlebot, which is Google search engine's spider.
Search Engine always want to index good and fresh contain on the web and these robot.txt instruct the web crawlers to how to index and crawl your blog in the search results.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|