The asterisk after “user-agent” means that the robots.txt file applies to all web robots that visit the site. The slash after “Disallow” tells the robot to not visit any pages on the site.After all, one of the major goals of SEO is to get search engines to crawl your site easily so they increase your ranking.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. | To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|