View Single Post
Old 01-24-2019, 05:20 AM   #5
wiliamjamesh
Registered User
 
Join Date: Sep 2016
Posts: 617
The asterisk after “user-agent” means that the robots.txt file applies to all web robots that visit the site. The slash after “Disallow” tells the robot to not visit any pages on the site.After all, one of the major goals of SEO is to get search engines to crawl your site easily so they increase your ranking.
__________________

To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
|
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.
wiliamjamesh is offline   Reply With Quote