Site Owners Forums - Webmaster Forums - View Single Post

jeffzeilenga · 03-13-2013, 04:05 AM

using Robots.txt is a file we can guide search engines to crawl or not to crawl certain sections of your website.

03-13-2013, 04:05 AM	#31
jeffzeilenga Registered User Join Date: Mar 2013 Posts: 58	using Robots.txt is a file we can guide search engines to crawl or not to crawl certain sections of your website.