Check the website robots file - Site Owners Forums

china-jewels · 11-26-2012, 12:43 AM

Check the website robots file. Robots file can stop spider grab website unnecessary content, in order to reduce the spider web site to the difficulty of grasping, reasonable use of robots files can better make a web site was collected, but if meet not use robots of webmaster, may be the wrong writing files, leading to the spider can't normal on the web to grab, grab a long time less than content, spiders will think this website is cheating website, and give your site punishment. Especially beginners webmaster, in the use of robots files, don't know file was spelled correctly, can use baidu webmaster robots tool, this tool can help adsense generation robots files, Google keyword analysis tool can also detection robots document writing is correct. Because the robots document writing mistake that punishment of webmaster, need to use tools found robots mistakes, lest cause greater influence.

rummy26 · 12-13-2012, 04:15 AM

Will you please share the steps how to check the robot.txt file of any site online.

Trademark · 10-07-2015, 12:57 AM

Thanks for sharing this useful information.

jonnyt240 · 10-10-2015, 10:23 AM

I have a website that can help you, you can go to woorank.com and enter your website to check it

etechstack · 10-11-2015, 08:14 AM

any single change in robots.txt may affect your website traffic.
be careful while making change in robots.txt file

Ashish Chaudhary

11-26-2012, 12:43 AM	#1
china-jewels Registered User Join Date: Oct 2012 Posts: 21	Check the website robots file Check the website robots file. Robots file can stop spider grab website unnecessary content, in order to reduce the spider web site to the difficulty of grasping, reasonable use of robots files can better make a web site was collected, but if meet not use robots of webmaster, may be the wrong writing files, leading to the spider can't normal on the web to grab, grab a long time less than content, spiders will think this website is cheating website, and give your site punishment. Especially beginners webmaster, in the use of robots files, don't know file was spelled correctly, can use baidu webmaster robots tool, this tool can help adsense generation robots files, Google keyword analysis tool can also detection robots document writing is correct. Because the robots document writing mistake that punishment of webmaster, need to use tools found robots mistakes, lest cause greater influence. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

12-13-2012, 04:15 AM	#2
rummy26 Registered User Join Date: Nov 2010 Location: us Posts: 584	Will you please share the steps how to check the robot.txt file of any site online. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

10-10-2015, 10:23 AM	#4
jonnyt240 Registered User Join Date: Sep 2015 Posts: 11	I have a website that can help you, you can go to woorank.com and enter your website to check it __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
How can I check my website in old browsers?	ncjbhd	HTML / DHTML	3	05-22-2014 05:08 PM
Regularly check the website information	neoprenesbr	Social Networks	8	02-13-2013 03:17 AM
How to check backlinks of your website?	aaron35	Search Engine Optimization	20	12-27-2012 02:26 AM
check your website is in sand box?	kant210	Google	2	11-06-2012 01:06 AM
500kb limit for Google robots file	Heidyplum7	Search Engine Optimization	0	03-15-2012 08:49 AM

10-07-2015, 12:57 AM	#3
Trademark Registered User Join Date: Sep 2015 Location: 6806 Eastern Ave Baltimore MD 21224 Posts: 3	Thanks for sharing this useful information.

10-11-2015, 08:14 AM	#5
etechstack Registered User Join Date: Oct 2015 Posts: 40	any single change in robots.txt may affect your website traffic. be careful while making change in robots.txt file Ashish Chaudhary

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)