sitemap.xml and robots.txt? - Site Owners Forums

jamesranatte · 01-31-2012, 03:54 AM

Hello friends, I need to know what is the difference between sitemap.xml and robots.txt?

cipl123 · 01-31-2012, 05:25 AM

As per my knowledge XML sitemap is a type of sitemap which is helpful for search engine spiders to crawl your website properly and robots.txt is a simple text file which you have to put into your root directory which allows the search engine spiders to crawl your website.

seoowner · 01-31-2012, 06:58 AM

Sitemap.xml is useful for search engine crawler. Google sitemaps is a tool made available from Google in 2005. It enables a webmaster to submit an index of web pages to Google using an XML data exchange standard through posting the sitemap on its server. Benefits include the ability to identify which pages have not been indexed and why. The tool also indicates pages that change regularly and reports on popularity of searches.

Robots.txt file is used for telling search engines not to crawl particular pages of the website.

jamesarnold80 · 01-31-2012, 09:09 PM

Using sitempa xml file, you can allow google to crawl your website. Using robots.txt, you tell google to not to crawl that page.

mikest · 01-31-2012, 11:00 PM

Sitemap.XML file is used for creating XML Based sitemap which is dynamic sitemap, whenever you added pages in your site, XML sitemap automatically update these pages and ping the search engine for indexing these pages!

Robot.txt is file which is present at your web server to allow Bot/Crawler whether to indexed the site/pages or not! You can also restrict your pages from indexing through robot,txt file!

shaunmark8 · 01-31-2012, 11:16 PM

Hello friends..

Sitemap.XML : It is helpful for search engine spiders to crawl your website properly.
robots.txt : it's just a "list of pages of" a website.

01-31-2012, 03:54 AM	#1
jamesranatte Registered User Join Date: Nov 2011 Location: India Posts: 277	sitemap.xml and robots.txt? Hello friends, I need to know what is the difference between sitemap.xml and robots.txt? __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* \| *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.* \| *To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.*

01-31-2012, 09:09 PM	#4
jamesarnold80 Registered User Join Date: Jan 2012 Posts: 67	Using sitempa xml file, you can allow google to crawl your website. Using robots.txt, you tell google to not to crawl that page. __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

01-31-2012, 11:00 PM	#5
mikest Registered User Join Date: Jan 2011 Posts: 146	Sitemap.XML file is used for creating XML Based sitemap which is dynamic sitemap, whenever you added pages in your site, XML sitemap automatically update these pages and ping the search engine for indexing these pages! Robot.txt is file which is present at your web server to allow Bot/Crawler whether to indexed the site/pages or not! You can also restrict your pages from indexing through robot,txt file! __________________ To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. \| To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts.

01-31-2012, 05:25 AM	#2
cipl123 Registered User Join Date: Apr 2011 Posts: 97	As per my knowledge XML sitemap is a type of sitemap which is helpful for search engine spiders to crawl your website properly and robots.txt is a simple text file which you have to put into your root directory which allows the search engine spiders to crawl your website.

01-31-2012, 06:58 AM	#3
seoowner Registered User Join Date: Apr 2011 Posts: 199	Sitemap.xml is useful for search engine crawler. Google sitemaps is a tool made available from Google in 2005. It enables a webmaster to submit an index of web pages to Google using an XML data exchange standard through posting the sitemap on its server. Benefits include the ability to identify which pages have not been indexed and why. The tool also indicates pages that change regularly and reports on popularity of searches. Robots.txt file is used for telling search engines not to crawl particular pages of the website.

01-31-2012, 11:16 PM	#6
shaunmark8 Registered User Join Date: Jan 2012 Posts: 239	Hello friends.. Sitemap.XML : It is helpful for search engine spiders to crawl your website properly. robots.txt : it's just a "list of pages of" a website.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)