crawling error?
 

my site is still not crawled? why? when i was developing my eCommerce magento site at that time i uploaded robot.txt in public_html to stop my site to crawl.. but now my site development is completed and i deleted those robot.txt file from public_html and add site in webmaster tool as well submit site map.. but it's not crawling my site... sitemap showing error in indexing... it's showing you submitted robot.txt but as i said that i deleted robot.txt file in public_html.. so please guide me... I feel nervous... what should i do?

There’s many reasons you may suffer from 404 page not found crawl errors however the most important thing is you fix them.

If you have too many 404 errors your site visitors will suffer a poor experience and the search engines may penalize you as well.

There’s many ways to check for broken links, some of which i have written about previously.

Rather than create a temporary fix, its better to fix them permanently and Google Webmaster Tools provides one of the best solutions.

You’ll need to have created an account with Google Webmaster Tools before we can proceed.