How to add robots.txt?
 

Hello all, how to add robots.txt to my website http://www.enerco.co.uk
Is it necessary to add robots.txt in my website?
Please suggest me, thanks

robots.txt file instructs spiders about blocked folders of website

Robots.txt file contains set of instruction, which tells google what to crawl on that particular site.

sample code

User Agent: *
Allow: /

The above code give permission to robots to crawl the entire website.
write this code in a notepad and save it as robots.txt and upload it in your server.

robots.txt is very important in seo to give instructions about the website for the Google.

Code:
User-agent: *
Disallow: /

i think should update go host @@

Hi, I'm also looking for this information so thanks for sharing it.

robots.txt is very important in seo to give instructions about the website for the Google.

Save the robots.txt code as a text file. Place the file in the highest-level directory of your site or the root of your domain.

You can add code to world with file robots.txt:
and you can sign in webmastertool add code: