10-14-2014, 12:19 AM
|
#16 |
|
Registered User
Join Date: Oct 2014
Posts: 33
|
Robots.txt file tell Search Engine's bot to which page need to crawl or not?
|
|
|
|
10-14-2014, 01:13 AM
|
#17 |
|
Registered User
Join Date: Aug 2014
Location: Surat
Posts: 847
|
Robot.txt is a text file which you put in your website to tell search engine which pages you would like not to crawl.
__________________
I am SEO expert and handling SEO for following words led tube light India, Send cakes Surat, Send Flowers cakes Surat, Led Tube Light Suratsend flowers to surat Buy cakes in Surat Buy flowers in surat Send ONLINE CAKES FLOWERS SURAT |
|
|
|
|
10-15-2014, 04:11 AM
|
#18 |
|
Registered User
Join Date: Aug 2014
Posts: 68
|
Robots.txt is a file used to block for robots to crawl that page.
|
|
|
|
 |
«
Previous Thread
|
Next Thread
»
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Linear Mode
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Crawlers, spider & robots.txt? | jackthomas087 | Search Engine Optimization | 0 | 04-22-2014 03:29 AM |
| Evil bots consuming all my sites traffic even after i disallowed them in robots.txt | Fking | General Discussion | 1 | 12-13-2013 11:27 PM |
| How to edit virtual robots.txt file in wordpress? | geniusoptimizer | PHP / mySQL | 1 | 04-12-2013 12:36 PM |
| The robots.txt file | rubberfender | Yahoo | 0 | 12-02-2012 07:32 PM |
| Unable to delete robots.txt file | notfake | Yahoo | 0 | 04-29-2012 02:19 AM |
All times are GMT -7. The time now is 10:09 AM.