|
Notices |
|
Thread Tools | Rate Thread | Display Modes |
![]() |
#6 |
Registered User
Join Date: Jul 2016
Posts: 57
|
Difference between robot txt and spider are as follows
robot txt is use for the specification of the webpage spider is use to crawl the webpages.
__________________
To view links or images in signatures your post count must be 10 or greater. You currently have 0 posts. |
![]() |
![]() |
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Thread Tools | |
Display Modes | Rate This Thread |
|
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
How to build Spider pool for SEO to rank website | Edison Thomas | Search Engine Optimization | 4 | 05-04-2018 03:52 AM |
Crawlers, spider & robots.txt? | jackthomas087 | Search Engine Optimization | 0 | 04-22-2014 03:29 AM |
Evil bots consuming all my sites traffic even after i disallowed them in robots.txt | Fking | General Discussion | 1 | 12-13-2013 11:27 PM |
Difference between Spider and Crawlers ? | noahwilson | Search Engine Optimization | 3 | 06-17-2013 07:04 PM |
what is difference between spider, crawler and robots? | noahwilson | Search Engine Optimization | 0 | 05-30-2013 03:04 AM |