Register on the forum now to remove ALL ads + popups + get access to tons of hidden content for members only!

Go Back   Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization

Notices


Reply
 
Thread Tools Rate Thread Display Modes
Old 12-16-2016, 09:43 PM   #1
stuartspindlow9
Registered User
 
Join Date: Jan 2016
Location: Thailand
Posts: 35
What is Crawler?

Hello Friends,

Please tell me what is crawler.
stuartspindlow9 is offline   Reply With Quote

Old 12-16-2016, 09:56 PM   #2
Wiztech Team
Registered User
 
Join Date: Dec 2016
Posts: 59
A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a "spider" or a "bot." Crawlers are typically programmed to visit sites that have been submitted by their owners as new or updated. Entire sites or specific pages can be selectively visited and indexed. Crawlers apparently gained the name because they crawl through a site a page at a time, following the links to other pages on the site until all pages have been read.

Wiztech Team is offline   Reply With Quote
Old 12-16-2016, 10:33 PM   #3
saradeuz
Registered User
 
Join Date: Dec 2016
Posts: 43
crawler is google bot made to check all website content.
saradeuz is offline   Reply With Quote
Old 12-16-2016, 10:44 PM   #4
webguruweb
Registered User
 
Join Date: May 2016
Posts: 163
A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a "spider" or a "bot."
webguruweb is offline   Reply With Quote
Old 12-16-2016, 10:49 PM   #5
santosh261
Registered User
 
Join Date: Oct 2016
Posts: 143
A program that systematically browses the World Wide Web in order to create an index of data.
santosh261 is offline   Reply With Quote
Old 12-17-2016, 12:53 AM   #6
whitebolt
Registered User
 
Join Date: Sep 2016
Posts: 372
crawler is google bot made to check all website content.
__________________
carcover||carcovers
whitebolt is offline   Reply With Quote
Old 12-17-2016, 01:59 AM   #7
sarveshsinghcns
Registered User
 
Join Date: Jul 2016
Location: mumbai
Posts: 71
A search engine crawler is a program or automated script that browses the World Wide Web in a methodical manner in order to provide up to date data to the particular search engine. While search engine crawlers go by many different names, such as web spiders and automatic indexers, the job of the search engine crawler is still the same.
sarveshsinghcns is offline   Reply With Quote
Old 12-17-2016, 02:07 AM   #8
henrybolt
Registered User
 
Join Date: Oct 2016
Posts: 330
A search engine crawler is a program or automated script that browses the World Wide Web in a methodical manner in order to provide up to date data to the particular search engine
__________________
car cover||
car covers
henrybolt is offline   Reply With Quote
Old 12-17-2016, 02:24 AM   #9
webdeveloper220
Registered User
 
Join Date: Feb 2016
Location: Delhi
Posts: 696
It is a google's programme to scan every website.
__________________
Web designing company in Delhi
webdeveloper220 is offline   Reply With Quote
Old 12-17-2016, 10:53 PM   #10
wesbrian467
Registered User
 
Join Date: Dec 2016
Location: USA
Posts: 10
It is automatic written code which scans every site on the web to list them on the search results. It takes consideration of many factor while scanning.
__________________
Wes Brian
Founder of MyBestReviewss
wesbrian467 is offline   Reply With Quote
Old 12-17-2016, 11:17 PM   #11
Ben Hartz
Registered User
 
Join Date: Jul 2016
Location: USA
Posts: 76
It's a google bot automatically scans the www
Ben Hartz is offline   Reply With Quote
Old 12-18-2016, 10:46 PM   #12
jyoti9sharma
Registered User
 
Join Date: Oct 2016
Posts: 61
It is automatic written code which scans every site on the web to list them on the search results. It takes consideration of many factor while scanning.
jyoti9sharma is offline   Reply With Quote
Old 12-19-2016, 10:51 PM   #13
jackparrow
Registered User
 
Join Date: Oct 2016
Posts: 150
A Web crawler is an Internet bot which systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering). Web search engines and some other sites use Web crawling or spidering software to update their web content or indices of others sites' web content...
jackparrow is offline   Reply With Quote
Old 12-20-2016, 01:00 AM   #14
janpaul7890
Registered User
 
Join Date: Jul 2016
Location: USA
Posts: 161
A web crawler spider robot is a program or automated script which browses the World Wide Web in a methodical, automated manner.
janpaul7890 is offline   Reply With Quote
Old 12-20-2016, 01:07 AM   #15
itabhyas
Registered User
 
Join Date: Nov 2016
Location: hyderabad
Posts: 165
A web crawler is a program that systematically browses the World Wide Web in order to create an index of data.
itabhyas is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
What is the crawler ? sonamsharma Search Engine Optimization 18 07-31-2015 02:46 AM
What is Crawler? eyebridge Search Engine Optimization 24 07-20-2014 06:01 AM
Can web crawler find unlinked pages of website? jamesranatte Review My Website 1 01-02-2014 10:55 PM
Crawler a role in SEO nachiketa Search Engine Optimization 11 12-30-2013 10:38 PM
Web Crawler rajivwebads Search Engine Optimization 12 02-23-2013 10:59 AM


All times are GMT -7. The time now is 10:17 PM.


Powered by vBulletin Copyright © 2013 vBulletin Solutions, Inc.