Go Back   Site Owners Forums - Webmaster Forums > Search Engine Optimization > Search Engine Optimization

Notices


 
 
Thread Tools Rate Thread Display Modes
Prev Previous Post   Next Post Next
Old 11-14-2015, 10:21 PM   #10
onehalf.transpo
Registered User
 
Join Date: Aug 2015
Location: Junction Business House, Level 2, Suite 203, Melbourne VIC 3182
Posts: 504
Crawling means sucking content without processing the results. Crawlers are rather dumb processes that fetch content supplied by Web servers answering (HTTP) requests of requested URIs, delivering those contents to other processes, e.g. crawling caches or directly to indexers. Crawlers get their URIs from a crawling engine that’s feeded from different sources, including links extracted from previously crawled Web documents, URI submissions, foreign Web indexes, and whatnot.

Indexing means making sense out of the retrieved contents, storing the processing results in a (more or less complex) document index. Link analysis is a way to measure URI importance, popularity, trustworthiness and so on. Link analysis is often just a helper within the indexing process, sometimes the end in itself, but traditionally a task of the indexer, not the crawler (high sophisticated crawling engines do use link data to steer their crawlers, but that has nothing to do with link analysis in document indexes).
onehalf.transpo is offline   Reply With Quote
 


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Google Crawling and Indexation 101 sinicline Search Engine Optimization 20 02-05-2016 07:47 PM
Disallowing crawling of js and css results in lower rankings Ruby707 Search Engine Optimization 0 01-24-2015 03:45 AM
Difference between indexing and Crawling patel_rosh Search Engine Optimization 0 01-11-2015 10:54 PM
Indexing and Crawling. binarynpixel Search Engine Optimization 7 09-13-2014 04:11 AM
What is the difference between Indexing and Crawling? revasharma557 Traffic Corner 13 06-10-2014 10:00 PM


All times are GMT -7. The time now is 02:31 PM.


Powered by vBulletin Copyright © 2020 vBulletin Solutions, Inc.