Keyword : distributed Web crawling


Exploring Web Partition in DHT-Based Distributed Web Crawling
Xiao XU Weizhe ZHANG Hongli ZHANG Binxing FANG 
Publication:   IEICE TRANSACTIONS on Information and Systems
Publication Date: 2010/11/01
Vol. E93-D  No. 11 ; pp. 2907-2921
Type of Manuscript:  Special Section PAPER (Special Section on Architectures, Protocols, and Applications for the Future Internet)
Category: 
Keyword: 
DHTdistributed Web crawlingWeb partitioncontent addressable networkcommunication overhead
 Summary | Full Text:PDF(4.4MB)

Efficient Distributed Web Crawling Utilizing Internet Resources
Xiao XU Weizhe ZHANG Hongli ZHANG Binxing FANG 
Publication:   IEICE TRANSACTIONS on Information and Systems
Publication Date: 2010/10/01
Vol. E93-D  No. 10 ; pp. 2747-2762
Type of Manuscript:  PAPER
Category: Data Engineering, Web Information Systems
Keyword: 
Internet computingdistributed Web crawlingDHTnetwork coordinate systemload balancing
 Summary | Full Text:PDF(2.2MB)