A Dynamic-Clustering Backup Scheme for High-Availability Distributed File Sharing Systems

Hoai Son NGUYEN   Dinh Nghia NGUYEN  Shinji SUGAWARA  

IEICE TRANSACTIONS on Communications   Vol.E102-B    No.3    pp.545-556
Publication Date: 2019/03/01
Publicized: 2018/09/10
Online ISSN: 1745-1345
DOI: 10.1587/transcom.2018EBP3108
Type of Manuscript: PAPER
Category: Network
peer-to-peer (P2P),  distributed hash table (DHT),  file backup,  load balancing,  

Full Text: PDF(2.3MB)>>
Buy this Article

DHT routing algorithms can provide efficient mechanisms for resource placement and lookup for distributed file sharing systems. However, we must still deal with irregular and frequent join/leave of nodes and the problem of load unbalancing between nodes in DHT-based file sharing systems. This paper presents an efficient file backup scheme based on dynamic DHT key space clustering in order to guarantee data availability and support load balancing. The main idea of our method is to dynamically divide the DHT network into a number of clusters, each of which locally stores and maintains data chunks of data files to guarantee the data availability of user data files even when node churn occurs. Further, high-capacity nodes in clusters are selected as backup nodes to achieve adequate load balancing. Simulation results demonstrate the superior effectiveness of the proposed scheme over other file replication schemes.