Design and Implementation of a Metadata Management Scheme for Large Distributed File Systems

Jong Hyeon YUN  Yong Hun PARK  Dong Min SEO  Seok Jae LEE  Jae Soo YOO  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E92-D   No.7   pp.1475-1478
Publication Date: 2009/07/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.E92.D.1475
Print ISSN: 0916-8532
Type of Manuscript: LETTER
Category: Dependable Computing
Keyword: 
distributed file system (DFS),  metadata server (MDS),  

Full Text: PDF(479.2KB)
>>Buy this Article


Summary: 
Most large-scale distributed file systems decouple a metadata operation from read and write operations for a file. In the distributed file systems, a certain server named a metadata server (MDS) is responsible for maintaining the metadata information of the file systems. In this paper, we propose a new metadata management scheme in order to provide the high metadata throughput and scalability for a cluster of MDSs. First, we derive a new metadata distribution technique. Then, we present a load balancing technique based on the distribution technique. Several experiments show that our scheme outperforms existing metadata management scheme in terms of scalability and load balancing.