GridFTP-APT: Automatic Parallelism Tuning Mechanism for GridFTP in Long-Fat Networks

Takeshi ITO  Hiroyuki OHSAKI  Makoto IMASE  

IEICE TRANSACTIONS on Communications   Vol.E91-B   No.12   pp.3925-3936
Publication Date: 2008/12/01
Online ISSN: 1745-1345
DOI: 10.1093/ietcom/e91-b.12.3925
Print ISSN: 0916-8516
Type of Manuscript: PAPER
Category: Network
automatic parallelism tuning,  Golden Section Search method,  Grid computing,  GridFTP,  GridFTP-APT,  parallel TCP connections,  parameter tuning,  

Full Text: PDF>>
Buy this Article

In this paper, we propose an extension to GridFTP that optimizes its performance by dynamically adjusting the number of parallel TCP connections. GridFTP has been used as a data transfer protocol to effectively transfer a large volume of data in Grid computing. GridFTP supports a feature called parallel data transfer that improves throughput by establishing multiple TCP connections in parallel. However, for achieving high GridFTP throughput, the number of TCP connections should be optimized based on the network status. In this paper, we propose an automatic parallelism tuning mechanism called GridFTP-APT (GridFTP with Automatic Parallelism Tuning) that adjusts the number of parallel TCP connections according to information available to the Grid middleware. Through simulations, we demonstrate that GridFTP-APT significantly improves the performance of GridFTP in various network environments.