Parallel Geospatial Raster Data I/O Using File View

Wei XIONG  Ye WU  Luo CHEN  Ning JING  

IEICE TRANSACTIONS on Information and Systems   Vol.E98-D   No.12   pp.2192-2195
Publication Date: 2015/12/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2015PAL0001
Type of Manuscript: Special Section LETTER (Special Section on Parallel and Distributed Computing and Networking)
Category: Storage System
parallel I/O,  geospatial raster,  file view,  MPI,  

Full Text: PDF(4.2MB)
>>Buy this Article

The challenges of providing a divide-and-conquer strategy for tackling large geospatial raster data input/output (I/O) are longstanding. Solutions need to change with advances in the technology and hardware. After analyzing the reason for the problems of traditional parallel raster I/O mode, a parallel I/O strategy using file view is proposed to solve these problems. Message Passing Interface I/O (MPI-IO) is used to implement this strategy. Experimental results show how a file view approach can be effectively married to General Parallel File System (GPFS). A suitable file view setting provides an efficient solution to parallel geospatial raster data I/O.