For Full-Text PDF, please login, if you are a member of IEICE,|
or go to Pay Per View on menu list, if you are a nonmember of IEICE.
Parallel Geospatial Raster Data I/O Using File View
Wei XIONG Ye WU Luo CHEN Ning JING
IEICE TRANSACTIONS on Information and Systems
Publication Date: 2015/12/01
Online ISSN: 1745-1361
Type of Manuscript: Special Section LETTER (Special Section on Parallel and Distributed Computing and Networking)
Category: Storage System
parallel I/O, geospatial raster, file view, MPI,
Full Text: PDF(4.2MB)
>>Buy this Article
The challenges of providing a divide-and-conquer strategy for tackling large geospatial raster data input/output (I/O) are longstanding. Solutions need to change with advances in the technology and hardware. After analyzing the reason for the problems of traditional parallel raster I/O mode, a parallel I/O strategy using file view is proposed to solve these problems. Message Passing Interface I/O (MPI-IO) is used to implement this strategy. Experimental results show how a file view approach can be effectively married to General Parallel File System (GPFS). A suitable file view setting provides an efficient solution to parallel geospatial raster data I/O.