An Improved Look-Up Table-Based FPGA Implementation of Image Warping for CMOS Image Sensors

Se-yong RO  Lin-bo LUO  Jong-wha CHONG  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E95-D   No.11   pp.2682-2692
Publication Date: 2012/11/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.E95.D.2682
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Image Processing and Video Processing
Keyword: 
Image warping,  look-up table,  perspective transformation,  panorama unrolling,  FPGA,  

Full Text: PDF>>
Buy this Article




Summary: 
Image warping is usually used to perform real-time geometric transformation of the images captured by the CMOS image sensor of video camera. Several existing look-up table (LUT)-based algorithms achieve real-time performance; however, the size of the LUT is still large, and it has to be stored in off-chip memory. To reduce latency and bandwidth due to the use of off-chip memory, this paper proposes an improved LUT (ILUT) scheme that compresses the LUT to the point that it can be stored in on-chip memory. First, a one-step transformation is adopted instead of using several on-line calculation stages. The memory size of the LUT is then reduced by utilizing the similarity of neighbor coordinates, as well as the symmetric characteristic of video camera images. Moreover, an elaborate pipeline hardware structure, cooperating with a novel 25-point interpolation algorithm, is proposed to accelerate the system and reduce further memory usage. The proposed system is implemented by a field-programmable gate array (FPGA)-based platform. Two different examples show that the proposed ILUT achieves real-time performance with small memory usage and low system requirements.