Depth Range Control in Visually Equivalent Light Field 3D

Munekazu DATE  Shinya SHIMIZU  Hideaki KIMATA  Dan MIKAMI  Yoshinori KUSACHI  

Publication
IEICE TRANSACTIONS on Electronics   Vol.E104-C   No.2   pp.52-58
Publication Date: 2021/02/01
Publicized: 2020/08/13
Online ISSN: 1745-1353
DOI: 10.1587/transele.2020DII0003
Type of Manuscript: INVITED PAPER (Special Section on Electronic Displays)
Category: Electronic Displays
Keyword: 
3D display,  light field,  linear blending,  depth range,  

Full Text: FreePDF


Summary: 
3D video contents depend on the shooting condition, which is camera positioning. Depth range control in the post-processing stage is not easy, but essential as the video from arbitrary camera positions must be generated. If light field information can be obtained, video from any viewpoint can be generated exactly and post-processing is possible. However, a light field has a huge amount of data, and capturing a light field is not easy. To compress data quantity, we proposed the visually equivalent light field (VELF), which uses the characteristics of human vision. Though a number of cameras are needed, VELF can be captured by a camera array. Since camera interpolation is made using linear blending, calculation is so simple that we can construct a ray distribution field of VELF by optical interpolation in the VELF3D display. It produces high image quality due to its high pixel usage efficiency. In this paper, we summarize the relationship between the characteristics of human vision, VELF and VELF3D display. We then propose a method to control the depth range for the observed image on the VELF3D display and discuss the effectiveness and limitations of displaying the processed image on the VELF3D display. Our method can be applied to other 3D displays. Since the calculation is just weighted averaging, it is suitable for real-time applications.