Local Riesz Pyramid for Faster Phase-Based Video Magnification

Shoichiro TAKEDA  Megumi ISOGAI  Shinya SHIMIZU  Hideaki KIMATA  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E103-D   No.10   pp.2036-2046
Publication Date: 2020/10/01
Publicized: 2020/06/22
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2020PCP0006
Type of Manuscript: Special Section PAPER (Special Section on Picture Coding and Image Media Processing)
Category: 
Keyword: 
video magnification,  Riesz pyramid,  phase,  video synthesis,  video analysis,  

Full Text: PDF>>
Buy this Article




Summary: 
Phase-based video magnification methods can magnify and reveal subtle motion changes invisible to the naked eye. In these methods, each image frame in a video is decomposed into an image pyramid, and subtle motion changes are then detected as local phase changes with arbitrary orientations at each pixel and each pyramid level. One problem with this process is a long computational time to calculate the local phase changes, which makes high-speed processing of video magnification difficult. Recently, a decomposition technique called the Riesz pyramid has been proposed that detects only local phase changes in the dominant orientation. This technique can remove the arbitrariness of orientations and lower the over-completeness, thus achieving high-speed processing. However, as the resolution of input video increases, a large amount of data must be processed, requiring a long computational time. In this paper, we focus on the correlation of local phase changes between adjacent pyramid levels and present a novel decomposition technique called the local Riesz pyramid that enables faster phase-based video magnification by automatically processing the minimum number of sufficient local image areas at several pyramid levels. Through this minimum pyramid processing, our proposed phase-based video magnification method using the local Riesz pyramid achieves good magnification results within a short computational time.