Dynamic Spatial Augmented Reality by Using Real-Time Object Tracking with a Depth Sensor

Daisuke KOBAYASHI  Ryo KOIZUMI  Naoki HASHIMOTO  

Publication
D - Abstracts of IEICE TRANSACTIONS on Information and Systems (Japanese Edition)   Vol.J99-D   No.3   pp.264-272
Publication Date: 2016/03/01
Online ISSN: 1881-0225
DOI: 
Type of Manuscript: Special Section PAPER (Special Section on Student Research)
Category: 
Keyword: 
spatial augmented reality,  tracking,  3D point cloud,  particle filter,  

Full Text(in Japanese): FreePDF(2.7MB)


Summary: 
Recently, spatial augmented reality (SAR) has been used for attractive projection effects by editing appearance of real objects by using a projector. In general SAR approaches, position of target objects are previously measured, but in dynamic SAR, position of moving objects have to be measured iteratively in real-time. However, a position sensor and camera-based object tracking could not be performed properly because of sensor embedding, and influence of projected light. Therefore, in this paper, we propose a robust position and pose tracking method with a depth sensor and high-speed processing with reduction of point cloud data for dynamic SAR.