Quantitative Assessment of Facial Paralysis Based on Spatiotemporal Features

Truc Hung NGO  Yen-Wei CHEN  Naoki MATSUSHIRO  Masataka SEO  

IEICE TRANSACTIONS on Information and Systems   Vol.E99-D   No.1   pp.187-196
Publication Date: 2016/01/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2015EDP7082
Type of Manuscript: PAPER
Category: Pattern Recognition
facial paralysis,  objective quantitative assessment,  spatiotemporal feature,  tracking of landmarks,  

Full Text: PDF(2.3MB)>>
Buy this Article

Facial paralysis is a popular clinical condition occurring in 30 to 40 patients per 100,000 people per year. A quantitative tool to support medical diagnostics is necessary. This paper proposes a simple, visual and robust method that can objectively measure the degree of the facial paralysis by the use of spatiotemporal features. The main contribution of this paper is the proposal of an effective spatiotemporal feature extraction method based on a tracking of landmarks. Our method overcomes the drawbacks of the other techniques such as the influence of irrelevant regions, noise, illumination change and time-consuming process. In addition, the method is simple and visual. The simplification helps to reduce the time-consuming process. Also, the movements of landmarks, which relate to muscle movement ability, are visual. Therefore, the visualization helps reveal regions of serious facial paralysis. For recognition rate, experimental results show that our proposed method outperformed the other techniques tested on a dynamic facial expression image database.