Joint Patch Weighting and Moment Matching for Unsupervised Domain Adaptation in Micro-Expression Recognition

Jie ZHU
Yuan ZONG
Hongli CHANG
Li ZHAO
Chuangao TANG

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E105-D    No.2    pp.441-445
Publication Date: 2022/02/01
Publicized: 2021/11/17
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2021EDL8045
Type of Manuscript: LETTER
Category: Image Recognition, Computer Vision
Keyword: 
micro-expression recognition,  domain adaptation,  transfer learning,  patch weighting,  feature representation learning,  

Full Text: PDF>>
Buy this Article



Summary: 
Unsupervised domain adaptation (DA) is a challenging machine learning problem since the labeled training (source) and unlabeled testing (target) sets belong to different domains and then have different feature distributions, which has recently attracted wide attention in micro-expression recognition (MER). Although some well-performing unsupervised DA methods have been proposed, these methods cannot well solve the problem of unsupervised DA in MER, a. k. a., cross-domain MER. To deal with such a challenging problem, in this letter we propose a novel unsupervised DA method called Joint Patch weighting and Moment Matching (JPMM). JPMM bridges the source and target micro-expression feature sets by minimizing their probability distribution divergence with a multi-order moment matching operation. Meanwhile, it takes advantage of the contributive facial patches by the weight learning such that a domain-invariant feature representation involving micro-expression distinguishable information can be learned. Finally, we carry out extensive experiments to evaluate the proposed JPMM method is superior to recent state-of-the-art unsupervised DA methods in dealing with cross-domain MER.