Class Prior Estimation from Positive and Unlabeled Data

Marthinus Christoffel DU PLESSIS  Masashi SUGIYAMA  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E97-D   No.5   pp.1358-1362
Publication Date: 2014/05/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.E97.D.1358
Type of Manuscript: LETTER
Category: Artificial Intelligence, Data Mining
Keyword: 
class-prior change,  outlier detection,  positive and unlabeled learning,  divergence estimation,  pearson divergence,  

Full Text: PDF>>
Buy this Article




Summary: 
We consider the problem of learning a classifier using only positive and unlabeled samples. In this setting, it is known that a classifier can be successfully learned if the class prior is available. However, in practice, the class prior is unknown and thus must be estimated from data. In this paper, we propose a new method to estimate the class prior by partially matching the class-conditional density of the positive class to the input density. By performing this partial matching in terms of the Pearson divergence, which we estimate directly without density estimation via lower-bound maximization, we can obtain an analytical estimator of the class prior. We further show that an existing class prior estimation method can also be interpreted as performing partial matching under the Pearson divergence, but in an indirect manner. The superiority of our direct class prior estimation method is illustrated on several benchmark datasets.