Automated Duplicate Bug Report Detection Using Multi-Factor Analysis

Jie ZOU  Ling XU  Mengning YANG  Xiaohong ZHANG  Jun ZENG  Sachio HIROKAWA  

IEICE TRANSACTIONS on Information and Systems   Vol.E99-D   No.7   pp.1762-1775
Publication Date: 2016/07/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2016EDP7052
Type of Manuscript: PAPER
Category: Software Engineering
duplicate bug reports detection,  topic model,  LDA,  N-gram,  LNG,  

Full Text: PDF(1.7MB)>>
Buy this Article

The bug reports expressed in natural language text usually suffer from vast, ambiguous and poorly written, which causes the challenge to the duplicate bug reports detection. Current automatic duplicate bug reports detection techniques have mainly focused on textual information and ignored some useful factors. To improve the detection accuracy, in this paper, we propose a new approach calls LNG (LDA and N-gram) model which takes advantages of the topic model LDA and word-based model N-gram. The LNG considers multiple factors, including textual information, semantic correlation, word order, contextual connections, and categorial information, that potentially affect the detection accuracy. Besides, the N-gram adopted in our LNG model is improved by modifying the similarity algorithm. The experiment is conducted under more than 230,000 real bug reports of the Eclipse project. In the evaluation, we propose a new evaluation metric, namely exact-accuracy (EA) rate, which can be used to enhance the understanding of the performance of duplicates detection. The evaluation results show that all the recall rate, precision rate, and EA rate of the proposed method are higher than treating them separately. Also, the recall rate is improved by 2.96%-10.53% compared to the state-of-art approach DBTM.