Cross-Validation-Based Association Rule Prioritization Metric for Software Defect Characterization

Takashi WATANABE  Akito MONDEN  Zeynep YÜCEL  Yasutaka KAMEI  Shuji MORISAKI  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E101-D   No.9   pp.2269-2278
Publication Date: 2018/09/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2018EDP7020
Type of Manuscript: PAPER
Category: Software Engineering
Keyword: 
association rule mining,  defect prediction,  cross-validation,  data mining,  software quality,  

Full Text: PDF(1.4MB)
>>Buy this Article


Summary: 
Association rule mining discovers relationships among variables in a data set, representing them as rules. These are expected to often have predictive abilities, that is, to be able to predict future events, but commonly used rule interestingness measures, such as support and confidence, do not directly assess their predictive power. This paper proposes a cross-validation -based metric that quantifies the predictive power of such rules for characterizing software defects. The results of evaluation this metric experimentally using four open-source data sets (Mylyn, NetBeans, Apache Ant and jEdit) show that it can improve rule prioritization performance over conventional metrics (support, confidence and odds ratio) by 72.8% for Mylyn, 15.0% for NetBeans, 10.5% for Apache Ant and 0 for jEdit in terms of SumNormPre(100) precision criterion. This suggests that the proposed metric can provide better rule prioritization performance than conventional metrics and can at least provide similar performance even in the worst case.