Concept Drift Detection for Evolving Stream Data

Jeonghoon LEE  Yoon-Joon LEE  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E94-D   No.11   pp.2288-2292
Publication Date: 2011/11/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.E94.D.2288
Print ISSN: 0916-8532
Type of Manuscript: LETTER
Category: Artificial Intelligence, Data Mining
Keyword: 
stream,  stream data,  concept drift,  change of the characteristics,  clustering,  

Full Text: PDF(325.4KB)
>>Buy this Article


Summary: 
In processing stream data, time is one of the most significant facts not only because the size of data is dramatically increased but because the characteristics of data is varying over time. To learn stream data evolving over time effectively, it is required to detect the drift of concept. We present a window adaptation function on domain value (WAV) to determine the size of windowed batch for learning algorithms of stream data and a method to detect the change of data characteristics with a criterion function utilizing correlation. When applying our adaptation function to a clustering task on a multi-stream data model, the result of learning synopsis of windowed batch determined by it shows its effectiveness. Our criterion function with correlation information of value distribution over time can be the reasonable threshold to detect the change between windowed batches.