Recent Advances and Trends in Large-Scale Kernel Methods

Hisashi KASHIMA  Tsuyoshi IDE  Tsuyoshi KATO  Masashi SUGIYAMA 

Publication
IEICE TRANSACTIONS on Information and Systems  Vol.E92-D  No.7  pp.1338-1353
Publication Date: 2009/07/01
Online ISSN: 1745-1361
Print ISSN: 0916-8532
Type of Manuscript: Special Section PAPER (Special Section on Large Scale Algorithms for Learning and Optimization)
Category: INVITED
Keyword: 
kernel methodssupport vector machineskernel tricklow-rank approximationoptimizationstructured data

Full Text: PDF(306.4KB)


Summary: 
Kernel methods such as the support vector machine are one of the most successful algorithms in modern machine learning. Their advantage is that linear algorithms are extended to non-linear scenarios in a straightforward way by the use of the kernel trick. However, naive use of kernel methods is computationally expensive since the computational complexity typically scales cubically with respect to the number of training samples. In this article, we review recent advances in the kernel methods, with emphasis on scalability for massive problems.