Boundedness of Input Space and Effective Dimension of Feature Space in Kernel Methods

Kazushi IKEDA  

IEICE TRANSACTIONS on Information and Systems   Vol.E87-D   No.1   pp.258-260
Publication Date: 2004/01/01
Online ISSN: 
Print ISSN: 0916-8532
Type of Manuscript: LETTER
Category: Biocybernetics, Neurocomputing
learning theory,  support vector machine,  effective dimension,  

Full Text: PDF(121KB)>>
Buy this Article

Kernel methods such as the support vector machines map input vectors into a high-dimensional feature space and linearly separate them there. The dimensionality of the feature space depends on a kernel function and is sometimes of an infinite dimension. The Gauss kernel is such an example. We discuss the effective dimension of the feature space with the Gauss kernel and show that it can be approximated to a sum of polynomial kernels and that its dimensionality is determined by the boundedness of the input space by considering the Taylor expansion of the kernel Gram matrix.