
For FullText PDF, please login, if you are a member of IEICE,
or go to Pay Per View on menu list, if you are a nonmember of IEICE.

Improving Generalization Ability through Active Learning
Sethu VIJAYAKUMAR Hidemitsu OGAWA
Publication
IEICE TRANSACTIONS on Information and Systems
Vol.E82D
No.2
pp.480487 Publication Date: 1999/02/25 Online ISSN:
DOI: Print ISSN: 09168532 Type of Manuscript: PAPER Category: BioCybernetics and Neurocomputing Keyword: active learning, wiener optimization criterion, generalization, inverse problem, training data selection,
Full Text: PDF(294.1KB)>>
Summary:
In this paper, we discuss the problem of active training data selection for improving the generalization capability of a neural network. We look at the learning problem from a function approximation perspective and formalize it as an inverse problem. Based on this framework, we analytically derive a method of choosing a training data set optimized with respect to the Wiener optimization criterion. The final result uses the apriori correlation information on the original function ensemble to devise an efficient sampling scheme which, when used in conjunction with the learning scheme described here, is shown to result in optimal generalization. This result is substantiated through a simulated example and a learning problem in high dimensional function space.

