Active Learning with Model Selection - Simultaneous Optimization of Sample Points and Models for Trigonometric Polynomial Models

IEICE Transactions on Information and Systems

Volumn E86-D, Issue 12, 2003, Pages 2753-2763

  Sugiyama, Masashi ^a   Ogawa, Hidemitsu ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Active learning; Generalization capability; Model selection; Supervised learning; Trigonometric polynomial space

Indexed keywords

COMPUTER SIMULATION; MATHEMATICAL MODELS; POLYNOMIALS; PROBLEM SOLVING; THEOREM PROVING;

ACTIVE LEARNING; GENERALIZATION CAPABILITY; MODEL SELECTION; SUPERVISED LEARNING; TRIGNOMETRIC POLYNOMIAL SPACE;

LEARNING SYSTEMS;

EID: 0842310437     PISSN: 09168532     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (22)

1. H. Akaike "A new look at the statistical model identification, " IEEE Trans. Autom. Control, vol.AC-19, no.6, pp.716-723, 1974.
2. A. Albert, Regression and the Moore-Penrose Pseudoinverse, Academic Press, New York and London, 1972.
3. N. Aronszajn, "Theory of reproducing kernels," Trans. American Math. Soc., vol.68, pp.337-404, 1950.
4. A.C. Atkinson and D.R. Cox, "Planning experiments for discriminating between models," J. Royal Statistical Society, Series B, vol.36, pp.321-348, 1974.
5. V. Cherkassky, X. Shao, X., F.M. Mulier, and V.N. Vapnik, "Model complexity control for regression using VC generalization bounds," IEEE Trans. Neural Netw., vol.10, no.5, pp. 1075-1089, 1999.
6. D.A. Cohn, "Neural network exploration using optimal experiment design," Neural Netw., vol.9, no.6, pp.1071-1083, 1996.
7. D.A. Cohn, Z. Ghahramani, and M.I. Jordan, "Active learning with statistical models," J. Artif. Intell. Res., vol.4, pp.129-145, 1996.
8. V.V. Fedorov, Theory of Optimal Experiments, Academic Press, New York, 1972.
9. K. Fukumizu, "Statistical active learning in multilayer perceptrons," IEEE Trans. Neural Netw., vol.11, no.1, pp.17-21, 2000.
10. K. Fukumizu and S. Watanabe, "Optimal training data and predictive error of polynomial approximation," IEICE Trans. Fundamentals (Japanese Edition), vol.J79-A, no.5, pp.1100-1108, May 1996.
11. D.J.C. MacKay, "Information-based objective functions for active data selection," Neural Comput., vol.4, no.4, pp.590-604, 1992.
12. P," Technometrics, vol.15, no.4, pp.661-675, 1973.
13. N. Murata, S. Yoshizawa, and S. Amari, "Network information criterion - Determining the number of hidden units for an artificial neural network model," IEEE Trans. Neural Netw., vol.5, no.6, pp.865-872, 1994.
14. H. Ogawa and T. Iijima, "A theory of pseudo orthogonal bases," IECE Trans. Inf. & Syst. (Japanese Edition), vol.58-D, no.5, pp.271-278, May 1975.
15. M.J.L. Orr, "Introduction to radial basis function networks," Technical Report, Center for Cognitive Science, University of Edinburgh, 1996.
16. J. Platt, "A resource-allocating network for function interpolation," Neural Comput., vol.3, no.2, pp.213-225, 1991.
17. R. Schatten, Norm Ideals of Completely Continuous Operators, Springer-Verlag. Berlin, 1970.
18. G. Schwarz, "Estimating the dimension of a model," Annals of Statistics, vol.6, pp.461-464, 1978.
19. [19] N. Sugiura "Further analysis of the data by Akaike's information criterion and the finite corrections," Commun. Stat. Theory and Methods, vol.7, no.1, pp.13-26, 1978.
20. M. Sugiyama and H. Ogawa, "Incremental active learning for optimal generalization," Neural Comput., vol.12, no.12, pp.2909-2940, 2000.
21. M. Sugiyama and H. Ogawa, "Active learning for optimal generalization in trigonometric polynomial models," IEICE Trans. Fundamentals, vol.E84-A, no.9, pp.2319-2329, Sept. 2001.
22. M. Sugiyama and H. Ogawa, "Subspace information criterion for model selection," Neural Comput., vol.13, no.8, pp.1863-1889, 2001.