Minimax nonparametric classification - Part II: Model selection for adaptation

IEEE Transactions on Information Theory

Volumn 45, Issue 7, 1999, Pages 2285-2292

  Yang, Yuhong ^a  

^a Department of Statistics Center for Statistics and Applications in Forensic Evidence Iowa State University 2438 Osborn Dr Ames   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; CONVERGENCE OF NUMERICAL METHODS; ERROR ANALYSIS; GRAPH THEORY; INTERPOLATION; MATHEMATICAL MODELS; NEURAL NETWORKS; PROBABILITY;

MINIMAX ADAPTIVE ESTIMATION; MINIMAX NONPARAMETRIC CLASSIFICATION;

INFORMATION THEORY;

EID: 0033356514     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/18.796369     Document Type: Article

References (22)

1. H. Akaike, "Information theory and an extension of the maximum likelihood principle," in Proc. 2nd Int. Symp. Infoormation Theory, B. N. Petrov and F. Csaki, Eds. Budapest, Hungary: Akademia Kiado, 1973, pp. 267-281.
2. A. R. Barron, "Complexity regularization with application to artificial neural networks," in Nonparametric Functional Estimation and Related Topics, G. Roussas, Ed. Dordrecht, The Netherlands: Kluwer, 1991, pp. 561-576.
3. _, "Neural net approximation," in Proc. Yale Worksh. Adaptive Learning Syst., K. Narendra, Ed. New Haven, CT: Yale Univ., May 1992.
4. _, "Universal approximation bounds for superpositions of a sigmoidal function," IEEE Trans. Inform. Theory, vol. 39, pp. 930-945, 1993.
5. _, "Approximation and estimation bounds for artificial neural networks," Machine Learning, vol. 14, pp. 115-133, 1994.
6. A. R. Barron, L. Birgé, and P. Massart, "Risk bounds for model selection via penalization," Probab. Theory Related Fields, vol. 13, pp. 301-413, 1999.
7. A. R. Barron, and T. M. Cover, "Minimum complexity density estimation," IEEE Trans. Inform. Theory, vol. 37, pp. 1034-1054, 1991.
8. L. Birgé and P. Massart, "From model selection to adaptive estimation," Research Papers in Probability and Statistics: Festschrift for Lucien Le Cam, D. Pollard, E. Torgersen, and G. Yang, Eds. New York: Springer-Verlag, 1996.
9. C. de Boor, A Practical Guide to Splines. New York: Springer-Verlag, 1978.
10. C. de Boor and G. J. Fix, "Spline approximation by quasi-interpolents," J. Approx. Theory, vol. 8, pp. 19-45, 1973.
11. L. Devroye, "Automatic pattern recognition: A study of the probability of error," IEEE Trans. Pattern Anal. Machine Intell., vol. 10, pp. 530-543, 1988.
12. L. Devroye, L. Györfi, and G. Lugosi, A Probabilistic Theory of Pattern Recognition. New York: Springer-Verlag, 1996.
13. A. Krzyzak and T. Linder, "Radial basis function networks and complexity regularization in function learning," IEEE Trans. Neural Networks, vol. 9, pp. 247-256, 1998.
14. G. Lugosi and A. Nobel, "Adaptive model selection using empirical complexities," Ann. Statist., 1996, submitted for publication.
15. G. Lugosi and K. Zeger, "Nonparametric estimation via empirical risk minimization," IEEE Trans. Inform. Theory, vol. 41, pp. 677-687, 1995.
16. _, "Concept learning using complexity regularization," IEEE Trans. Inform. Theory, vol. 42, pp. 48-54, 1996.
17. L. L. Schumaker, Spline functions: Basic theory. New York: Wiley-Interscience, 1981.
18. C. J. Stone, "The use of polynomial splines and their tensor products in multivariate function estimation," Ann. Statist., vol. 22, pp. 118-184, 1994.
19. Y. Yang and A. R. Barron, "An asymptotic property of model selection criteria," IEEE Trans. Inform. Theory, vol. 44, pp. 95-116, 1998.
20. _, "Information-theoretic determination of minimax rates of convergence," accepted by Ann. Statist., 1999.
21. Y. Yang, "Minimax nonparametric classification - Part I: Rates of convergence," this issue, pp. 0000-0000.
22. _, "Minimax nonparametric classification - Part II: Model selection for adaptation," Preprint 8, Dept. Statistics, Iowa State Univ., Ames, 1998.