Estimation of generalization error: Random and fixed inputs

Statistica Sinica

Volumn 16, Issue 2, 2006, Pages 569-588

  Wang, Junhui ^a   Shen, Xiaotong ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Averaging; Logistic; Margins; Penalization; Support vector

Indexed keywords

EID: 33746128910     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (18)

1. Blake, C. L. and Merz, C. J. (1998). UCI Repository of machine learning databases. http://www.ics.uci.edu/mlearn/MLRepository.html. University of California, Irvine, Department of Information and Computer Science.
2. Bradley, P. S. and Mangasarian, O. L. (2000). Massive data discrimination via linear support vector machines. Optimization Methods and Software 13, 1-10.
3. Breiman, L. (1992). The little bootstrap and other methods for dimensionality selection in regression: X-fixed prediction error. J. Amer. Statist. Assoc. 87, 738-754.
4. Breiman, L. and Spector, P. (1992). Submodel selection and evaluation in regression - the X - Random case. Internat. Rev. Statist. 3, 291-319.
5. Breiman, L. (1996). Heuristics of instability and stabilization in model selection. Ann. Statist. 24, 2350-2383.
6. Cortes, C. and Vapnik, V. (1995). Support vector networks. Machine Learning 20, 273-297.
7. Devroye L, Gyorfi L. and Lugosi G. (1996). A probabilistic theory of pattern recognition, Springer-Verlag, New York.
8. Denby, L., Landwehr, J. M. and Mallows, C. L. (2004). Discussion of Efron's paper entitled "The estimation of prediction error: covariance penalties and Cross-Validation". J. Amer. Statist. Assoc. 90, 633-634.
9. Efron, B. (1983). Estimating the error rate of a prediction rule: improvement on cross-validation. J. Amer. Statist. Assoc. 78, 316-331.
10. Efron, B. (1986). How biased is the apparent error rate of a prediction rule?. J. Amer. Statist. Assoc. 81, 461-470.
11. Efron, B. (2004). The estimation of prediction error: covariance penalties and cross-validation. J. Amer. Statist. Assoc. 99, 619-632.
12. Hastie, T., Rosset, S., Tibshirani, R. and Zhu, J. (2004). The entire regularization path for the support vector machine. J. of Machine Learning Research 5, 1391-1415.
13. Lee, Y., Lin, Y. and Wahba, G. (2003). Multicategory support vector machines, theory and application to the classification of microarray data and satellite radiance data. J. Amer. Statist. Assoc. 99, 67-81.
14. L, cross-validation and generalized cross-validation: Discrete index set. Ann. Statist. 15, 958-975.
15. Shen, X. and Huang, H.-C. (2005). Optimal model assessment, selection and combination. J. Amer. Statist. Assoc., to appear.
16. Shen, X., Huang, H.-C. and Ye, J. (2004). Adaptive model selection and assessment for exponential family distributions. Technometrics 46, 306-317.
17. Shen, X., Tseng, G. C. Zhang, X. and Wong, W. H. (2003). On Psi-learning. J. Amer. Statist. Assoc. 98, 724-734.
18. Vapnik, V. and Chervonenkis, A. (1991). The necessary and sufficient conditions for consistency of the method of empirical risk minimization. Pattern Recogn. Image Anal. 1, 284-305.