Estimation of the conditional risk in classification: The swapping method

Computational Statistics and Data Analysis

Volumn 52, Issue 6, 2008, Pages 3220-3232

  Daudin, Jean Jacques ^a   Mary Huard, Tristan ^a  

^a AgroParisTech   (France)

Author keywords

Classification; Covariance penalty; Model selection

Indexed keywords

ALGORITHMS; COVARIANCE MATRIX; DATA TRANSFER; MATHEMATICAL MODELS; RISK ANALYSIS;

EMPIRICAL ERROR RATE; SWAPPING METHOD;

CLASSIFICATION (OF INFORMATION);

EID: 39049150829     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2007.10.003     Document Type: Article

References (23)

1. Alon U., Barkai N., Notterman D.A., Gish K., Ybarra S., Mack D., and Levine A.J. Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc. Nat. Acad. Sci. USA 96 12 (1999) 6745-6750
2. Bartlett P.L., Boucheron S., and Lugosi G. Model selection and error estimation. Mach. Learn. 48 (2000) 85-113
3. Bartlett, P.L., Boucheron, S., Lugosi, G., 2000b. Model selection and error estimation. Technical Report 508, Department of Economics and Business, Universitat Pompeu Fabra.
4. Birgé L., and Massart P. Gaussian model selection. J. European Math. Soc. 3 (2001) 203-268
5. Breiman L., Friedman J., Olshen R., and Stone C. Classification and Regression Trees (1984), Wadsworth International, Belmont, CA
6. Cherkassky V., and Ma Y. Comparison of model selection for regression. Neural Comput. 15 7 (2003) 1691-1714
7. Daudin, J., Mary-Huard, T., 2005. Model selection in classification: the swapping method. In: International Symposium on Applied Stochastic Models and Data Analysis.
8. Devroye L., Gyorfi L., and Lugosi G. A Probabilistic Theory of Pattern Recognition (1996), Springer, Berlin
9. Dudoit S., Fridlyand J., and Speed T. Comparison of discrimination methods for the classification of tumors using gene expression data. J. Amer. Statist. Assoc. 97 (2002) 77-87
10. Efron, B., 1986. How biased is the apparent error rate of a prediction rule?. J. Amer. Statist. Assoc. 461-470.
11. Efron B. The estimation of prediction error: covariance penalties and cross-validation. J. Amer. Statist. Assoc. 99 (2004) 619-642
12. Fix, E., Hodges, J., 1991a. Discriminatory analysis-nonparametric discrimination: consistency principles. In: Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques. IEEE Computer Society Press, Los Alamitos, CA (Reprint of original work from 1952).
13. Fix, E., Hodges, J., 1991b. Nonparametric discrimination: small sample performance. In: Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques. IEEE Computer Society Press, Los Alamitos, CA (Reprint of original work from 1952).
14. Fort G., and Lambert-Lacroix S. Classification using partial least squares with penalized logistic regression. Bioinformatics 21 7 (2004) 1104-1111
15. Ghosh A. On optimum choice of k in nearest neighbor classification. Comput. Statist. Data Anal. 50 11 (2006) 3113-3123
16. Hastie T., Tibshirani R., and Friedman J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2001), Springer, New York
17. Kearns M., Mansour Y., Ng A., and Ron D. An experimental and theoretical comparison of model selection methods. Mach. Learning 27 1 (1997) 7-50
18. Lugosi G., and Zeger K. Concept learning using complexity regularization. IEEE Trans. Inform. Theory 42 1 (1995) 48-54
19. p. Technometrics 12 (1973) 591-612
20. Massart P. Some applications of concentration inequalities to statistics. Ann. Fac. Sci. Toulouse IX (2000) 245-303
21. Stein C. Estimation of the mean of a multivariate normal distribution. Ann. Statist. 9 6 (1981) 1135-1151
22. Tibshirani R., and Knight K. The covariance inflation criterion for adaptive model selection. J. Roy Statist. Soc. B 61 3 (1999) 529-546
23. Ye J. On measuring and correcting the effects of data mining and model selection. J. Amer. Statist. Assoc. 93 (1998) 120-131