Dimension reduction in nonparametric kernel discriminant analysis

Journal of Computational and Graphical Statistics

Volumn 14, Issue 4, 2005, Pages 847-866

  Hernández, Adolfo ^a   Velilla, Santiago ^b  

^a UNIVERSITY OF EXETER   (United Kingdom)

^b UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

Class separation; Curse of dimensionality; Dimension reduction subspaces; Kernel discriminant rule; Projection pursuit; Sliced average variance estimation (SAVE); Sliced inverse regression (SIR)

Indexed keywords

EID: 29544445970     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/106186005X79610     Document Type: Article

References (34)

1. Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, C. J. (1984), Classification and Regression Trees, Belmont, CA: Wadsworth.
2. Cook, R. D. (1998), Regression Graphics: Ideas for Studying Regressions Through Graphics, New York: Wiley.
3. Cook, R. D., and Critchley, F. (2000), "Identifying Outliers and Regression Mixtures Graphically," Journal of the American Statistical Association, 95, 781-794.
4. Cook, R. D., and Lee, H. (1999), "Dimension Reduction with a Binary Response," Journal of the American Statistical Association, 94, 1187-1200.
5. Cook, R. D., and Weisberg, S. (1991), Discussion of "Sliced Inverse Regression for Dimension Reduction" by K. C. Li, Journal of the American Statistical Association, 86, 328-332.
6. Cook, R. D., and Yin, X. (2001), "Dimension Reduction and Visualization in Discriminant Analysis" (with discussion), Australian and New Zealand Journal of Statistics, 43, 147-199.
7. Dawid, A. P. (1979), "Conditional Independence in Statistical Theory," Journal of the Royal Statistical Society, Series B, 41, 1-31.
8. Friedman, J., Stuetzle, W., and Schroeder, A. (1984), "Projection Pursuit Density Estimation," Journal of the American Statistical Association, 79, 599-608.
9. Fukunaga, K. (1972), Introduction to Statistical Pattern Recognition, New York: Academic Press.
10. Gill, P. E., Murray, W., Saunders, M. A., and Wright, M. H. (1998), User's Guide for NPSOL 5.0: A FORTRAN Package for Nonlinear Programming, Technical Report SOL 86-1, Stanford University.
11. Gill, P. E., Murray, W., and Wright, M. H. (1981), Practical Optimization, New York: Academic Press.
12. Hand, D. J. (1981), Discrimination and Classification, Chichester, UK: Wiley.
13. _ (1997), Construction and Assessment of Classification Rules, New York: Wiley.
14. Hastie, T., Tibshirani, R., and Buja, A. (1994), "Flexible Discriminant Analysis by Optimal Scoring," Journal of the American Statistical Association, 89, 1255-1270.
15. Hastie, T., Tibshirani, R., and Friedman, J. (2001), The Elements of Statistical Learning: Data Mining, Inference and Prediction, New York: Springer Verlag.
16. Hastie, T., and Zhu, M. (2001), Discussion of "Dimension Reduction and Visualization in Discriminant Analysis" by Cook and Yin, Australian and New Zealand Journal of Statistics, 43, 179-185.
17. Hermans, J, Habbema, J. D. F., and Schaefer, J. R. (1982), "The ALLOC80 Package for Discriminant Analysis," Statistical Software Newsletter, 8, 15-20.
18. Levene, H. (1960), "Contributions to Probability and Statistics: Essays in Honor of Harold Hotelling," ed. I. Olkin, Stanford, CA: Stanford University Press.
19. Li, K. C. (1991), "Sliced Inverse Regression for Dimension Reduction" (with discussion), Journal of the American Statistical Association, 86, 316-342.
20. _ (2000), "High Dimensional Data Analysis Via the SIR/PHD Approach," upublished manuscript dated April 6, 2000. Available online at www.stat.ucla.edu/~kcli/sir-PHD.pdf.
21. Lim, T. S., Lo, W. Y., and Shih, Y. S. (2000), "A Comparison of Prediction Accuracy, Complexity, and Training Time of Thirty-Three Old and New Classification Algorithms," Machine Learning Journal, 40, 203-228.
22. Lo, W., and Vanichsetakul, N. (1988), "Tree-Structured Classification via Generalized Discriminant Analysis" (with discussion), Journal of the American Statistical Association, 83, 715-728.
23. McLachlan, G. J. (1992), Discriminant Analysis and Statistical Pattern Recognition, New York: Wiley.
24. Merz, C. J., and Murphy, P. M. (1996), UCI Repository of Machine Learning Databases, University of California, Irvine, CA: Dept. of Information and Computer Science.
25. Michie, D., Spiegelhalter, D. J., and Taylor, C. C. (1994), Machine Learning, Neural and Statistical Classification, London: Chapman and Hall.
26. Polzehl, J. (1995), "Projection Pursuit Discriminant Analysis," Computational Statistics and Data Analysis, 20, 141-157.
27. Ripley, B. D. (1996), Pattern Recognition and Neural Networks, Cambridge UK: Cambridge University Press.
28. Rubin, H. (1956), "Uniform Convergence of Random Functions with Applications to Statistics," The Annals of Mathematical Statistics, 27, 200-203.
29. Scott, D. W. (1992), Multivariate Density Estimation: Theory, Practice and Visualization, New York: Wiley.
30. Seber, G. A. F. (1984), Multivariate Observations, New York: Wiley.
31. Silverman, B. W. (1986), Density Estimation for Statistics and Data Analysis, London: Chapman and Hall.
32. Xia, Y., Tong, H., Li, W. K., and Zhu, L-X. (2002), "An Adaptive Estimation of Dimension Reduction Space" (with discussion), Journal of the Royal Statistical Society, 64, 363-410.
33. Yin, X., and Cook, R. D. (2003), "Estimating Central Subspaces via Inverse Third Moments," Biometrika, 90, 113-125.
34. Zhu, M., and Hastie, T. (2003), "Feature Extraction for Non-Parametric Discriminant Analysis," Journal of Computational and Graphical Statistics, 12, 101-120.