On nearest neighbor classification using adaptive choice of k

Journal of Computational and Graphical Statistics

Volumn 16, Issue 2, 2007, Pages 482-502

  Ghosh, Anil K ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY KANPUR   (India)

Author keywords

Bayesian strength function; Cross validation; Misclassification rate; Noninformative prior; Optimal Bayes risk; p value; Posterior probability; Robustness

Indexed keywords

EID: 34250701071     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/106186007X208380     Document Type: Article

References (34)

1. Aho, A. V., Hopcroft, J. D., and Ullman, J. E. (1974), Design and Analysis of Computer Algorithms, London: Addison-Wesley.
2. Anderson, T. W. (1984), An Introduction to Multivariate Statistical Analysis, New York: Wiley.
3. Andrews, D. F., and Herzberg, A. M. (1985), Data: A Collection of Problems from Many Fields for the Student and Research Worker, New York: Springer-Verlag.
4. Bailey, T., and Jain, A. (1978), "A Note on Distance-Weighted k -Nearest Neighbor Rules," IEEE Transactions on Systems, Man, Cybernetics, 8, 311-313.
5. Breiman, L. (1996), "Bagging Predictors," Machine Learning, 24, 123-140.
6. Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, C. J. (1984), Classification and Regression Trees, London: Chapman and Hall.
7. Cover, T. M., and Hart, P. E. (1967), "Nearest Neighbor Pattern Classification," IEEE Transactions on Information Theory, 13, 21-27.
8. Dasarathy, B. V. (ed.) (1991), Nearest Neighbor (NN) Norms: NNPattern Classification Techniques, Washington: IEEE Computer Society.
9. Domeniconi, C., Peng, J., and Gunopulos, D. (2002), "Locally Adaptive Metric Nearest Neighbor Classification," IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 1281-1285.
10. Efron, B., and Tibshirani, R. (1993), An Introduction to Bootstrap, New York: Chapman and Hall.
11. Fix, E., and Hodges, J. L. (1951), "Discriminatory Analysis - Nonparametric Discrimination: Consistency Properties," Project 21-49-004, Report 4, pp. 261-279. US Air Force School of Aviation Medicine, Randolph Field.
12. Friedman, J. H. (1994), "Flexible Metric Nearest Neighbor Classification," Technical Report, Dept. of Statistics, Stanford University.
13. Friedman, J. H., Hastie, T., and Tibshirani, R. (2000), "Additive Logistic Regression: A Statistical View of Boosting" (with discussion), The Annals of Statistics, 28, 337-407.
14. Ghosh, A. K. (2004), "Some Nonparametric and Semiparametric Methods for Discriminant Analysis," unpublished Ph.D. Thesis, Statistics and Mathematics Unit, Indian Statistical Institute, Kolkata. Avalable online at http://www.geocities.com/ghosh_anilk/draft.pdf.
15. Ghosh, A. K., Chaudhuri, P., and Murthy, C. A. (2006), "Multi-scale Classification Using Nearest Neighbor Density Estimates," IEEE Transactions on Systems, Man, Cybernetics, Part B, 36, 1139-1148.
16. Gilks, W. R., Richardson, S., and Spiegelhalter, D. J. (1996) Markov Chain Monte Carlo in Practice, London: Chapman and Hall.
17. Hastie, T., and Tibshirani, R. (1996), "Discriminant Adaptive Nearest Neighbor Classification," IEEE Transactions on Pattern Analysis and Machine Intellience, 18, 607-616.
18. Hastie, T., Tibshirani, R., and Friedman, J. H. (2001), The Elements of Statistical Learning: Data Mining, Inference and Prediction, New York: Springer-Verlag.
19. Holmes, C. C., and Adams, N. M. (2002), "A Probabilistic Nearest Neighbor Method for Statistical Pattern Recognition," Journal of the Royal Statistical Society, Series B, 64, 295-306.
20. _ (2003), "Likelihood Inference in Nearest-Neighbor Classification Methods," Biometrika, 90, 99-112.
21. Johnson, R. A., and Wichern, D. W. (1992), Applied Multivariate Statistical Analysis, Englewood Cliffs, NJ: Prentice Hall.
22. Loftsgaarden, D. O., and Quesenberry, C. P. (1965), "A Nonparametric Estimate of Multivariate Density Function," The Annals of Mathematical Statistics, 36, 1049-1051.
23. Mahalanobis, P. C. (1936), "On the Generalized Distance in Statistics," in Proceedings of the National Academy of Sciences, India, 12, 49-55.
24. Mitra, P., Murthy, C. A., and Pal, S. K. (2002), "Density Based Multiscale Data Condensation," IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 734-747.
25. Pal, S. K., Bandopadhyay, S., and Murthy, C. A. (1998), "Genetic Algorithms for Generation of Class Boundaries," IEEE Transactions on Systems, Man, Cybernetics, 28, 816-828.
26. Peng, J., Heisterkamp, D. R., and Dai, H. K. (2004), "Adaptive Quasiconformal Kernel Nearest Neighbor Classification," IEEE Transactions on Pattern Analysis and Machine Intelligence, 26, 656-661.
27. Opitz, D., and Maclin, R. (1999), "Popular Ensemble Methods: An Empirical Study," Journal of Artificial Intelligence Research, 11, 169-198.
28. Ripley, B. D. (1996), Pattern Recognition and Neural Networks, Cambridge: Cambridge University Press.
29. Schapire, R. E., Fruend, Y., Bartlett, P., and Lee, W. (1998), "Boosting the Margin: A New Explanation for the Effectiveness of Voting Methods," The Annals of Statistics, 26, 1651-1686.
30. Seigmund, D. (1985), Sequential Analysis: Tests and Confidence Intervals, New York: Springer-Verlag.
31. Silverman, B. W. (1986), Density Estimation for Statistics and Data Analysis, London: Chapman and Hall.
32. Stone, M. (1977), "Cross-validation: A Review," Mathematische Operationsforschung und Statistik, Series Statistics, 9, 127-139.
33. Wald, A. (1973), Sequential Analysis, New York: Dover.
34. Wettschereck, D., and Dietterich, T. G. (1994), "Locally Adaptive Nearest Neighbor Algorithm," Advances in Neural Information Systems, 6, 184-191.