On optimum choice of k in nearest neighbor classification

Computational Statistics and Data Analysis

Volumn 50, Issue 11, 2006, Pages 3113-3123

  Ghosh, Anil K ^a  

^a INDIAN STATISTICAL INSTITUTE   (India)

Author keywords

Accuracy index; Bayesian strength function; Cross validation; Misclassification rate; Neighborhood parameter; Non informative prior; Optimal Bayes risk; Posterior probability

Indexed keywords

BENCHMARKING; FUNCTION EVALUATION; PARAMETER ESTIMATION; PROBABILITY; PROBLEM SOLVING;

ACCURACY INDEX; BAYESIAN STRENGTH FUNCTION; CROSS-VALIDATION; MISCLASSIFICATION RATE; NEIGHBORHOOD PARAMETER; NON-INFORMATIVE PRIOR; OPTIMAL BAYES RISK; POSTERIOR PROBABILITY;

CLASSIFICATION (OF INFORMATION);

EID: 33646575961     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2005.06.007     Document Type: Article

References (24)

1. Aho A.V., Hopcroft J.E., and Ullman J.D. Design and Analysis of Computer Algorithms (1974), Addison-Wesley, London
2. Anderson T.W. An Introduction to Multivariate Statistical Analysis (1984), Wiley, New York
3. Cover T.M., and Hart P.E. Nearest neighbor pattern classification. IEEE Trans. Inform. Theory 13 (1968) 21-27
4. Dasarathy, B.V. (Ed.), 1991. Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques. IEEE Computer Society, Washington.
5. Duda R., Hart P., and Stork D.G. Pattern Classification (2000), Wiley, New York
6. Fix, E., Hodges, J.L., 1951. Discriminatory analysis-nonparametric discrimination: consistency properties. Project 21-49-004, Report 4, pp. 261-279. US Air Force School of Aviation Medicine, Randolph Field.
7. Friedman, J.H., 1994. Flexible metric nearest neighbor classification. Technical Report, Department of Statistics, Stanford University.
8. Friedman, J.H., 1996. Another approach to ploychotomous classification. Technical Report, Department of Statistics, Stanford University.
9. Ghosh A.K., and Chaudhuri P. Optimal smoothing in kernal discriminant analysis. Stat. Sinica 14 (2004) 457-483
10. Ghosh, A.K., Chaudhuri, P., Murthy, C.A. 2005. On visualization and aggregation of nearest neighbor classifiers. IEEE Trans. Pattern Anal. Mach. Intell., to appear.
11. Hastie T., and Tibshirani R. Discriminant adaptive nearest neighbor classification. IEEE Trans. Pattern Anal. Mach. Intell. 18 (1996) 607-616
12. Hastie T., and Tibshirani R. Classification by pairwise coupling. Ann. Statist. 26 (1998) 451-471
13. Hastie T., Tibshirani R., and Friedman J.H. The Elements of Statistical Learning: Data Mining, Inference and Prediction (2001), Springer, New York
14. Holmes C.C., and Adams N.M. A probabilistic nearest neighbor method for statistical pattern recognition. J. Roy. Statist. Soc. Ser. B 64 (2002) 295-306
15. Holmes C.C., and Adams N.M. Likelihood inference in nearest-neighbor classification methods. Biometrika 90 (2003) 99-112
16. Johnson R.A., and Wichern D.W. Applied Multivariate Statistical Analysis (1992), Prentice-Hall, Prentice, NJ
17. Lachenbruch P.A., and Mickey M.R. Estimation of error rates in discriminant analysis. Technometrics 10 (1968) 1-11
18. Loftsgaarden D.O., and Quesenberry C.P. A nonparametric estimate of multivariate density function. Ann. Math. Statist. 36 (1965) 1049-1051
19. Mahalanobis, P.C., 1936. On the generalized distance in statistics. In: Proceedings of the National Academy of Sciences, India, 12, 49-55.
20. McLachlan G.J. Discriminant Analysis and Statistical Pattern Recognition (1992), Wiley, New York
21. Paik, M., Yang, Y., 2004. Combining nearest neighbor classifiers versus cross-validation selection. Statis. Appl. Genet. Mol. Biol. 3, Article 12.
22. Ripley B.D. Pattern Recognition and Neural Networks (1996), Cambridge University Press, Cambridge
23. Silverman B.W. Density Estimation for Statistics and Data Analysis (1986), Chapman & Hall, London
24. Stone M. Cross validation: a review. Math. Operationsforschung und Statistik, Series Statistics 9 (1977) 127-139