A Bootstrap Technique for Nearest Neighbor Classifier Design

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 19, Issue 1, 1997, Pages 73-79

  Hamamoto, Yoshihiko ^a   Uchimura, Shunji ^a   Tomita, Shingo ^a  

^a YAMAGUCHI UNIVERSITY   (Japan)

Author keywords

Bootstrap; Error rate; High dimensions; Nearest neighbor classifier; Outlier; Peaking phenomenon; Small training sample size

Indexed keywords

DATA PROCESSING; DECISION THEORY; ERRORS; ESTIMATION; LEARNING SYSTEMS; OPTIMIZATION; PERFORMANCE;

BOOTSTRAP; NEAREST NEIGHBOR CLASSIFIER; PEAKING PHENOMENON; SMALL TRAINING SAMPLE SIZE;

PATTERN RECOGNITION;

EID: 0030853030     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/34.566814     Document Type: Article

References (22)

1. T.M. Cover and P.E. Hart, "Nearest Neighbor Pattern Classification,"IEEE Trans. Information Theory, vol. 13, no. 1, pp. 21-27, Jan. 1967.
2. K. Fukunaga and D.M. Hummels, "Bias of Nearest Neighbor Error Estimates,"IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, pp. 103-112, Jan. 1987.
3. B. Efron, "Bootstrap Methods: Another Look at.the Jackknife,"Annual Statistics, vol. 7, pp. 1-26,1979.
4. A.K. Jain, R.C. Dubes, and C.-C. Chen, "Bootstrap Techniques for Error Estimation,"IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, pp. 628-633,1987.
5. M.C. Chernick, V.K. Murthy, and C.D. Nealy, "Application of Bootstrap and Other Resampling Techniques: Evaluation of Classifier Performance,"Pattern Recognition Letters, vol. 3, pp. 167-178, 1985.
6. S.M. Weiss, "Small Sample Error Rate Estimation for &-NN Classifiers,"IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, pp. 285-289,1991.
7. K. Fukunaga and D.M. Hummels, "Bayes Error Estimation Using Parzen and fc-NN Procedures,"IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, pp. 634-643,1987.
8. K. Fukunaga, Introduction to Statistical Pattern Recognition, second ed. Academic Press, 1990.
9. J. Van Ness, "On the Dominance of Non-Parametric Bayes Rule Discriminant Algorithms in High Dimensions,"Pattern Recognition, vol. 12, pp. 355-368,1980.
10. A.K. Jain and B. Chandrasekaran, "Dimensionality and Sample Size Considerations in Pattern Recognition Practice,"Handbook of Statistics, P.R. Krishnaiah and L.N. Kanal, eds., vol. 2. North Holland, 1982, pp. 835-855.
11. P. Lachenbruch and M. Mickey, "Estimation of Error Rates in Discriminant Analysis,"Technometrics, vol. 10, pp. 1-11,1968.
12. E. Fix and J.L. Hodges, Jr., "Discriminatory Analysis: Nonparametric Discrimination: Consistency Properties," Report No. 4, USAF School of Aviation Medicine, Randolph Field, Texas, Feb. 1951.
13. E. Fix and J.L. Hodges, Jr., "Discriminatory Analysis: Nonparametric Discrimination: Small Sample Performance," Report No. 11, USAF School of Aviation Medicine, Randolph Field, Texas, Aug. 1952.
14. D. Gabor, "Theory of Communication," J. Inst. Elect. Engr., vol. 93, pp. 429-459,1946.
15. Y. Hamamoto, S. Uchimura, K. Masamizu, and S. Tomita, "Recognition of Handprinted Chinese Characters Using Gabor Features,"Proc. Third Int'l Conf. Document Analysis and Recognition, pp.819-823, Montreal, Aug. 1995.
16. Y. Hamamoto, S. Uchimura, M. Watanabe, T. Yasuda, and S. Tomita, "Recognition of Handwritten Numerals Using Gabor Features,"Proc. 13th Int'l Conf. Pattern Recognition, vol. 3, pp. 250-253, Vienna, Aug. 1996.
17. P.E. Hart, "The Condensed Nearest Neighbor Rule,"IEEE Trans. Information Theory, vol. 14, pp. 515-516, May 1968.
18. G.W. Gates, "The Reduced Nearest Neighbor Rule,"IEEE Trans. Information Theory, vol. 18, pp. 431-433, May 1972.
19. Q. Xie, C.A. Laszlo, and R.K. Ward, "Vector Quantization Technique for Nonparametric Classifier Design,"IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, pp. 1,326-1,330,1993.
20. G.F. Hughes, "On the Mean Accuracy of Statistical Pattern Recognizers,"IEEE Trans. Information Theory, vol. 14, no. 1, pp. 55-63, 1968.
21. DJ. Hand, "Recent Advances in Error Rate Estimation,"Pattern Recognition Letters, vol. 4, pp. 335-346,1986.
22. B. Chandrasekaran and A.K. Jain, "On Balancing Decision Functions," J. Cybernetics and Information Science, vol. 2, no. 1, pp. 12-15, 1979.