Evaluation of prototype learning algorithms for nearest-neighbor classifier in application to handwritten character recognition

Pattern Recognition

Volumn 34, Issue 3, 2001, Pages 601-615

  Liu, Cheng Lin ^a   Nakagawa, Masaki ^b  

^a HITACHI LTD   (Japan)

^b TOKYO UNIVERSITY OF AGRICULTURE AND TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; CHARACTER RECOGNITION; DATABASE SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; OPTIMIZATION; VECTOR QUANTIZATION;

CHINESE CHARACTER RECOGNITION; HANDWRITTEN NUMERAL RECOGNITION; LEARNING VECTOR QUANTIZATION; MINIMUM CLASSIFICATION ERROR; NEAREST NEIGHBOR CLASSIFIER; PROTOTYPE LEARNING; STOCHASTIC GRADIENT SEARCH;

PATTERN RECOGNITION SYSTEMS;

EID: 0035283342     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0031-3203(00)00018-2     Document Type: Article

References (52)

1. R.O. Duda P.E. Hart Pattern Classification and Scene Analysis 1973 Wiley Interscience New York
2. K. Fukunaga Introduction to Statistical Pattern Recognition 2nd Edition 1990 Academic Press New York
3. P.A. Devjver J. Kittler Pattern Recognition: A Statistical Approach 1982 Prentice-Hall Englewood Cliffs, NJ
4. T.M. Cover P.E. Hart Nearest neighbor pattern classification IEEE Trans. Inform. Theory 13 1967 212 217
5. B.V. Dasarathy (Ed.), Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques, IEEE Computer Society Press, Silver Spring, MD, 1991.
6. K. Fukunaga P.M. Narendra A branch and bound algorithm for computing k -nearest neighbors IEEE Trans. Comput. 24 1975 750 753
7. P.J. Grother G.T. Candela J.L. Blue Fast implementations of nearest neighbor classifiers Pattern Recognition 30 3 1997 459 465
8. A. Djouadi E. Bouktache A fast algorithm for the nearest-neighbor classifier IEEE Trans. Pattern Anal. Mach. Intell. 19 3 1997 277 282
9. R.D. Short K. Fukunaga The optimal distance measure for nearest neighbor classification IEEE Trans. Inform. Theory 27 1981 622 627
10. K. Fukunaga T.E. Flick An optimal global nearest neighbor metric IEEE Trans. Pattern Anal. Mach. Intell. 6 3 1984 314 318
11. R.V.D. Heiden F.C.A. Gren The Box-Cox metric for nearest neighbor classification improvement Pattern Recognition 30 2 1997 273 279
12. F. Ricci P. Avesani Data compression and local metrics for nearest neighbor classification IEEE Trans. Pattern Anal. Mach. Intell. 21 4 1999 380 384
13. T. Denoeux A k -nearest neighbor classification rule based on Dempster-Shafer theory IEEE Trans. System Man Cybernet. 25 5 1995 804 813
14. T. Hastie R. Tobshirai Discriminant adaptive nearest neighbor classification IEEE Trans. Pattern Anal. Mach. Intell. 18 6 1996 607 615
15. Y. Hamamoto S. Uchimura S. Tomita A bootstrap technique to nearest neighbor classifier design IEEE Trans. Pattern Anal. Mach. Intell. 19 1 1997 73 79
16. P.E. Hart The condensed nearest neighbor rule IEEE Trans. Inform. Theory 14 1968 515 516
17. G.W. Gates The reduced nearest neighbor rule IEEE Trans. Inform. Theory 18 1972 431 433
18. F.J. Ferri J.V. Albert E. Vidal Considerations about sample-size sensitivity of a family of edited nearest-neighbor rules IEEE Trans. Systems Man Cybernet. Part B: Cybernet. 29 4 1999 667 672
19. L.I. Kuchenva J.C. Bezdek Nearest prototype classification: clustering, genetic algorithm, or random search? IEEE Trans. Systems Man Cybernet. Part C: Appl. Rev. 28 1 1998 160 164
20. U. Lipowezky Selection of the optimal prototype subset for 1-NN classification Pattern Recognition Lett. 19 1998 907 918
21. Q. Xie C.A. Laszlo R.K. Ward Vector quantization technique for nonparametric classifier design IEEE Trans. Pattern Anal. Mach. Intell. 15 12 1993 1326 1330
22. J.C. Bezdek Multiple-prototype classifier design IEEE Trans. Systems Man Cybernet. Part C: Appl. Rev. 28 1 1998 67 79
23. C.-L. Chang Finding prototypes for nearest neighbor classifiers IEEE Trans. Comput. 23 11 1974 1179 1184
24. T. Kohonen The self-organizing map Proc. IEEE 78 9 1990 1464 1480
25. T. Kohonen, G. Barna, R. Chrisley, Statistical pattern recognition with neural networks: benchmarking studies, Proceedings of the IEEE ICNN, Vol. I, 1988, pp. 61–68.
26. T. Kohonen, Improved versions of learning vector quantization, Proceedings of the IJCNN, Vol. I, 1990, pp. 545–550.
27. S. Geva J. Sitte Adaptive nearest neighbor pattern recognition IEEE Trans. Neural Networks 2 2 1991 318 322
28. S-W. Lee H-H. Song Optimal design of reference models for large-set handwritten character recognition Pattern Recognition 27 9 1994 1267 1274
29. H-H. Song S-W. Lee LVQ combined with simulated annealing for optimal design of large-set reference models Neural Networks 9 2 1996 329 336
30. C-L. Liu, I-J. Kim, J.H. Kim, High accuracy handwritten Chinese character recognition by improved feature matching method, Proceedings of the fourth ICDAR, Ulm, Germany, 1997, pp. 1033–1037.
31. H. Yan Prototype optimization for nearest neighbor classification using a two-layer perceptron Pattern Recognition 26 2 1993 317 324
32. K. Urahama Y. Furukawa Gradient descent learning of nearest neighbor classifiers with outlier rejection Pattern Recognition 28 5 1995 761 768
33. B-H. Juang S. Katagiri Discriminative learning for minimization error classification IEEE Trans. Signal Process. 40 12 1992 3043 3054
34. A. Sato, K. Yamada, Generalized learning vector quantization, in: Advances in Neural Information Processing Systems, Vol. 8, MIT Press, Cambridge, MA, 1996, pp. 423–429.
35. A. Sato, K. Yamada, A formulation of learning vector quantization using a new misclassification measure, Proceedings of the 14th ICPR, Vol. I, Brisbane, 1998, pp. 322–325.
36. Y.S. Huang, et al., A simulated annealing approach to construct optimized prototypes for nearest neighbor classification, Proceedings of the 13th ICPR, Vol. IV, Vienna, 1996, pp. 483–487.
37. D. Miller A global optimization technique for statistical classifier design IEEE Trans. Signal Process. 44 12 1996 3108 3122
38. C. Decaestecker Finding prototypes for nearest neighbor classification by gradient descent and deterministic annealing Pattern Recognition 30 2 1997 281 288
39. J. Blue Evaluation of pattern classifiers for fingerprint and OCR applications Pattern Recognition 27 4 1994 485 501
40. L. Holmström Neural and statistical classifiers — taxonomy and two case studies IEEE Trans. Neural Networks 8 1 1997 5 17
41. A. Joshi On neurobiological, neuro-fuzzy, machine learning, and statistical pattern recognition techniques IEEE Trans. Neural Networks 8 1 1997 18 31
42. C.Y. Suen Computer recognition of unconstrained handwritten numerals Proc. IEEE 80 7 1992 1162 1180
43. S. Mori K. Yamamoto M. Yasuda Research on machine recognition of handprinted characters IEEE Trans. Pattern Anal. Mach. Intell. 6 4 1984 386 405
44. T.H. Hilderbrand W. Liu Optical recognition of Chinese characters: advances since 1980 Pattern Recognition 26 2 1993 205 225
45. H. Robbins S. Monro A stochastic approximation method Ann. Math. Statist. 22 1951 400 407
46. D.E. Rumelhat, G.E. Hinton, R.J. Williams, Learning internal representation by error propagation in: D.E. Rumelhart, J.L. McClelland (Eds.), Parallel Distributed Processing, Vol. 1, MIT Press, Cambridge, MA, 1986, pp. 318–361.
47. H. Ney On the probabilistic interpretation of neural network classifiers and discriminant training criteria IEEE Trans. Pattern Anal. Mach. Intell. 17 2 1995 107 118
48. S-W. Lee Multilayer cluster neural network for totally unconstrained handwritten numeral recognition Neural Networks 8 5 1995 783 792
49. J. Franke Isolated handprinted digit recognition H. Bunke P.S.P. Wang Handbook of Character Recognition and Document Image Analysis 1997 World Scientific Singapore 103 121
50. C-L. Liu Y-J. Liu R-W. Dai Preprocessing and statistical/structural feature extraction for handwritten numeral recognition A.C. Downton S. Impedovo Progress of Handwriting Recognition 1997 World Scientific Singapore 161 168
51. S-W. Lee J-S. Park Nonlinear shape normalization methods for the recognition of large-set handwritten characters Pattern Recognition 27 7 1994 895 902
52. H. Yamada K. Yamamoto T. Saito A nonlinear normalization method for handprinted Kanji character recognition — line density equalization Pattern Recognition 23 9 1990 1023 1029