Discriminative learning quadratic discriminant function for handwriting recognition

IEEE Transactions on Neural Networks

Volumn 15, Issue 2, 2004, Pages 430-444

  Liu, Cheng Lin ^a   Sako, Hiroshi ^a   Fujisawa, Hiromichi ^a  

^a HITACHI LTD   (Japan)

Author keywords

Discriminative learning quadratic discriminant function (DLQDF); Handwritten digit recognition; Minimum classification error (MCE); Noncharacter resistance; Numerical string recognition; Pattern classification

Indexed keywords

ERROR ANALYSIS; LEARNING ALGORITHMS; LEARNING SYSTEMS; NUMERICAL METHODS; QUADRATIC PROGRAMMING;

DISCRIMINATIVE LEARNING QUADRATIC DISCRIMINANT FUNCTION; HANDWRITING RECOGNITION; MINIMUM CLASSIFICATION ERROR;

NEURAL NETWORKS;

ARTICLE; DISCRIMINATION LEARNING; HANDWRITING; RECOGNITION;

DISCRIMINATION LEARNING; HANDWRITING; RECOGNITION (PSYCHOLOGY);

EID: 2442596064     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2004.824263     Document Type: Article

References (50)

1. A. K. Jain, R. P. W. Duin, and J. Mao, "Statistical pattern recognition: A review," IEEE Trans. Pattern Anal. Mach. Intell, vol. 22, pp. 4-37, Jan. 2000.
2. F. Kimura, K. Takashina, S. Tsuruoka, and Y. Miyake, "Modified quadratic discriminant functions and the application to chinese character recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 9, pp. 149-153, Jan. 1987.
3. J. H. Friedman, "Regularized discriminant analysis," J. Am. Statist. Ass., vol. 84, no. 405, pp. 165-175, 1989.
4. J. P. Hoffbeck and D. A. Landgrebe, "Covariance matrix estimation and classification with limited training data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, pp. 763-767, July 1996.
5. M. Sakai, M. Yoneda, and H. Hase, "A new robust quadratic discriminant function," in Proc. 14th Int. Conf. Pattern Recognition, Brisbane, 1998, pp. 99-102.
6. T. Kawatani, "Handwritten kanji recognition with determinant normalized quadratic discriminant function," in Proc. 15th Int. Conf. Pattern Recognition, vol. 2, Barcelona, 2000, pp. 343-346.
7. M. Iwamura, S. Omachi, and H. Aso, "A modification of eigenvalues to compensate estimation errors of eigenvectors," in Proc. 15th Int. Conf. Pattern Recognition, vol. 2, Barcelona, 2000, pp. 378-381.
8. C.-L. Liu, H. Sako, and H. Fujisawa, "Performance evaluation of pattern classifiers for handwritten character recognition," Int. J. Document Analysis and Recognition, vol. 4, no. 3, pp. 191-204, 2002.
9. H. Fujisawa, Y. Nakano, and K. Kurino, "Segmentation methods for character recognition: From segmentation to document structure analysis," Proc. IEEE, vol. 80, pp. 1079-1092, July 1992.
10. Y. Saifullah and M. T. Manry, "Classification-based segmentation of ZIP codes," IEEE Trans. System Man Cybernet., vol. 23, no. 5, pp. 1437-1443, 1993.
11. R. G. Casey and E. Lecolinet, "A survey of methods and strategies in character segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, pp. 690-706, July 1996.
12. F. Kimura, Y. Miyake, and M. Sridhar, "Handwritten ZIP code recognition using lexicon free word recognition algorithm," in Proc. 3rd Int. Conf. Document Analysis and Recognition, Montreal, 1995, pp. 906-910.
13. T. M. Ha, J. Zimmermann, and H. Bunke, "Off-line handwritten numeral string recognition by combining segmentation-based and segmentation-free methods," Pattern Recognition, vol. 31, no. 3, pp. 257-272, 1998.
14. K. K. Kim, Y. K. Chung, J. H. Kim, and C. Y. Suen, "Recognition of uncontrained handwritten numeral strings using decision value generator," in Proc. 6th Int. Conf. Document Analysis and Recognition, Seattle, 2001, pp. 14-17.
15. J. Zhou, A. Krzyzak, and C. Y. Suen, "Verification-A method of enhancing the recognizers of isolated and touching handwritten numerals," Pattern Recognition, vol. 35, no. 5, pp. 1179-1189, 2002.
16. L. S. Oliveira, R. Sabourin, F. Bortolozzi, and C. Y. Suen, "Automatic recognition of handwritten numeral strings: A recognition and verification strategy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, pp. 1438-1454, Nov. 2002.
17. B.-H. Juang and S. Katagiri, "Discriminative learning for minimum error classification," IEEE Trans. Signal Processing, vol. 40, pp. 3043-3054, Dec. 1992.
18. B.-H. Juang, W. Chou, and C.-H. Lee, "Minimum classification error rate methods for speech recognition," IEEE Trans. Speech and Audio Processing, vol. 5, pp. 257-265, May 1997.
19. Y. D. Rubenstein and T. Hastie, "Discriminative vs informative learning," in Proc. 3rd Int. Conf. Knowledge Discovery and Data Mining, CA, 1997, pp. 49-53.
20. S. Katagiri, B.-H. Juang, and C.-H. Lee, "Pattern recognition using a family of design algorithms based upon the generalized probabilistic descent method," Proc. IEEE, vol. 86, pp. 2345-2375, 1998.
21. W. Chou, "Discriminant-function-based minimum recognition error pattern-recognition approach to speech recognition," Proc. IEEE, vol. 88, pp. 1201-1223, Aug. 2000.
22. A. Biem, S. Katagiri, and B.-H. Juang, "Pattern recognition using discriminative feature extraction," IEEE Trans. Signal Processing, vol. 45, pp. 500-504, Feb. 1997.
23. H. Watanabe, T. Yamaguchi, and S. Katagiri, "Discriminative metric design for robust pattern recognition," IEEE Trans. Signal Processing, vol. 45, pp. 1655-2662, Nov. 1997.
24. Q. Huo, Y. Ge, and Z.-D. Feng, "High performance Chinese OCR based on Gabor features, discriminative feature extraction and model training," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, vol. 3, Utah, USA, 2001, pp. 1517-1520.
25. A. E. Biem, "Minimum classification error training of hidden Markov models for handwriting recognition," in Proc. Int. Conf. Acoustics, Speech, and Signal Processing, vol. 3, Utah, USA, 2001, pp. 1529-1532.
26. T. Fukumoto, T. Wakabayashi, F. Kimura, and Y. Miyake, "Accuracy improvement of handwritten character recognition by GLVQ," in Proc. 7th Int. Workshop Frontiers of Handwriting Recognition, Amsterdam, The Netherlands, 2000, pp. 271-280.
27. H. Watanabe and S. Katagiri, "Subspace method for minimum error pattern recognition," IEICE Trans. Information Syst., vol. E80-D, no. 12, pp. 1095-1104, 1997.
28. Y. Kurosawa, "Probabilistic descent method applied to similarity and distance measure of quadratic form for pattern recognition technical report of IEICE," (in Japanese), PRMU97-181 (1997-12).
29. R. Zhang, X. Ding, and J. Zhang, "Offline handwritten character recognition based on discriminative training of orthogonal Gaussian mixture model," in Proc. 6th Int. Conf. Document Analysis and Recognition, Seattle, WA, 2001, pp. 221-225.
30. H.-C. Yau and M. T. Manry, "Iterative improvement of a Gaussian classifier," Neural Networks, vol. 3, no. 4, pp. 437-443, 1990.
31. J. Schürmann, Pattern Classification: A Unified View of Statistical and Neural Approaches. West Sussex, U.K.: Wiley Interscience, 1996.
32. U. Kreßel and J. Schürmann, "Pattern classification techniques based on function approximation," in Handbook of Character Recognition and Document Image Analysis, H. Bunke and P. S. P Wang, Eds. Singapore: World Scientific, 1997, pp. 49-78.
33. C.-L. Liu, H. Sako, and H. Fujisawa, "Learning quadratic discriminant function for handwritten character recognition," in Proc. 16th Int. Conf. Pattern Recognition, vol. 4, Quebec, Canada, 2002, pp. 44-47.
34. ____, "Integrated segmentation and recognition of handwritten numerals: Comparison of classification algorithms," in Proc. 8th Int. Workshop Frontiers of Handwriting Recognition, Ontario, Canada, 2002, pp. 303-308.
35. B. Moghaddam and A. Pentland, "Probabilistic visual learning for object representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, pp. 696-710, July 1997.
36. H. Robbins and S. Monro, "A stochastic approximation method," Ann. Math. Stat., vol. 22, pp. 400-407, 1951.
37. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
38. P. J. Grother. (1995) NIST Special Database 19: Handprinted Forms and Characters Database, Technical Rep.
39. C.-L. Liu, Y.-J. Liu, and R.-W. Dai, "Preprocessing and statistical/structural feature extraction for handwritten numeral recognition," in Progress of Handwriting Recognition, A. Downton and S. Impedovo, Eds. Singapore: World Scientific, 1997, pp. 161-168.
40. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representations by back-propagation errors," Nature, vol. 323, no. 9, pp. 533-536, 1986.
41. J. Bromley and J. S. Denker, "Improving rejection performance on handwritten digits by training with rubbish," Neural Computation, vol. 5, pp. 367-370, 1993.
42. L. Yaeger, R. Lyon, and B. Webb, "Effective training of a neural network character classifier for word recognition," in Advances in Neural Information Processing Systems 9, M. Mozer, M. Jordan, and T. Petsche, Eds. Cambridge, MA: MIT Press, 1997.
43. Y. LeCun, L. Bottou, Y. Bengyo, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, pp. 2278-2324, Nov. 1998.
44. W.-T. Chen and P. Gader, "Word level discriminative training for handwritten word recognition," in Proc. 7th Int. Workshop Frontiers of Handwriting Recognition, Amsterdam, The Netherlands, 2000, pp. 393-402.
45. Y. H. Tay, P.-M. Lallican, M. Khalid, S. Knerr, and C. Viard-Gaudin, "An analytical handwritten word recognition system with word-level discriminant training," in Proc. 6th Int. Conf. Document Analysis and Recognition, Seattle, WA, 2001, pp. 726-730.
46. U. Ramer, "An iterative procedure for the polygonal approximation of plane closed curves," Computer Graphics and Image Processing, vol. 1, pp. 244-256, 1972.
47. S.-W. Lee and S.-Y. Kim, "Integrated segmentation and recognition of handwritten numerals with cascade neural network," IEEE Trans. Syst. Man Cybernet. C, vol. 29, pp. 285-290, May 1999.
48. P. D. Gader, M. Mohamed, and J.-H. Chiang, "Handwritten word recognition with character and inter-character neural networks," IEEE Trans. System Man Cybernet. B., vol. 27, no. 1, pp. 158-164, 1997.
49. A. d. S. Britto Jr, R. Sabourin, E. Lethelier, F. Bortolozzi, and C. Y. Suen, "Improvement in handwritten numeral string recognition by slant normalization and contextual information," in Proc. 7th Int. Workshop Frontiers of Handwriting Recognition, Amsterdam, The Netherlands, 2000, pp. 323-332.
50. Y.-K. Chen and J.-F. Wang, "Segmentation of single- or multiple-touching handwritten numeral string using background and foreground analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, pp. 1304-1317, Nov. 2000.