Binary decision clustering for neural-network-based optical character recognition

Pattern Recognition

Volumn 29, Issue 3, 1996, Pages 425-437

  Wilson, C L ^a   Grother, Patrick J ^a   Barnes, C S ^a  

^a NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

Author keywords

Data clustering; Dynamic systems; K L transform; Neural networks; OCR; Pattern recognition

Indexed keywords

DECISION THEORY; ERRORS; IMAGE PROCESSING; NEURAL NETWORKS; SET THEORY;

BINARY DECISION CLUSTERING; DATA CLUSTERING; DIGIT RECOGNITION DECISION; DYNAMIC SYSTEMS; KARHUNEN-LOEVE TRANSFORMS;

OPTICAL CHARACTER RECOGNITION;

EID: 0030110337     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/0031-3203(95)00105-0     Document Type: Article

References (41)

1. J. L. Blue, G. T. Candela, P. J. Grother, R. Chellappa and C. L. Wilson, Evaluation of pattern classifiers for fingerprint and OCR applications, Pattern Recognition 27(4), 485-501 (1994).
2. G. A. Carpenter and S. Grossberg, A massively parallel architecture for a self organizing neural pattern recognition machine, Neural Networks 2, 169-181 (1989).
3. G. A. Carpenter and S. Grossberg, A massively parallel architecture for a self-organizing neural pattern recognition machine, Comput. Vis. Graphics Image Process. 37, 54-115 (1987).
4. G. A. Carpenter and S. Grossberg, Art 2: self-organization of stable category recognition codes for analog input patterns, Appl. Opt. 26, 4919-4930 (1987).
5. J. A. Hartigan, Clustering Algorithm, pp. 84-108, John Wiley & Sons, Inc., New York (1975).
6. D. L. Alkon, K. T. Blackwell, G. S. Barbour, A. K. Rigler and T. P. Vogl, Pattern-recognition by an artificial network derived from biological neuronal systems, Biol. Cybernet. 62, 363-376 (1990).
7. R. Granger, J. Ambros-Ingerson and G. Lynch, Derivations of encoding characteristics of layer II cerebral cortex, J. Congn. Neurosci. 1(1), 67-87 (1989).
8. J. Ambros-Ingerson, R. Granger and G. Lynch, Simulation of paleocortex performs hierarchical clustering, Science 247, 1344-1348 (1990).
9. C. L. Wilson, FAUST: a vision based neural network multi-map pattern recognition architecture, Proc. Appl. Artific. Neural Networks III. Orlando, SPIE (April 1992).
10. Y. Le Cun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard and L. D. Jackel, Handwritten digit recognition with a back-propagation network, Advances in Neural Information Processing Systems, D. Touretzky, ed. Vol. 2, pp. 598-605. Morgan Kaufman, Denver (1990).
11. G. L. Martin, Centered-object integrated segmentation and recognition for visual character recognition, Advances in Neural Information Processing Systems, J. Moody, S. Hanson and R. Lippmann, eds, Vol. 4, pp. 504-511. Morgan Kaufmann, Denver (December 1991).
12. G. Martin and J. Pittman, Recognizing hand-printed letters and digits, Advances in Neural Information Processing Systems, D. Touretzky, ed, Vol. 2, pp. 405-414. Morgan Kaufmann, Denver (1990).
13. G. Martin and J. Pittman, Recognizing handprinted letters and digits using backpropagation, Neural Comput. 3, 258-267 (1991).
14. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd edn Academic Press, New York (1990).
15. R. A. Wilkinson, J. Geist, S. Janet, P. J. Grother, C. J. C. Burges, R. Creecy, B. Hammond, J. J. Hull, N. J. Larsen, T. P. Vogl and C. L. Wilson, The first optical character recognition systems conference. Technical Report NISTIR 4912, National Institute of Standards and Technology (August 1992).
16. M. D. Garris, J. L. Blue, G. T. Candela, D. L. Dimmick, J. Geist, P. J. Grother, S. A. Janet and C. L. Wilson, NIST form-based handprint recognition system. Technical Report NISTIR 5469, National Institute of Standards and Technology (July 1994).
17. O. M. Omidvar, J. L. Blue and C. L. Wilson, Improving neural network performance for character and fingerprint classification by altering network dynamics, Proc. World Congr. Neural Networks. Washington, DC (July 1995).
18. P. J. Grother, Karhunen Loève feature extraction for neural handwritten character recognition, Proc. Appl. Artific. Neural Networks III. Orlando, SPIE (April 1992).
19. T. P. Vogl, K. L. Blackwell, S. D. Hyman, G. S. Barbour and D. L. Alkon, Classification of Japanese Kanji using principal component analysis as a preprocessor to an artificial neural network, Int. Joint Conf. Neural Networks, Vol. 1, pages 233-238. IEEE and International Neural Network Society 7 (1991).
20. D. E. Rumelhart, G. E. Hinton and R. J. Williams, Learning representations by back-propagating errors, Nature 332, 533-536 (1986).
21. R. Fletcher and C. M. Reeves, Function minimization by conjugate gradients, Comput. J. 7, 149-154 (1964).
22. E. M. Johansson, F. U. Dowla and D. M. Goodman, Backpropagation learning for multi-layer feed-forward neural networks using the conjugate gradient method, IEEE Trans. Neural Networks (1991).
23. M. F. Møller, A scaled conjugate gradient algorithm for fast supervised learning. Technical Report PB-339, Aarhus University (1990).
24. J. L. Blue and P. J. Grother, Training Feed Forward Networks Using Conjugate Gradients. Conf. Character Recognition Digitizer Technol. Vol. 1661, pp. 179-190. San Jose California, SPIE (February 1992).
25. T. Poggio and F. Girosi, Networks for approximation and learning, Proc. IEEE 78(9), 1481-1497 (1990).
26. M. T. Musavi, W. Ahmed, K. H. Chan, K. B. Faris and K. M. Hummels, On the training of radial basis function classifiers, Neural Networks 5, 595-603 (1992).
27. D. Wettschereck and T. Dietterich, Improving the performance of radial basis function networks by learning center locations, Advances in Neural Information Processing Systems 4, J. E. Moody, S. J. Hanson and R. P. Lippmann, eds, pp. 1133-1140. Morgan Kaufmann, San Mateo, (1991).
28. D. F. Specht, Probabilistic neural networks, Neural Networks 3(1), 109-118 (1990).
29. M. D. Garris and R. A. Wilkinson, Handwritten segmented characters database. Technical Report Special Database 3, HWSC, National Institute of Standards and Technology (February 1992).
30. C. L. Wilson and M. D. Garris, Handprinted character database. Technical Report Special Database 1, HWDB, National Institute of Standards and Technology (April 1990).
31. R. G. Casey and H. Takahashi, Experience in segmenting and recognizing the NIST database, Proc. Int. Workshop Frontiers Handwriting Recognition. France (1991).
32. P. J. Grother, Cross validation comparison of NIST OCR databases, D. P. D'Amato, ed, Vol. 1906. SPIE, San Jose (1993).
33. C. L. Wilson and J. L. Blue, Neural network methods applied to character recognition, Soc. Sci. Comput. Rev. 10, 173-195 (1992).
34. M. D. Garris and C. L. Wilson, Reject mechanisms for massively parallel neural network character recognition systems, Neural and Stochastic Methods in Image and Signal Processing, S.-S. Chen, ed. Vol. 1766. SPIE, San Diego (1992).
35. C. L. Wilson, A new self-organizing neural network architecture for parallel multi-map pattern recognition -FAUST, Prog. Neural Networks 4, to be published.
36. O. M. Omidvar and C. L. Wilson, Information Content in Neural Net Optimizaton, J. Connect. Sci. 6, 91-103 (1993).
37. O. M. Omidvar and C. L. Wilson, Optimization of neural network topology and information content using boltzmann methods, Proc. IJCNN IV, 594-599 (June 1992).
38. M. W. Hirsch and S. Smale, Differential Equations, Dynamical Systems, and Linear Algebra. Academic Press, New York (1974).
39. J. Guckenheimer and P. Holmes, Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields. Springer-Verlag, New York (1983).
40. M. W. Hirsch, Convergent activation dynamics in continuous time networks, Neural Networks 2, 331-349 (1989).
41. J. Geist, R. A. Wilkinson, S. Janet, P. J. Grother, B. Hammond, N. W. Larsen, R. M. Klear, M. J. Matsko, C. J. Burges, R. Creecy, J. J. Hull, T. P. Vogl and C. L. Wilson, The second census optical character recognition systems conference. Technical Report NISTIR 5452, National Institute of Standards and Technology (May 1994).