Offline recognition of unconstrained handwritten texts using HMMs and statistical language models

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 26, Issue 6, 2004, Pages 709-720

  Vinciarelli, Alessandro ^a   Bengio, Samy ^a   Bunke, Horst ^b  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

^b UNIVERSITY OF BERN   (Switzerland)

Author keywords

Continuous density Hidden Markov Models; N grams; Offline cursive handwriting recognition; Statistical language models

Indexed keywords

COMPUTATIONAL LINGUISTICS; CONSTRAINT THEORY; ERROR CORRECTION; MARKOV PROCESSES; MATHEMATICAL MODELS; STATISTICAL METHODS; TEXT PROCESSING;

HIDDEN MARKOV MODELS; OFFLINE RECOGNITION; STATISTICAL LANGUAGE MODELS; TEXT RECOGNITION;

PATTERN RECOGNITION SYSTEMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER INTERFACE; DOCUMENTATION; HANDWRITING; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION PROCESSING; INFORMATION RETRIEVAL; MATHEMATICAL COMPUTING; METHODOLOGY; PROBABILITY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; AUTOMATIC DATA PROCESSING; BIOMETRY; COMPUTER GRAPHICS; DOCUMENTATION; HANDWRITING; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MARKOV CHAINS; MODELS, STATISTICAL; NUMERICAL ANALYSIS, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SUBTRACTION TECHNIQUE; USER-COMPUTER INTERFACE;

EID: 3042527199     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2004.14     Document Type: Article

References (37)

1. T. Steinherz, E. Rivlin, and N. Intrator, "Off-Line Cursive Script Word Recognition - A Survey," Int'l J. Document Analysis and Recognition, vol. 2, no. 2, pp. 1-33, Feb. 1999.
2. R. Plamondon and S.N. Srihari, "Online and Offline Handwriting Recognition: A Comprehensive Survey," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 1, pp. 63-84, Jan. 2000.
3. A. Vinciarelli, "A Survey on Off-Line Cursive Word Recognition," Pattern Recognition, vol. 35, no. 7, pp. 1433-1446, June 2002.
4. U.V. Marti and H. Bunke, "The IAM-Database: An English Sentence Database for Offline Handwriting Recognition," Int'l J. Document Analysis and Recognition, vol. 5, no. 1, pp. 39-46, Jan. 2002.
5. A.W. Senior and A.J. Robinson, "An Off-Line Cursive Handwriting Recognition System," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 309-321, Mar. 1998.
6. M. Zimmermann and H. Bunke, "Automatic Segmentation of the IAM Off-Line Database for Handwritten English Text," Proc. 16th Int'l Conf. Pattern Recognition, vol. IV, pp. 35-39, 2002.
7. R. Rosenfeld, "Two Decades of Statistical Language Modeling: Where Do We Go from Here?" Proc. IEEE, vol. 88, no. 8, pp. 1270-1278, Aug. 2000.
8. F. Jelinek, Statistical Aspects of Speech Recognition. MIT Press 1998.
9. G. Kim, V. Govindaraju, and S.N. Srihari, "An Architecture for Handwritten Text Recognition Systems," Pattern Recognition, vol. 2, pp. 37-44, 1999.
10. U.V. Marti and H. Bunke, "Using a Statistical Language Model to Improve the Performance of an HMM-Based Cursive Handwriting Recognition System," Int'l J. Pattern Recognition and Artificial Intelligence, vol. 15, no. 1, pp. 65-90, 2001.
11. A. Vinciarelli, S. Bengio, and H. Bunke, "Offline Recognition of Large Vocabulary Cursive Handwritten Text," Proc. Int'l Conf. Document Analysis and Recognition, 2003.
12. T. Paquet and Y. Lecourtier, "Recognition of Handwritten Sentences Using a Restricted Lexicon," Pattern Recognition, vol. 26, no. 3, pp. 391-407, Mar. 1993.
13. D. Guillevic and C.Y. Suen, "Recognition of Legal Amounts on Bank Cheques," Pattern Analysis and Applications, vol. 1, no. 1, 1998.
14. E. Cohen, J.J. Hull, and S.N. Srihari, "Control Structure for Interpreting Handwritten Addresses," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 10, pp. 1049-1055, Oct. 1994.
15. J. Park and V. Govindaraju, "Use of Adaptive Segmentation in Handwritten Phrase Recognition," Pattern Recognition, vol. 35, pp. 245-252, 2002.
16. G. Kim and V. Govindaraju, "Handwritten Phrase Recognition as Applied to Street Name Images," Pattern Recognition, vol. 31, no. 1, pp. 41-51, Jan. 1998.
17. M. El Yacoubi, M. Gilloux, and J.M. Bertille, "A Statistical Approach for Phrase Location and Recognition within a Text Line: An Application to Street Name Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 2, pp. 172-188, Feb. 2002.
18. A. El Yacoubi, J.M. Bertille, and M. Gilloux, "Conjoined Location of Street Names within a Postal Address Delivery Line," Proc. Int'l Conf. Document Analysis and Recognition, vol. 2, pp. 1024-1027, 1995.
19. G. Kim, V. Govindaraju, and S.N. Srihari, "An Architecture for Handwritten Text Recognition Systems," Int'l J. Document Analysis and Recognition, vol. 2, pp. 37-44, 1999.
20. R.K. Srihari and C.M. Baltus, "Incorporating Syntactic Constraints in Recognizing Handwritten Sentences," Proc. Int'l Joint Conf. Artificial Intelligence, pp. 1262-1267, 1993.
21. R.K. Srihari, "Use of Lexical and Syntactic Techniques in Recognizing Handwritten Text," Proc. ARPA Workshop Human Language Technology, pp. 403-407, 1994.
22. F. Jelinek, "Self-Organized Language Modeling of Speech Recognition," Readings in Speech Recognition, A. Waibel and L. Kai-Fu, eds., pp. 450-506, Palo Alto, Calif.: Morgan Kaufmann, 1989.
23. A.J. Viterbi, "Error Bounds for Convolutional Codes and an Asymptotically Optimal Decoding Algorithm," IEEE Trans. Information Theory, vol. 13, pp. 260-269, 1967.
24. S. Chen and R. Rosenfeld, "A Survey of Smoothing Techniques for ME Models," IEEE Trans. Speech and Audio Processing, vol. 8, no. 1, pp. 37-50, Jan. 2000.
25. S.M. Katz, "Estimation of Probabilities from Sparse Data for the Language Model Component of a Speech Recognizer," IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 35, no. 3, pp. 400-401, 1987.
26. R. Rosenfeld, "A Maximum Entropy Approach to Adaptive Statistical Language Modeling," Computer Speech and Language, vol. 10, pp. 187-228, 1996.
27. D. Klakow and J. Peters, "Testing the Correlation of Word Error Rate and Perplexity," Speech Comm., vol. 38, pp. 19-28, 2002.
28. A. Vinciarelli and J. Luttin, "Off-Line Cursive Script Recognition Based on Continuous Density HMM," Proc. Seventh Int'l Workshop Frontiers in Handwriting Recognition, pp. 493-498, 2000.
29. A. Vinciarelli and S. Bengio, "Offline Cursive Word Recognition Using Continuous Density Hmms Trained with PCA or ICA Features," Proc. 16th Int'l Conf. Pattern Recognition, pp. 493-498, 2002.
30. A. Vinciarelli and J. Luttin, "A New Normalization Technique for Cursive Handwritten Words," Pattern Recognition Letters, vol. 22, no. 9, pp. 1043-1050, 2001.
31. L. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Readings in Speech Recognition, A. Waibel and L. Kai-Fu, eds., pp. 267-296, Palo Alto, Calif: Morgan Kaufmann, 1989.
32. L.E. Baum and T. Petrie, "Statistical Inference for Probabilistic Functions of Finite State Markov Chains," Annals of Math. Statistics, vol. 37, pp. 1554-1563, 1966.
33. L.E. Baum, T. Petrie, G. Soules, and N. Weiss, "A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains," Annals of Math. Statistics, vol. 41, no. 1, pp. 164-171, 1970.
34. L. E. Baum, "An Inequality and Associated Maximization Technique in Statistical Estimation for Probabilistic Functions of Markov Processes," Inequalities, vol. 3, pp. 1-8, 1972.
35. R. Bellman, Adaptive Control Processes: A Guided Tour. Princeton Univ. Press, 1991.
36. F. Sebastiani, "Machine Learning in Automated Text Categorization," ACM Computing Surveys, vol. 34, no. 1, pp. 1-47, 2002.
37. D. Graff, C. Cieri, S. Strassel, and N. Martey, "The TDT-3 Text and Speech Corpus," Proc. Topic Detection and Tracking Workshop, 2000.