High-performance OCR for printed english and fraktur using lstm networks

Proceedings of the International Conference on Document Analysis and Recognition, ICDAR

Volumn , Issue , 2013, Pages 683-687

  Breuel, Thomas M ^a   Ul Hasan, Adnan ^a   Al Azawi, Mayce Ali ^a   Shafait, Faisal ^b  

^a University of Koblenz Landau   (Germany)

^b UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

LSTM Networks; OCR; RNN

Indexed keywords

HAND-WRITTEN CHARACTERS; HANDWRITING RECOGNITION; LONG SHORT-TERM MEMORY; POST-PROCESSING TECHNIQUES; RECOGNITION ACCURACY; RNN; STATISTICAL PROPERTIES; TRAINING AND TESTING;

ALGORITHMS; OPTICAL CHARACTER RECOGNITION; STATISTICAL TESTS;

CHARACTER RECOGNITION;

EID: 84889596137     PISSN: 15205363     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDAR.2013.140     Document Type: Conference Paper

References (24)

1. T. M. Breuel, "The OCRopus open source OCR system," in DRR XV, vol. 6815, Jan. 2008, p. 68150F.
2. R. Smith, "History of the Tesseract OCR engine: what worked and what didn't," in DRR XX, San Francisco, USA, Feb. 2013.
3. L. R. Rabiner, "A tutorial on Hidden Markov Models and selected applications in speech recognition," Proc. of the IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
4. Z. Lu, R. M. Schwartz, P. Natarajan, I. Bazzi, and J. Makhoul, "Advances in the BBN BYBLOS OCR System. " in ICDAR. IEEE Computer Society, 1999, pp. 337-340.
5. S. Espana-Boquera, M. J. Castro-Bleda, J. Gorbe-Moya, and F. Zamora-Martinez, "Improving Offline Handwritten Text Recognition with Hybrid HMM/ANN Models," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 33, no. 4, pp. 767-779, Apr. 2011.
6. Y. Bengio, Y. Lecun, C. Nohl, and C. Burges, "LeRec: A NN/HMM hybrid for on-line handwriting recognition," Neural Computation, vol. 7, no. 6, pp. 1289-1303, Nov. 1995.
7. Y. Bengio, Y. LeCun, and D. Henderson, "Globally Trained Handwritten Word Recognizer Using Spatial Representation, Convolutional Neural Networks, and Hidden Markov Models. " in NIPS, J. D. Cowan, G. Tesauro, and J. Alspector, Eds. Morgan Kaufmann, 1993, pp. 937-944.
8. A. W. Senior, "Off-line Cursive Handwriting Recognition using Recurrent Neural Networks," Ph. D. dissertation, England, 1994.
9. S. Hochreiter and J. Schmidhuber, "Long Short-Term Memory," Nueral Computation, vol. 9, no. 8, pp. 1735-1780, 1997.
10. A. Graves, M. Liwicki, S. Fernandez, Bertolami, H. Bunke, and J. Schmidhuber, "A Novel Connectionist System for Unconstrained Handwriting Recognition," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 31, no. 5, pp. 855-868, May 2008.
11. J. L. Elman, "Finding Structure in Time. " Cognitive Science, vol. 14, no. 2, pp. 179-211, 1990.
12. W. Maass, T. Natschlager, and H. Markram, "Real-time computing without stable states: a new framework for neural computation based on perturbations. " Neural Computation, vol. 14, no. 11, pp. 2531-2560, Nov. 2002.
13. H. Jaeger, "Tutorial on Training Recurrent Neural Networks, Covering BPTT, RTRL, EKF and the 'Echo State Network' approach," Sankt Augustin, Tech. Rep., 2002.
14. S. Hochreiter, Y. Bengio, P. Frasconi, and J. Schmidhuber, "Gradient flow in recurrent nets: the difficulty of learning long-term dependencies," in A Field Guide to Dynammical Recurrent Neural Netwoks, S. C. Kremer and J. F. Kolen, Eds. IEEE Press, 2001.
15. Y. Bengio, P. Smirard, and P. Frasconi, "Learning long-term dependencies with gradient descent is difficult," IEEE Trans. on Neural Networks, vol. 5, no. 2, pp. 157-166, Mar. 1994.
16. A. Graves, S. Fernandez, F. Gomes, and J. Schmidhuber, "Connectionist Temporal Classification: Labeling Unsegemented Sequence Data with Recurrent Nerual Networks," in ICML, Pennsylvania, USA, 2006, pp. 369-376.
17. S. F. Rashid, F. Shafait, and T. M. Breuel, "Scanning Nerual Network for Text Line Recognition," in DAS, Gold Coast, Australia, Mar. 2012.
18. A. Graves, "Offline Arabic Handwriting Recognition with Multidimensional Recurrent Neural Networks. " Springer, 2012, pp. 297-313.
19. "RNNLIB: A recurrent neural network library for sequence learning problems. " [Online]. Available: http://sourceforge. net/projects/ rnnl
20. I. T. Phillips., "User's reference manual for the UW English/Technical Document Image Database III," Seattel University, Washington, USA, Tech. Rep., 1996.
21. R. Smith, "An Overview of the Tesseract OCR Engine," in ICDAR, 2007, pp. 629-633.
22. "ABBYY. " [Online]. Available: http://www. abbyy. com/recognition server
23. G. E. Kopec and P. A. Chou, "Document Image Decoding Using Markov Source Models. " IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 16, no. 6, pp. 602-617, 1994.
24. "OCRopus-Open Source Document Analysis and OCR system. " [Online]. Available: https://code. google. com/p/ocropus