Combining diverse on-line and off-line systems for handwritten text line recognition

Pattern Recognition

Volumn 42, Issue 12, 2009, Pages 3254-3263

  Liwicki, Marcus ^a,b   Bunke, Horst ^b  

^a GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

^b UNIVERSITY OF BERN   (Switzerland)

Author keywords

Bidirectional long short term memory networks; Hidden Markov models; Multiple classifier combination; Off line handwriting recognition; On line handwriting recognition

Indexed keywords

BIDIRECTIONAL LONG SHORT-TERM MEMORY NETWORKS; CLASSIFICATION SYSTEM; FEATURE SETS; FINAL DECISION; HANDWRITING RECOGNITION; HANDWRITTEN TEXT LINE RECOGNITION; INDIVIDUAL CLASSIFIERS; LINE FEATURES; MICROSOFT; MULTIPLE CLASSIFIER COMBINATION; MULTIPLE CLASSIFIER SYSTEMS; OFF-LINE HANDWRITING RECOGNITION; OFFLINE SYSTEMS; ON-LINE HANDWRITING RECOGNITION; RECOGNITION RATES; RECOGNITION SYSTEMS; RECOGNIZER OUTPUT VOTING ERROR REDUCTIONS; SHORT TERM MEMORY; VOTING STRATEGIES;

ARCHITECTURAL DESIGN; BRAIN; CLASSIFIERS; COMBINES; COMPUTATIONAL GRAMMARS; FEEDFORWARD NEURAL NETWORKS; LEARNING SYSTEMS; OBJECT RECOGNITION;

HIDDEN MARKOV MODELS;

EID: 68249115834     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.10.030     Document Type: Article

References (63)

1. Plamondon R., and Srihari S.N. On-line and off-line handwriting recognition: a comprehensive survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 1 (2000) 63-84
2. Vinciarelli A. A survey on off-line cursive script recognition. Pattern Recognition 35 7 (2002) 1433-1446
3. Bunke H. Recognition of cursive Roman handwriting-past, present and future. Proceedings of the 7th International Conference on Document Analysis and Recognition vol. 1 (2003) 448-459
4. Seiler R., Schenkel M., and Eggimann F. Off-line cursive handwriting recognition compared with on-line recognition. ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) vol. IV-vol. 7472 (1996), IEEE Computer Society, Washington, DC, USA 505
5. Tappert C.C., Suen C.Y., and Wakahara T. The state of the art in online handwriting recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 12 8 (1990) 787-808
6. Steinherz T., Rivlin E., and Intrator N. Offline cursive script word recognition-a survey. International Journal on Document Analysis and Recognition 2 2-3 (1999) 90-110
7. C.Y. Suen, K. Kim, Q. Xu, J. Kim, L. Lam, Handwriting recognition-the last frontiers, in: Proceedings of the 15th International Conference on Pattern Recognition, vol. 4, 2000, pp. 4001-4010.
8. Wilfong G., Sinden F., and Ruedisueli L. On-line recognition of handwritten symbols. IEEE Transactions on Pattern Analysis and Machine Intelligence 18 9 (1996) 935-940
9. Hu J., Lim S.G., and Brown M.K. Writer independent on-line handwriting recognition using an HMM approach. Pattern Recognition 33 1 (2000) 133-147
10. Bahlmann C., and Burkhardt H. The writer independent online handwriting recognition system frog on hand and cluster generative statistical dynamic time warping. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 3 (2004) 299-310
11. C. Bahlmann, B. Haasdonk, H. Burkhardt, Online handwriting recognition with support vector machines-a kernel approach, in: Proceedings of the 8th International Workshop on Frontiers in Handwriting Recognition, 2002, pp. 49-54.
12. Sayre K.M. Machine recognition of handwritten words: a project report. Pattern Recognition 5 3 (1973) 213-228
13. Schomaker L. Using stroke- or character-based self-organizing maps in the recognition of on-line, connected cursive script. Pattern Recognition 26 3 (1993) 443-450
14. Kavallieratou E., Fakotakis N., and Kokkinakis G. An unconstrained handwriting recognition system. International Journal on Document Analysis and Recognition 4 4 (2002) 226-242
15. L.R. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, in: Proceedings of the IEEE, vol. 77(2), 1989, pp. 257-286.
16. S. Bercu, G. Lorette, On-line handwritten word recognition: an approach based on hidden Markov models, in: Proceedings of the 3rd International Workshop on Frontiers in Handwriting Recognition, 1993, pp. 385-390.
17. T. Starner, J. Makhoul, R. Schwartz, G. Chou, Online cursive handwriting recognition using speech recognition techniques, in: International Conference on Acoustics, Speech and Signal Processing, vol. 5, 1994, pp. 125-128.
18. Hu J.Y., Brown M.K., and Turin W. HMM based online handwriting recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 18 10 (1996) 1039-1045
19. Liwicki M., and Bunke H. Handwriting recognition of whiteboard notes-studying the influence of training set size and type. International Journal of Pattern Recognition and Artificial Intelligence 21 1 (2007) 83-98
20. Haykin S. Neural Networks: A Comprehensive Foundation (1994), Prentice-Hall PTR, Englewood Cliffs, NJ
21. Bourbakis N.G. Handwriting recognition using a reduced character method and neural nets. Proceedings of SPIE Nonlinear Image Processing VI vol. 2424 (1995) 592-601
22. A. Brakensiek, A. Kosmala, D. Willett, W. Wang, G. Rigoll, Performance evaluation of a new hybrid modeling technique for handwriting recognition using identical on-line and off-line data, in: Proceedings of the 5th International Conference on Document Analysis and Recognition, Bangalore, India, 1999, pp. 446-449.
23. Marukatat S., Artières T., Dorizzi B., and Gallinari P. Sentence recognition through hybrid neuro-Markovian modelling. Proceedings of the 6th International Conference on Document Analysis and Recognition (2001) 731-735
24. Schenkel M., Guyon I., and Henderson D. On-line cursive script recognition using time delay neural networks and hidden Markov models. Machine Vision and Applications 8 (1995) 215-223
25. Jäger S., Manke S., Reichert J., and Waibel A. Online handwriting recognition: the NPen++ recognizer. International Journal on Document Analysis and Recognition 3 3 (2001) 169-180
26. Caillault E., Viard-Gaudin C., and Ahmad A.R. MS-TDNN with global discriminant trainings. Proceedings of the 8th International Conference on Document Analysis and Recognition (2005) 856-861
27. A.W. Senior, F. Fallside, An off-line cursive script recognition system using recurrent error propagation networks, in: International Workshop on Frontiers in Handwriting Recognition, Buffalo, NY, USA, 1993, pp. 132-141.
28. Senior A.W., and Robinson A.J. An off-line cursive handwriting recognition system. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 3 (1998) 309-321
29. J. Schenk, G. Rigoll, Novel hybrid NN/HMM modelling techniques for on-line handwriting recognition, in: Proceedings of the 10th International Workshop on Frontiers in Handwriting Recognition, 2006, pp. 619-623.
30. Johnson M.T. Capacity and complexity of HMM duration modeling techniques. IEEE Signal Processing Letters 12 5 (2005) 407-410
31. Graves A., Fernández S., Gomez F., and Schmidhuber J. Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks. Proceedings of the International Conference on Machine Learning (2006) 369-376
32. Graves A., and Schmidhuber J. Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Networks 18 5-6 (2005) 602-610
33. Liwicki M., Graves A., Bunke H., and Schmidhuber J. A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks. Proceedings of the 9th International Conference on Document Analysis and Recognition vol. 1 (2007) 367-371
34. Kuncheva L.I. Combining Pattern Classifiers: Methods and Algorithms (2004), Wiley, New York
35. Huang Y.S., and Suen C.Y. A method of combining multiple experts for the recognition of unconstrained handwritten numerals. IEEE Transactions on Pattern Analysis and Machine Intelligence 17 1 (1995) 90-94
36. Vinciarelli A., and Perrone M. Combining online and offline handwriting recognition. Proceedings of the 7th International Conference on Document Analysis and Recognition (2003) 844-848
37. Ye X., Cheriet M., and Suen C.Y. StrCombo: combination of string recognizers. Pattern Recognition Letters 23 (2002) 381-394
38. M.C.F.K. Sirlantzis, M.S. Hoque, Genetic algorithms for multi-classifier system configuration: a case study in character recognition, in: Proceedings of the 2nd Workshop on Multiple Classifier Systems, 2001, pp. 99-108.
39. Günter S., and Bunke H. Multiple classifier systems in off-line handwritten word recognition on the influence of training set and vocabulary size. International Journal of Pattern Recognition and Artificial Intelligence 18 (2004) 1303-1320
40. J. Fiscus, A post-processing system to yield reduced word error rates: recognizer output voting error reduction ROVER, in: IEEE Workshop on Automatic Speech Recognition and Understanding, 1997, pp. 347-352.
41. Bertolami R., and Bunke H. Multiple handwritten text recognition systems derived from specific integration of a language model. Proceedings of the 8th International Conference on Document Analysis and Recognition (2005) 521-524
42. O. Velek, S. Jäger, M. Nakagawa, Accumulated-recognition-rate normalization for combining multiple on/off-line Japanese character classifiers tested on a large database, in: Proceedings of the 4th Workshop on Multiple Classifier Systems, 2003, pp. 196-205.
43. Liwicki M., and Bunke H. Combining on-line and off-line systems for handwriting recognition. Proceedings of the 9th International Conference on Document Analysis and Recognition vol. 1 (2007) 372-376
44. Pittman J.A. Handwriting recognition: Tablet PC text input. Computer 40 9 (2007) 49-54
45. Knerr S., Anisimov V., Baret O., Gorsky N., Price D., and Simon J. The A2iA INTERCHEQUE system: courtesy amount and legal amount recognition for French checks. International Journal of Pattern Recognition and Artificial Intelligence 11 4 (1997) 505-548
46. S. Knerr, E. Augustin, A neural network-hidden Markov model hybrid for cursive word recognition, in: International Conference on Pattern Recognition, vol. 2, 1998, pp. 1518-1520.
47. M. Liwicki, H. Bunke, Combining on-line and off-line bidirectional long short-term memory networks for handwritten text line recognition, in: Proceedings of the 11th International Conference on Frontiers in Handwriting Recognition, 2008, pp. 31-36.
48. Dempster A.P., Laird N.M., and Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. Journal of Royal Statistical Society 39 1 (1977) 1-38
49. G.D. Forney, The Viterbi algorithm, in: Proceedings of the IEEE, vol. 61, 1973, pp. 268-278.
50. Günter S., and Bunke H. HMM-based handwritten word recognition: on the optimization of the number of states, training iterations and Gaussian components. Pattern Recognition 37 (2004) 2069-2079
51. Rojas R. Neural Networks-A Systematic Introduction (1996), Springer, Berlin
52. Fernández S., Graves A., and Schmidhuber J. Sequence labelling in structured domains with hierarchical recurrent neural networks. Proceedings of the 20th International Joint Conference on Artificial Intelligence (2007) 774-779
53. Schuster M., and Paliwal K.K. Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing 45 (1997) 2673-2681
54. Wang L., and Jiang T. On the complexity of multiple sequence alignment. Journal of Computational Biology 1 4 (1994) 337-348
55. Wagner R., and Fischer M. The string-to-string correction problem. Journal of the ACM 21 (1974) 168-173
56. Liwicki M., and Bunke H. IAM-OnDB-an on-line English sentence database acquired from handwritten text on a whiteboard. Proceedings of the 8th International Conference on Document Analysis and Recognition vol. 2 (2005) 956-961
57. E. Bauer, R. Kohavi, An empirical comparison of voting classification algorithms: bagging, boosting, and variants, Machine Learning 36 (1-2) (1999).
58. Ho T.K. The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 (1998) 832-844
59. Bertolami R., Zimmermann M., and Bunke H. Rejection strategies for offline handwritten text line recognition. Pattern Recognition Letters 27 16 (2006) 2005-2012
60. Gorski N. Optimizing error-reject trade off in recognition systems. Proceedings of the 4th International Conference on Document Analysis and Recognition vol. 2 (1997) 1092-1096
61. Pitrelli J., and Perrone M.P. Confidence-scoring post-processing for off-line handwritten-character recognition verification. Proceedings of the 7th International Conference on Document Analysis and Recognition vol. 1 (2003) 278-282
62. U.-V. Marti, H. Bunke, Using a statistical language model to improve the performance of an HMM-based cursive handwriting recognition system, in: Int. J. Pattern Recognition Artif. Intell. 21 (2001) 65-90.
63. J. Schenk, S. Schwrzler, G. Rigoll, Discrete single vs. multiple stream HMMs: a comparative evaluation of their use in on-line handwriting recognition of whiteboard notes, in: Proceedings of the 11th International Conference on Frontiers in Handwriting Recognition, 2008, pp. 550-555.