Unsupervised writer adaptation of whole-word HMMs with application to word-spotting

Pattern Recognition Letters

Volumn 31, Issue 8, 2010, Pages 742-749

  Rodríguez Serrano, José A ^a,b   Perronnin, Florent ^a   Sánchez, Gemma ^b   Lladós, Josep ^b  

^a XEROX RESEARCH CENTRE EUROPE   (France)

^b UNIVERSITAT AUTÒNOMA DE BARCELONA   (Spain)

Author keywords

Document analysis; Handwriting recognition; Hidden Markov model; Word spotting; Writer adaptation

Indexed keywords

ADAPTATION TECHNIQUES; CODEBOOKS; DOCUMENT ANALYSIS; HANDWRITING RECOGNITION; HANDWRITTEN WORDS; SEMI-CONTINUOUS; WORD MODELS;

FEEDFORWARD NEURAL NETWORKS; HIDDEN MARKOV MODELS;

CHARACTER RECOGNITION;

EID: 77950301011     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2010.01.007     Document Type: Article

References (42)

1. Adamek T., Connor N.E., and Smeaton A.F. Word matching using single closed contours for indexing handwritten historical documents. Internat. J. Doc. Anal. Recognition 9 2 (2007) 153-165
2. Anastasakos, T., McDonough, J., Schwartz, R., Makhoul, J., 1996. A compact model for speaker-adaptive training. In: Internat. Conf. on Spoken Language Processing, vol. 2. pp. 1137-1140.
3. Ball, G., Srihari, S.R., 2008. Writer adaptation in off-line Arabic handwriting recognition. In: Document Recognition and Retrieval XV.
4. Brakensiek A., Kosmala A., and Rigoll G. Proc. 23rd DAGM Symposium on, Pattern Recognition, Munich, Germany, September 12-14 (2001), Springer, Berlin, Heidelberg 32 (Writer Adaptation for Online Handwriting Recognition)
5. Chan, J., Ziftci, C., Forsyth, D., 2006. Searching off-line Arabic documents. In: Proc. 2006 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 1455-1462.
6. Chen, F.R., Wilcox, L.D., Bloomberg, D.S., 1993. Word spotting in scanned images using hidden Markov models. In: IEEE Conf. on Audio, Speech and Signal Processing, vol. 5. pp. 1-40.5.
7. Cho B.-J., and Kim J.H. Print keyword spotting with dynamically synthesized pseudo 2d HMMs. Pattern Recognition Lett. 25 9 (2004) 999-1011
8. Connell S.D., and Jain A.K. Writer adaptation for online handwriting recognition. IEEE Trans. Pattern Anal. Machine Intell. 24 3 (2002) 329-346
9. Edwards, J., Teh, Y.W., Forsyth, D.A., Bock, R., Maire, M., Vesom, G., 2004. Making Latin manuscripts searchable using gHMMs. In: Neural Information Processing Systems.
10. El-Yacoubi A., Sabourin R., Suen C.Y., and Gilloux M. An HMM-based approach for off-line unconstrained handwritten word modeling and recognition. IEEE Trans. Pattern Anal. Machine Intell. 21 8 (1999) 752-760
11. Fink, G.A., Plötz, T., 2006. Unsupervised estimation of writing style models for improved unconstrained off-line handwriting recognition. In: Proc. 10th Internat. Workshop on Frontiers in Handwriting. IEEE, La Baule, France.
12. Gales, M., 1996. The generation and use of regression class trees for mllr adaptation. Tech. Rep. CUED/F-INFENG/TR.263, Cambridge University, Cambridge, UK.
13. Gauvain J.-L., and Lee C.-H. Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains. IEEE Trans. Speech Audio Process. 2 2 (1994) 291-298
14. Huang, X.D., Jack, M.A., 1990. Semi-continuous hidden Markov models for speech signals. In: Readings in Speech Recognition. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, pp. 340-346.
15. Kienzle, W., Chellapilla, K., 2006. Personalized handwriting recognition via biased regularization. In: ICML'06: Proc. 23rd Internat. Conf. on Machine Learning, pp. 457-464.
16. Knerr S., Augustin E., Baret O., and Price D. Hidden Markov model based word recognition and its application to legal amount reading on French checks. Comput. Vision Image Understand. 70 3 (1998) 404-419
17. Knill, K., Young, S., 1994. Speaker dependent keyword spotting for accessing stored speech. Tech. Rep. CUED/F-INFENG/TR 193, Cambridge University Engineering Department.
18. Kolcz A., Alspector J., Augusteijn M., Carlson R., and Popescu G.V. A line-oriented approach to word spotting in handwritten documents. Pattern Anal. Appl. 3 2 (2000) 153-168
19. Kuhn, R., Junqua, J.-C., Nguyen, P., Niedzielski, N., 2000. Rapid speaker adaptation in the eigenvoice space. IEEE Trans. Speech Audio Process. 8.
20. Kuo S.S., and Agazzi O.E. Keyword spotting in poorly printed documents using pseudo 2-D hidden Markov models. IEEE Trans. Pattern Anal. Machine Intell. 16 8 (1994) 842-848
21. Leggetter C., and Woodland P. Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models. Comput. Speech Language 9 (1995) 171-185
22. Liu, Y., Perronnin, F., 2008. A similarity measure between unordered vector sets with application to image categorization. In: IEEE Conf. on Computer Vision and Pattern Recognition.
23. Manmatha, R., Han, C., Riseman, E.M., 1996. Word spotting: A new approach to indexing handwriting. In: Proc. 1996 IEEE Conf. on Computer Vision and Pattern Recognition, p. 631.
24. Martin, A., Doddington, G., Kamm, T., Ordowski, M., Przybocki, M., 1997. The DET curve in assessment of detection task performance. In: Proc. EuroSpeech'97, pp. 1895-1898.
25. Mouchère H., Anquetil E., and Ragot N. Writer style adaptation in online handwriting recognizers by a fuzzy mechanism approach: The adapt method. Internat. J. Pattern Recognition Artif. Intell. 21 1 (2007) 99-116
26. Myers C.S., Rabiner L.R., and Rosenberg A.E. On the use of dynamic time warping for word spotting and connected word recognition. Bell System Technol. J. 60 (1981) 303-325
27. Rath, T.M., Manmatha, R., 2003. Word image matching using dynamic time warping. In: Proc. 2003 IEEE Conf. on Computer Vision and Pattern Recognition, pp. 521-527.
28. Rath T.M., and Manmatha R. Word spotting for historical documents. Int. J. Doc. Anal. Recognition 9 (2007) 139-152
29. Rath, T., Lavrenko, V., Manmatha, R., 2003. A statistical approach to retrieving historical manuscript images. CIIR Technical Report MM-42.
30. Reynolds D.A., Quatieri T.F., and Dunn R.B. Speaker verification using adapted Gaussian mixture models. Digital Signal Process. 10 (2000) 19-41
31. Rodríguez, J.A., Perronnin, F., Sánchez, G., Lladós, J., 2008. Unsupervised writer style adaptation for handwritten word spotting. In: Internat. Conf. on Pattern Recognition.
32. Rodríguez-Serrano J.A., and Perronnin F. Handwritten word-spotting using hidden Markov models and universal vocabularies. Pattern Recognition 42 (2009) 2106-2116
33. Rose, R.C., Paul, D.B., 1990. A hidden Markov model based keyword recognition system. In: Internat. Conf. on Acoustics, Speech, and Signal Processing, pp. 129-132.
34. Saykol E., Sinop A., Gudukbay U., Ulusoy O., and Cetin A. Content-based retrieval of historical ottoman documents stored as textual images. IEEE Trans. Image Process. 13 3 (2004) 314-325
35. Schlapbach A., Liwicki M., and Bunke H. A writer identification system for on-line whiteboard data. Pattern Recognition 41 7 (2008) 2381-2397
36. Sivic J., and Zisserman A. Efficient visual search of videos cast as text retrieval. Pattern Anal. Mach. Intell. IEEE Trans. 31 4 (2009) 591-606
37. Srihari, S.N., Huang, C., Srinivasan, H., 2004. Content-based retrieval of handwritten document images. In: Knowledge Based Computer Systems (KBCS 2004).
38. Srihari, S.N., Huang, C., Srinivasan, H., 2005. A search engine for handwritten documents. In: Document Recognition and Retrieval XIII, pp. 66-75.
39. Terasawa, K., Nagasaki, T., Kawashima, T., 2005. Eigenspace method for text retrieval in historical document images. In: Proc. 8th Internat. Conf. on Document Analysis Recognition, pp. 436-441.
40. Terasawa, K., Tanaka, Y., 2007. Locality sensitive pseudo-code for document images. In: Proc. 9th Internat. Conf. on Document Analysis and Recognition. IEEE Computer Society, Washington, DC, USA, pp. 73-77.
41. Van der Zant T., Schomaker L., and Haak K. Handwritten-word spotting using biologically inspired features. IEEE Trans. Pattern Anal. Machine Intell. 30 (2008) 1945-1957
42. Vinciarelli A., and Bengio S. Writer adaptation techniques in HMM based off-line cursive script recognition. Pattern Recognition Lett. 23 8 (2002) 905-916