Word spotting and recognition with embedded attributes

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 12, 2014, Pages 2552-2566

  Almazan, Jon ^a   Gordo, Albert ^b   Fornes, Alicia ^a   Valveny, Ernest ^a  

^a UNIVERSITAT AUTÒNOMA DE BARCELONA   (Spain)

^b Xerox Research Center Europe   (France)

Author keywords

[No Author keywords available]

Indexed keywords

WORD SPOTTING;

ALGORITHM; AUTOMATED PATTERN RECOGNITION; FACTUAL DATABASE; HANDWRITING; HUMAN; IMAGE PROCESSING; MACHINE LEARNING; PROCEDURES;

ALGORITHMS; DATABASES, FACTUAL; HANDWRITING; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MACHINE LEARNING; PATTERN RECOGNITION, AUTOMATED;

EID: 84908681000     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2339814     Document Type: Article

References (59)

1. J. Almazán, A. Gordo, A. Fornés, and E. Valveny, "Handwritten word spotting with corrected attributes," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 1017-1024.
2. R. Manmatha and J. Rothfeder, "A scale space approach for automatically segmenting words from historical handwritten documents," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1212-1225, Aug. 2005.
3. L. Neumann and J. Matas, "Real-time scene text localization and recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3538-3545.
4. L. Neumann and J. Matas, "Scene text localization and recognition with oriented stroke detection," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 97-104.
5. A. Bissacco, M. Cummins, Y. Netzer, and H. Neven, "PhotoOCR: Reading text in uncontrolled conditions," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 785-792.
6. A. Fischer, A. Keller, V. Frinken, and H. Bunke, "HMM-based word spotting in handwritten documents using subword models," in Proc. 20th Int. Conf. Pattern Recog., 2010, pp. 3416-3419.
7. V. Frinken, A. Fischer, R. Manmatha, and H. Bunke, "A novel word spotting method based on recurrent neural networks," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 2, pp. 211-224, Feb. 2012.
8. R. Manmatha, C. Han, and E. M. Riseman, "Word spotting: A new approach to indexing handwriting," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 1996, pp. 631-637.
9. T. Rath, R. Manmatha, and V. Lavrenko, "A search engine for historical manuscript images," in Proc. 27th Annu. Int. ACM SIGIR Conf. Res. Develop. Inform. Retrieval, 2004, pp. 369-376.
10. T. Rath and R. Manmatha, "Word spotting for historical documents," Int. J. Document Anal. Recog., vol. 9, pp. 139-152, 2007.
11. J. A. Rodríguez-Serrano and F. Perronnin, "Local gradient histogram features for word spotting in unconstrained handwritten documents," presented at the Int. Conf. Frontiers Handwriting Recognition, Montreal, QC, Canada, 2008.
12. J. A. Rodríguez-Serrano and F. Perronnin, "A model-based sequence similarity with application to handwritten wordspotting," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2108-2120, Nov. 2012.
13. S. España-Bosquera, M. Castro-Bleda, J. Gorbe-Moya, and F. Zamora-Martinez, "Improving offline handwritten text recognition with hybrid HMM/ANN models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 4, pp. 767-779, Apr. 2011.
14. I. Yalniz and R. Manmatha, "An efficient framework for searching text in noisy documents," in Proc. 10th IAPR Int. Workshop Document Anal. Syst., 2012, pp. 48-52.
15. K. Wang, B. Babenko, and S. Belongie, "End-to-end scene text recognition," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 1457-1464.
16. A. Mishra, K. Alahari, and C. V. Jawahar, "Top-down and bottomup cues for scene text recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2687-2694.
17. J. A. Rodríguez-Serrano and F. Perronnin, "Label embedding for text recognition," in Proc. Brit. Mach. Vis. Conf., 2013, pp. 5.1-5.12.
18. C. Leslie, E. Eskin, and W. Noble, "The spectrum kernel: A string kernel for SVM protein classification," in Pacific Symp. Biocomput., 2002, pp. 564-575.
19. H. Lodhi, C. Saunders, J. Shawe-Taylor, N. Cristianini, and C. Watkins, "Text classification using string kernels," J. Mach. Learn. Res., vol. 2, pp. 419-444, 2002.
20. H. Jégou, M. Douze, and C. Schmid, "Product quantization for nearest neighbor search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 117-128, Jan. 2011.
21. S. Lu, L. Li, and C. L. Tan, "Document image retrieval through word shape coding," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 19313-1918, Nov. 2008.
22. P. Keaton, H. Greenspan, and R. Goodman, "Keyword spotting for cursive document retrieval," in Proc. Workshop Document Image Anal., 1997, pp. 74-81.
23. F. Perronnin and J. A. Rodríguez-Serrano, "Fisher kernels for handwritten word-spotting," in Proc. 10th Int. Conf. Document Anal. Recog., 2009, pp. 106-110.
24. T. Jaakkola and D. Haussler, "Exploiting generative models in discriminative classifiers," in Proc. Conf. Adv. Neural Inform. Process. Syst., 1999, pp. 487-493.
25. B. Gatos and I. Pratikakis, "Segmentation-free word spotting in historical printed documents," in Proc. 10th Int. Conf. Data Anal. Recog., 2009, pp. 271-275.
26. M. Rusiñol, D. Aldavert, R. Toledo, and J. Lladós, "Browsing heterogeneous document collections by a segmentation-free word spotting method," in Proc. Int. Conf. Data Anal. Recog., 2011, pp. 63-67.
27. J. Almazán, A. Gordo, A. Fornés, and E. Valveny, "Efficient exemplar word spotting," in Proc. Brit. Mach. Vis. Conf., 2012, pp. 67.1-67.11.
28. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2005, pp. 886-893.
29. T. Malisiewicz, A. Gupta, and A. Efros, "Ensemble of exemplar-SVMs for object detection and beyond," in Proc. Int. Conf. Comput. Vis., 2011, pp. 89-96.
30. A. Mishra, K. Alahari, and C. V. Jawahar, "Scene text recognition using higher order language priors," in Proc. Brit. Mach. Vis. Conf., 2012, pp. 127.1-127.11.
31. A. Mishra, K. Alahari, and C. V. Jawahar, "Image retrieval using textual Cues," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 3040-3047.
32. V. Goel, A. Mishra, K. Alahari, and C. V. Jawahar, "Whole is greater than sum of parts: Recognizing scene text words," in Proc. 12th Int. Conf. Document Anal. Recog., 2013, pp. 398-402.
33. C. H. Lampert, H. Nickisch, and S. Harmeling, "Learning to detect unseen object classes by between-class attribute transfer," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 951-958.
34. A. Farhadi, I. Endres, D. Hoiem, and D. Forsyth, "Describing objects by their attributes," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 1778-1785.
35. M. Rohrbach, M. Stark, and B. Schiele, "Evaluating knowledge transfer and zero-shot learning in a large-scale setting," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 1641-1648.
36. C. Wah and S. Belongie, "Attribute-based detection of unfamiliar classes with humans in the loop," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 779-786.
37. A. Fischer, A. Keller, V. Frinken, and H. Bunke, "Lexicon-free handwritten word spotting using character HMMs," Pattern Recog. Lett., vol. 33, pp. 934-942, 2012.
38. S. Bengio, J. Weston, and D. Grangier, "Label embedding trees for lagre multi-class tasks," in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 163-171.
39. Z. Akata, F. Perronnin, Z. Harchaoui, and C. Schmid, "Labelembedding for attribute-based classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 819-826.
40. F. Perronnin, J. Sánchez, and T. Mensink, "Improving the Fisher kernel for large-scale image classification," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 143-156.
41. B. Siddiquie, R. S. Feris, and L. S. Davis, "Image ranking and retrieval based on multi-attribute queries," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 801-808.
42. L. Torresani, M. Szummer, and A. Fitzgibbon, "Efficient object category recognition using classemes," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 776-789.
43. K. Chatfield, V. Lempitsky, A. Vedaldi, and A. Zisserman, "The devil is in the details: An evaluation of recent feature encoding methods," in Proc. Brit. Mach. Vis. Conf., 2011, pp. 76.1-76.12.
44. G. Csurka, C. R. Dance, L. Fan, J. Willamowski, and C. Bray, "Visual categorization with bags of keypoints," in Proc. Workshop Statist. Learn. Comput. Vis., 2004, pp. 1-2.
45. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2006, pp. 2169-2178.
46. J. Sánchez, F. Perronnin, and T. de Campos, "Modeling the spatial layout of images beyond spatial pyramids," Pattern Recog. Lett., vol. 33, pp. 2216-2223, 2012.
47. W. J. Scheirer, N. Kumar, P. N. Belhumeur, and T. E. Boult, "Multi-attribute spaces: Calibration for attribute fusion and similarity search," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 2933-2940.
48. H. Hotelling, "Relations between two sets of variants," Biometrika, vol. 28, pp. 321-377, 1936.
49. D. Hardoon, S. Szedmak, and J. Shawe-Taylor, "Canonical Correlation Analysis: An Overview with Application to Learning Methods," Neural Comput., vol. 16, no. 12, pp. 2639-2664, 2004.
50. M. B. Blaschko and C. H. Lampert, "Correlational spectral clustering," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
51. Y. Gong, S. Lazebnik, A. Gordo, and F. Perronnin, "Iterative quantization: A procrustean approach to learning binary codes for large-scale image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 12, pp. 2916-2929, Dec. 2013.
52. J. Weston, S. Bengio, and N. Usunier, "Large scale image annotation: learning to rank with joint word-image embeddings," in Proc. Eur. Conf. Mach. Learn., vol. 81, no. 1, pp. 21-25, 2010.
53. A. Rahimi and B. Recht, "Randomm features for large-scale kernel machines," presented at the 21st Annu. Conf. Adv. Neural Information Processing Systems, Vancouver, BC, Canada, 2007.
54. U.-V. Marti and H. Bunke, "The IAM-database: An English sentence database for off-line handwriting recognition," Int. J. Document Anal. Recog., vol. 5, pp. 39-46, 2002.
55. D. Aldavert, M. Rusiñol, R. Toledo, and J. Lladós, "Integrating visual and textual cues for query-by-string word spotting," in Proc. 12th Int. Conf. Document Anal. Recog., 2013, pp. 511-515.
56. J. Sánchez, F. Perronnin, T. Mensink, and J. Verbeek, "Image classification with the Fisher vector: Theory and practice," Int. J. Comput. Vis., vol. 105, pp. 222-245, 2013.
57. H. Jégou and O. Chum, "Negative evidences and co-occurrences in image retrieval: The benefit of PCA and whitening," in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 774-787.
58. A. Vinciarelli and S. Bengio, "Offline cursive word recognition using continuous density hidden Markov models trained with PCA or ICA features," in Proc. 16th Int. Conf. Pattern Recog., 2002, pp. 81-84.
59. T. de Campos, B. Babu, and M. Varma, "Character recognition in natural images," in Proc. Conf. Comput. Vis. Theory Appl., 2009, pp. 273-280.