End-to-end scene text recognition using tree-structured models

Pattern Recognition

Volumn 47, Issue 9, 2014, Pages 2853-2866

  Shi, Cunzhao ^a   Wang, Chunheng ^a   Xiao, Baihua ^a   Gao, Song ^a   Hu, Jinlong ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

End to end; Normalized pictorial structure; Part based tree structured models (TSMs); Scene text recognition

Indexed keywords

FORESTRY; VOCABULARY CONTROL;

COMPLEX BACKGROUND; END-TO-END; PICTORIAL STRUCTURES; SCENE TEXT; STATE-OF-THE-ART METHODS; STRUCTURE INFORMATION; TREE-STRUCTURED; VISION COMMUNITIES;

CHARACTER RECOGNITION;

FORESTRY; MODELS;

EID: 84900831251     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.03.023     Document Type: Article

References (49)

1. J. Gao, J. Yang, An adaptive algorithm for text detection from natural scenes, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, IEEE, 2001, pp. II-84
2. X. Chen, A. Yuille, Detecting and reading text in natural scenes, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, IEEE, 2004, pp. II-366
3. M. Lyu, J. Song, and M. Cai A comprehensive method for multilingual video text detection, localization, and extraction IEEE Trans. Circuits Syst. Video Technol. 15 2 2005 243 255
4. Q. Ye, Q. Huang, W. Gao, and D. Zhao Fast and robust text detection in images and video frames Image Vis. Comput. 23 6 2005 565 576
5. B. Epshtein, E. Ofek, Y. Wexler, Detecting text in natural scenes with stroke width transform, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2010, pp. 2963-2970
6. L. Neumann, J. Matas, Real-time scene text localization and recognition, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012
7. Y. Pan, X. Hou, and C. Liu A hybrid approach to detect and localize texts in natural scene images IEEE Trans. Image Process. 20 3 2011 800 813
8. C. Yi, and Y. Tian Localizing text in scene images by boundary clustering, stroke segmentation, and string fragment classification IEEE Trans. Image Process. 21 9 2012 4256 4268
9. P. Shivakumara, T. Phan, and C. Tan A Laplacian approach to multi-oriented text detection in video IEEE Trans. Pattern Anal. Mach. Intell. 33 2 2011 412 419
10. K. Wang, S. Belongie, Word spotting in the wild, Computer Vision-ECCV, 2010, pp. 591-604
11. K. Wang, B. Babenko, S. Belongie, End-to-end scene text recognition, in: International Conference on Computer Vision, ICCV, 2011
12. A. Mishra, K. Alahari, C.V. Jawahar, Scene text recognition using higher order langauge priors, in: BMVC, 2012
13. A. Mishra, K. Alahari, C.V. Jawahar, Top-down and bottom-up cues for scene text recognition, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2012
14. T. Novikova, O. Barinova, P. Kohli, V. Lempitsky, Large-lexicon attribute-consistent text recognition in natural images, in: ECCV, Springer, Firenze, Italy, 2012, pp. 752-765
15. X. Chen, J. Yang, J. Zhang, and A. Waibel Automatic detection and recognition of signs from natural scenes IEEE Trans. Image Process. 13 1 2004 87 99
16. T. de Campos, B. Babu, M. Varma, Character recognition in natural images, in: VISAPP, February 2009
17. A. Newell, L. Griffin, Multiscale histogram of oriented gradient descriptors for robust character recognition, in: International Conference on Document Analysis and Recognition (ICDAR), IEEE, 2011, pp. 1085-1089
18. A. Coates, B. Carpenter, C. Case, S. Satheesh, B. Suresh, T. Wang, D. Wu, A. Ng, Text detection and character recognition in scene images with unsupervised feature learning, in: International Conference on Document Analysis and Recognition (ICDAR), IEEE, 2011, pp. 440-445
19. S.M. Lucas, Icdar 2005 text locating competition results, in: Proceedings of Eighth International Conference on Document Analysis and Recognition (ICDAR), IEEE, 2005, pp. 80-84
20. H. Chen, S.S. Tsai, G. Schroth, D.M. Chen, R. Grzeszczuk, B. Girod, Robust text detection in natural images with edge-enhanced maximally stable extremal regions, in: 18th IEEE International Conference on Image Processing (ICIP), IEEE, 2011, pp. 2609-2612
21. Y. Song, A. Liu, L. Pang, S. Lin, Y. Zhang, S. Tang, A novel image text extraction method based on k-means clustering, in: Seventh IEEE/ACIS International Conference on Computer and Information Science (ICIS), IEEE, 2008, pp. 185-190
22. D. Chen, J. Olobez, H. Bourlard, Text segmentation and recognition in complex background based on Markov random field, in: 16th International Conference on Pattern Recognition, vol. 4, IEEE, 2002, pp. 227-230
23. Q. Ye, W. Gao, Q. Huang, Automatic text segmentation from complex background, in: International Conference on Image Processing (ICIP), vol. 5, IEEE, 2004, pp. 2905-2908
24. M. Li, M. Bai, C. Wang, and B. Xiao Conditional random field for text segmentation from images with complex background Pattern Recognit. Lett. 31 14 2010 2295 2308
25. C. Shi, B. Xiao, C. Wang, Y. Zhang, Adaptive graph cut based binarization of video text images, in: 10th IAPR International Workshop on Document Analysis Systems (DAS), 2012, pp. 58-62
26. P. Shivakumara, T. Phan, S. Bhowmick, C. Tan, and U. Pal A novel ring radius transform for video character reconstruction Pattern Recognit. 46 1 2013 131 140
27. J. Feild, E. Learned-Miller, Scene Text Recognition with Bilateral Regression, Technical Report UM-CS-2012-021, University of Massachusetts- Amherst, Computer Science Research Center, University of Massachusetts, Amherst, MA 01003-4601, 2012
28. V. Wu, R. Manmatha, and E.M. Riseman Textfinder: an automatic system to detect and recognize text in images IEEE Trans. Pattern Anal. Mach. Intell. 21 11 1999 1224 1229
29. L. Neumann, J. Matas, A method for text localization and recognition in real-world images, in: ACCV, Springer, Queenstown, New Zealand, 2010, pp. 770-783
30. T. Wang, D.J. Wu, A. Coates, A.Y. Ng, End-to-end text recognition with convolutional neural networks, in: 21st International Conference on Pattern Recognition (ICPR), IEEE, 2012, pp. 3304-3308
31. Y. Yang, D. Ramanan, Articulated pose estimation with flexible mixtures-of-parts, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2011, pp. 1385-1392
32. X. Zhu, D. Ramanan, Face detection, pose estimation, and landmark localization in the wild, in: CVPR, 2012, pp. 2879-2886
33. K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. Van Gool A comparison of affine region detectors Int. J. Comput. Vis. 65 1-2 2005 43 72
34. J. Matas, O. Chum, M. Urban, T. Pajdla, Robust wide baseline stereo from maximally stable extremal regions, in: BMVC, vol. 1, 2002, pp. 384-393
35. C. Shi, C. Wang, B. Xiao, Y. Zhang, and S. Gao Scene text detection using graph model built upon maximally stable extremal regions Pattern Recognit. Lett. 34 2 2013 107 116
36. A. Shahab, F. Shafait, A. Dengel, Icdar 2011 robust reading competition challenge. 2: Reading text in scene images, in: International Conference on Document Analysis and Recognition (ICDAR), IEEE, 2011, pp. 1491-1496
37. L. Breiman Random forests Mach. Learn. 45 1 2001 5 32
38. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 2005, pp. 886-893
39. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan Object detection with discriminatively trained part-based models IEEE Trans. Pattern Anal. Mach. Intell. 32 9 2010 1627 1645
40. C. Shi, C. Wang, B. Xiao, Y. Zhang, S. Gao, Z. Zhong, Scene text recognition using part-based tree-structured character detection, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2013
41. Abbyy finereader 9.0., http://www.abbyy.com
42. S. Lucas, A. Panaretos, L. Sosa, A. Tang, S. Wong, R. Young, ICDAR 2003 robust reading competitions, in: Proceedings of the Seventh International Conference on Document Analysis and Recognition (ICDAR), vol. 2, 2003, pp. 682-687
43. P. Felzenszwalb, and D. Huttenlocher Pictorial structures for object recognition Int. J. Comput. Vis. 61 1 2005 55 79
44. M. Everingham, L. Van Gool, C.K.I. Williams, J. Winn, A. Zisserman, The PASCAL visual object classes challenge 2008 (VOC2008) results, http://www.pascal-network.org/challenges/VOC/voc2008/workshop/index.html
45. M. Everingham, L. Van Gool, C.K.I. Williams, J. Winn, A. Zisserman, The PASCAL visual object classes challenge 2009 (VOC2009) results, http://www.pascal-network.org/challenges/VOC/voc2009/workshop/index.html
46. Q.-F. Wang, F. Yin, and C.-L. Liu Handwritten Chinese text recognition by integrating multiple contexts IEEE Trans. Pattern Anal. Mach. Intell. 34 8 2012 1469 1481
47. X.-D. Zhou, C.-L. Liu, M. Nakagawa, Online handwritten Japanese character string recognition using conditional random fields, in: Proceedings of the 10th International Conference on Document Analysis and Recognition (ICDAR), Barcelona, Spain, 2009, pp. 682-687
48. S. Senda, K. Yamada, A maximum-likelihood approach to segmentation-based recognition of unconstrained handwriting text, in: Proceedings of the 6th International Conference on Document Analysis and Recognition (ICDAR), Seattle, 2001, pp. 682-687
49. C. Wolf, and J. Jolion Object count/area graphs for the evaluation of object detection and segmentation algorithms Int. J. Doc. Anal. Recognit. 8 4 2006 280 296