A robust approach for text detection from natural scene images

Pattern Recognition

Volumn 48, Issue 9, 2015, Pages 2906-2920

  Sun, Lei ^a   Huo, Qiang ^b   Jia, Wei ^a   Chen, Kai ^a  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b MICROSOFT RESEARCH ASIA   (China)

Author keywords

Color enhanced contrasting extremal region; Natural scene images; Neural networks; Text detection

Indexed keywords

COLOR; FORESTRY; NEURAL NETWORKS;

DIVIDE AND CONQUER; EXTREMAL; ILLUMINATION INVARIANT; NATURAL SCENE IMAGES; REMAINING COMPONENT; ROBUST APPROACHES; SATURATION CHANNELS; TEXT DETECTION;

IMAGE ENHANCEMENT;

EID: 84929510797     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2015.04.002     Document Type: Article

References (53)

1. L. Neumann, J. Matas, On combining multiple segmentations in scene text recognition, in: Proceedings of the ICDAR, 2013, pp. 523-527.
2. X.-C. Yin, X.-W. Yin, K.-Z. Huang, and H.-W. Hao Robust text detection in natural scene images IEEE Trans. PAMI 36 5 2013 970 983
3. Y.-F. Pan, X. Hou, and C.-L. Liu A hybrid approach to detect and localize texts in natural scene images IEEE Trans. Image Process. 20 3 2011 800 813
4. D. Karatzas, et al., ICDAR 2013 robust reading competition, in: Proceedings of the ICDAR, 2013, pp. 1484-1493.
5. C. Yao, X. Bai, W.-Y. Liu, Y. Ma, Z.-W. Tu, Detecting texts of arbitrary orientations in natural images, in: Proceedings of the CVPR, 2012, pp. 1083-1090.
6. X. Chen, A. Yuille, Detecting and reading text in natural scenes, in: Proceedings of the CVPR, 2004, pp. 366-373.
7. A. Coates, B. Carpenter, C. Case, S. Satheesh, B. Suresh, T. Wang, D. Wu, A. Ng, Text detection and character recognition in scene images with unsupervised feature learning, in: Proceedings of the ICDAR, 2011, pp. 440-445.
8. R. Minetto, N. Thone, M. Cord, N.J. Leite, and J. Stolfi T-HOG: an effective gradient-based descriptor for single line text regions Pattern Recognit. 46 3 2013 1078 1090
9. K. Wang, B. Babenko, S. Belongie, End-to-end scene text recognition, in: Proceedings of the ICCV, 2011, pp. 1457-1464.
10. C. Shi, C. Wang, B. Xiao, Y. Zhang, and S. Gao Scene text detection using graph model built upon maximally stable extremal regions Pattern Recognit. Lett. 34 2 2013 107 116
11. L. Neumann, J. Matas, Scene text localization and recognition with oriented stroke detection, in: Proceedings of the ICCV, 2013, pp. 97-104.
12. A. Shahab, F. Shafait, A. Dengel, ICDAR 2011 robust reading competition challenge 2: reading text in scene images, in: Proceedings of the ICDAR, 2011, pp. 1491-1496.
13. H. Chen, S. Tsai, G. Schroth, D. Chen, R. Grzeszczuk, B. Girod, Robust text detection in natural images with edge-enhanced maximally stable extremal regions, in: Proceedings of the ICIP, 2011, pp. 2609-2612.
14. H.-I. Koo, and D.-H. Kim Scene text detection via connected component clustering and nontext filtering IEEE Trans. Image Process. 22 6 2013 2296 2305
15. L. Neumann, J. Matas, A method for text localization and recognition in real-world images, in: Proceedings of the ACCV, 2010, pp. 770-783.
16. L. Neumann, J. Matas, Real-time scene text localization and recognition, in: Proceedings of the CVPR, 2012, pp. 3538-3545.
17. L. Sun, Q. Huo, W. Jia, K. Chen, Robust text detection in natural scene images by generalized color-enhanced contrasting extremal region and neural networks, in: Proceedings of the ICPR, 2014.
18. A. González, and L.M. Bergasa A text reading algorithm for natural images Image Vis. Comput. 31 3 2013 255 274
19. J. Matas, O. Chum, M. Urban, T. Pajdla, Robust wide baseline stereo from maximally stable extremal regions, in: Proceedings of the BMVC, 2002, pp. 384-393.
20. L. Sun, Q. Huo, A component-tree based method for user-intention guided text extraction, in: Proceedings of the ICPR, 2012, pp. 633-636.
21. B. Epshtein, E. Ofek, Y. Wexler, Detecting text in natural scenes with stroke width transform, in: Proceedings of the CVPR, 2010, pp. 2963-2970.
22. L. Sun, Q. Huo, An improved component tree based approach to user-intention guided text extraction from natural scene images, in: Proceedings of the ICDAR, 2013, pp. 383-387.
23. K. Jung, K. Kim, and A. Jain Text information extraction in images and video: a survey Pattern Recognit. 37 5 2004 977 997
24. J. Zhang, R. Kasturi, Extraction of text objects in video documents: recent progress, in: Proceedings of the International Workshop on DAS, 2008, pp. 5-17.
25. N. Sharma, U. Pal, M. Blumenstein, Recent advances in video based document processing: a review, in: Proceedings of the International Workshop on DAS, 2012, pp. 63-68.
26. H.-G. Zhang, K.-L. Zhao, Y.-Z. Song, and J. Guo Text extraction from natural scene image: a survey Neurocomputing 122 25 2013 310 323
27. W. Niblack An Introduction to Digital Image Processing 1985 Strandberg Publishing Birkeroed, Denmark
28. P. Shivakumara, T.-Q. Phan, S.-J. Lu, and C.-L. Tan Gradient vector flow and grouping-based method for arbitrarily oriented scene text detection in video images IEEE Trans. Circuits Syst. Video Technol. 23 10 2013 1729 1739
29. L. Neumann, J. Matas, Text localization in real-world images using efficiently pruned exhaustive search, in: Proceedings of the ICDAR, 2011, pp. 687-691.
30. H.-Y. Chong, S.J. Gortler, T. Zickler, A perception-based color space for illumination-invariant image processing, in: Proceedings of the SIGGRAPH, 2008.
31. L. Kang, Y. Li, D. Doermann, Orientation robust text line detection in natural images, in: Proceedings of the CVPR, 2014.
32. Y. Bengio, A. Courville, and P. Vincent Representation learning: a review and new perspectives IEEE Trans. PAMI 35 8 2013 1798 1828
33. O. Russakovsky, et al., ImageNet large scale visual recognition challenge, in: Proceedings of the CoRR, abs/1409.0575, 2014.
34. J. Deng, W. Dong, R. Socher, L. Li, K. Li, F.-F. Li, Imagenet: a large-scale hierarchical image database, in: Proceedings of the CVPR, 2009, pp. 248-255.
35. N. Japkowicz, and S. Stephen The class imbalance problem: a systematic study Intell. Data Anal. 6 5 2002 429 449
36. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner Gradient-based learning applied to document recognition Proc. IEEE 86 11 1998 2278 2324
37. C. Merino-Gracia, K. Lenc, M. Mirmehdi, A head-mounted device for recognizing text in natural scenes, in: Proceedings of the International Workshop on CBDAR, 2011, pp. 29-41.
38. L. Najman, and M. Couprie Building the component tree in quasi-linear time IEEE Trans. Image Process. 15 11 2006 3531 3539
39. P. Salembier, A. Oliveras, and L. Garrido Anti-extensive connected operators for image and sequence processing IEEE Trans. Image Process 7 4 1998 555 570
40. E. Carlinet, and T. Geraud A comparison of many max-tree computation algorithms Mathematical Morphology and Its Applications to Signal and Image Processing vol. 7883 2013 Springer Berlin, Heidelberg 73 85
41. C. Szegedy et al., Intriguing properties of neural networks, in: Proceedings of the ICLR, 2014.
42. K.-K. Sung, and T. Poggio Example-based learning for view-based human face detection IEEE Trans. PAMI 20 1 1998 39 51
43. Z. Kalal, J. Matas, K. Mikolajczyk, Weighted sampling for large-scale boosting, in: Proceedings of the BMVC, 2008, pp. 42.1-42.10.
44. J. Philbin, et al., Object retrieval with large vocabularies and fast spatial matching, in: Proceedings of the CVPR, 2007, pp. 1-8.
45. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, R.R. Salakhutdinov, Improving neural networks by preventing co-adaptation of feature detectors, 2012 (arXiv:1207.0580).
46. H.A. Rowley, S. Baluja, and T. Kanade Neural network-based face detection IEEE Trans. PAMI 20 1998 22 38
47. "Street View Text Dataset" [Online]. Available: (http://vision.ucsd.edu/kai/svt/).
48. R. Nagy, A. Dicker, M.W. Klaus, NEOCR: a configurable dataset for natural image text recognition, in: Proceedings of the International Workshop on CBDAR, 2011, pp. 150-163.
49. "KAIST scene text database" [Online]. Available: (http://www.iapr-tc11.org/mediawiki/index.php/KAIST-Scene-Text-Database).
50. C. Wolf, and J.M. Jolion Object count/area graphs for the evaluation of object detection and segmentation algorithms Int. J. Doc. Anal. Recognit. 8 4 2006 280 296
51. "ICDAR 2013 Robust Reading Competition" [Online]. Available: (http://dag.cvc.uab.es/icdar2013competition/?ch=2&com=results).
52. A. Bissacco, M. Cummins, Y. Netzer, H. Neven, PhotoOCR: reading text in uncontrolled conditions, in: Proceedings of the ICCV, 2013, pp. 785-792.
53. C. Wolf, et al., DetEval - Evaluation software for object detection algorithms, [Online]. Available: (http://liris.cnrs.fr/christian.wolf/software/deteval/index.html).