A unified framework for multioriented text detection and recognition

IEEE Transactions on Image Processing

Volumn 23, Issue 11, 2014, Pages 4737-4749

  Yao, Cong ^a   Bai, Xiang ^a   Liu, Wenyu ^a  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

arbitrary orientations; dictionary search; natural image; text detection; text recognition; Unified framework

Indexed keywords

ARBITRARY ORIENTATION; NATURAL IMAGES; TEXT DETECTION; TEXT RECOGNITION; UNIFIED FRAMEWORK;

ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CLASSIFICATION; COMPUTER ASSISTED DIAGNOSIS; DOCUMENTATION; IMAGE ENHANCEMENT; NATURAL LANGUAGE PROCESSING; PHOTOGRAPHY; PROCEDURES; READING; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; WRITING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DOCUMENTATION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; NATURAL LANGUAGE PROCESSING; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; READING; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; WRITING;

EID: 84907546391     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2353813     Document Type: Article

References (78)

1. L. V. Remias, A Real-Time Image Understanding System for an Autonomous Mobile Robot. Washington, DC, USA: Storming Media, 1996.
2. S. S. Tsai, H. Chen, D. Chen, G. Schroth, R. Grzeszczuk, and B. Girod, "Mobile visual search on printed documents using text and low bit-rate features, " in Proc. 18th IEEE ICIP, Sep. 2011, pp. 2601-2604.
3. D. B. Barber, J. D. Redding, T. W. McLain, R. W. Beard, and C. N. Taylor, "Vision-based target geo-location using a fixed-wing miniature air vehicle, " J. Intell. Robot. Syst., vol. 47, no. 4, pp. 361-382, 2006.
4. G. N. Desouza and A. C. Kak, "Vision for mobile robot navigation: A survey, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 2, pp. 237-267, Feb. 2002.
5. K. I. Kim, K. Jung, and J. H. Kim, "Texture-based approach for text detection in images using support vector machines and continuously adaptive mean shift algorithm, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1631-1639, Dec. 2003.
6. X. Chen and A. L. Yuille, "Detecting and reading text in natural scenes, " in Proc. IEEE CVPR, Jun./Jul. 2004, pp. II-366-II-373.
7. D. Chen, J.-M. Odobez, and H. Bourlard, "Text detection and recognition in images and video frames, " Pattern Recognit., vol. 37, no. 3, pp. 595-608, 2004.
8. M. R. Lyu, J. Song, and M. Cai, "A comprehensive method for multilingual video text detection, localization, and extraction, " IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 2, pp. 243-255, Feb. 2005.
9. T. E. de Campos, B. R. Babu, and M. Varma, "Character recognition in natural images, " in Proc. VISAPP, Feb. 2009, pp. 121-132.
10. B. Epshtein, E. Ofek, and Y. Wexler, "Detecting text in natural scenes with stroke width transform, " in Proc. IEEE CVPR, Jun. 2010, pp. 2963-2970.
11. K. Wang and S. Belongie, "Word spotting in the wild, " in Proc. 11th ECCV, 2010, pp. 591-604.
12. L. Neumann and J. Matas, "A method for text localization and recognition in real-world images, " in Proc. 10th ACCV, 2010, pp. 770-783.
13. C. Yi and Y. Tian, "Text string detection from natural scenes by structure-based partition and grouping, " IEEE Trans. Image Process., vol. 20, no. 9, pp. 2594-2605, Sep. 2011.
14. A. Coates et al., "Text detection and character recognition in scene images with unsupervised feature learning, " in Proc. ICDAR, Sep. 2011, pp. 440-445.
15. K. L. Bouman, G. Abdollahian, M. Boutin, and E. J. Delp, "A low complexity sign detection and text localization method for mobile applications, " IEEE Trans. Multimedia, vol. 13, no. 5, pp. 922-934, Oct. 2011.
16. X. Liu and W. Wang, "Robustly extracting captions in videos based on stroke-like edges and spatio-temporal analysis, " IEEE Trans. Multimedia, vol. 14, no. 2, pp. 482-489, Apr. 2012.
17. L. Neumann and J. Matas, "Real-time scene text localization and recognition, " in Proc. IEEE CVPR, Jun. 2012, pp. 3538-3545.
18. T. Novikova, O. Barinova, P. Kohli, and V. Lempitsky, "Large-lexicon attribute-consistent text recognition in natural images, " in Proc. 12th ECCV, 2012, pp. 752-765.
19. C. Yao, X. Bai, B. Shi, and W. Liu, "Strokelets: A learned multiscale representation for scene text recognition, " in Proc. IEEE CVPR, Jun. 2014, pp. 4042-4049.
20. A. Mishra, K. Alahari, and C. V. Jawahar, "Top-down and bottomup cues for scene text recognition, " in Proc. IEEE CVPR, Jun. 2012, pp. 2687-2694.
21. K. Wang, B. Babenko, and S. Belongie, "End-to-end scene text recognition, " in Proc. IEEE ICCV, Nov. 2011, pp. 1457-1464.
22. J. J. Weinman, "Unified detection and recognition for reading text in scene images, " Ph.D. dissertation, Dept. Comput. Sci., Univ. Massachusetts Amherst, Amherst, MA, USA, 2008.
23. A. Torralba, K. P. Murphy, and W. T. Freeman, "Sharing features: Efficient boosting procedures for multiclass object detection, " in Proc. IEEE CVPR, Jun./Jul. 2004, pp. II-762-II-769.
24. A. Torralba, K. P. Murphy, and W. T. Freeman, "Sharing visual features for multiclass and multiview object detection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 5, pp. 854-869, May 2007.
25. E. Murphy-Chutorian and J. Triesch, "Shared features for scalable appearance-based object recognition, " in Proc. IEEE Workshop Appl. Comput. Vis., Jan. 2005, pp. 16-21.
26. A. Ikica and P. Peer, "An improved edge profile based method for text detection in images of natural scenes, " in Proc. IEEE EUROCON, Apr. 2011, pp. 1-4.
27. X. Tong and D. A. Evans, "A statistical approach to automatic OCR error correction in context, " in Proc. 4th Workshop Very Large Corpora, 1996, pp. 88-100.
28. R. Smith, "Limits on the application of frequency-based language models to OCR, " in Proc. ICDAR, 2011, pp. 538-542.
29. Y. Bassil and M. Alwani, "OCR context-sensitive error correction based on Google web 1T 5-gram data set, " Amer. J. Sci. Res., vol. 50, pp. 55-78, Feb. 2012.
30. K. Kukich, "Techniques for automatically correcting words in text, " ACM Comput. Surv., vol. 24, no. 4, pp. 377-439, 1992.
31. R. Haldar and D. Mukhopadhyay, "Levenshtein distance technique in dictionary lookup methods: An improved approach, " CoRR, (2011). [Online]. Available: http://arxiv.org/abs/1101.1232
32. V. I. Levenshtein. "Binary codes capable of correcting deletions, insertions, and reversals, " Soviet Phys. Doklady, vol. 10; 8:707-710, 1966.
33. A. Shahab, F. Shafait, and A. Dengel, "ICDAR 2011 robust reading competition challenge 2: Reading text in scene images, " in Proc. ICDAR, 2011, pp. 1491-1496.
34. C. Yao, X. Bai, W. Liu, Y. Ma, and Z. Tu, "Detecting texts of arbitrary orientations in natural images, " in Proc. IEEE CVPR, Jun. 2012, pp. 1083-1090.
35. R. Lienhart and F. Stuber, "Automatic text recognition in digital videos, " Dept. Math. Comput. Sci., Univ. Mannheim, Mannheim, Germany, Tech. Rep. TR-95-036, 1995.
36. Y. Zhong, K. Karu, and A. K. Jain, "Locating text in complex color images, " Pattern Recognit., vol. 28, no. 10, pp. 1523-1535, 1995.
37. V. Wu, R. Manmatha, and E. M. Riseman, "Finding text in images, " in Proc. 2nd ACM Int. Conf. Digital Libraries, 1997, pp. 3-12.
38. A. K. Jain and B. Yu, "Automatic text location in images and video frames, " Pattern Recognit., vol. 31, no. 12, pp. 2055-2076, 1998.
39. V. Wu, R. Manmatha, and E. M. Riseman, "Textfinder: An automatic system to detect and recognize text in images, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 11, pp. 1224-1229, Nov. 1999.
40. Y. Zhong, H. Zhang, and A. K. Jain, "Automatic caption localization in compressed video, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 4, pp. 385-392, Apr. 2000.
41. H. Li, D. Doermann, and O. Kia, "Automatic text detection and tracking in digital video, " IEEE Trans. Image Process., vol. 9, no. 1, pp. 147-156, Jan. 2000.
42. Y.-F. Pan, X. Hou, and C.-L. Liu, "A hybrid approach to detect and localize texts in natural scene images, " IEEE Trans. Image Process., vol. 20, no. 3, pp. 800-813, Mar. 2011.
43. C. Yao, X. Zhang, X. Bai, W. Liu, Y. Ma, and Z. Tu, "Rotation-invariant features for multi-oriented text detection in natural images, " PLoS ONE, vol. 8, no. 8, p. e70173, 2013.
44. X.-C. Yin, X. Yin, K. Huang, and H.-W. Hao, "Accurate and robust text detection: A step-in for text retrieval in natural scene images, " in Proc. 36th SIGIR, 2013, pp. 1091-1092.
45. D. Chen, J. Luettin, and K. Shearer, "A survey of text detection and recognition in images and videos, " Institut Dalle Molle d' Intelligence Artificielle Perceptual, EPFL, Martigny, Switzerland, Tech. Rep. TR-00-38, Aug. 2000.
46. K. Jung, K. Kim, and A. Jain, "Text information extraction in images and video: A survey, " Pattern Recognit., vol. 37, no. 5, pp. 977-997, 2004.
47. J. Liang, D. Doermann, and H. Li, "Camera-based analysis of text and documents: A survey, " Int. J. Document Anal. Recognit., vol. 7, no. 2, pp. 84-104, 2005.
48. H. Chen, S. S. Tsai, G. Schroth, D. M. Chen, R. Grzeszczuk, and B. Girod, "Robust text detection in natural images with edge-enhanced maximally stable extremal regions, " in Proc. 18th IEEE ICIP, Sep. 2011, pp. 2609-2612.
49. A. Mosleh, N. Bouguila, and A. B. Hamza, "Image text detection using a bandlet-based edge detector and stroke width transform, " in Proc. BMVC, 2012, pp. 63.1-63.12.
50. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust wide baseline stereo from maximally stable extremal regions, " in Proc. BMVC, 2002, pp. 384-396.
51. L. Breiman, "Random forests, " Mach. Learn., vol. 45, no. 1, pp. 5-32, 2001.
52. Y. Amit and D. Geman, "Shape quantization and recognition with randomized trees, " Neural Comput., vol. 9, no. 7, pp. 1545-1588, 1997.
53. V. Lepetit, P. Lagger, and P. Fua, "Randomized trees for real-time keypoint recognition, " in Proc. IEEE CVPR, Jun. 2005, pp. 775-781.
54. F. Moosmann, E. Nowak, and F. Jurie, "Randomized clustering forests for image classification, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 9, pp. 1632-1646, Sep. 2008.
55. J. Shotton, M. Johnson, and R. Cipolla, "Semantic texton forests for image categorization and segmentation, " in Proc. IEEE CVPR, Jun. 2008, pp. 1-8.
56. G. Rogez, J. Rihan, S. Ramalingam, C. Orrite, and P. H. S. Torr, "Randomized trees for human pose detection, " in Proc. IEEE CVPR, Jun. 2008, pp. 1-8.
57. X. C. Yin, X. Yin, K. Huang, and H. Hao, "Robust text detection in natural scene images, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 5, pp. 970-983, May 2014.
58. Microsoft. (2014). Bing Search Engine. [Online]. Available: http://www.bing.com/
59. Microsoft. (2010). Microsoft Web N-Gram Service (Public Beta). [Online]. Available: http://web-ngram.research.microsoft.com/info/
60. Y. Li and B. Liu, "A normalized Levenshtein distance metric, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 1091-1095, Jun. 2007.
61. P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik, "Contour detection and hierarchical image segmentation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 898-916, May 2011.
62. H. Shao, T. Svoboda, and L. V. Gool, "ZuBuD-Zurich buildings database for image based recognition, " Comput. Vis. Lab., Swiss Federal Inst. Technol., Zürich, Switzerland, Tech. Rep. 260, Apr. 2003.
63. J. Philbin, O. Chum, M. Isard, J. Sivic, and A. Zisserman, "Object retrieval with large vocabularies and fast spatial matching, " in Proc. IEEE CVPR, Jun. 2007, pp. 1-8.
64. S. M. Bileschi, "Streetscenes: Towards scene understanding in still images, " Ph.D. dissertation, Dept. Elect. Eng. Comput. Sci., MIT, Cambridge, MA, USA, 2006.
65. CASIA. (2011). CASIA Tampered Image Detection Evaluation Database. [Online]. Available: http://forensics.idealtest.org/
66. M. Everingham, L. V. Gool, C. Williams, J. Winn, and A. Zisserman. (2011). The PASCAL Visual Object Classes Challenge 2011 (VOC2011) Results. [Online]. Available: http://www.pascalnetwork. org/challenges/VOC/voc2011/workshop/index.html
67. S. M. Lucas, A. Panaretos, L. Sosa, A. Tang, S. Wong, and R. Young, "ICDAR 2003 robust reading competitions, " in Proc. 7th ICDAR, Aug. 2003, pp. 682-687.
68. S. M. Lucas, "ICDAR 2005 text locating competition results, " in Proc. 8th ICDAR, Aug./Sep. 2005, pp. 80-84.
69. C. Wolf and J.-M. Jolion, "Object count/area graphs for the evaluation of object detection and segmentation algorithms, " Int. J. Document Anal. Recognit., vol. 8, no. 4, pp. 280-296, 2006.
70. R. Nagy, A. Dicker, and K. Meyer-Wegener, "NEOCR: A configurable dataset for natural image text recognition, " in Proc. CBDAR, Sep. 2011, pp. 150-163.
71. L. Neumann and J. Matas, "On combining multiple segmentations in scene text recognition, " in Proc. 12th ICDAR, Aug. 2013, pp. 523-527.
72. H. Koo and D. H. Kim, "Scene text detection via connected component clustering and nontext filtering, " IEEE Trans. Image Process., vol. 22, no. 6, pp. 2296-2305, Jun. 2013.
73. C. Shi, C. Wang, B. Xiao, Y. Zhang, and S. Gao, "Scene text detection using graph model built upon maximally stable extremal regions, " Pattern Recognit. Lett., vol. 34, no. 2, pp. 107-116, 2013.
74. C. Yi and Y. Tian, "Text detection in natural scene images by stroke Gabor words, " in Proc. ICDAR, 2011, pp. 177-181.
75. S. Milyaev, O. Barinova, T. Novikova, P. Kohli, and V. Lempitsky, "Image binarization for end-to-end text understanding in natural images, " in Proc. 12th ICDAR, Aug. 2013, pp. 128-132.
76. L. Neumann and J. Matas, "Scene text localization and recognition with oriented stroke detection, " in Proc. IEEE ICCV, Dec. 2013, pp. 97-104.
77. X. Wang, Z. Zhang, Y. Ma, X. Bai, W. Liu, and Z. Tu, "Robust subspace discovery via relaxed rank minimization, " Neural Comput., vol. 26, no. 3, pp. 611-635, 2014.
78. C. Yao, X. Bai, W. Liu, and L. J. Latecki, "Human detection using learned part alphabet and pose dictionary, " in Proc. ECCV, 2014, pp. 251-266.