Robust text detection in natural scene images

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 5, 2014, Pages 970-983

  Yin, Xu Cheng ^a,b   Yin, Xuwang ^b   Huang, Kaizhu ^c   Hao, Hong Wei ^d  

^a Department of Computer Science and Technology ^*  (China)

^b UNIVERSITY OF SCIENCE AND TECHNOLOGY BEIJING   (China)

^c XI AN JIAOTONG LIVERPOOL UNIVERSITY   (China)

^d INSTITUTE OF AUTOMATION   (China)

Author keywords

distance metric learning; maximally stable extremal regions; Scene text detection; single link clustering

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER VISION;

CLUSTERING THRESHOLD; DISTANCE METRIC LEARNING; MAXIMALLY STABLE EXTREMAL REGIONS; POSTERIOR PROBABILITY; SCENE TEXT; SINGLE-LINK CLUSTERING; STATE-OF-THE-ART PERFORMANCE; TEXT DETECTION IN NATURAL SCENES;

CLUSTERING ALGORITHMS;

EID: 84900558052     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2013.182     Document Type: Article

References (42)

1. Y. Zhong, H. Zhang, and A. Jain, "Automatic caption localization in compressed video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 4, pp. 385-392, Apr. 2000.
2. H. Li, D. Doermann, and O. Kia, "Automatic text detection and tracking in digital video," IEEE Trans. Image Process., vol. 9, no. 1, pp. 147-156, Jan. 2000. (Pubitemid 30562093)
3. J. Weinman, E. Learned-Miller, and A. Hanson, "Scene text recognition using similarity and a lexicon with sparse belief propagation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 10, pp. 1733-1746, Oct. 2009.
4. X.-C. Yin, H.-W. Hao, J. Sun, and S. Naoi, "Robust vanishing point detection for mobile cam-based documents," in Proc. ICDAR, Beijing, China, 2011, pp. 136-140.
5. P. Shivakumara, Q. P. Trung, and C. L. Tan, "A laplacian approach to multi-oriented text detection in video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 2, pp. 412-419, Feb. 2011.
6. X. Chen and A. Yuille, "Detecting and reading text in natural scenes," in Proc. IEEE Conf. CVPR, vol. 2. Washington, DC, USA, 2004, pp. 366-373.
7. J.-J. Lee, P.-H. Lee, S.-W. Lee, A. Yuille, and C. Koch, "Adaboost for text detection in natural scene," in Proc. ICDAR, Beijing, China, 2011, pp. 429-434.
8. K. Kim, K. Jung, and J. Kim, "Texture-base approach for text detection in images using support vector machines and continuously adaptive mean shift algorithm," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1631-1639, Dec. 2003.
9. B. Epshtein, E. Ofek, and Y. Wexler, "Detecting text in natural scenes with stroke width transform," in Proc. IEEE Conf. CVPR, San Francisco, CA, USA, 2010, pp. 2963-2970.
10. C. Yi and Y. Tian, "Text string detection from natural scenes by structure-based partition and grouping," IEEE Trans. Image Process., vol. 20, no. 9, pp. 2594-2605, Sept. 2011.
11. C. Mancas-Thillou and B. Gosselin, "Color text extraction with selective metric-based clustering," Comput. Vis. Image Und., vol. 107, no. 1-2, pp. 97-107, 2007. (Pubitemid 46829949)
12. C. Yi and Y. Tian, "Localizing text in scene images by boundary clustering, stroke segmentation, and string fragment classification," IEEE Trans. Image Process., vol. 21, no. 9, pp. 4256-4268, Sept. 2012.
13. C. Yi and Y. Tian, "Text extraction from scene images by character appearance and structure modeling," Comput. Vis. Image Und., vol. 117, no. 2, pp. 182-194, 2013.
14. Y.-F. Pan, X. Hou, and C.-L. Liu, "A hybrid approach to detect and localize texts in natural scene images," IEEE Trans. Image Process., vol. 20, no. 3, pp. 800-813, Mar. 2011.
15. J. D. Lafferty, A. McCallum, and F. C. N. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Proc. Int. Conf. Mach. Learn., San Francisco, CA, USA, 2001, pp. 282-289.
16. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust wide baseline stereo from maximally stable extremal regions," in Proc. Brit. Mach. Vis. Conf., vol. 1. 2002, pp. 384-393.
17. A. Shahab, F. Shafait, and A. Dengel, "ICDAR robust reading competition challenge 2: Reading text in scene images," in Proc. ICDAR, 2011, pp. 1491-1496.
18. H. Chen et al., "Robust text detection in natural images with edgeenhanced maximally stable extremal regions," in Proc. IEEE Int. Conf. Image Process., 2011, pp. 2609-2612.
19. C. Merino-Gracia, K. Lenc, and M. Mirmehdi, "A head-mounted device for recognizing text in natural scenes," in Proc. Int. Workshop CBDAR, Beijing, China, 2011, pp. 29-41.
20. L. Neumann and J. Matas, "Real-time scene text localization and recognition," in Proc. IEEE Conf. CVPR, Providence, RI, USA, 2012, pp. 3538-3545.
21. L. Neumann and J. Matas, "Text localization in real-world images using efficiently pruned exhaustive search," in Proc. ICDAR, Beijing, China, 2011, pp. 687-691.
22. L. Neumann and J. Matas, "A method for text localization and recognition in real-world images," in Proc. ACCV, vol. 3. Queenstown, New Zealand, 2011, pp. 770-783.
23. C. Shi, C. Wang, B. Xiao, Y. Zhang, and S. Gao, "Scene text detection using graph model built upon maximally stable extremal regions," Pattern Recognit. Lett., vol. 34, no. 2, pp. 107-116, 2013.
24. K. Jung, K. Kim, and A. Jain, "Text information extraction in images and video: A survey," Pattern Recognit., vol. 37, no. 5, pp. 977-997, 2004. (Pubitemid 38473840)
25. J. Liang, D. Doermann, and H. Li, "Camera-based analysis of text and documents: A survey," IJDAR, vol. 7, no. 2-3, pp. 84-104, 2005. (Pubitemid 41051508)
26. J. Zhang and R. Kasturi, "Extraction of text objects in video documents: Recent progress," in Proc. IAPR Workshop DAS, Nara, Japan, 2008, pp. 1-13.
27. F. Yin and C.-L. Liu, "Handwritten Chinese text line segmentation by clustering with distance metric learning," Pattern Recognit., vol. 42, no. 12, pp. 3146-3157, 2009.
28. X. Yin, X.-C. Yin, H.-W. Hao, and K. Iqbal, "Effective text localization in natural scene images with MSER, geometry-based grouping and ada boost," in Proc. Int. Conf. Pattern Recognit., Tsukuba, Japan, 2012, pp. 725-728.
29. A. Jain, M. Murty, and P. Flynn, "Data clustering: A review," ACM Comput. Surv., vol. 31, no. 3, pp. 264-323, 1999.
30. M. Bilenko, S. Basu, and R. J. Mooney, "Integrating constraints and metric learning in semi-supervised clustering," in Proc. Int. Conf. Mach. Learn., Banff, AB, Canada, 2004, pp. 81-88. (Pubitemid 40290795)
31. E. P. Xing, A. Y. Ng, M. I. Jordan, and S. Russell, "Distance metric learning, with application to clustering with side-information," in Advances in Neural Information Processing Systems 15. MIT Press, 2002, pp. 505-512.
32. D. Klein, S. D. Kamvar, and C. D. Manning, "From instance-level constraints to space-level constraints: Making the most of prior knowledge in data clustering," in Proc. Int. Conf. Mach. Learn., San Francisco, CA, USA, 2002, pp. 307-314.
33. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed. Springer-Verlag, 2009.
34. J. Nocedal, "Updating Quasi-Newton matrices with limited storage," Math. Comput., vol. 35, no. 151, pp. 773-782, 1980.
35. D. Karatzas, S. R. Mestre, J. Mas, F. Nourbakhsh, and P. P. Roy, "ICDAR 2011 robust reading competition challenge 1: Reading text in born-digital images (web and email)," in Proc. ICDAR, 2011, pp. 1485-1490.
36. T. Q. Phan, P. Shivakumara, and C. L. Tan, "Detecting text in the real world," in Proc. ACM Int. Conf. MM, New York, NY, USA, 2012, pp. 765-768.
37. K. Wang, B. Babenko, and S. Belongie, "End-to-end scene text recognition," in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, 2011, pp. 1457-1464.
38. C. Yao, X. Bai, W. Liu, Y. Ma, and Z. Tu, "Detecting texts of arbitrary orientations in natural images," in Proc. IEEE Conf. CVPR, Providence, RI, USA, 2012, pp. 1083-1090.
39. S. Lucas et al., "ICDAR 2003 robust reading competitions: Entries, results and future directions," IJDAR, vol. 7, no. 2-3, pp. 105-122, 2005. (Pubitemid 41051509)
40. A. Vedaldi and B. Fulkerson, VLFeat: An Open and Portable Library of Computer Vision Algorithms [Online]. Available: http://www.vlfeat.org/, 2008.
41. H. I. Koo and D. H. Kim, "Scene text detection via connected component clustering and nontext filtering," IEEE Trans. Image Process., vol. 22, no. 6, pp. 2296-2305, June 2013.
42. D. Karatzas et al., "ICDAR 2013 robust reading competition," in Proc. ICDAR, Washington, DC, USA, 2013, pp. 1115-1124.