Localizing text in scene images by boundary clustering, stroke segmentation, and string fragment classification

IEEE Transactions on Image Processing

Volumn 21, Issue 9, 2012, Pages 4256-4268

  Yi, Chucai ^a   Tian, Yingli ^b  

^a CITY UNIVERSITY OF NEW YORK   (United States)

^b CITY COLLEGE OF NEW YORK   (United States)

Author keywords

Bigram color uniformity; boundary clustering (BC); color assignment; Gabor based text features; string fragment classification; stroke segmentation; text localization

Indexed keywords

BOUNDARY CLUSTERING (BC); COLOR ASSIGNMENTS; COLOR UNIFORMITY; FRAGMENT CLASSIFICATION; TEXT FEATURE; TEXT LOCALIZATION;

ALGORITHMS; BOUNDARY LAYERS; COLOR; IMAGE SEGMENTATION;

CHARACTER RECOGNITION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CLUSTER ANALYSIS; HUMAN; IMAGE PROCESSING; METHODOLOGY; PATIENT; SELF HELP; VIDEORECORDING; WRITING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; SELF-HELP DEVICES; VIDEO RECORDING; VISUALLY IMPAIRED PERSONS; WRITING;

EID: 84865421190     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2199327     Document Type: Article

References (34)

1. T. M. Breuel, "The OCRopus open source OCR system," in Proc. IS&T/SPIE 20th Ann. Symp., 2008, pp. 0F1-0F15.
2. R. Smith, "An overview of the tesseract OCR engine," in Proc. Int. Conf. Document Anal. Recogn., 2007, pp. 629-633.
3. N. Nikolaou and N. Papamarkos, "Color reduction for complex document images," Int. J. Imaging Syst. Technol., vol. 19, no. 1, pp. 14-26, 2009.
4. X. Chen, J. Yang, J. Zhang, and A. Waibel, "Automatic detection and recognition of signs from natural scenes," IEEE Trans. Image Process., vol. 13, no. 1, pp. 87-99, Jan. 2004.
5. C. Mancas-Thillou and B. Gosselin, "Spatial and color spaces combination for natural scene text extraction," in Proc. IEEE Conf. Image Process., Oct. 2006, pp. 985-988.
6. Y. Song, A. Liu, L. Pang, S. Lin, Y. Zhang, and S. Tang, "A novel image text extraction method based on K-means clustering," in Proc. 7th Int. Conf. Comput. Inform. Sci., 2008, pp. 185-190.
7. B. Epshtein, E. Ofek, and Y. Wexler, "Detecting text in nature scenes with Stroke width transform," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., Jun. 2010, pp. 2963-2970.
8. V. Dinh, S. Chun, S. Cha, H. Ryu, and S. Sull, "An efficient method for text detection in video based on stroke width similarity," in Proc. Asian Conf. Comput. Vision, 2007, pp. 200-209.
9. K. Subramanian, P. Natarajan, M. Decerbo, and D. Castanon, "Character- Stroke detection for text-localization and extraction," in Proc. Int. Conf. Document Anal. Recogn., 2005, pp. 33-37.
10. X. Chen and A. Yuille, "Detecting and reading text in natural scenes," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., Jun.-Jul. 2004, pp. 366-373.
11. C. Yi and Y. Tian, "Text string detection from natural scenes by structure-based partition and grouping," IEEE Trans. Image Process., vol. 20, no. 9, pp. 2594-2604, Sep. 2011.
12. Y. Zheng, H. Li, and D. Doermann, "A parallel-line detection algorithm based on HMM decoding," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 777-792, May 2005. (Pubitemid 40608409)
13. H. Anoual, S. Elfkihi, and A. Jilbab, "Features extraction for text detection and localization," in Proc. 5th Int. Symp. I/V Commun. Mobile Netw., 2010, pp. 1-4.
14. T. Kasar, J. Kumar, and A. Ramakrishnan, "Font and background color independent text binarization," in Proc. 2nd Int. Workshop Camera- Based Document Anal. Recogn., 2007, pp. 3-9.
15. W. Kim and C. Kim, "A new approach for overlay text detection and extraction from complex video scene," IEEE Trans. Image Process., vol. 18, no. 2, pp. 401-411, Dec. 2009.
16. C. Liu, C. Wang, and R. Dai, "Text detection in images based on unsupervised classification of edge-based features," in Proc. Int. Conf. Document Anal. Recogn., vol. 2, pp. 610-614, Aug.-Sep. 2005. (Pubitemid 46442397)
17. M. Lyu, J. Song, and M. Cai, "A comprehensive method for multilingual video text detection, localization, and extraction," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 2, pp. 243-255, Feb. 2005. (Pubitemid 40265948)
18. T. Phan, P. Shivakumara, and C. L. Tan, "A Laplacian method for video text detection," in Proc. 10th Int. Conf. Document Anal. Recogn., 2009, pp. 66-70.
19. M. Wan, F. Zhang, H. Cheng, and Q. Liu, "Text localization in spam image using edge features," in Proc. Int. Conf. Commun. Circuits Syst., 2008, pp. 838-842.
20. S. M. Hanif and L. Prevost, "Text detection and localization in complex scene images using constrained AdaBoost algorithm," in Proc. 10th Int. Conf. Document Anal. Recogn., Jul. 2009, pp. 1-5.
21. S. Kumar, R. Gupta, N. Khanna, S. Chaudhury, and S. D. Joshi, "Text extraction and document image segmentation using matched wavelets and MRF model," IEEE Trans. Image Process., vol. 16, no. 8, pp. 2117- 2128, Aug. 2007. (Pubitemid 47225463)
22. W. Pan, C. Suen, and T. Bui, "Script identification using steerable Gabor filters," in Proc. Int. Conf. Document Anal. Recogn., Aug.-Sep. 2005, pp. 883-887. (Pubitemid 46442451)
23. M. Shi, Y. Fujisawab, T. Wakabayashia, and F. Kimura, "Handwritten numeral recognition using gradient and curvature of gray scale image," Pattern Recogn., vol. 35, no. 10, pp. 2051-2059, 2002. (Pubitemid 34812863)
24. C. Jung, Q. Liu, and J. Kim, "Accurate text localization in images based on SVM output scores," Image Vision Comput., vol. 27, no. 9, pp. 1295- 1301, 2008.
25. A. K. Jain and S. Bhattacharjee, "Text segmentation using Gabor filters for automatic document processing," Mach. Vision Appl., vol. 5, no. 3, pp. 169-184, 1992.
26. L. Li and M. K. H. Leung, "Integrating intensity and texture differences for robust change detection," IEEE Trans. Image Process., vol. 11, no. 2, pp. 105-112, Feb. 2002. (Pubitemid 34278447)
27. J. Canny, "A computational approach to edge detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 6, pp. 679-698, Jun. 1986.
28. J. Weinman, E. Leanred-Miller, and A. Hanson, "Scene text recognition using similarity and a lexicon with sparse belief propagation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 10, pp. 1733-1746, Oct. 2009.
29. N. Otsu, "A threshold selection method from gray-level histograms," IEEE Trans. Syst. Man Cybern., vol. 9, no. 1, pp. 62-66, Jan. 1979. (Pubitemid 9413341)
30. ICDAR2003 Robust Reading Competition. (2003) [Online]. Available: http://algoval.essex.ac.uk/icdar/Datasets.html
31. ICDAR2011 Robust Reading Competition. (2011) [Online]. Available: http://robustreading.opendfki.de/wiki/SceneText
32. S. M. Lucas, A. Panaretos, L. Sosa, A. Tang, S. Wong, and R. Young, "ICDAR 2003 robust reading competitions," in Proc. Int. Conf. Document Anal. Recogn., 2003, pp. 682-687.
33. S. M. Lucas, "ICDAR 2005 text locating competition results," in Proc. Int. Conf. Document Anal. Recogn., 2005, pp. 80-84. (Pubitemid 46442295)
34. ICDAR2011 Robust Reading Competition (2011) [Online]. Available: http://www.cvc.uab.es/icdar2011competition/