Multi-Spectral Fusion Based Approach for Arbitrarily Oriented Scene Text Detection in Video Images

IEEE Transactions on Image Processing

Volumn 24, Issue 11, 2015, Pages 4488-4501

  Liang, Guozhu ^a   Shivakumara, Palaiahnakote ^b   Lu, Tong ^a   Tan, Chew Lim ^c  

^a NANJING UNIVERSITY   (China)

^b UNIVERSITY OF MALAYA   (Malaysia)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Laplacian wavelet; Maxima stable extreme regions; Multi spectral fusion

Indexed keywords

FREQUENCY DOMAIN ANALYSIS; LAPLACE TRANSFORMS; PIXELS;

ARBITRARY ORIENTATION; LAPLACIANS; MAXIMA STABLE EXTREME REGIONS; MULTI-SPECTRAL; NATURAL SCENE IMAGES; NEAREST NEIGHBORS; STATE-OF-THE-ART METHODS; WAVELET SUB BANDS;

CHARACTER RECOGNITION;

EID: 84941010608     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2465169     Document Type: Article

References (39)

1. J. Yan and X. Gao, "Detection and recognition of text superimposed in images base on layered method, " Neurocomputing, vol. 134, pp. 3-14, Jun. 2014.
2. K. Jung, K. I. Kim, and A. K. Jain, "Text information extraction in images and video: A survey, " Pattern Recognit., vol. 37, no. 5, pp. 977-997, May 2004.
3. J. Liang, D. Doermann, and H. Li, "Camera-based analysis of text and documents: A survey, " in Proc. IJDAR, 2005, pp. 84-104.
4. J. Zhang and R. Kasturi, "Extraction of text objects in video documents: Recent progress, " in Proc. DAS, 2008, pp. 5-17.
5. C. Yao, X. Bai, and W. Liu, "A unified framework for multioriented text detection and recognition, " IEEE Trans. Image Process., vol. 23, no. 1, pp. 4737-4749, Nov. 2014.
6. P. Shivakumara, T. Q. Phan, and C. L. Tan, "A Laplacian approach to multi-oriented text detection in video, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 2, pp. 412-419, Feb. 2011.
7. P. Shivakumara, A. Dutta, C. L. Tan, and U. Pal, "Multi-oriented scene text detection in video based on wavelet and angle projection boundary growing, " in Multimedia Tools and Applications. New York, NY, USA: Springer-Verlag, 2013.
8. J. Zhang and R. Kasturi, "A novel text detection system based on character and link energies, " IEEE Trans. Image Process., vol. 23, no. 9, pp. 4187-4198, Sep. 2014.
9. C. Yi and Y. Tian, "Localizing text in scene images by boundary clustering, stroke segmentation, and string fragment classification, " IEEE Trans. Image Process., vol. 21, no. 9, pp. 4256-4268, Sep. 2012.
10. D. Crandall, S. Antani, and R. Kasturi, "Extraction of special effects caption text events from digital video, " in Proc. IJDAR, 2003, pp. 138-157.
11. D. Chen and J.-M. Odobez, "Video text recognition using sequential Monte Carlo and error voting methods, " Pattern Recognit. Lett., vol. 26, no. 9, pp. 1386-1403, Jul. 2005.
12. B. Epshtein, E. Ofek, and Y. Wexler, "Detecting text in natural scenes with stroke width transform, " in Proc. CVPR, Jun. 2010, pp. 2963-2970.
13. C. Yao, X. Bai, W. Liu, Y. Ma, and Z. Tu, "Detecting texts of arbitrary orientations in natural images, " in Proc. CVPR, Jun. 2012, pp. 1083-1090.
14. X.-C. Yin, Z. Yin, K. Huang, and H.-W. Hao, "Robust text detection in natural scene images, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 5, pp. 970-983, May 2014.
15. Y. Li, W. Jia, C. Shen, and A. van den Hengel, "Characterness: An indicator of text in the wild, " IEEE Trans. Image Process., vol. 23, no. 4, pp. 1666-1677, Apr. 2014.
16. L. Wang, W. Fan, Y. He, J. Sun, Y. Katsuyama, and Y. Hotta, "Fast and accurate text detection in natural scene images with user-intention, " in Proc. ICPR, Aug. 2014, pp. 2920-2925.
17. R. Minetto, N. Thome, M. Cord, N. J. Leite, and J. Stolfi, "T-HOG: An effective gradient-based descriptor for single line text regions, " Pattern Recognit., vol. 46, no. 3, pp. 1078-1090, Mar. 2013.
18. X. Liu and W. Wang, "Robustly extracting captions in videos based on stroke-like edges and spatio-Temporal analysis, " IEEE Trans. Multimedia, vol. 14, no. 2, pp. 482-489, Apr. 2012.
19. H. Li, D. Doermann, and O. Kia, "Automatic text detection and tracking in digital video, " IEEE Trans. Image Process., vol. 9, no. 1, pp. 147-156, Jan. 2000.
20. L. Wu, P. Shivakumara, T. Lu, and C. L. Tan, "Text detection using Delaunay triangulation in video sequence, " in Proc. DAS, Apr. 2014, pp. 41-45.
21. X. Zhao, K.-H. Lin, Y. Fu, Y. Hu, Y. Liu, and T. S. Huang, "Text from corners: A novel approach to detect text and caption in videos, " IEEE Trans. Image Process., vol. 20, no. 3, pp. 790-799, Mar. 2011.
22. A. Mosleh, N. Bouguila, and A. B. Hamza, "Automatic inpainting scheme for video text detection and removal, " IEEE Trans. Image Process., vol. 22, no. 11, pp. 4460-4472, Nov. 2013.
23. X. Rong, C. Yi, X. Yang, and Y. Tian, "Scene text recognition in multiple frames based on text tracking, " in Proc. ICME, Jul. 2014, pp. 1-6.
24. L. Gomez and D. Karatzas, "MSER-based real-Time text detection and tracking, " in Proc. ICPR, Aug. 2014, pp. 3110-3115.
25. P. Shivakumara, T. Q. Phan, S. Lu, and C. L. Tan, "Gradient vector flow and grouping-based method for arbitrarily oriented scene text detection in video images, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 10, pp. 1729-1739, Oct. 2013.
26. Y. Liu, Y. Song, Y. Zhang, and Q. Meng, "A novel multi-oriented chinese text extraction approach from videos, " in Proc. ICDAR, Aug. 2013, pp. 1355-1359.
27. Z. Zhang, W. Wang, and K. Lu, "Video text extraction using the fusion of color gradient and log-Gabor filter, " in Proc. ICPR, Aug. 2014, pp. 2938-2943.
28. R. Raghavendra and C. Busch, "Novel image fusion scheme based on dependency measure for robust multispectral palmprint recognition, " Pattern Recognit., vol. 47, no. 6, pp. 2205-2221, Jun. 2014.
29. H. Chen, S. S. Tsai, G. Schroth, D. M. Chen, R. Grzeszczuk, and B. Girod, "Robust text detection in natural images with edgeenhanced maximally stable extremal regions, " in Proc. ICIP, Sep. 2011, pp. 2609-2612.
30. L. Sun, Q. Huo, W. Jia, and K. Chen, "Robust text detection in natural scene images by generalized color-enhanced contrasting extremal region and neural networks, " in Proc. ICPR, Aug. 2014, pp. 2715-2720.
31. M. A. Abbas and A. A. Shoukry, "CMUNE: A clustering using mutual nearest neighbors algorithm, " in Proc. ICISSPA, Jul. 2012, pp. 1192-1197.
32. A. Risnumawan, P. Shivakumara, C. S. Chan, and C. L. Tan, "A robust arbitrary text detection system for natural scene images, " Expert Syst. Appl., vol. 41, no. 18, pp. 8027-8048, Dec. 2014.
33. D. Karatzas et al., "ICDAR 2013 robust reading competition, " in Proc. ICDAR, Aug. 2013, pp. 1484-1493.
34. X.-S. Hua, L. Wenyin, and H.-J. Zhang, "An automatic performance evaluation protocol for video text detection algorithms, " IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 7, pp. 498-507, Apr. 2004.
35. A. Shahab, F. Shafait, and A. Dengel, "ICDAR 2011 robust reading competition challenge 2: Reading text in scene images, " in Proc. ICDAR, Sep. 2011, pp. 1491-1496.
36. L. Neumann and J. Matas, "Real-Time scene text localization and recognition, " in Proc. CVPR, Jun. 2012, pp. 3538-3545.
37. Y. Liu, D. Zhang, Y. Zhang, and S. Lin, "Real-Time scene text detection based on stroke model, " in Proc. ICPR, Aug. 2014, pp. 3116-3120.
38. L. Kang, Y. Li, and D. Doermann, "Orientation robust text line detection in natural images, " in Proc. CVPR, Jun. 2014, pp. 4034-4041.
39. X. Chen and A. L. Yuille, "Detecting and reading text in natural scenes, " in Proc. CVPR, Jun./Jul. 2004, pp. II-366-II-373.