Robustly extracting captions in videos based on stroke-like edges and spatio-temporal analysis

IEEE Transactions on Multimedia

Volumn 14, Issue 2, 2012, Pages 482-489

  Liu, Xiaoqian ^a   Wang, Weiqiang ^b  

^a UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^b INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

Spatio temporal; stroke like edges; text detection; text extraction

Indexed keywords

COMPLEX BACKGROUND; DATA SETS; DETECTION AND LOCALIZATION; EDGE DETECTION METHODS; EVALUATION EXPERIMENTS; INTER-FRAME; INTER-FRAME INFORMATION; POST PROCESSING; SPATIAL ANALYSIS; SPATIO-TEMPORAL; SPATIOTEMPORAL ANALYSIS; STROKE-LIKE EDGES; TEMPORAL FEATURES; TEXT DETECTION; TEXT EXTRACTION; VIDEO FRAME;

EDGE DETECTION; IMAGE SEGMENTATION; VIDEO SIGNAL PROCESSING;

CHARACTER RECOGNITION;

EID: 84859029327     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2177646     Document Type: Article

References (25)

1. S. H. Park, K. I. Kim, K. Jung, and H. J. Kim, "Locating car license plates using neural networks," Electron. Lett., vol. 35, no. 17, pp. 1475-1477, 1999.
2. W. Wu, X. Chen, and J. Yang, "Detection of text on road signs from video," Intell. Transp. Syst., vol. 6, no. 4, pp. 378-390, 2005. (Pubitemid 43015535)
3. J. C. Shimy, C. Doraiz, and R. Bollez, "Automatic text extraction from video for content-based annotation and retrieval," in Proc. Int. Conf. Pattern Recognition, Australia, Aug. 16-20, 1998, pp. 618-620.
4. N. Ezaki, M. Bulacu, and L. Schomaker, "Text detection from natural scene images: Towards a system for visually impaired persons," in Proc. Int. Conf. Pattern Recognition, Cambridge, U.K., Aug. 23-26, 2004, pp. 683-686.
5. Y. Liu, H. Lu, X. Y. Xue, and Y. P. Tan, "Effective video text detection using line features," in Proc. Int. Conf. Control, Automation, Robotics and Vision, 2004, pp. 1528-1532. (Pubitemid 40893787)
6. P. Dubey, "Edge based text detection for multi-purpose application," in Proc. Int. Conf. Signal Processing, Beijing, China, Nov. 16-20, 2006.
7. M. Cai, J. Song, and M. R. Lyu, "A new approach for video text detection," in Proc. Int. Conf. Image Processing, Rochester, NY, Sep. 22-25, 2002, pp. 117-120.
8. P. Shivakumara, T. Q. Phan, and C. L. Tan, "Video text detection based on filters and edge features," in Proc. IEEE Int. Conf. Multimedia and Expo, New York, Jun. 3, 2009, pp. 514-517.
9. X. S. Hua, X. R. Chen, W. Y. Liu, and H. J. Zhong, "Automatic location of text in video frames," in Proc. ACM Workshop Multimedia: Information Retrieval, Ottawa, ON, Canada, Sep. 5, 2001.
10. I. Ar and M. E. Karsligli, "Text area detection in digital documents images using textural features," in Proc. Int. Conf. Computer Analysis of Images and Patterns, Vienna, Austria, Aug. 27-29, 2007.
11. K. I. Kim, K. Jung, and J. H. Kim, "Texture-based approach for text detection in images using support vector machines and continuously adaptive mean shift algorithm," Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1631-1639, 2003.
12. C. Garcia and X. Apostolidis, "Text detection and segmentation in complex color images," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Istanbul, Turkey, 2000, pp. 2326-2329.
13. A. K. Jain and S. Bhattacharjee, "Text segmentation using Gabor filters for automatic document processing,"Mach, Vis. Appl, vol. 5, no. 3, pp. 169-184, 1992.
14. W. Mao, F. Chung, K. K. M. Lam, and W. Siu, "Hybrid Chinese/English text detection in images and video frames," in Proc. Int. Conf. Pattern Recognition, Quebec City, QC, Canada, Aug. 11-15, 2002.
15. Q.Ye, Q. Huang, W. Gao, andD. Zhao, "Fast and robust text detection in images and video frames," Image Vis. Comput., vol. 23, no. 6, pp. 565-576, 2005. (Pubitemid 40537040)
16. K. I.Kim, K. Jung, S.H. Park, and H. J. Kim, "Support vectormachinebased text detection in digital video," Pattern Recognit., vol. 34, no. 2, pp. 527-529, 2001. (Pubitemid 32871895)
17. Q. Liu, C. Jung, and Y. Moon, "Text segmentation based on stroke filter," in Proc. ACM Int. Conf. Multimedia, Santa Barbara, CA, Oct. 23-27, 2006, pp. 129-132. (Pubitemid 47113520)
18. Q. Liu, C. Jung, S. Kim, Y. Moon, and J. Kim, "Stroke filter for text localization in video images," in Proc. IEEE Int. Conf. Image Processing, Atlanta, GA, Oct. 8-11, 2006, pp. 1473-1476.
19. B. Epshtein, E. Ofek, and Y. Wexler, "Detecting text in natural scenes with stroke width transform," in Proc. Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, Jun. 13-18, 2010, pp. 2963-2970.
20. K. Jung, K. I. Kim, and A. K. Jain, "Text information extraction in images and video: A survey," Pattern Recognit., vol. 37, no. 5, pp. 977-997, 2004. (Pubitemid 38473840)
21. H. Hase, T. Shinokawa, M. Yoneda, and C. Y. Suen, "Character string extraction from color documents," Pattern Recognit., vol. 34, no. 7, pp. 1349-1365, 2001. (Pubitemid 32430735)
22. J. Gllavata, R. Ewerth, T. Stefi, and B. Freisleben, "Unsupervised text segmentation using color and wavelet features," in Proc. Int. Conf. Image and Video Retrieval, Dublin, Ireland, Jul. 21-23, 2004, pp. 216-224.
23. X. Tang, X. Gao, J. Liu, and H. J. Zhang, "A spatial-temporal approach for video caption detection and recognition," IEEE Trans. Neural Netw., vol. 13, no. 4, pp. 961-971, 2002.
24. J. Shi and C. Tomasi, "Good features to track," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, Seattle, WA, Jun. 21-23, 1994, pp. 593-600.
25. X. Q. Liu, W. Q.Wang, and T. S. Zhu, "Extracting captions in complex background from videos," in Proc. Int. Conf. Pattern Recognition, Istanbul, Turkey, Aug. 23-26, 2010, pp. 3232-3235.