Text from corners: A novel approach to detect text and caption in videos

IEEE Transactions on Image Processing

Volumn 20, Issue 3, 2011, Pages 790-799

  Zhao, Xu ^a   Lin, Kai Hsiang ^b   Fu, Yun ^c   Hu, Yuxiao ^d   Liu, Yuncai ^a   Huang, Thomas S ^b  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c the State University of New York   (United States)

^d MICROSOFT   (United States)

Author keywords

Caption detection; Harris corner detector; moving caption; optical flow; text detection; video retrieval

Indexed keywords

CAPTION DETECTION; HARRIS CORNER DETECTOR; MOVING CAPTION; TEXT DETECTION; VIDEO RETRIEVAL;

ALGORITHMS; DECISION TREES; DETECTORS; OPTICAL FLOWS;

INFORMATION RETRIEVAL;

EID: 79951819462     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2010.2068553     Document Type: Article

References (30)

1. Y. Rui, T. S. Huang, and S. F. Chang, "Image retrieval: Current techniques, promising directions, and open issues," J. Vis. Commun. Image Represent., vol. 10, no. 1, pp. 39-62, 1999.
2. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years," IEEE Trans. PatternAnal. Mach. Intell., vol. 22, no. 12, pp. 1349-1380, Dec. 2000. (Pubitemid 32088465)
3. Y. A. Aslandogan and C. T. Yu, "Techniques and systems for image andvideoretrieval," IEEETrans.Knowl. Data Eng., vol. 11,no. 1,pp. 56-63, Jan./Feb. 1999.
4. X. Tang, X. Gao, J. Liu, and H. Zhang, "A spatial-temporal approach for video caption detection and recognition," IEEE Trans. Neural Netw., vol. 13, no. 4, pp. 961-971, Jul. 2002.
5. H.Li,D. Doermann, and O. Kia, "Automatic text detection and tracking indigitalvideo,"IEEETrans.ImageProces.,vol.9,no. 1,pp. 147-156, Jan. 2000. (Pubitemid 30562093)
6. K. Kim, K. Jung, and J. Kim, "Texture-based approach for text detection in images using support vector machines and continuously adaptive mean shift algorithm," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1631-1639, Dec. 2003.
7. Y. Zhong, H. Zhang, and A. K. Jain, "Automatic caption localization in compressed video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 4, pp. 385-392, Apr. 2000.
8. K. Jung, K. I. Kim, and A. K. Jain, "Text information extraction in images and video: A survey," Pattern Recognit., vol. 37, no. 5, pp. 977-997, 2004. (Pubitemid 38473840)
9. F. Idris and S. Panchanathan, "Review of image and video indexing techniques," J. Vis. Commun. Image Represent., vol. 8, no. 2, pp. 146-166, 1997. (Pubitemid 127437179)
10. Y. Zhong, K. Karu, and A. K. Jain, "Locating text in complex color images," Pattern Recognit., vol. 28, no. 10, pp. 1523-1535, 1995. (Pubitemid 26443598)
11. V. Wu, R. Manmatha, and E. M. Riseman, "Textfinder: An automatic system to detect and recognize text in images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 11, pp. 1224-1229, Nov. 1999. (Pubitemid 32211200)
12. W. Mao, F. Chung, K. K. M. Lam, and W. Sun, "Hybrid chinese/english text detection in images and video frames," in Proc. 16th Int. Conf. PatternRecognit., 2002, vol. 3, pp. 1015-1018. (Pubitemid 44844658)
13. B. K. Sin, S. K. Kim, and B. J. Cho, "Locating characters in scene images using frequency features," in Proc. 16th Int. Conf. Pattern Recognit., 2002, vol. 3, pp. 489-492.
14. Y. Hao, Z. Yi, H. Zengguang, and T. Min, "Automatic text detection in video frames based on bootstrap artificial neural network and ced," in Proc. 11thInt. Conf. CentralEur. Comput. Graph., Vis. Comput. Vis., 2003, vol. 11, pp. 4246-4251.
15. A. K. Jain and B. Yu, "Automatic text location in images and video frames," Pattern Recognit., vol. 31, no. 12, pp. 2055-2076, 1998.
16. J. Ohya, A. Shio, and S. Akamatsu, "Recognizing characters in scene images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 16, no. 2, pp. 214-220, Feb. 1994.
17. R. Lienhart and F. Stuber, "Automatic text recognition in digital videos," in Proc. Image Video Process. IV, pp. 180-188.
18. W. Kim and C. Kim, "A new approach for overlay text detection and extraction from complex video scene," IEEE Trans. Image Process., vol. 18, no. 2, pp. 401-411, Feb. 2009.
19. M. A. Smith and T. Kanade, Video Skimming for Quick Browsing Based on Audio and Image Characterization Carnegie Mellon Univ., School Comput. Sci., Pittsburgh, PA, Tech. Rep. CMU-CS-95-186, 1995.
20. L. Agnihotri and N. Dimitrova, "Text detection for video analysis," in Proc. IEEE Workshop Content-Based Access Image Video Libraries, Washington, DC, 1999, pp. 109-113.
21. C. Garcia and X. Apostolidis, "Text detection and segmentation in complex color images," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2000, vol. 6, pp. 2326-2329.
22. X. Liu and J. Samarabandu, "Multiscale edge-based text extraction from complex images," in Proc. Int. Conf. Multimedia Expo., 2006, pp. 1721-1724. (Pubitemid 46680067)
23. M. R. Lyu, J. Song, and M. Cai, "A comprehensive method for multilingual video text detection, localization, and extraction," IEEE Trans. CircuitsSyst. Video Technol., vol. 15, no. 2, pp. 243-255, Feb. 2005. (Pubitemid 40265948)
24. F. Coulmas, The Blackwell Encyclopedia of Writing Systems. Oxford, U.K.: Blackwell, 1996.
25. X. S. Hua, X. R. Chen, L. Wenyin, and H. J. Zhang, "Automatic location of text in video frames," in Proc. ACM Workshops Multimedia: MultimediaInf. Retriev., 2001, pp. 24-27.
26. C. Harris and M. Stephens, "A combined corner and edge detector," in Proc. Alvey Vis. Conf., 1988, pp. 147-151.
27. C. Schmid, R. Mohr, and C. Bauckhage, "Evaluation of interest point detectors," Int. J. Comput. Vis., vol. 37, no. 2, pp. 151-172, 2000.
28. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. Int. Joint Conf. Artif. Intell., 1981, pp. 674-679. (Pubitemid 14478744)
29. J. R. Bergen, P. Anandan, K. J. Hanna, and R. Hingorani, "Hierarchical model-based motion estimation," in Proc. Eur. Conf. Comput. Vis., 1992, vol. 588, pp. 237-252.
30. L. Breiman, Classification and Regression Trees. London, U.K.: Chapman & Hall, 1998.