Content extraction and interpretation of superimposed captions for broadcasted sports videos

IEEE Transactions on Broadcasting

Volumn 54, Issue 3, 2008, Pages 333-346

  Shih, Huang Chia ^a   Huang, Chung Lin ^a,b  

^a NATIONAL TSING HUA UNIVERSITY   (Taiwan)

^b FO GUANG UNIVERSITY   (Taiwan)

Author keywords

Content based video analysis; Contextual understanding; Sports video; Superimposed caption box (SCB); Video annotation

Indexed keywords

CODES (SYMBOLS); INFORMATION RETRIEVAL SYSTEMS; INFORMATION THEORY; VIDEO RECORDING; VISUAL COMMUNICATION;

A-PRIORI; AND MODELING; BITMAPS; CONTENT EXTRACTION; CONTENT-BASED VIDEO ANALYSIS; CONTEXTUAL UNDERSTANDING; SEMANTIC INTERPRETATION; SPORTS VIDEO; SPORTS VIDEOS; SUPERIMPOSED CAPTION BOX (SCB); TEMPLATE EXTRACTION; VIDEO ANNOTATION; VIDEO CONTENTS;

PROGRAM INTERPRETERS;

EID: 50549091956     PISSN: 00189316     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBC.2008.2001143     Document Type: Article

References (35)

1. "MPEG-7: Overview (version 8)," ISO/IEC, JTC1/SC29 /WG11, Jul. 2002, N4980.
2. S.-F. Chang, T. Sikora, and A. Puri, "Overview of the MPEG-7 standard," IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 6, pp. 688-695, Jun. 2001, special issue on MPEG-7.
3. S. Dasiopoulou, V. Mezaris, I. Kompatsiaris, V-K. Papastathis, and M. G. Strintzis, "Knowledge-assisted semantic video object detection," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 10, pp. 1210-1224, Oct. 2005.
4. M. R. Naphade, I. V. Kozintsev, and T. S. Huang, "A factor graph framework for semantic video indexing," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 1, pp. 40-52, Jan. 2002.
5. M. R. Naphade, S. Basu, J. R. Smith, C.-Y. Lin, and B. Tseng, "Modeling semantic concepts to support query by keywords in video," in Proc. IEEE ICIP 2002, Rochester, New York, Sep. 22-25, 2002.
6. N. Babaguchi, Y. Kawai, T. Ogura, and T. Kitahashi, "Personalized abstraction of broadcasted American football video by highlight selection," IEEE Trans. Multimedia, vol. 6, no. 4, pp. 575-586, Aug. 2004.
7. C.-H. Liang, W.-T. Chu, J.-H. Kuo, J.-L. Wu, and W.-H. Cheng, "Baseball event detection using game-specific feature sets and rules," in Proc. IEEE ISCAS 2005, Kobe, Japan, May 23-26, 2005.
8. C. G. M. Snoek and M. Worring, "Multimodal video indexing: A review of the state-of-the-art," Multimedia Tools and Applications, vol. 25, no. 1, pp. 5-35, 2005.
9. D. A. Sadlier and N. E. O' Connor, "Event detection in field sports video using audio-visual features and a support vector machine," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 10, pp. 1225-1233, Oct. 2005.
10. T. Sato, T. Kanada, E. Hughes, and M. Smith, "Video OCR for digit news archives," in IEEE Workshop on CAIVD, Jan. 1998, pp. 52-60.
11. X. Tang, X. Gao, J. Liu, and H. Z. Zhang, "A spatial- temporal approach for video caption detection and recognition," IEEE Trans Neural Networks, vol. 13, no. 4, pp. 961-971, Jul. 2002.
12. G. Xu, Y.-F. Ma, H.-J. Zhang, and S.-Q. Yang, "An HMM-based framework for video semantic analysis," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 11, pp. 1422-1433, Nov. 2005.
13. H. C. Shih and C. L. Huang, "MSN: Statistical understanding of broad-casted sports video using multilevel semantic network," IEEE Trans. Broadcasting, vol. 15, no. 4, pp. 449-459, Dec. 2005.
14. C. Y. Chao, H. C. Shih, and C. L. Huang, "Semantics-based highlight extraction of soccer program using DBN," in Proc. IEEE ICASSP 2005, Philadelphia, PA, Mar. 18-23, 2005.
15. W.-N. Lie and S.-H. Shia, "Combining caption and visual features for semantic event classification of baseball video," in Proc. IEEE ICME 2005, Jul. 6-8, 2005.
16. D. Zhang, R. K. Rajendran, and S.-F. Chang, "General and domain-specific techniques for detecting and recognizing superimposed text in video," in Proc. IEEE ICIP 2002, Sep. 22-25, 2002.
17. S.-H. Sung and W.-S. Chun, "Knowledge-based numeric open caption recognition for live sportscast," in Proc. IEEE ICPR 2002, Aug. 11-15, 2002.
18. M. R. Lyu, J. Song, and M. Cai, "A comprehensive method for multilingual video text detection, localization, and extraction," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 2, pp. 243-255, Feb. 2005.
19. R. Lienhart and A. Wernicke, "Localizing and segmenting text in images and videos," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 14, pp. 256-268, Apr. 2002.
20. R. Lienhart, "Video OCR: A survey and practitioner's guide," The Kluwer International Series in Video Computing, vol. 6: Video Mining, 2003.
21. H. Li and D. Doermann, "Text enhancement in digit video using multiple frame integration," in Proc. of 7th ACM Int. Conf. on Multimedia, Orlando, Florida, Oct. 1999, pp. 19-22.
22. J. Xi, X.-S. Hua, X.-R. Chen, W. Liu, and H.-J. Zhang, "A video text detection and recognition system," in Proc. IEEE ICME 2001, Tokyo, Japan, Aug. 22-25, 2001.
23. X. Chen and A. L. Yuille, "Detecting and reading text in natural scenes," in Proc. IEEE CVPR 2004, Washington, DC, Jul. 2004, pp. 366-373.
24. A. Ekin, A. M. Tekalp, and R. Mehrotra, "Automatic soccer video analysis and summarization," IEEE Trans. Image Processing, vol. 12, no. 7, pp. 796-807, Jul. 2003.
25. A. Polesel, G. Ramponi, and V. J. Mathews, "Image enhancement via adaptive unsharp masking," IEEE Trans. Image Processing, vol. 9, no. 3, pp. 505-510, Mar. 2000.
26. K. Fukanaga, Introduction to Statistical Pattern Recognition. New York: Academic Press, 1972.
27. N. Otsu, "A threshold selection method from gray-level histograms," IEEE Trans. Systems, Man, and Cybernetics, vol. 9, no. 1, pp. 62-66, Mar. 1979.
28. O. Trier, A. Jain, and T. Taxt, "Feature extraction, methods for character recognition - A survey," Pattern Recognition, vol. 29, no. 4, pp. 641-662, 1996.
29. A. Khotanzad and Y. H. Hong, "Invariant image recognition by Zernike moments," IEEE Trans. Pattern Anal Mach. Intell., vol. 12, no. 5, pp. 489-497, May 1990.
30. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
31. K. Crammer and Y. Singer, "On the algorithmic implementation, of multi-class kernel-based machines," J. of Machine Learning Research, vol. 2, pp. 265-292, Dec. 2001.
32. G. Miao, G. Zhu, S. Jiang, Q. Huang, C. Xu, and W. Gao, "A real-time score detection and recognition approach for broadcast basketball video," in Proc. IEEE ICME 2007, Beijing, China, Jul. 2-5, 2007, pp. 1691-1694.
33. Y. Takahashi, N. Nitta, and N. Babaguchi, "User and device adaptation for sports video content," in Proc. IEEE ICME 2007, Beijing, China, Jul. 2-5, 2007, pp. 1051-1054.
34. A. Kokaram, N. Rea, R. Dahyot, A. M. Tekalp, P. Bouthemy, P. Gros, and I. Sezan, "Browsing sports video," IEEE Signal Processing Magazine, pp. 46-58, March 2006.
35. Z. Xiong, X. S. Zhou, Q. Tian, Y. Rui, and T. S. Huang, "Semantic retrieval of video," IEEE Signal Processing Magazine, pp. 18-27, March 2006.