A framework for flexible summarization of racquet sports video using multiple modalities

Computer Vision and Image Understanding

Volumn 113, Issue 3, 2009, Pages 415-424

  Liu, Chunxi ^a   Huang, Qingming ^a,b   Jiang, Shuqiang ^b   Xing, Liyuan ^c   Ye, Qixiang ^a   Gao, Wen ^d  

^a UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

^b INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^c NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

^d PEKING UNIVERSITY   (China)

Author keywords

Highlight ranking; Scene segmentation; Sports video summarization; Temporal voting strategy

Indexed keywords

AUDIO ACOUSTICS; VISUAL COMMUNICATION;

AUDIO AND VIDEOS; AUDIO CLASSIFICATIONS; AUDIO KEYWORDS; EVENT DETECTIONS; HIGHLIGHT RANKING; MULTIPLE MODALITIES; SCENE SEGMENTATION; SHOT CLUSTERING; SPORTS VIDEO SUMMARIZATION; TABLE-TENNIS; TEMPORAL VOTING STRATEGY; VIDEO CONTENTS; VIDEO SHOTS; VOTING SCHEMES;

VIDEO RECORDING;

EID: 59349103114     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2008.08.002     Document Type: Article

References (31)

1. Y. Gong, T.S. Lim, H.C. Chua, Automatic parsing of TV soccer programs, in: Proc. Int. Conf. Multimedia Computing and Systems, Washington, DC, USA, May 1995, pp. 167-170.
2. L. Xie, S.-F. Chang, A. Divakaran, H. Sun, Structure analysis of soccer video with hidden Markov models, in: Proc. Int. Conf. Acoustic, Speech and Signal Processing, Orlando, USA, May 2002, vol. 4, pp. 4096-4099.
3. Ekin A., Tekalp A.M., and Mehrotra R. Automatic soccer video analysis and summarization. IEEE Transaction on Image Processing 12 7 (2003) 796-807
4. Y. Rui, A. Gupta, A. Acero, Automatically extracting highlights for TV baseball programs, in: Proc. ACM Multimedia, Marina del Rey, CA, USA, October 2000, pp. 105-115.
5. M. Xu, L.-Y. Duan, C.-S. Xu, Q. Tian, A fusion scheme of visual and auditory modalities for event detection in sports video, in: Proc. Int. Conf. Acoustic, Speech and Signal Processing, Hong Kong, China, April 2003, vol. 3, pp. 189-192.
6. Z. Xiong, R. Radhakrishnan, A. Divakaran, T.S. Huang, Audio events detection based highlights extraction from baseball, golf and soccer games in a unified framework, in: Proc. Int. Conf. Acoustic, Speech and Signal Processing, Hong Kong, China, April 2003, vol. 5, pp. 632-635.
7. Snoek C.G.M., and Worring M. Multimodal video indexing: a review of the state-of-the-art. Multimedia Tools and Applications 25 1 (2005) 5-35
8. Gong Y., Han M., Hua W., and Xu W. Maximum entropy model-based baseball highlight detection and classification. Computer Vision and Image Understanding 96 2 (2004) 181-199
9. Leonardi R., Migliorati P., and Prandini M. Semantic indexing of soccer audio-visual sequences: a multimodal approach based on controlled Markov chains. IEEE Transaction on Circuits System and Video Technology 14 5 (2004) 634-643
10. J. Huang, Z. Liu, Y. Wang, Y. Chen, E.K. Wong, Integration of multimodal features for video scene classification based on HMM, in: Proc. Int. Workshop on Multimedia Signal Processing, Denmark, September 1999, pp. 53-58.
11. M. Petkovic, V. Mihajlovic, W. Jonker, S. Kajan, Multimodal extraction of highlights from TV formula 1 programs, in: Proc. Int. Conf. Multimedia and Expo, Switzerland, August 2002, vol. 1, pp. 817-820.
12. S. Nepal, U. Srinivasan, G. Reynolds, Automatic detection of 'goal' segments in basketball videos, in: Proc. ACM Multimedia, Ottawa, Canada, October 2001, pp. 261-269.
13. A. Hanjalic, Generic approach to highlights extraction from a sports video, in: Proc. Int. Conf. Image Processing, Spain, September 2003, vol. 1, pp. 1-4.
14. Z. Xiong, R. Radhakrishnan, A. Divakaran, Generation of sports highlights using motion activity in combination with a common audio feature extraction framework, in: Proc. Int. Conf. Image Processing, Catalonia, Spain, September 2003, vol. 1, pp. 14-17.
15. Zhu G., Huang Q.-M., Xu C.-S., Xing L.-Y., Gao W., and Yao H.-X. Human behavior analysis for highlight ranking in broadcast racket sports video. IEEE Transaction on Multimedia 9 6 (2007) 1167-1182
16. B. Zhang, W.-B. Dou, L.-M. Chen, Audio content-based highlight detection using adaptive Hidden Markov Model, in: Proc. Int. Conf. Intelligent Systems Design and Applications, Shandong, China, vol. 1, 2006, pp. 798-803.
17. B. Zhang, W. Chen, W.-B. Dou, J. Yu, L.-M. Chen, Content-based table tennis games highlight detection utilizing audiovisual clues, in: Proc. Int. Conf. Image and Graphics, Sichuan, China, 2007, pp. 833-838.
18. W. Chen, Y.-J. Zhang, Tracking ball and players with applications to highlight ranking of broadcasting table tennis video, in: Proc. Int. Conf. Computational Engineering in Systems Applications, Beijing, China, October 2006, vol. 2, pp. 1896-1903.
19. Lu H., and Tan Y.-P. Unsupervised clustering of dominant scenes in sports video. Pattern Recognition Letters 24 15 (2003) 2651-2662
20. T. Mei, Y.-F. Ma, H.-Q. Zhou, W.-Y. Ma, H.-J. Zhang, Sports video mining with mosaic, in: Proc. Int. Conf. Multi-media Modeling, Melbourne, Australia, January 2005, pp. 107-114.
21. Duan L.Y., Xu M., Tian Q., Xu C.S., and Jin J.S. A unified framework for semantic shot classification in sports video. IEEE Transactions on Multimedia 7 6 (2005) 1066-1083
22. W.-G. Zhang, Q.-X Ye, L.-Y. Xing. Q.-M. Huang, W. Gao, Unsupervised sports video scene clustering and its applications to story units detection, in: Proc. SPIE. Visual Communications and Image Processing, Beijing, China, July 2005, vol. 5960, pp. 446-455.
23. Lu L., Zhang H.-J., and Li S.-Z. Content-based audio classification and segmentation by using support vector machines. Multimedia Systems 8 6 (2003) 482-492
24. Zhang T., and Kuo C.-C.J. Audio content analysis for online audiovisual data segmentation and classification. IEEE Transaction on Speech and Audio Processing 9 4 (2001) 441-457
25. Wang Y., Liu Z., and Huang J. Multimedia content analysis using audio and visual information. IEEE Transaction on Signal Processing Magazine 17 4 (2000) 12-36
26. Jain A.-K. Statistical pattern recognition: a review. IEEE Transaction on Pattern Analysis and Machine Intelligence 22 1 (2001) 4-37
27. Scholkopf B., Burges C., and Smola A.-J. Advances in kernel methods: support vector machine (1999), MIT Press
28. Hanjalic A., and Xu L.-Q. Affective video content representation and modeling. IEEE Transaction on Multimedia 17 1 (2005) 143-154
29. K.-A. Peker, A. Divakaran, Framework for measurement of the intensity of motion activity of video segments, in: Proc. SPIE Internet Multimedia Management Systems III, July 2002, vol. 4862, pp. 126-137.
30. K.-A. Peker, R. Cabasson, A. Divakaran, Rapid generation of sports video highlights using the MPEG-7 motion activity descriptor, in: Proc. SPIE Storage and Retrieval for Media Databases, San Jose, CA, January 2002, vol. 4676, pp. 318-323.
31. Peker K.A., and Divakaran A. Framework for measurement of the intensity of motion activity of video segments. Journal of Visual Communication and Image Representation 15 3 (2004) 265-284