An intelligent strategy for the automatic detection of highlights in tennis video recordings

Expert Systems with Applications

Volumn 36, Issue 6, 2009, Pages 9907-9918

  Huang, Yo Ping ^a   Chiou, Ching Lin ^b   Sandnes, Frode Eika ^c  

^a NATIONAL TAIPEI UNIVERSITY OF TECHNOLOGY   (Taiwan)

^b TATUNG UNIVERSITY   (Taiwan)

^c OSLO METROPOLITAN UNIVERSITY   (Norway)

Author keywords

Computational intelligence; Highlight; Precision and recall rates; Sport video

Indexed keywords

AUDIO AND VIDEOS; AUTOMATIC DETECTIONS; COMPUTATIONAL INTELLIGENCE; CONTENT-BASED; HIGHLIGHT; KEY SEGMENTS; MEAN PRECISION; PRECISION AND RECALL RATES; RAPID GROWTHS; SPORT VIDEO; TARGET DOMAINS; VIDEO INDEXING; VIDEO PLAYBACKS;

ARTIFICIAL INTELLIGENCE; BROADCASTING; BUBBLES (IN FLUIDS); INTELLIGENT CONTROL;

VIDEO RECORDING;

EID: 64049111777     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2009.01.078     Document Type: Article

References (42)

1. Academic staff at physics UNSW: Wolfe, J. (2008). Available: The definition and examples of the decibel-.
2. Assfalg J., Bertini M., Colombo C., and Bimbo A.D. Semantic annotation of sports videos. IEEE Multimedia 9 2 (2002) 52-60
3. Babaguchi N., Kawai Y., and Kitahashi Y. Event based indexing of broadcasted sports video by intermodal collaboration. IEEE Transactions on Multimedia 4 1 (2002) 68-75
4. Babaguchi N., Kawai Y., Ogura T., and Kitahashi T. Personalized abstraction of broadcasted American football video by highlight selection. IEEE Transactions on Multimedia 6 4 (2004) 575-586
5. Bertini M., Cucchiara R., Bimbo A., and Prati A. Semantic adaptation of sport videos with user-centred performance analysis. IEEE Transactions on Multimedia 8 3 (2006) 433-443
6. Canny J.F. A computational approach to edge-detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 8 6 (1986) 679-698
7. Coldefy, F., Bouthemy, P., Betser, M., & Gravier, G. (2004). Tennis video abstraction from audio and visual cues. In Proceedings of IEEE international workshop on multimedia signal processing, Siena, Italy (pp. 163-166).
8. Duan L.-Y., Xu M., Tian Q., Xu C.-S., and Jin J.S. A unified framework for semantic shot classification in sports video. IEEE Transactions on Multimedia 7 6 (2005) 1066-1083
9. Gonzalez R.G., and Woods R.E. Digital Image Processing (1992), Addison Wesley, New York, NY, USA
10. Han B., Hu Y.C., Wang G.J., Wu W.G., and Yoshigahara T. Enhanced sports video shot boundary detection based on middle level features and a unified model. IEEE Transactions on Consumer Electronics 53 3 (2007)
11. Hanjalic, A. (2003). Generic approach to highlights extraction from a sport video. In Proceedings of IEEE international conference on image processing, Barcelona, Spain (pp. 1-4, vol. 1).
12. Huang Y.-P., Hsu L.-W., and Sandnes F.E. An intelligent subtitle detection model for locating television commercials. IEEE Transactions on Systems, Man, and Cybernetics: Part B 37 2 (2007) 485-492
13. Huang C.-L., Shih H.-C., and Chao C.-Y. Semantic analysis of soccer video using dynamic Bayesian network. IEEE Transactions on Multimedia 8 4 (2006) 749-760
14. Jang J.S.R., and Gulley N. The Fuzzy Logic Toolbox for use with MATLAB (1995), The Mathworks Inc.
15. Jang J.S.R., Sun C.T., and Mizutani E. Neuro-Fuzzy and Soft Computing (1997), Prentice-Hall, Inc., NJ, USA
16. Kijak E., Gravier G., Oisel L., and Gros P. Audiovisual integration for tennis structuring. Multimedia Tools and Application 30 3 (2006) 289-312
17. Kongwah W., and Yan X. Advertising insertion in sports webcasts. IEEE Multimedia 14 2 (2007) 78-82
18. Lao, W., Han, J., & de With, P. H. N. (2006). Automatic sports video analysis using audio clues and context knowledge. In Proceedings of the 24th IASTED international conference on internet and multimedia systems and applications, Innsbruck, Austria (pp. 198-202, vol. 1).
19. Leonardi R., Migliorati R., and Prandini M. Semantic indexing of soccer audio-visual sequences: A multimodal approach based on controlled Markov chains. IEEE Transactions on Circuits and Systems for Video Technology 14 5 (2004) 634-643
20. Liang D., Huang Q.M., Liu Y., Zhu G.Y., and Gao W. Video2Cartoon: A system for converting broadcast soccer video into 3D cartoon animation. IEEE Transactions on Consumer Electronics 53 3 (2007) 1138-1146
21. Maar D., and Hildreth E. Theory of edge detection. Proceedings of the Royal Society London, Series B, Biological Sciences 207 1167 (1980) 187-217
22. Otsuka I., Radhakrishnan R., Siracusa M., Divakaran A., and Mishima H. An enhanced video summarization system using audio features for a personal video recorder. IEEE Transactions on Consumer Electronics 52 1 (2006) 168-172
23. Otsuka I., Suginohara H., Kusunoki Y., and Divakaran A. Detection of music segment boundaries using audio-visual features for a personal video recorder. IEEE Transactions on Consumer Electronics 53 1 (2007) 150-154
24. Pan, H., Beek, P. V., & Sezan, M. I. (2001). Detection of slow-motion replay segments in sports video for highlights generation. In Proceedings of IEEE international conference on acoustics, speech, and signal processing, Salt Lakes, UT, USA (pp. 1640-1652, vol. 3).
25. Peltonen, V., Tuomi, J., Klapuri, A., Huopaniemi, J., & Sorsa, T. (2002). Computational auditoy scene recognition. In Proceedings of IEEE international conference on acoustics, speech, and signal processing, Orlando, FL, USA (pp. 1941-1944, vol. 2).
26. Rabiner L.R. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77 2 (1989) 257-286
27. Rabiner L., and Schafer R. Digital Processing of Speech Signals (1978), Prentice-Hall, Englewood Cliffs, NJ, USA
28. Rea, N., Dahyot, R., & Kokaram, A. (2005). Classification and representation of semantic content in broadcast tennis videos. In Proceedings of IEEE international conference on image processing, Genoa, Italy (pp. 1204-1207, vol. 3).
29. Sadlier D.A., and O'Connor N.E. Event detection in field sports video using audio-visual features and a support vector Machine. IEEE Transactions on Circuits and Systems for Video Technology 15 10 (2005) 1225-1233
30. Shih H.-C., and Huang C.-L. MSN: statistical understanding of broadcasted baseball video using multi-level semantic network. IEEE Transactions on Broadcasting 51 4 (2005) 449-459
31. Sonka M., Hlavac V., and Boyle R. Image Processing, Analysis and Machine Vision. 2nd ed. (1999), Brooks/Cole, Pacific Grove, CA
32. Tjondronegoro D., Chen Y.-P., and Pham B. Integrating highlights for more complete sports video summarization. IEEE Multimedia 11 4 (2004) 22-37
33. Tjondronegoro, D., Chen, Y.-P., & Pham, B. (2003). Sports video summarization using highlights and play-breaks. In Proceedings of the fifth ACM SIGMM international workshop on multimedia information retrieval, Berkeley, CA, USA (pp. 201-208).
34. Wang J., Cheng E., Xu C., Lu H.Q., and Tian Q. Generation of personalized music sports video using multimodal cues. IEEE Transactions on Multimedia 9 3 (2007) 576-588
35. Xiong, Z., Radhakrishnan, R., Divakaran, A., & Huang, T. S. (2003). Audio events detection based highlights extraction from baseball, golf and soccer games in a unified framework. In Proceedings of IEEE international conference on multimedia and expo, Baltimore, MD, USA (pp. 401-404, vol. 3).
36. Xiong, Z., Radhakrishnan, R., & Divakaran, A. (2003). Generation of sports highlights using motion activities in combination with a common audio feature extraction framework. In Proceedings of IEEE international conference on image processing, Barcelona, Spain (pp. 5-8, vol. 1).
37. Yager R.R., and Filev D.P. Essentials of Fuzzy Modeling and Control (1994), Addison Wesley, New York, NY, USA
38. Zhang T., and Kuo C.-C.J. Audio content analysis for online audiovisual data segmentation and classification. IEEE Transactions on Speech and Audio Processing 9 4 (2001) 441-457
39. Zhang T., and Kuo C.C.J. Audio content analysis for online audiovisual data segmentation and classification. IEEE Transactions on Speech and Audio Processing 9 4 (2001) 441-457
40. Zhao, Z., Jiang, S., Huang, Q., & Zhu, G. (2006). Highlight summarization in sports video based on replay detection. In Proceedings of IEEE international conference on multimedia and expo, Toronto, Ontario, Canada (pp. 1613-1616).
41. Zhong, D., & Chang, S.-F. (2001). Structure analysis of sports video using domain models. In Proceedings of IEEE international conference on multimedia and expo, Tokyo, Japan (pp. 713-726).
42. Zhu G.Y., Huang Q.M., Xu C.S., Xing L.Y., Gao W., and Yao H.X. Human behavior analysis for highlight ranking in broadcast racket sports video. IEEE Transactions on Multimedia 9 6 (2007) 1167-1182