Fusion of audio and motion information on HMM-based highlight extraction for baseball games

IEEE Transactions on Multimedia

Volumn 8, Issue 3, 2006, Pages 585-599

  Cheng, Chih Chieh ^b   Hsu, Chiou Ting ^a,c  

^a IEEE   (Taiwan)

^b INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE   (Taiwan)

^c NATIONAL TSING HUA UNIVERSITY   (Taiwan)

Author keywords

Audio feature; Camera motion; Hidden Markov model; Highlight extraction; Likelihood model; Object motion intensity

Indexed keywords

AUDIO FEATURE; CAMERA MOTION; HIDDEN MARKOV MODEL; HIGHLIGHT EXTRACTION; LIKELIHOOD MODEL; OBJECT MOTION INTENSITY;

COMPUTER GRAPHICS; DATABASE SYSTEMS; FEATURE EXTRACTION; MATHEMATICAL MODELS; MOTION ESTIMATION; SOUND RECORDING; VIDEO RECORDING;

MULTIMEDIA SYSTEMS;

EID: 33646717803     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2006.870726     Document Type: Article

References (49)

1. D. Zhong and S. F. Chang, "Structure analysis of sports video using domain models," in Proc. ICME'01, 2001, pp. 713-716.
2. A. Ekin, A. M. Tekalp, and R. Mehrotra, "Automatic soccer video analysis and summarization," IEEE Trans. Image Processing, vol. 12, no. 7, pp. 796-807, Jul. 2003.
3. V. Tovinkere and R. J. Qian, "Detecting semantic events in soccer games: toward a complete solution," in Proc. ICME'01, 2001.
4. J. Assfalg, M. Bertini, A. Del Bimbo, W. Nunziati, and P. Pala, "Detection and recognition of football highlights using HMM," in Proc. ICECS'02, 2002, vol. 3, pp. 1059-1062.
5. G. Xu, Y. F. Ma, H. J. Zhang, and S. Q. Yang, "A HMM based semantic analysis framework for sports game event detection," in Proc. ICIP '03, Sep. 2003, vol. 1, pp. 25-28.
6. B. Li and I. Sezan, "Semantic sports video analysis: approaches and new applications," in Proc. ICIP'03, Sep. 2003, vol. 1, pp. 27-20.
7. T. Kawashima, K. Tateyama, T. Iijima, and Y. Aoki, "Indexing of baseball telecast for content-based video retrieval," in Proc. ICIP'98, 1998, vol. 1, pp. 871-874.
8. M. Petkovic, V. Mihajlovic, and W. Jonker, "Techniques for automatic video content derivation," in Proc. ICIP'03, Sep. 2003.
9. H. Pan, P. van Beek, and M. I. Sezan, "Detection of slow-motion replay segments in sports video for highlights generation," in Proc. ICASSP'01, 2001, vol. 3, pp. 1649-1642.
10. Y. Rui, A. Gupta, and A. Acero, "Automatically extracting highlights for TV baseball programs," in Eighth ACM Int. Conf. Multimedia, 2000, pp. 105-115.
11. Z. Xiong, R. Radhakrishnan, A. Divakaran, and T. Huang, "Audio events detection based highlights extraction from baseball, golf and soccer games in a unified framework," in Proc. ICASSP 2003, Apr. 2003, vol. 3, pp. 401-404.
12. R. Leonardi, P. Migliorati, and M. Prandini, "Semantic indexing of sports program sequences by audio-visual analysis," in Proc. ICIP 2003, Sep. 2003, vol. 3, pp. 401-404.
13. A. Divakaran, R. Radhakrishnan, and K. A. Peker, "Motion activity-based extraction of key-frames from video shots," in Proc. ICIP'02, Sep. 2002, vol. 1, pp. 932-935.
14. X. Shao, C. Xu, and M. S. Kankanhalli, "Automatically generating summaries for musical video," in Proc. ICIP 2003. Sep. 2003, vol. 2, pp. 547-550.
15. Y. Gong and X. Liu, "Video summarization and retrieval using singular value decomposition," Multimedia Syst., vol. 9, no. 2, Aug. 2003.
16. M. Smith and T. Kanade, "Video skimming and characterization through the combination of image and language understanding techniques," in Proc. CVPR'97, 1997.
17. Y. F. Ma and H. J. Zhang, "A model of motion attention for video skimming," in Proc. ICIP 2002, Sep. 2002.
18. H. Sundaram, L. Xie, and S. F. Chang, "A utility framework for the automatic generation of audio-visual skims," in Proc. ACM Multimedia, 2002.
19. M. J. Roach, J. S. D. Mason, and M. Pawlewski, "Video genre classification using dynamics," in Proc. ICASSP'01, 2001.
20. A. Bonzanini, R. Leonardi, and P. Migliorati, "Event recognition in sport programs using low-level motion indices," in Proc. ICME'01, 2001.
21. N. Peyrard and P. Bouthemy, "Detection of meaningful events in videos based on a supervised classification approach," in Proc. ICIP'03, Sep. 2003.
22. Y. P. Tan, D. D. Saur, S. R. Kulkarni, and P. J. Ramadge, "Rapid estimation of camera motion from compressed video with application to video annotation," IEEE Tran. Circuits Syst. Video Technol., vol. 10, no. 1, pp. 133-146, Feb. 2000.
23. P. Chang, M. Han, and Y. Gong, "Extract highlights from baseball game video with Hidden Markov models," in Proc. ICIP 2002, Sep. 2002. vol. 1, pp. 609-612.
24. L. Xie, S. F. Chang, A. Divakaran, and H. Sun, "Structure analysis of sports video with Hidden Markov models," in Proc. ICASSP'02, 2002, vol. 1, p. PAGES?.
25. G. Xu, Y. F. Ma, H. J. Zhang, and S. Q. Yang, "Motion-based event recognition using HMM," in Proc. ICPR '02,2002, vol. 2, pp. 831-834.
26. Y. L. Chang, W. Zeng, I. Kamel, and R. Alonso, "Integrated image and speech analysis for content-based video indexing," in Proc. ICMCS 1996, 1996, pp. 306-313.
27. A. Albiol, L. Torres, and J. Delp, "The indexing of persons in news sequences using audio-visual data," in Proc. ICASSP'03, 2003.
28. S. C. Chen, M. L. Shyu, W. Liao, and C. Zhang, "Scene change detection by audio and video clues," in Proc. ICME'02, 2002, vol. 2, pp. 365-368.
29. Z. Xiong, R. Radhakrishnan, and A. Divakaran, "Generation of sports highlights using motion activity in combination with a common audio feature extraction framework," in Proc. ICIP 2003, Sep. 2003, vol. 1, pp. 5-8.
30. W. Hua, M. Han, and Y. Gong, "Baseball scene classification using multimedia features," in Proc. ICME'02, 2002, vol. 1, pp. 821-824.
31. A. Hanjalic, "Generic approach to highlight extraction from a sport video," in Proc. ICIP'03, Sep. 2003, vol. 1, pp. 1-4.
32. R. Dahyot, A. Kokaram, N. Rea, and H. Denman, "Joint audio visual retrieval for tennis broadcasts," in Proc. ICASSP'03, 2003, vol. 3, pp. 561-564.
33. Y. Gong, X. Liu, and W. Hua, "Creating motion video summaries with partial audio-visual alignment," in Proc. ICME'02, 2002, vol. 1, pp. 26-29.
34. C. C. Cheng and C. T. Hsu, "Content-based audio classification with generalized ellipsoid distance," in Proc. PCM 2002, Dec. 2002, p. PAGES?.
35. Y. Wang, Z. Liu, and J. C. Huang, "Multimedia content analysis," IEEE Signal Process. Mag., pp. 12-36, Nov. 2000.
36. A. M. Kondoz, Digital Speech. New York: Wiley, 1994.
37. L. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
38. J. R. Deller, J. H. L. Hansen, and J. G. Proakis, Discrete-Time Processing of Speech Signals. Piscataway, NJ: IEEE Press, 2000.
39. T. Hastie and R. Tibshirani, "Discriminant analysis by gaussian mixtures," J. Roy. Statist. Soc. B, 1996.
40. T. Zhang and C.-C. J. Kuo, "Audio content analysis for online audiovisual data segmantation and classification," IEEE Trans. Speech Audio Process., vol. 9, no. 4, pp. 441-457, May 2001.
41. M. A. T. Figueiredo and A. K. Jain, "Unsupervised learning of finite mixture models," IEEE Tran. Pattern Anal. Mach. Intell., vol. 24, no. 3, pp. 381-396, Mar. 2002.
42. _, "Unsupervised selection and estimation of finite mixture models," in Proc. ICPR '00, 2000, pp. 87-90.
43. F. Dufaux and J. Konrad, "Efficient, robust, and fast global motion estimation for video coding," IEEE Tran. Image Process., vol. 9, no. 3, pp. 497-501, Mar. 2000.
44. Y. T. Tse and R. Baker, "Global zoom/pan estimation and compensation for video compression," in Proc. ICASSP'91, 1991.
45. I. Koprinska and S. Carrato, "Temporal video segmentation: a survey," Signal Processing: Image. Communication, vol. 16, pp. 477-500, 2001.
46. A. Hanjalic, "Shot-boundary detection: unraveled and resolved?," IEEE Trans. Circuit Syst. Video Technol., vol. 12, no. 2, pp. 90-105, Feb. 2002.
47. W. J. Heng and K. N. Ngan, "Shot boundary refinement for long transition in digital video sequence," IEEE Trans. Multimedia, vol. 4, no. 4, pp. 434-445, Dec. 2002.
48. L. Rabiner, "A tutorial on Hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1999.
49. D. Gatica-Perez, A. Loui, and M. T. Sun, "Finding structure in home videos by probabilistic hierarchical clustering," IEEE Trans. Circuit Syst. Video Technol., vol. 13, no. 6, pp. 539-548, Jun. 2003.