Generation of personalized music sports video using multimodal cues

IEEE Transactions on Multimedia

Volumn 9, Issue 3, 2007, Pages 576-587

  Wang, Jinjun ^b   Chng, Engsiong ^a,b   Xu, Changsheng ^a,c   Lu, Hanqinq ^a,d   Tian, Qi ^a,c  

^a IEEE

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^d INSTITUTE OF AUTOMATION   (China)

Author keywords

Event boundary detection; Multimodality analysis; Music sports video; Semantic event detection; Semi automatic video editing; Sports video processing

Indexed keywords

ALGORITHMS; DYNAMIC PROGRAMMING; FEATURE EXTRACTION; SEMANTICS; TELEVISION BROADCASTING;

MUSIC SPORTS VIDEO; SEMANTIC EVENT DETECTION; SEMI-AUTOMATIC VIDEO EDITING; SPORTS VIDEO BROADCASTING; SPORTS VIDEO PROCESSING;

VIDEO SIGNAL PROCESSING;

EID: 33947603086     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2006.888013     Document Type: Article

References (32)

1. N. Adami, R. Leonardi, and P. Migliorati, "An overview of multi-modal techniques for the characterization of sport programmes," in Proc. SPIE Visual Communication and Image Processing (VCIP), 2003, pp. 1296-1306.
2. B. Li, J. Errico, H. Pan, and M. I. Sezan, "Bridging the semantic gap in sports," in Proc. SPIE Storage and Retrieval for Media Databases, 2003, pp. 314-326.
3. N. Babaguchi, Y. Kawai, and T. Kitahashi, "Event based indexing of broadcasted sports video by intermodal collaboration," IEEE Trans. Multimedia, vol. 4, no. 1, pp. 68-75, Mar. 2002.
4. Y. Rui, A. Gupta, and A. Acero, "Automatically extracting highlights for TV baseball programs," in Proc. ACM MultiMedia, 2002, pp. 105-115.
5. K. A. Peker, R. Cabasson, and A. Divakaran, "Rapid generation of sports video highlights using the MPEG-7 motion activity descriptor," in Proc. SPIE Storage and Retrieval for Media Databases, 2000, vol. 4676, pp. 318-323.
6. Z. Xiong, R. Radhakrishnan, and A. Divakaran, "Generation of sports highlights using motion activity in combination with a common audio feature extraction framework," in Proc. IEEE Int. Conf. Image Processing (ICIP), 2003, vol. 1, pp. 5-8.
7. A. Ekin, A. M. Tekalp, and R. Mehrotra, "Robust dominant color region detection with applications to sports video analysis," in Proc. IEEE Int. Conf. Image Processing (ICIP), 2003, vol. 1, pp. 21-24.
8. L. Xie, P. Xu, S.-F. Chang, A. Divakaran, and H. Sun, "Structure analysis of soccer video with domain knowledge and hidden Markov models," Pattern Recogniti. Lett., vol. 24, pp. 767-775, 2003.
9. R. Leonardi, P. Migliorati, and M. Prandini, "Semantic indexing of soccer audio-visual sequences: A multimodal approach based on controlled Markov chains," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 5, pp. 34-43, May 2004.
10. J. Wang, C. Xu, E. Chng, X. Yu, and Q. Tian, "Event detection based on non-broadcast sports video," in Proc. IEEE Int. Conf. Image Processing (ICIP), 2004, pp. 1637-1640.
11. J. Wang, C. Xu, E. Chng, K. Wan, and Q. Tian, "Automatic replay generation for soccer video broadcasting," in Proc. ACM MultiMedia, 2004, pp. 31-38.
12. N. Babaguchi and N. Nitta, "Intermodal collaboration: A strategy for semantic content analysis for broadcasted sports video," in Proc. IEEE Int. Conf. Image Processing (ICIP), 2003, vol. 1, pp. 13-16.
13. M. Christel, M. Smith, C. Taylor, and D. Winkler, "Evolving video skims into useful multimedia abstractions," in Proc. CHI 98, ACM, 1998, pp. 171-178.
14. X. Hua, L. Lu, and H. Zhang, "Automatic music video generation based on temporal pattern analysis," in Proc. ACM MultiMedia, 2004, pp. 472-475.
15. J. Foote, M. Cooper, and A. Girgensohn, "Creating music videos using automatic media analysis," in Proc. ACM MultiMedia, 2002, pp. 553-560.
16. Muvee AutoProducer™ MuVee Technologies Pte. Ltd [Online]. Available: http://www.muvee.com/, 5.0
17. X. Hua, L. Lu, and H. Zhang, "Ave: Automated home video editing," in Proc. ACM MultiMedia, 2003, pp. 490-497.
18. A. Girgensohn, J. Boreczky, P. Chiu, J. Doherty, J. Foote, G. Golovchinsky, S. Uchihashi, and L. Wilcox, "A semi-automatic approach to home video editing," in Proc. ACM UIST, 2000, pp. 81-89.
19. X. Hua, L. Lu, and H. Zhang, "Optimization-based automated home video editing system," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 5, pp. 572-583, May 2004.
20. J. Wang, C. Xu, E. Chng, L. Duan, K. Wan, and Q. Tian, "Automatic generation of personalized music sports video," in Proc. ACM MultiMedia, 2005, pp. 31-38.
21. J. Assfalg, M. Bertini, C. Colombo, A. Bimbo, and W. Nunziati, "Semantic annotation of soccer videos: Automatic highlights identification," Comput. Vis. Image Understand., vol. 92, pp. 285-305, Nov. 2003.
22. N. Nitta and N. Babaguchi, "Automatic story segmentation of closed-caption text for semantic content analysis of broadcasted sports video," in Proc. Int. Workshop on Multimedia Information Systems, 2002, pp. 110-116.
23. dtsearch dtSearch Corp [Online]. Available: http://www.dt-search.com/, 6.50
24. M2-Edit Pro™ MediaWare Solutions Pte. Ltd, USA [Online]. Available: http://www.mediawaresolutions.com/, 5.0
25. Y. Tan, D. Saur, S. Kulkami, and P. Ramadge, "Rapid estimation of camera motion from compressed video with application to video annotation," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 1, pp. 133-146, Feb. 2000.
26. V. A. Petrushin, "Hidden Markov models: Fundamentals and applications," in Online Symp. Electronics Engineers, 2000.
27. S. Takagi, S. Hattori, K. Yokoyama, A. Kodate, and H. Tominaga, "Sports video categorizing method using camera motion parameters," in Proc. IEEE Int. Conf. Mult. Expo (ICME), 2003, pp. 461-464.
28. J. Wang, C. Xu, E. Chng, and Q. Tian, "Sports highlight detection from keyword sequences using HMM," in Proc. IEEE Int. Conf. Mult. Expo (ICME), 2004, pp. 599-602.
29. Hidden Markov Model Toolkit Machine Intelligence Lab., Cambridge Univ., Cambridge, U.K. [Online]. Available: http://htk.eng.cam.ac.uk/, 3.3
30. J. Pylkkonen and M. Kurimo, "Duration modeling techniques for continuous speech recognition," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), 2004, pp. 385-388.
31. N. Maddage, C. Xu, M. Kankanhalli, and X. Shao, "Content-based music structure analysis with applications to music semantics understanding," in Proc. ACM MultiMedia, 2004, pp. 112-119.
32. E. Ukkonen, "On approximate string matching," in Proc. Int. Conf. on Found. Comput. Theory, 1983, vol. 158, pp. 487-495.