Semantic concept mining based on hierarchical event detection for soccer video indexing

Journal of Multimedia

Volumn 4, Issue 5, 2009, Pages 298-312

  Kolekar, Maheshkumar H ^a   Palaniappan, Kannappan ^a   Sengupta, Somnath ^b   Seetharaman, Gunasekaran ^c  

^a University of Missouri   (United States)

^b INDIAN INSTITUTE OF TECHNOLOGY   (India)

^c AIR FORCE RESEARCH LABORATORY   (United States)

Author keywords

Content based indexing; Event detection; Highlights; Mining; Semantic concept; Sequential association; Sports; Video classification

Indexed keywords

CLASSIFICATION (OF INFORMATION); IMAGE RETRIEVAL; IMAGE SEGMENTATION; INDEXING (OF INFORMATION); MINING; SEMANTICS; VIDEO SIGNAL PROCESSING;

CONTENT-BASED INDEXING; EVENT DETECTION; HIGHLIGHTS; SEMANTIC CONCEPT; VIDEO CLASSIFICATION;

SPORTS;

EID: 77953218764     PISSN: 17962048     EISSN: None     Source Type: Journal    
DOI: 10.4304/jmm.4.5.298-312     Document Type: Article

References (44)

1. N. Dimitrova, H. Zhang, B. Shahraray, I. S. T. Huang, and A. Zakhor, "Applications of video-content analysis and retrieval," in proc. of IEEE Multimedia, vol. 9, no. 3, pp. 42-55, 2002.
2. M. H. Kolekar and S. Sengupta, "Semantic Indexing of News Video Sequences: A Multimodal Hierarchical Approach Based on Hidden Markov Model," in IEEE Int. Region 10 Conference (TENCON), 2005.
3. M. Shyu, Z. Xie, M. Chen, and S. Chen, "Video semantic event/concept detection using a subspace-based multimedia data mining framework," in IEEE Transactions on Multimedia, vol. 10, no. 2, 2008.
4. M. H. Kolekar and S. Sengupta, "Event-importance Based Customized and Automatic Cricket Highlight Generation," in IEEE Int. Conf. on Multimedia and Expo, pp. 1617-1620,2006.
5. C. Xu, J. Wang, H. Lu, and Y. Zhang, "A Novel Frame-work for Semantic Annotation and Personalized Retrieval of Sports Video," in IEEE Transactions on Multimedia, vol. 10, no. 3, pp. 421-436, 2008.
6. A. Kokaram, N. Rea, R. Dahyot, M. Tekalp, P. Bouthemy, P. Gros, and I. Sezan, "Browsing sports video: trends in sports-related indexing and retrieval work," in IEEE Signal Processing Magazine, vol. 23, no. 2, pp. 47-58, 2006.
7. Y. Li, J. Smith, T. Zhang, and S. Chang, "Multimedia database management systems," in Elsevier Journal of Visual Communication and Image Representation, pp. 431-440,2004.
8. L. Duan, M. Xu, T. Chua, Q. Tian, and C. Xu, "A mid-level representation framework for semantic sports video analysis," in proc. of ACM Int. Conf on Multimedia, 2003.
9. J. Wang, E. Chng, C. Xu, H. Lu, and Q. Tian, "Generation of personalized music sports video using multimodal cues," in IEEE Transaction on Multimedia, vol. 9, no. 3, pp. 576-588,2007.
10. A. Ekin and A. M. Tekalp, "Automatic soccer video analysis and summarization," in Sym. Electronic Imaging: Science and Technology: Storage and Retrieval for Image and Video database IV, 2003.
11. X. Tong, Q. Liu, and H. Lu, "Shot classification in broad-cast soccer video," in Electronics Letters on Computer Vision and image Analysis, vol. 7, no. 1, pp. 16-25, 2008.
12. G. Sudhir, J. Lee, and A. K. Jain, "Automatic classification of tennis video for high-levelcontent-based retrieval," in proc. of IEEE Int. Workshop on Content-Based Access of Image and Video Database, 1998.
13. G. Zhu, Q. Huang, C. Xu, L. Xing, W. Gao, and H. Yao, "Human Behavior Analysis for Highlight Ranking in Broadcast Racket Sports Video," in IEEE Transactions on Multimedia, vol. 9, no. 6, pp. 1167-1182, 2007.
14. C. Cheng and C. Hsu, "Fusion of audio and motion information on HMM based highlight extraction for baseball games," in IEEE Transaction on Multimedia, vol. 8, no. 3, 2006.
15. Y. Rui, A. Gupta, and A. Acero, "Automatically extracting highlights for TV baseball programs," in eighth ACM Int. Conf. Multimedia, 2000.
16. L. Duan, M. Xu, Q. Tian, C. Xu, and J. Jin, "A Unified Framework for Semantic Shot Classification in Sports Video," in IEEE Transactions on Multimedia, vol. 7, no. 6, pp. 1066-1083, 2005.
17. A. Hanjalic, "Adaptive extraction of highlights from a sport video based on excitement modeling," in IEEE Transactions on Multimedia, vol. 7, no. 6, pp. 1114 - 1122, 2005.
18. D. Sadlier and N. O'Connor, "Event detection in field sports video using audio-visual features and a support vector machine," in IEEE Transaction on Circuits and Systems for Video Technology, vol. 15, no. 10, 2005.
19. Z. Xiong, R. Radhakrishnan, A. Divakaran, and T. Huang, "Audio events detection based highlight extraction from baseball, golf and soccer games in a unified framework," in proc. ICASSP, vol. 3, 2003.
20. B. Li, H. Pan, and I. Sezan, "A General Framework for Sports Video Summarization with its application to Soccer," in IEEE Int. Conf. on Audio, Speech, and Signal Processing, vol. 3, pp. 169-172, 2003.
21. S. Lefevre, B. Maillard, and N. Vincent, "3 classes segmentation for analysis of football audio sequences", in Int. Conf. on Digital Signal Processing, 2002.
22. N. Babaguchi, Y. Kawai, T. Ogura, and T. Kitahashi, "Personalized Abstraction of Broadcasted American Football Video by Highlight Selection," in IEEE Transactions on Multimedia, vol. 6, no. 4, pp. 575-586, 2004.
23. K. Wan and C. Xu, "Recent soccer highlight generation with a novel dominant speech feature extractor," in IEEE Int. Conf. on Multimedia and Expo, vol. 1, 2004.
24. Y. Ding and G. Fan, "Segmental Hidden Markov Model for View-based Sports Video Analysis," in IEEE Conf. on Computer Vision and Pattern Recognition, 2007.
25. M. Barnard and J. Odobez, "Multi-modal audio-visual event recognition for football analysis," in IEEE Int. work-shop on Neural Networks for Signal Processing, 2003.
26. R. Ren and J. Jose, "Football video segmentation based on video production strategy," in Lecture Notes in Computer Science, vol. 3408, pp. 433-446, 2005.
27. N. Ancona, G. Cicirelli, A. Branca, and A. Distante, "Goal detection in football by using support vector machines for classification," in proc. of Int. Joint Conf. on Neural Networks, vol. 1, 2001.
28. J. Assfalg, M. Bertini, C. Colombo, A. Bimbo, and W. Nunziati, "Semantic annotation of soccer videos: automatic highlights identification," in Elsevier Journal on Computer Vision and Image Understanding, 2003.
29. L. Wang, M. Lew, and G. Xu, "Offense based temporal segmentation for event detection in soccer video," in Poc. Of the 6th ACM SIGMM international workshop on Multimedia information retrieval, 2004.
30. T. Yu and Y. Zhang, "Retrieval of video clips using global motion information," in Electronics Letters, vol. 37, no. 14, 2001.
31. M. Xu, J. Orwell, and G. Jones, "Tracking football players with multiple cameras," in IEEE Int. Conf. on Image Processing, vol. 5, 2004.
32. Y. Li, A. Dore, and J. Orwell, "Evaluating the performance of systems for tracking football players and ball," in IEEE Int. Conf. Advanced video and signal based surveillance, 2005.
33. P. Nillius, J. Sullivan, and S. Carlsson, "Multi-target tracking-linking identities using bayesian network inference," in IEEE Int. Conf. on Computer Vision and Pattern Recognition, vol. 2, 2006.
34. X. Zhu, X. Wu, A. K. Elmagarmid, Z. Feng, and L. Wu, "Video Data Mining: Semantic Indexing and Event Detection from the Association Perspertive," in IEEE Transcation on Knowledge and Data Engineering, vol. 17, no. 5, 2005.
35. R. Agarwal and R. Shrikant, "Fast Algorithm for mining association rules," in proc. of Int Conf on Very Large Data Bases, 1994.
36. V. Chasanis, A. Likas, and N. Galatsanos, "Scene Detection in Videos Using Shot Clustering and Symbolic Sequence Segmentation," in IEEE Workshop on Multimedia Signal Processing, 2007.
37. C. Ngo, T. Pong, and H. Zhang, "On clustering and retrieval of video shots through temporal slices analysis," in IEEE Transactions on Multimedia, vol. 4, no. 4, 2002.
38. L. Wang, X. Liu, S. Lin, G. Xu, and H. Shum, "Generic slow-motion replay detection in sports video," in IEEE Int. Conf. on Image Processing, vol. 3, pp. 1585-1588, 2004.
39. H. Pan, B. Li, and M. Sezan, "Automatic detection of replay segments in broadcast sports programs by detection of logos in scene transition," in IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2002.
40. P. Xu, L. Xie, S. Chang, A. Divakaran, A. Vetro, and H. Sun, "Algorithms and system for segmentation and structure analysis in soccer video," in IEEE Int. Conf. on Multimedia and Expo, 2001.
41. F. Bunyak, K. Palaniappan, S. Nath, and G. Seetharaman, "Flux Tensor Constrained Geodesic Active Contours with Sensor Fusion for Persistent Object Tracking," in Journal of Multimedia, vol. 2, no. 4, 2007.
42. V. Tovinkere and R. J. Qian, "Detecting semantic events in soccer games: towards a complete solution," in proc. Of IEEE Int. Conf. on Multimedia and Expo, 2001.
43. W. Zhou, A. Vellaikal, and C. Kuo, "Rule-based video classification system for basketball video indexing," in Proc. ACM workshop on Multimedia, 2000.
44. M.H. Kolekar and S. Sengupta, "A Hierarchical Framework for Generic Sports Video Classification," in Lecture Notes on Computer Science (LNCS), Springer-Verlag Berlin Heidelberg, vol. 3852, 2006.