Fuzzy rule-based reasoning approach for event detection and annotation of broadcast soccer video

Applied Soft Computing Journal

Volumn 13, Issue 2, 2013, Pages 846-866

  Hosseini, Monireh Sadat ^a   Eftekhari Moghadam, Amir Masoud ^a  

^a ISLAMIC AZAD UNIVERSITY   (Iran)

Author keywords

Data mining; Decision tree; Event detection; Fuzzy rule based reasoning; Soccer video annotation; Video summarization

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA MINING; DECISION MAKING; DECISION TREES; FUZZY RULES; PATTERN RECOGNITION; SEMANTICS; SPORTS; TREES (MATHEMATICS); VIDEO SIGNAL PROCESSING;

BROADCAST SOCCER VIDEOS; DECISION MAKING PROCESS; DERIVATIVE STRUCTURES; EVENT DETECTION; FUZZY RULE BASED; SOCCER VIDEO; STATISTICAL INFORMATION; VIDEO SUMMARIZATION;

FUZZY INFERENCE;

EID: 84881649779     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2012.10.007     Document Type: Article

References (47)

1. T. D'Orazio, M. Leo, A review of vision-based systems for soccer video analysis, Pattern Recognition 43 (8) (2010) 2911-2926.
2. L. Ballan, M. Bertini, A.D. Bimbo, L. Seidenari, G. Serra, Event detection and recognition for semantic annotation of video, Multimedia Tools and Applications 51 (2) (2011) 279-302.
3. D. Tjondronegoro, Y.P.P. Chen, Knowledge-discounted event detection in sports video, IEEE Transactions on Systems, Man, and Cybernetics. Systems and Humans 40 (5) (2010) 1009-1024.
4. C. Xu, et al., Using webcast text for semantic event detection in broadcast sports video, IEEE Transactions on Multimedia 10 (7) (2008) 1342-1355.
5. A. Ulges, C. Schulze, M. Koch, T.M. Breuel, Learning automatic concept detectors from online video, Computer Vision and Image Understanding 114 (4) (2010) 429-438.
6. C. Xu, J. Wang, H. Lu, Y. Zhang, A novel framework for semantic annotation and personalized retrieval of sports video, IEEE Transactions on Multimedia 10 (3) (2008)421-436.
7. M.H. Kolekar, K. Palaniappan, Semantic concept mining based on hierarchical event detection for soccer video indexing, Journal of Multimedia 4 (5) (2009) 298-312.
8. X. Gao, Z. Niu, D. Tao, X. Li, Non-goal scene analysis for soccer video, Neurocomputing 74(4) (2011) 540-548.
9. L. Ballan, M. Bertini, A.D. Bimbo, G. Serra, Semantic annotation of soccer videos by visual instance clustering and spatial/temporal reasoning in ontologies, Multimedia Tools and Applications 48 (2) (2010)313-337.
10. S. Kara, et al., An ontology-based retrieval system using semantic indexing, Information Systems 37 (4) (2012) 294-305.
11. V. Pallavi, J. Mukherjee, A.K. Majumdar, S. Sural, Graph-based multiplayer detection and tracking in broadcast soccer videos, IEEE Transactions on Multimedia 10 (5)(2008)794-805.
12. M.H. Kolekar, S. Sengupta, Event-importance based customized and automatic cricket highlight generation, IEEE International Conference on Multimedia and Expo (2006)1617-1620.
13. G. Zhu, Q. Huang, C. Xu, L. Xing, W. Gao, H. Yao, Human behavior analysis for highlight ranking in broadcast racket sports video, IEEE Transactions on Multimedia 9 (6) (2007) 1167-1182.
14. L. Duan, M. Xu, Q. Tian, C. Xu, J. Jin, A unified framework for semantic shot classification in sports video, IEEE Transactions on Multimedia 7 (6) (2005) 1066-1083.
15. C. Cheng, C. Hsu, Fusion of audio and motion information on HMM based highlight extraction for baseball games, IEEE Transactions on Multimedia 8 (3) (2006)585-599.
16. M.H. Hung, C.H. Hsieh, CM. Kuo, J.S. Pan, Generalized playfield segmentation of sport videos using color features, Pattern Recognition Letters 32 (7) (2011) 987-1000.
17. P. Wang, Z.Q. Liu, S.Q. Yang, Investigation on unsupervised clustering algorithms for video shot categorization, Soft Computing 11 (4) (2007) 355-360.
18. Y.F. Zhang, C. Xu, X. Zhang, H. Lu, Personalized retrieval of sports video based on multi-modal analysis and user preference acquisition, Multimedia Tools and Applications 44 (2) (2009) 305-333.
19. N. Babaguchi, Y. Kawai, T. Kitahashi, Event based indexing of broadcast sports video by intermodal collaboration, IEEE Transactions on Multimedia 4 (1) (2002) 68-75.
20. N. Babaguchi, Y. Kawai, T. Ogura, T. Kitahashi, Personalized abstraction of broadcasted American football video by highlight selection, IEEE Transactions on Multimedia 6 (4) (2004) 575-586.
21. H.G. Kim, S. Roeber, A. Samour, T. Sikora, Detection of goal event in soccer videos, Storage and Retrieval Methods and Applications for Multimedia (2005) 317-325.
22. J. Liu, X. Tong, W. Li, T. Wang, Y. Zhang, H. Wang, Automatic player detection, labeling and tracking in broadcast soccer video, Pattern Recognition Letters 30 (2) (2009) 103-113.
23. T. D'Orazio, M. Leo, P. Spagnolo, M. Nitti, N.A. Mosca, visual system for real time detection of goal events during soccer matches, Computer Vision and Image Understanding 113 (5) (2009) 622-632.
24. J. Assflag, et al., Semantic annotation of soccervideos: automatic highlight identification, Computer Vision and Image Understanding 92 (2) (2003) 285-305.
25. L.H. Yong, H. Tingting, Integrating multiple feature fusion for semantic event detection in Soccer Video, International Joint Conference on Artificial Intelligence (2009)128-131.
26. X. Yu, L. Li, H.W. Leong, Interactive broadcast services for live soccer video based on instant semantics acquisition, Visual Communication and Image Representation 20 (2) (2009) 117-130.
27. Z. Niu, X. Gao, Q. Tian, Tactic analysis based on real-world ball trajectory in soccervideo, Pattern Recognition 45 (5) (2012) 1937-1947.
28. C. Yajima, Y. Nakanishi, K. Tanaka, Querying video data by spatiotemporal relationships of moving object traces, in: 6th IFIP Work. Conf. Visual Database Syst, Brisbane, Australia, 2002, pp. 357-370.
29. V. Pallavi, J. Mukherjee, A.K. Majumdar, S. Sural, Ball detection from broadcast soccer videos using static and dynamic features, Visual Communication and Image Representation 19 (7) (2008) 426-436.
30. D. Zhong, S.F. Chang, Structure analysis of sports video using domain models, in: Proc. IEEE ICME, Tokyo, Japan, 2001, pp. 713-716.
31. P. Xu, L. Xie, S.F. Chang, A. Divakaran, A. Vetro, H. Sun, Algorithms and system for segmentation and structure analysis in soccer video, in: Proc. Int'l. Conf. Multimedia & Expo (ICME), 2001, pp. 928-931.
32. J. Assfalg, M. Bertini, A. Del Bimbo, W. Nunziati, P. Pala, Soccer highlights detection and recognition using HMMs, in: Proc. Int'l. Conf. Multimedia & Expo (ICME), 2002, pp. 825-828.
33. L. Xie, P. Xu, S.F. Chang, A. Divakaran, H. Sun, Structure analysis of soccer video with domain knowledge and hidden Markov models, Pattern Recognition letters 25 (7) (2004) 767-775.
34. Y. Gao, W.B. Wang, J.H. Yong, H.J. Gu, Dynamic video summarization using two-level redundancy detection, Multimedia Tools and Applications 42 (2) (2009) 233-250.
35. D.A. Sadlier, N.E. O'Connor, Event detection in field sports video using audiovisual features and a support vector machine, IEEE Transactions Circuits and Systems for Video Technology 15 (10) (2005) 1225-1233.
36. X. Sun, G. Jin, M. Huang, G. Xu, Bayesian network based soccer video event detection and retrieval, in: Multispectral Image Processing and Pattern Recognition, Beijing, China, 2003.
37. C.L. Huang, H.C. Shih, C.Y. Chao, Semantic analysis of soccer video using dynamic Bayesian network, IEEE Transactions on Multimedia 8 (4) (2006) 749-760.
38. M.H. Kolekar, Bayesian belief network based broadcast sports video indexing, Multimedia Tools and Applications 54 (1) (2011) 27-54.
39. A. Ekin, A.M. Tekalp, R. Mehrotra, Automatic soccer video analysis and summarization, IEEE Transactions on Image Processing 12 (7) (2003) 796-807.
40. J. Yen, Fuzzy logic-a modern perspective, IEEE Transactions on Knowledge and Data Engineering 11 (1) (1999) 153-165.
41. L.X. Wang, A Course in Fuzzy Systems and Control, Prentice Hall, 1997.
42. S.N. Sivanandum, S. Sumathi, S.N. Deepa, Introduction to Fuzzy Logic Using Matlab, Springer-Verlag, Berlin, Heidelberg, 2007.
43. P.N. Tan, M. Steinbach, V. Kumar, Introduction to Data Mining, Pearson Addison Wesley, 2006.
44. S. Mitra, K.M. Konwar, S.K. Pal, Fuzzy decision tree, linguistic rules and fuzzy knowledge-based network: generation and evaluation, IEEE Transactions on Systems, Man and Cybernetics. Part C, Applications and Reviews 32 (4) (2002) 328-339.
45. T.M. Mitchell, Machine Learning, McGraw-Hill Science, Engineering, Math, 1997.
46. J. Ren, J. Orwell, G.A. Jones, M. Xu, Tracking the soccer ball using multiple fixed cameras, Computer Vision and Image Understanding 113 (5) (2009) 633-642.
47. T. D'Orazio, et al., An investigation into the feasibility of real-time soccer offside detection from a multiple camera system, IEEE Transactions on Circuits and Systems for Video Technology 19 (12) (2009) 1804-1818.