A review of vision-based systems for soccer video analysis

Pattern Recognition

Volumn 43, Issue 8, 2010, Pages 2911-2926

  D'Orazio, T ^a   Leo, M ^a  

^a INSTITUTE OF INTELLIGENT SYSTEMS FOR AUTOMATION   (Italy)

Author keywords

Computer vision; Low level and high level feature extraction; Modeling of feature dynamics; Soccer video analysis

Indexed keywords

EXTRACTION MODELING; HIGH-LEVEL FEATURES; MODELING OF FEATURE DYNAMICS; SOCCER VIDEO ANALYSIS;

COMPUTER CRIME; COMPUTER VISION; VIDEO RECORDING; VIDEO STREAMING;

FEATURE EXTRACTION;

EID: 77951259249     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2010.03.009     Document Type: Article

References (89)

1. Leonardi R., Migliorati P., and Prandini M. Semantic indexing of soccer audio-visual sequences: a multimodal approach based on controlled Markov chains. IEEE Transactions on Circuits and Systems for Video Technology 14 5 (2004) 634-643
2. Y.-L. Kang, J.-H. Lim, M.S. Kankanhalli, C.-S. Xu, Q. Tian, Goal detection in soccer video using audio/visual keywords, in: IEEE International Conference on Image Processing (ICIP), Singapore, 24-27 October 2004, pp. 1629-1632.
3. Sadlier D.A., and Connor O. Event detection in field sports video using audio-visual features and a support vector machine. IEEE Transactions on Circuits and Systems for Video Technology 5 10 (2005) 1225-1233
4. S.C. Chen, M.L. Shyu, M. Chen, C. Zhang, A decision tree-based multimodal data mining framework for soccer goal detection, in: IEEE Proceedings of International Conference on Multimedia and Expo (ICME), Taipei, Taiwan, 27-30 June 2004, pp. 265-268.
5. Xie L., Xu P., Chang S.F., Divakaran A., and Sun H. Structure analysis of soccer video with domain knowledge and hidden Markov models. Pattern Recognition Letters 25 7 (2004) 767-775
6. Ekin A., Tekalp A., and Mehrotra R. Automatic soccer video analysis and summarization. IEEE Transactions on Image Processing 12 (2003) 796-807
7. Aghbari Z., Kaneko K., and Makinouchi A. Content-trajectory approach for searching video databases. IEEE Transactions on Multimedia 5 4 (2003) 516-531
8. F. Wang, Y.F. Ma, H.J. Zhang, J.T. Li, A generic framework for semantic sports video analysis using dynamic Bayesian networks, in: Proceedings of the 11th International Multimedia Modelling Conference, Melbourne, Australia, 12-14 January 2005, pp. 115-122.
9. Huang C.L., Shih H.C., and Chao C.Y. Semantic analysis of soccer video using dynamic Bayesian network. IEEE Transactions on Multimedia 8 4 (2006) 749-760
10. Gao Y., Wang W.B., Yong J.H., and Gu H.J. Dynamic video summarization using two-level redundancy detection. Multimedia Tools and Applications 42 (2009) 233-250
11. Assfalg J., Bertini M., Colombo C., Del Bimbo A., and Nunziati W. Semantic annotation of soccer videos: automatic highlights identification. Computer Vision and Image Understanding 92 2-3 (2003) 285-305
12. Y. Ariki, S. Kubota, M. Kumano, Automatic production system of soccer sports video by digital camera work based on situation recognition, in: Proceedings of the Eight IEEE International Symposium on Multimedia (ISM'06), San Diego, California, 11-13 December 2006.
13. Xu C., Zhang Y.F., Zhu G., Rui Y., Lu H., and Huang Q. Using webcast text for semantic event detection in broadcast sports video. IEEE Transaction on Multimedia 10 7 (2008) 1342-1355
14. Gonzales R., and Woods R. Digital Image Processing. third ed. (2008), Prentice-Hall, Upper Saddle River, NJ
15. Otsuka I., Nakane K., Divakaran A., Hatanaka K., and Ogawa M. A highlight scene detection and video summarization system using audio feature for a personal video recorder. IEEE Transactions on Consumer Electronics 51 1 (2005) 112-116
16. Cheng C.C., and Hsu C.T. Fusion of audio and motion information on HMM-based highlight extraction for baseball games. IEEE Transactions on Multimedia 8 3 (2006) 585-599
17. D.W. Tjondronegoro, Y.-P. Chen, B. Pham, Classification of self-consumable highlights for soccer video summaries, in: IEEE International Conference on Multimedia and Expo, Baltimore, Maryland, 6-9 July 2003, pp. 579-582.
18. Y.Q. Yang, Y.D. Lu, W. Chen, A framework for automatic detection of soccer goal event based on cinematic template, in: Proceedings of 2004 International Conference on Machine Learning and Cybernetics, Shanghai, China, 26-29 August 2004, pp. 3759-3764.
19. Seo K.W., Ko J.S., Ahn I.K., and Kim C.G. An intelligent display scheme of soccer video on mobile devices. IEEE Transactions on Circuits and Systems for Video Technology 17 10 (2007) 1395-1401
20. C. Pei, L. Gao, S. Yang, C. Hou, A ROI detection model for soccer video on small display, in: Third International Symposium on Intelligent Information Technology Application, vol. 2, Nanchang University, China, 21-22 November 2009, pp. 392-395.
21. Bertini M., Cucchiara R., Bimbo A., and Prati A. Semantic adaptation of sport videos with user-centred performance analysis. IEEE Transactions on Multimedia 8 3 (2006) 433-443
22. Hartley R., and Zisserman A. Multiple View Geometry in Computer Vision (2000), Cambridge University Press, Cambridge, UK
23. Faugeras O. Three-Dimensional Computer Vision: A Geometric Approach (1996), MIT Press, Cambridge, MA
24. Tsai R.Y. A versatile camera calibration technique for 3D machine vision. IEEE Journal Robotics & Automation 4 (1987) 323-344
25. Yilmaz A., Javed O., and Shah M. Object tracking: a survey. ACM Computing Surveys 38 4 (2006) 13-58
26. Ramanan D., Forsyth D.A., and Zisserman A. Tracking people by learning their appearance. IEEE Transactions on Pattern Analysis and Machine Intelligence 29 1 (2007) 65-81
27. Andrade E.L., Woods J.C., Khan E., and Ghanbari M. Region-based analysis and retrieval for tracking of semantic objects and provision of augmented information in interactive sport scenes. IEEE Transactions on Multimedia 7 6 (2005) 1084-1096
28. Thomas G. Real-time camera tracking using sports pitch markings. Journal Real Time Image Processing 2 2-3 (2007) 117-132
29. X. Yu, X. Yan, L. Li, H.W. Leong, An instant semantics acquisition system of live soccer video with application to live event alert and on-the-fly language selection, in: Conference on Image and Video Retrieval (CIVR), Niagara Falls, Canada, 7-9 July 2008.
30. Rodriguez T., Reid I.D., Horaud R., Dalal N., and Goetz M. Image interpolation for virtual sports scenarios. Machine Vision and Applications 16 4 (2005) 236-245
31. Inamoto N., and Saito H. Virtual viewpoint replay for a soccer match by view interpolation from multiple cameras. IEEE Transactions on Multimedia 9 6 (2007) 1155-1166
32. J.B. Hayet, J. Piater, J. Verly, Robust incremental rectification of sports video sequences, in: British Machine Vision Conference 2004, Kingston University, London, 7-9 September 2004.
33. Wang J., Xu C., Chng E., Lu H., and Tian Q. Automatic composition of broadcast sports video. Multimedia Systems 14 4 (2008) 179-193
34. Jung C.R. Efficient background subtraction and shadow removal for monochromatic video sequences. IEEE Transactions on Multimedia 11 3 (2009) 571-577
35. McHugh J.M., Konrad J., Saligrama V., and Jodoin P.M. Foreground-adaptive background subtraction. IEEE Signal Processing Letters 16 5 (2009) 390-393
36. Zhang J., and Gong S. People detection in low-resolution video with non-stationary background. Image and Vision Computing 27 4 (2009) 437-443
37. Khan S.M., and Shah M. Tracking multiple occluding people by localizing on multiple scene planes. IEEE Transactions on Pattern Analysis and Machine Intelligence 31 3 (2009) 505-519
38. Fleuret F., Berclaz J., Lengagne R., and Fua P. Multicamera people tracking with a probabilistic occupancy map. IEEE Transactions on Pattern Analysis and Machine Intelligence 30 2 (2008) 267-282
39. Black J., and Ellis T. Multi camera image tracking. Image and Vision Computing 24 11 (2006) 1256-1267
40. Piciarelli C., and Foresti G.L. On-line trajectory clustering for anomalous events detection. Pattern Recognition Letters 27 15 (2006) 1835-1842
41. Haritaoglu I., Harwood D., and Davis L. W4: real-time surveillance of people and their activities. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 8 (2000) 809-830
42. C. Stauffer, W. Grimson, Adaptive background mixture models for real-time tracking, in: International Conference on Compute Vision and Pattern Recognition CVPR, Ft. Collins, CO, USA, June 1999, pp. 246-252.
43. M. Xu, T. Ellis, Partial observation vs. blind tracking through occlusion, in: Proceedings of the British Machine Vision Conference, Cardiff 2-5 September 2002, pp. 777-786.
44. Ren J., Orwell J., Jones G., and Xu M. Real-time modeling of 3-d soccer ball trajectories from multiple fixed cameras. IEEE Transaction on Circuits and Systems for Video Technology 18 3 (2008) 350-362
45. Yu X., Leong H.W., Xu C., and Tian Q. Trajectory-based ball detection and tracking in broadcast soccer video. IEEE Transactions on Multimedia 8 6 (2006) 1164-1178
46. Liu Y., Liang D., Huang Q., and Gao W. Extracting 3D information from broadcast soccer video. Image and Vision Computing 24 10 (2006) 1146-1162
47. T. Shimawaki, T. Sakiyama, J. Miura, Y. Shirai, Estimation of ball route under overlapping with players and lines in soccer video image sequence, in: International Conference on Pattern Recognition ICPR, Hong Kong, 20-24 August 2006, pp. 359-362.
48. K. Choi, Y. Seo, Tracking soccer ball in TV broadcast video, Image Analysis and Processing (ICIAP), Cagliari, Italy, 6-8 September 2005, pp. 661-668.
49. Pallavi V., Mukherjee J., Majumdar A.K., and Sural S. Ball detection from broadcast soccer videos using static and dynamic features. Journal Visual Communication and Image Representation 19 7 (2008) 426-436
50. D'Orazio T., Leo M., Distante A., and Guaragnella C. New algorithm for ball recognition using circle hough transform and neural classifier. Pattern Recognition 37 3 (2004) 393-408
51. T. Misu, A. Matsui, M. Naemura, M. Fujii, N. Yagi, Distributed particle filtering for multiocular soccer ball tracking, in: IEEE International Conference on Acoustic, Speech and Signal Processing, Hawaii, USA, 15-20 April 2007, pp. 937-940.
52. Figueroa P.J., Leite N.J., and Barros L.R.M. Background recovering in outdoor image sequences: an example of soccer player segmentation. Image and Vision Computing 24 4 (2006) 363-374
53. J.R. Renno, J. Orwell, D.J. Thirde, G.A. Jones, Shadow classification and evaluation for soccer player detection, in: British Machine Vision Conference, Kingston University, London, 7-9 September 2004, pp. 839-848.
54. Vandenbroucke N., Macaire L., and Postaire J.G. Color image segmentation by pixel classification in an adapted hybrid color space. Application to soccer image analysis. Computer Vision and Image Understanding 90 2 (2003) 190-216
55. Khatoonabadi S.H., and Rahmati M. Automatic soccer players tracking in goal scenes by camera motion elimination. Image and Vision Computing 27 4 (2009) 469-479
56. Naemura M., Fukuda A., Mizutani Y., Izumi Y., Tanaka Y., and Enami K. Morphological segmentation of sport scenes using color information. IEEE Transactions on Broadcasting 46 3 (2000) 181-188
57. M. Beetz, N.v. Hoyningen-Huene, J. Bandouch, B. Kirchlechner, S. Gedikli, A. Maldonado, Camera-based observation of football games for analyzing multi-agent activities, in: AAMAS '06: Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems, Hakodate, Japan, 8-12 May 2006, pp. 42-49.
58. S. Gedikli, J. Bandouch, N. Hoyningen-Huene, B. Kirchlechner, M. Beetz, An adaptive vision system for tracking soccer players from variable camera settings, in: Proceedings of the Fifth International Conference on Computer Vision Systems (ICVS 2007), Bielefeld University, Germany, 21-24 March 2007.
59. M. Beetz, S. Gedikli, J. Bandouch, B. Kirchlechner, N. von Hoyningen-Huene, A. Perzylo, Visually tracking football games based on TV broadcasts, in: International Joint Conference on Artificial Intelligence, Hyderabad, India, 6-12 January 2007, pp. 2066-2071.
60. J. Liu, X. Tong, W. Li, T. Wang, Y. Zhang, H. Wang, B. Yang, L. Sun, S. Yang, Automatic player detection, Labeling and Tracking in Broadcast Soccer Video, in: British Machine Vision Conference, University of Warwick, UK, 10-13 September 2007.
61. Liu J., Tong X., Li W., Wang T., Zhang Y., and Wang H. Automatic player detection, labeling and tracking in broadcast soccer video. Pattern Recognition Letters 30 2 (2009) 103-113
62. P. Nillius, J. Sullivan, S. Carlsson, Multi target tracking-linking identities using Bayesian network inference, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), New York, USA, 17-22 June 2006.
63. J. Sullivan, S. Carlsson, Tracking and labelling of interacting multiple targets, in: Proceedings of Ninth European Conference on Computer Vision (ECCV), Graz, Austria, 7-13 May 2006.
64. Joo S.W., and Chellappa R. A multiple hypothesis approach for multiobject tracking. IEEE Transaction on Image Processing 16 11 (2007) 2849-2854
65. J. Miura, H. Kubo, Tracking players in highly complex scenes in broadcast soccer video using a constraint satisfaction approach, in: Proceedings of CIVR 2008, Niagara Falls, Canada, 2008.
66. Pallavi V., Mukherjee J., Majumdar A.K., and Sural S. Graph based multiplayer detection and tracking in broadcast soccer video. IEEE Transactions on Multimedia 10 (2008) 794-805
67. Xu M., Orwell J., Lowey L., and Thirde D. Architecture and algorithms for tracking football players with multiple cameras. IEE Proceedings-Vision, Image and Signal Processing 152 2 (2005) 232-241
68. W. Du, J.B. Hayet, J. Piater, J. Verly, Collaborative Multicamera tracking of athletes in Team Sports, CVBASE '06-Workshop on Computer Vision Based Analysis in Sport Environments, Graz, Austria, 12 May 2006.
69. W. Du, J. Piater, Multi-camera people tracking by collaborative particle filters and principal axis-based integration, in: Lecture Notes in Computer Science, vol. 4843, 2007, pp. 365-374.
70. Figueroa P.J., Leite N.J., and Barros L.R.M. Tracking soccer players aiming their kinematical motion analysis. Computer Vision and Image Understanding 101 2 (2006) 122-135
71. T. Misu, S. Gohshi, Y. Izumi, Y. Fujita, M. Naemura, Robust tracking of athletes using multiple features of multiple views, in: International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, Plzen-Bory, Czech Republic, 2-6 February 2004, pp. 285-292.
72. J.B. Hayet, T. Mathes, J. Czyz, J. Piater, J. Verly, B. Macq, A modular multi-camera framework for team sports tracking, in: IEEE Conference on Advanced Video and Signal Based Surveillance, Como, Italy, 15-16 September 2005, pp. 493-498.
73. T. Mathes, J. Piater, Robust non-rigid object tracking using point distribution models, British Machine Vision Conference, Oxford, UK, 5-8 September 2005.
74. P. Spagnolo, P.L. Mazzeo, M. Leo, T. D'Orazio, Unsupervised algorithms for segmentation and clustering applied to soccer pla rs classification, in: Proceeding of the International Conference on Signal Processing and Multimedia Applications, Barcelona, Spain, 28-31 July 2007, pp. 129-134.
75. H. Kim, S. Nam, J. Kim, Player segmentation evaluation for trajectory estimation in soccer games, in: Proceeding of Image and Vision Computing, Palmerston North, New Zealand, 26-28 November 2003, pp. 159-162.
76. M. Kristan, J. Pers, M. Perse, S. Kovacic, M. Bon, Multiple interacting targets tracking with application to team sports, in: Proceeding of the Fourth International Symposium on Image and Signal Processing and Analysis, Zagreb, Croatia, 15-17 September 2005.
77. Z. Xu, P. Shi, Segmentation of player and team discrimination in soccer video, in: Proceedings of the IEEE International Workshop on VLSI Design and Video Technology (IWVDVT), Suzhou, China, 28-31 May 2005.
78. S. Iwase, H. Saito, Parallel tracking of all soccer players by integrating detected positions in multiple view images, in: ICPR '04: Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04), vol. 4, Cambridge, UK, 23-26 August 2004, pp. 751-754.
79. G. Zhu, Q. Huang, C. Xu, Y. Rui, S. Jiang, W. Gao, H. Yao, Trajectory based event tactics analysis in broadcast sports video, in: MULTIMEDIA '07: Proceedings of the 15th International Conference on Multimedia, Augsburg, Germany, 24-29 September 2007, pp. 58-67.
80. G. Zhu, C. Xu, Y. Zhang, Q. Huang, H. Lu, Event tactic analysis based on player and ball trajectory in broadcast video, in: Conference on Image and Video Retrieval (CIVR), Niagara Falls, Canada, 7-9 July 2008.
81. Barros R.M.L., Misuta M.S., Menezes R.P., Figueroa P.J., Moura F.A., Cunha S.A., Anido R., and Leite N.J. Analysis of the distances covered by first division Brazilian soccer players obtained with an automatic tracking method. Journal of Sports Science and Medicine 6 2 (2007) 233-242
82. X. Yu, T. Sen Hay, X. Yan, E. Chng, A player possession acquisition system for broadcast soccer video, in: Proceedings of the IEEE International Conference on Multimedia & Expo, Amsterdam, The Netherlands, 6-8 July 2005.
83. Tsai P.S., Meijome T., and Austin P.G. Scout: a game speed analysis and tracking system. Machine Vision and Application 8 5 (2007) 289-299
84. C. Kang, J. Hwang, N.K. Li, Trajectory analysis for soccer players, in: Proceedings of the Sixth IEEE International Conference on Data Mining-Workshops (ICDMW'06), Hong Kong, China, 18 December 2006.
85. Beetz M., Kirchlechner B., and Lames M. Computerized real-time analysis of football games. IEEE Pervasive Computing 4 3 (2005) 33-39
86. D'Orazio T., Leo M., Spagnolo P., Nitti M., Mosca N., and Distante A. A visual system for real time detection of goal events during soccer matches. Computer Vision and Image Understanding 113 5 (2009) 622-632
87. S. Hashimoto, S. Ozawa, A system for automatic judgment of offsides in soccer games, in: IEEE International Conference on Multimedia and Expo, Toronto, Canada, 9-12 July 2006, pp. 1889-1892.
88. W.C. Naidoo, J.R. Tapamo, Soccer video analysis by ball, player and referee tracking, in: SAICSIT '06: Proceedings of the 2006 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists on IT Research in Developing Countries, Somerset West, South Africa, 9-11 October 2006, pp. 51-60.
89. D'Orazio T., Leo M., Spagnolo P., Mazzeo P.L., Mosca N., Nitti M., and Distante A. An investigation into the feasibility of real-time soccer offside detection from a multiple camera system. IEEE Transaction on Circuits and Systems for Video Technology 19 12 (2009) 1804-1817