Automatic detection and analysis of player action in moving background sports video sequences

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 20, Issue 3, 2010, Pages 351-364

  Li, Haojie ^a   Tang, Jinhui ^b   Wu, Si ^c   Zhang, Yongdong ^d   Lin, Shouxun ^d  

^a DALIAN UNIVERSITY OF TECHNOLOGY   (China)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c ORANGE LABS   (France)

^d INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

Action recognition; Human body tracking; Sports training; Video analysis; Video object segmentation

Indexed keywords

ACTION RECOGNITION; AUTOMATIC ANALYSIS; AUTOMATIC DETECTION; COARSE-TO-FINE; DYNAMIC BACKGROUND; FINE GRANULARITY; GAME VIDEOS; GLOBAL MOTION ESTIMATION; GRANULARITY LEVELS; HUMAN BODY TRACKING; INPUT VIDEOS; KINEMATIC MEASUREMENTS; KINEMATIC PARAMETERS; OBJECT SEGMENTATION; PERFORMANCE IMPROVEMENTS; PLAYER ACTION; ROBUST ALGORITHM; SPORTS VIDEO; SPORTS VIDEO SEQUENCES; TRAINING PURPOSE; VIDEO ANALYSIS; VIDEO CLIPS; VIDEO INDEXING AND RETRIEVAL; VIDEO-OBJECT SEGMENTATION;

FOOTAGE COUNTERS; INDEXING (OF INFORMATION); KINEMATICS; MOTION COMPENSATION; VIDEO RECORDING;

MOTION ESTIMATION;

EID: 77749310224     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2009.2035833     Document Type: Article

References (40)

1. F. Wang, J.-T. Li, Y.-D. Zhang, and S.-X. Lin, "Semantic and structural analysis of TV diving programs," J. Comput. Sci. Technol., vol.19, no.6, pp. 928-935, Nov. 2004.
2. L. X. Xie, P. Xu, S.-F. Chang, A. Divakaran, and H. Sun, "Structure analysis of soccer video with domain knowledge and hidden Markov models," Pattern Recognit. Lett., vol.25, no.7, pp. 767-775, May 2004.
3. C.-C. Lien, C.-L. Chiang, and C.-H. Lee, "Scene-based event detection for baseball videos," J. Visual Commun. Image Representation, vol.18, no.1, pp. 1-14, Feb. 2007.
4. G. Xu, Y.-F. Ma, H.-J. Zhang, and S.-Q. Yang, "An HMM-based framework for video semantic analysis," IEEE Trans. Circuits Syst. Video Technol., vol.15, no.11, pp. 1422-1433, Nov. 2005.
5. G. Pingali, Y. Jean, A. Opalach, and I. Carlbom, "LucentVision: Converting real world events into multimedia experiences," in Proc. IEEE Int. Conf. Multimedia Expo, 2000, pp. 1433-1436.
6. X. G. Yu, N. J. Jiang, L.-F. Cheong, H. W. Leong, and X. Yan, "Automatic camera calibration of broadcast tennis video with applications to 3-D virtual content insertion and ball detection and tracking," Comput. Vision Image Understand., vol.113, no.5, pp. 643-652, May 2009.
7. L.-Y. Duan, M. Xu, T.-S. Chua, Q. Tian, and C.-S. Xu, "A mid-level representation framework for semantic sports video analysis," in Proc. ACM Conf. Multimedia, 2003, pp. 33-44.
8. H. Miyamori and S. Iisaku, "Video annotation for content-based retrieval using human behavior analysis and domain knowledge," in Proc. Automat. Face Gesture Recognition, 2000, pp. 320-325.
9. G. Y. Zhu, Q. M. Huang, C. S. Xu, L. Xing, W. Gao, and H. Yao, "Human behavior analysis for highlight ranking in broadcast racket sports video," IEEE Trans. Multimedia, vol.9, no.6, pp. 1167-1182, Oct. 2007.
10. R. Poppe, "Vision-based human motion analysis: An overview," Com-put. Vision Image Understand., vol.108, nos. 1-2, pp. 4-18, Oct. 2007.
11. T. Moeslund, A. Hilton, and V. Krüger, "A survey of advances in vision-based human motion capture and analysis," Comput. Vision Image Understand., vol.104, nos. 2-3, pp. 90-126, Nov. 2006.
12. J. Yamato, J. Ohya, and K. Ishii, "Recognizing human action in time-sequential images using hidden Markov model," in Proc. Comput. Vision Pattern Recognit., 1992, pp. 379-385.
13. J. Sullivan and S. Carlsson, "Recognizing and tracking human action," in Proc. Eur. Conf. Comput. Vision, Lecture Notes in Computer Science 2350, no.1. 2002, pp. 629-644.
14. A. A. Efros, A. C. Berg, G. Mori, and J. Malik, "Recognizing action at a distance," in Proc. Int. Conf. Comput. Vision, 2003, pp. 726-733.
15. W.-L. Lu, K. Okuma, and J. J. Little, "Tracking and recognizing actions of multiple hockey players using the boosted particle filter," Image Vision Comput., vol.27, no.1, pp. 189-205, Jan. 2009.
16. P. Fogueroa, N. Leite, and R. Barros, "Tracking soccer players aiming their kinematical motion analysis," Comput. Vision Image Understand., vol.101, no.2, pp. 122-135, Feb. 2006.
17. J. R. Wang and N. Parameswaran, "Detecting tactics patterns for archiving tennis video clips," in Proc. Int. Symp. Multimedia Softw. Eng., 2004, pp. 186-192.
18. A. W. B. Smith and B. C. Lovell, "Visual tracking for sports applications," in Proc. Workshop Digital Image Comput., 2005, pp. 79-84.
19. R. Urtasun, D. J. Fleet, and P. Fua, "Monocular 3-D tracking of the golf swing," in Proc. Comput. Vision Pattern Recognit., 2005, pp. 932-938.
20. R. Cassel, C. Collet, and R. Gherbi, "Real-time acrobatic gesture analysis," in Proc. Gesture Workshop, 2005, pp. 88-99.
21. J. Konrad and F. Dufaux, "Digital Equipment Corporation, improved global motion estimation for N3," in Meeting of ISO/IEC/SC29/WG11, no. MPEG97/M3096, San Jose, CA, 1998.
22. B. Qi and A. Amer, "Robust and fast global motion estimation oriented to video object segmentation," in Proc. IEEE Int. Conf. Image Process., 2005, pp. 153-156.
23. T. Chiew, C. How, D. Bull, and C. Canagarajah, "Rapid block-based global motion estimation and its applications," in Proc. Int. Conf. Consumer Electron., 2002, pp. 228-229.
24. N. Ostu, "A threshold selection method from gray level histogram," IEEE Trans. Syst. Man. Cybern., vol.9, no.1, pp. 62-66, Jan. 1979.
25. D. Farin, "Automatic video segmentation employing object/camera modeling techniques," Ph.D. dissertation, CIP-Data Library, Tech. Univ. Eindhoven, Eindhoven, The Netherlands, 2005.
26. T. S. Chua, H. Feng, and A. Chandrashekhara, "An unified framework for shot boundary detection via active learning," in Proc. Int. Conf. Acoust. Speech Signal Proces., 2003, pp. 845-848.
27. A. K. Jain and R. C. Dube, "Clustering methods and algorithms," in Algorithms for Clustering Data. Englewood Cliffs, NJ: Prentice-Hall, 1988, pp. 55-142.
28. C. S. Myers and L. R. Rabiner, "A comparative study of several dynamic time-warping algorithms for connected word recognition," Bell Syst. Te c h. J., vol.60, no.7, pp. 1389-1409, Sep. 1981.
29. S. Wu, S.-X. Lin, and Y.-D. Zhang, "Automatic segmentation of moving objects in video sequences based on dynamic background construction," Chin. J. Comput., vol.28, no.8, pp. 1386-1392, Aug. 2005.
30. T. Aach, A. Kaup, and R. Mester, "Statistical model-based change detection in moving video," Signal Process., vol.31, no.2, pp. 165-180, Mar. 1993.
31. M. Kass, A. Witkini, and D. Terzopoulos, "Snakes: Active contour models," Int. J. Comput. Vision, vol.1, no.4, pp. 321-331, Jan. 1998.
32. M. K. Hu, "Visual pattern recognition by moment invariants," IEEE Trans. Inform. Theory, vol.8, no.2, pp. 179-187, Feb. 1962.
33. R. Green and L. Guan, "Quantifying and recognizing human movement patterns from monocular video images-part I: A new framework for modeling human motion," IEEE Trans. Circuits Syst. Video Technol., vol.14, no.2, pp. 179-190, Feb. 2004.
34. J. Deutscher, A. Blake, and I. Reid, "Articulated body motion capture by annealed particle filtering," in Proc. Comput. Vision Pattern Recognition, 2000, pp. 126-133.
35. D. M. Gavrila and V. Philomin, "Real-time object detection for smart vehicles," in Proc. Int. Conf. Comput. Vision, 1999, pp. 87-93.
36. C.-T. Hsu and Y.-C. Tsan, "Mosaics of video sequences with moving objects," Signal Process. Image Commun., vol.19, no.11, pp. 81-98, Nov. 2004.
37. http://www.dartfish.com/en/sports-enhancements/sport performance software/index.htm
38. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. Assoc. Comput. Machinery, vol.24, no.6, pp. 381-395, Jun. 1981.
39. P. J. Rousseeuw and K. Van Driessen, "Computing LTS regression for large data sets," Data Mining Knowl. Discovery, vol.12, no.1, pp. 29-45, Jan. 2006.
40. F. S. Rovati, D. Pau, E. Piccinelli, L. Pezzoni, and J.-M. Bard, "An innovative, high quality and search window independent motion estimation algorithm and architecture for MPEG-2 encoding," IEEE Trans. Consumer Electron., vol.46, no.3, pp. 697-705, Aug. 2000. (Pubitemid 30958060)