An HMM-based framework for video semantic analysis

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 15, Issue 11, 2005, Pages 1422-1433

  Xu, Gu ^a,b   Ma, Yu Fei ^a,c   Zhang, Hong Jiang ^a,b,e   Yang, Shi Qiang ^a,d,f  

^a IEEE   (China)

^b MICROSOFT RESEARCH ASIA   (China)

^c IBM CHINA RESEARCH LAB   (China)

^d TSINGHUA UNIVERSITY   (China)

^e Advanced Technology Center   (China)

^f Tsinghua Microsoft Multimedia Joint Research Laboratory   (China)

Author keywords

Event detection; Hidden markov models (HMMs); Sports videos; Video semantic analysis

Indexed keywords

EVENT DETECTION; HIDDEN MARKOV MODELS (HMM); SPORTS VIDEO; VIDEO SEMANTIC ANALYSIS;

ALGORITHMS; AUTOMATION; DETECTORS; MARKOV PROCESSES; MOTION ESTIMATION; ROBUSTNESS (CONTROL SYSTEMS); SEMANTICS; VECTORS;

IMAGE ANALYSIS;

EID: 27844532508     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2005.856903     Document Type: Article

References (31)

1. F. Liu and R. W. Picard, "Finding periodicity in space and time," in Proc. IEEE Int. Conf. Computer Vision, 1998, pp. 376-383.
2. R. Polana and R. Nelson, "Detecting activities," in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 1993, pp. 2-7.
3. L. Zelnik-Manor and M. Irani, "Vent-based analysis of video," in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 2001, pp. 123-130.
4. M. J. Roach, J. D. Mason, and M. Pawlewski, "Video genre classification using dynamics," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 2001, pp. 1557-1560.
5. B. T. Truong and C. Dorai, "Automatic genre identification for content-based video categorization," in Proc. IEEE Int. Conf. Pattern Recognition, 2000, pp. 230-233.
6. K. Messer, W. Christmas, and J. Kittler, "Automatic sports classification," in Proc. IEEE Int. Conf. Pattern Recognition, 2002, pp. 1005-1008.
7. J. Liu and B. Bhanu, "Learning semantic visual concepts from video," in Proc. IEEE Int. Conf. Pattern Recognition, 2002, pp. 1061-1064.
8. N. Vasconcelos and A. Lippman, "A Bayesian framework for semantic content characterization," in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 1998, pp. 566-571.
9. M. R. Naphade, M. R. Naphade, S. Basu, J. R. Smith, C.-Y. Lin, and B. Tseng, "A statistical modeling approach to content based video retrieval," in Proc. IEEE. Int. Conf. Pattern Recognition, 2002, pp. 953-956.
10. M. R. Naphade, T. Kristjansson, B. Frey, and T. S. Huang, "Probabilistic multimedia objects (multijects): A novel approach to video indexing and retrieval in multimedia systems," in Proc. IEEE Int. Conf. Image Processing, 1998, pp. 536-540.
11. M. R. Naphade and T. S. Huang, "Semantic video indexing using a probabilistic framework," in Proc. IEEE Int. Conf. Pattern Recognition, 2000, pp. 79-84.
12. H. J. Zhang, Y. Gong, S. W. Smoliar, and S. Y. Tan, "Automatic parsing of news video," in Proc. IEEE Int. Conf. Multimedia Computing and Systems, 1994, pp. 45-54.
13. A. Ekin, A. M. Tekalp, and R. Mehrotra, "Automatic soccer video analysis and summarization," IEEE Trans. Image Process., vol. 12, no. 7, pp. 796-807, Jul. 2003.
14. Y.-P. Tan, D. D. Saur, S. R. Kulkami, and P. J. Ramadge, "Rapid estimation of camera motion from compressed video with application to video annotation," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 2, pp. 133-146, Feb. 2000.
15. G. Sudhir, J. C. M. Lee, and A. K. Jain, "Automatic classification of tennis video for high-level content-based retrieval," in Proc. IEEE Int. Workshop Content-Based Access of Image and Video Database, 1998, pp. 81-90.
16. Y. Gong, T. S. Lim, and H. C. Chua, "Automatic parsing of tv soccer programs," in Proc. IEEE Int. Conf. Multimedia Computing and Systems, 1995, pp. 167-174.
17. D. Zhong and S. F. Chang, "Structure analysis of sports video using domain models," in Proc. IEEE Int. Conf. Multimedia and Expo., 2001, pp. 713-716.
18. T. Liu and J. R. Kender, "Rule-based video classification system for basketball video indexing," in Proc. ACM Multimedia Workshops, 2000, pp. 213-216.
19. W. Zhou, A. Vellaikal, and C. C. J. Kuo, "A hidden Markov model approach to the structure of documentaries," in Proc. IEEE Int. Workshop Content-Based Access of Image and Video Libraries, 2000, pp. 111-115.
20. J. M. Sanchez, X. Binefa, and J. R. Kender, "Coupled Markov chains for video contents characterization," in Proc. IEEE Int. Conf. Pattern Recognition, 2002, pp. 461-464.
21. M. Petkovic, W. Jonker, and Z. Zivkovic, "Recognizing strokes in tennis videos using hidden Markov models," in Proc. IASTED Int. Conf. Visualization, Imaging and Image Processing, 2001, pp. 512-516.
22. L. Xie, S.-F. Chang, A. Divakaran, and H. Sun, "Structure analysis of soccer video with hidden Markov models," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 2002, pp. 4096-4099.
23. C. L. Huang and C. Y. Chang, "Video summarization using hidden Markov model," in Proc. IEEE Int. Conf. Information Technology: Coding and Computing, 2001, pp. 473-477.
24. W. Wolf, "Hidden Markov model parsing of video programs," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 1997, pp. 2609-2611.
25. H. Pan, P. van Beek, and M. I. Sezan, "Detection of slow-motion replay segments in sports video for highlights generation," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 2001, pp. 1649-1652.
26. J. C. Huang, Z. Liu, and Y. Wang, "Joint video scene segmentation and classification based on hidden Markov model," in Proc. IEEE Int. Conf. Multimedia and Expo., 2000, pp. 1551-1554.
27. G. S. Chambers, S. Venkatesh, G. A. W. West, and H. H. Bui, "Hierarchical recognition of intentional human gestures for sports video annotation," in Proc. IEEE Int. Conf. Pattern Recognition, 2002, pp. 1082-1085.
28. L. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 256-286, Feb. 1989.
29. H. Bourlard, S. Dupont, and C. Ris, "Multi-Stream Speech Recognition," IDIAP, IDIAP-RR 07, 1996.
30. S. Zhu and K. K. Ma, "A new diamond search algorithm for fast blockmatching motion estimation," IEEE Trans. Image Process., vol. 9, no. 2, pp. 287-290, Feb. 2000.
31. S. Young et al. (2001) The HTK Book (for HTK Version 3.2), Online Manual. [Online]. Available: http://htk.eng.cam.ac.uk/prot-docs/htk-book.pdf