Discriminative optical flow tensor for video semantic analysis

Computer Vision and Image Understanding

Volumn 113, Issue 3, 2009, Pages 372-383

  Gao, Xinbo ^a   Yang, Yimin ^a   Tao, Dacheng ^b   Li, Xuelong ^c  

^a XIDIAN UNIVERSITY   (China)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

General tensor discriminant analysis; Hidden Markov models; Linear discriminant analysis; Optical flow tensor; Video semantic analysis

Indexed keywords

COMPUTATIONAL GRAMMARS; DISCRIMINANT ANALYSIS; FEATURE EXTRACTION; IMAGE RETRIEVAL; INFORMATION THEORY; MARKOV PROCESSES; OBJECT RECOGNITION; OPTICAL FLOWS; SEMANTICS; TENSORS; VIDEO RECORDING;

CONTEXT SENSITIVES; CROSS VALIDATIONS; DIMENSIONALITY REDUCTIONS; FEATURE DIMENSIONS; FEATURE EXTRACTION METHODS; FUNDAMENTAL CHARACTERISTICS; GENERAL TENSOR DISCRIMINANT ANALYSIS; LINEAR DISCRIMINANT ANALYSIS; MOTION INFORMATIONS; OPTICAL FLOW TENSOR; SEMANTIC ANALYSIS; SEMANTIC INFORMATIONS; SEMANTIC UNITS; TEMPORAL MODELING; VIDEO SEMANTIC ANALYSIS; VIDEO SEQUENCES; WELL MODELS;

HIDDEN MARKOV MODELS;

EID: 59549107420     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2008.08.007     Document Type: Article

References (37)

1. Ekin A., Tekalp A.M., and Mehrota R. Automatic soccer video analysis and summarization. IEEE Trans. Image Process. 12 7 (2003) 796-807
2. Li Y., Narayanan S., and Kuo C.-C.J. Content-based movie analysis and indexing based on audio visual cues. IEEE Trans. Circuits Syst. Video Technol. 14 8 (2004) 1073-1085
3. L.Q. Xu, Y. Li, Video classification using spatial-temporal features and PCA, in Int. Conf. Multimedia and Expo, Baltimore, 2003, pp. 485-488.
4. Sadlier D.A., and O'Connor N.E. Event detection in field sports video using audio-visual features and a support vector Machine. IEEE Trans. Circuits Syst. Video Technol. 15 10 (2005) 1225-1233
5. F. Wang, Y.F. Ma, H.J. Zhang, J.T. Li, A generic framework for semantic sports video analysis using dynamic Bayesian networks, in Proc. IEEE Int. Conf. Multimedia Model., 2005, pp. 115-122.
6. Huang C.L., Shih H.C., and Chao C.Y. Semantic analysis of soccer video using dynamic Bayesian network. IEEE Trans. Multimedia 8 4 (2006) 749-760
7. Xu G., Ma Y.F., Zhang H.J., and Yang S.Q. An HMM-based framework for video semantic analysis. IEEE Trans. Circuits Syst. Video Technol. 15 11 (2005) 1422-1433
8. Xie L., Chang S.F., Divakaran A., and Sun H. Structure analysis of soccer video with domain knowledge and hidden Markov models. PRL 25 7 (2004) 767-775
9. Huang J.C., Liu Z., and Wang Y. Joint scene classification and segmentation based on hidden Markov model. IEEE Trans. Multimedia 7 3 (2005) 538-550
10. Rabiner L. A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77 2 (1989) 256-286
11. F. Niu, M. A. Mottaled, HMM-based segmentation and recognition of human activities from video sequences, in Proc. IEEE Int. Conf. Multimedia and Expo. Amsterdam, IEEE, 2005, pp. 804-807.
12. M. Barnard, J.-M Odobez, Sports event recognition using layered HMMs, in Proc. of IEEE Int. Conf. Multimedia and Expo. Amsterdam, 2005, pp. 1150-1153.
13. Trivedi M.M., Huang K.S., and Mikic I. Dynamic context capture and distributed video arrays for intelligent spaces. IEEE Trans. Syst. Man Cybernet. 35 1 (2005) 145-163
14. O. Alatas, O. Javed, M. Shah, Compressed spatio-temporal descriptors for video matching and retrieval, in Proc. IEEE Int. Conf. Pattern Recognition, 2004, pp. 882-885.
15. Hsieh J.W., Yu S.L., and Chen Y.S. Motion-based video retrieval by trajectory matching. IEEE Trans. Circuits Syst. Video Technol. 16 3 (2006) 396-409
16. Horn B.K.P., and Schunk B.G. Determining optical flow. Artificial Intell. 15 (1981) 185-204
17. Barron J.L., Fleet D.J., and Beauchemin S. Performance of optical flow techniques. Int. J. Comput. Vis. 12 1 (1994) 43-77
18. B.D. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in Proc. 7th Int. Joint Conf. Artificial Intell., 1981, pp. 674-679.
19. Anandan P. A computational framework and an algorithm for the measurement of visual motion. Int. J. Comput. Vis. 2 (1989) 283-310
20. Heeger D.J. Optical flow from spatiotemporal filters. Int. J. Comput. Vis. 1 (1988) 279-302
21. Fleet D.J., and Jepson A.D. Computation of component image velocity from local phase information. Int. J. Comput. Vis. 5 1 (1990) 77-104
22. Tao D., Li X., Hu W., Maybank S., and Wu X. Supervised tensor learning. Knowledge Inform. Syst.. 13 1 (2007) 1-42
23. Tao D., Li X., Wu X., and Maybank S. General tensor discriminant analysis and gabor features for gait recognition. IEEE Trans. Pattern Anal. Mach. Intell. 29 10 (2007) 1700-1715
24. L.D. Lathauwer, Signal processing based on multilinear algebra, Ph.D. Thesis, Katholike Universiteit Leuven, 1997.
25. Baum L.E., and Egon J.A. An inequality with applications to statistical estimation for probabilistic functions of a Markov process and to a model for ecology. Bull. Am. Meteorol. Soc. 37 2 (1967) 360-363
26. Forney G.D. The Viterbi algorithm. Proc. IEEE (1973) 268-278
27. Baum L.E. An inequality and associated maximization technique in statistical estimation for probabilistic functions of Markov processes. Inequalities 3 (1972) 1-8
28. Gao X., and Tang X. Unsupervised video-shot segmentation and model-free anchorperson detection for news video story parsing. IEEE Trans. Circuits Syst. Video Technol. 12 9 (2002) 765-776
29. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. Second ed. (2000), Wiley-Interscience
30. D. Xu, S. Lin, S. Yan, X. Tang, Rank-one projections with adaptive margins for face recognition, IEEE Int. Conf. Computer Vis. Pattern Recogn., 37(5) (2006) 1226-1236.
31. D. Tao, X. Li, X. Wu, S.J. Maybank, Tensor rank one discriminant analysis, Neurocomputing, in press.
32. D. Xu, S. Yan, L. Zhang, H. Zhang, Z. Liu, H. Shum, Concurrent subspace analysis, IEEE Int. Conf. Comput. Vis. Pattern Recogn. 2 (2005) 203-208.
33. S. Yan, D. Xu, Q. Yang, L. Zhang, X. Tang, H. Zhang, Discriminant analysis with tensor representation, IEEE Int. Conf. Comput. Vis. Pattern Recogn. 1 (2005) 526-532.
34. Fu Y., and Huang T.S. Image classification using correlation tensor analysis. IEEE Trans. Image Process. (TIP) 17 2 (2008) 226-234
35. Fu Y., Yan S., and Huang T.S. Classification and feature extraction by simplexization. IEEE Trans. Inform. Forensics Security 3 1 (2008) 91-100
36. Tao D., Tang X., Li X., and Wu X. Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 28 7 (2006) 088-1,099
37. D. Tao, X. Li, X. Wu, S.J. Maybank, Geometric mean for subspace selection in multiclass classification, IEEE Trans. Pattern Anal. Mach. Intell. in press.