Human Action Recognition with Multiple-Instance Markov Model

IEEE Transactions on Information Forensics and Security

Volumn 9, Issue 10, 2014, Pages 1581-1591

  Zhou, Wen ^a   Zhang, Zhong ^b  

^a Samsung Telecom Research and Development Center   (China)

^b TIANJIN NORMAL UNIVERSITY   (China)

Author keywords

Bismuth; Clutter; Feature extraction; Hidden Markov models; Histograms; Markov processes; Vectors

Indexed keywords

BISMUTH; CHAINS; CLUTTER (INFORMATION THEORY); ENCODING (SYMBOLS); FEATURE EXTRACTION; GESTURE RECOGNITION; IMAGE RECOGNITION; MARKOV PROCESSES; MOTION ESTIMATION; VECTORS;

ACTION REPRESENTATIONS; BACKGROUND CLUTTER; HISTOGRAMS; HUMAN-ACTION RECOGNITION; ILLUMINATION VARIATION; MULTIPLE MARKOV CHAINS; STATISTICAL RELATIONSHIP; TEMPORAL INFORMATION;

HIDDEN MARKOV MODELS;

EID: 84937515964     PISSN: 15566013     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIFS.2014.2344448     Document Type: Article

References (40)

1. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, "Learning realistic human actions from movies," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
2. H. Wang, M. M. Ullah, A. Klaser, I. Laptev, C. Schmid, "Evaluation of local spatio-temporal features for action recognition," in Proc. Brit. Mach. Vis. Conf., 2009, pp. 124.1-124.11.
3. Q. V. Le, W. Y. Zou, S. Y. Yeung, A. Y. Ng, "Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 3361-3368.
4. S. Sadanand and J. J. Corso, "Action bank: A high-level representation of activity in video," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1234-1241.
5. Z. Zhang, C. Wang, B. Xiao, W. Zhou, S. Liu, "Action recognition using context-constrained linear coding," IEEE Signal Process. Lett., vol. 19, no. 7, pp. 439-442, Jul. 2012.
6. J. Liu, B. Kuipers, S. Savarese, "Recognizing human actions by attributes," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 3337-3344.
7. Z. Zhang, C. Wang, B. Xiao, W. Zhou, S. Liu, "Attribute regularization based human action recognition," IEEE Trans. Inf. Forensics Security, vol. 8, no. 10, pp. 1600-1609, Oct. 2013.
8. M. Raptis, I. Kokkinos, S. Soatto, "Discovering discriminative action parts from mid-level video representations," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1242-1249.
9. A. F. Bobick and A. D. Wilson, "A state-based approach to the representation and recognition of gesture," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 12, pp. 1325-1337, Dec. 1997.
10. Q. Shi, L. Cheng, L. Wang, A. Smola, "Human action segmentation and recognition using discriminative semi-Markov models," Int. J. Comput. Vis., vol. 93, no. 1, pp. 22-32, 2011.
11. N. M. Oliver, B. Rosario, A. P. Pentland, "A Bayesian computer vision system for modeling human interactions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 831-843, Aug. 2000.
12. P. Natarajan and R. Nevatia, "Coupled hidden semi Markov models for activity recognition," in Proc. WMVC, Feb. 2007, p. 10.
13. L. Shao and R. Mattivi, "Feature detector and descriptor evaluation in human action recognition," in Proc. ACM Int. Conf. Image Video Retr., 2010, pp. 477-484.
14. L. Shao, L. Ji, Y. Liu, J. Zhang, "Human action segmentation and recognition via motion and shape analysis," Pattern Recognit. Lett., vol. 33, no. 4, pp. 438-445, Mar. 2012.
15. X. Zhen, L. Shao, D. Tao, X. Li, "Embedding motion and structure features for human action recognition," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 7, pp. 1182-1190, Jul. 2013.
16. M. Raptis and S. Soatto, "Tracklet descriptors for action modeling and video analysis," in Proc. 11th Eur. Conf. Comput. Vis., Sep. 2010, pp. 577-590.
17. Z. Zhang, C. Wang, B. Xiao, W. Zhou, S. Liu, C. Shi, "Cross-view action recognition via a continuous virtual path," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 2690-2697.
18. M. S. Ryoo and J. K. Aggarwal, "Spatio-temporal relationship match: Video structure comparison for recognition of complex human activities," in Proc. IEEE 12th Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 1593-1600.
19. K. Tang, L. Fei-Fei, D. Koller, "Learning latent temporal structure for complex event detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1250-1257.
20. C. Sminchisescu, A. Kanaujia, Z. Li, D. Metaxas, "Conditional models for contextual human motion recognition," in Proc. 10th IEEE Int. Conf. Comput. Vis., vol. 2. Oct. 2005, pp. 1808-1815.
21. M.-M. Cheng, G.-X. Zhang, N. J. Mitra, X. Huang, S.-M. Hu, "Global contrast based salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 409-416.
22. T. G. Dietterich, R. H. Lathrop, T. Lozano-Perez, "Solving the multiple instance problem with axis-parallel rectangles," Artif. Intell., vol. 89, nos. 1-2, pp. 31-71, Jan. 1997.
23. O. Maron and A. Ratan, "Multiple-instance learning for natural scene classification," in Proc. 15th ICML, vol. 15. 1998, pp. 341-349.
24. Z. H. Zhou and M. L. Zhang, "Multi-instance multi-label learning with application to scene classification," in Proc. Adv. Neural Inf. Process. Syst., vol. 19. 2007, p. 1609.
25. B. Babenko, M.-H. Yang, S. Belongie, "Visual tracking with online multiple instance learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 983-990.
26. J. Lafferty, A. McCallum, F. C. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Proc. 18th Int. Conf. Mach. Learn., 2011, pp. 282-289.
27. I. Tsochantaridis, T. Joachims, T. Hofmann, Y. Altun, "Large margin methods for structured and interdependent output variables," in Proc. J. Mach. Learn. Res., 2005, pp. 1453-1484.
28. A. L. Yuille, A. Rangarajan, A. Yuille, "The concave-convex procedure (CCCP)," in Proc. Adv. Neural Inf. Process. Syst., vol. 2. 2002, pp. 1033-1040.
29. M. Grant and S. Boyd. (2014, Mar.). CVX: Matlab Software for Disciplined Convex Programming, Version 2.1. [Online]. Available: http://cvxr.com/cvx
30. S. Andrews, I. Tsochantaridis, T. Hofmann, "Support vector machines for multiple-instance learning," in Proc. Adv. Neural Inf. Process. Syst., 2003, pp. 561-568.
31. A. J. Viterbi, "Error bounds for convolutional codes and an asymptotically optimum decoding algorithm," IEEE Trans. Inf. Theory, vol. 13, no. 2, pp. 260-269, Apr. 1967.
32. I. Laptev, "On space-time interest points," Int. J. Comput. Vis., vol. 64, no. 2, pp. 107-123, Sep. 2005.
33. C. Schuldt, I. Laptev, B. Caputo, "Recognizing human actions: A local SVM approach," in Proc. 17th ICPR, vol. 3. Aug. 2004, pp. 32-36.
34. M. D. Rodriguez, J. Ahmed, M. Shah, "Action MACH a spatiotemporal maximum average correlation height filter for action recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
35. J. Liu, J. Luo, M. Shah, "Recognizing realistic actions from videos 'in the wild'," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1996-2003.
36. P. Dollár, V. Rabaud, G. Cottrell, S. Belongie, "Behavior recognition via sparse spatio-temporal features," in Proc. 2nd IEEE Int. Workshop VSPETS, Oct. 2005, pp. 65-72.
37. R. Minhas, A. A. Mohammed, Q. M. J. Wu, "Incremental learning in human action recognition based on snippets," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 11, pp. 1529-1541, Nov. 2011.
38. A. Castrodad and G. Sapiro, "Sparse modeling of human actions from motion imagery," Int. J. Comput. Vis., vol. 100, no. 1, pp. 1-15, Oct. 2012.
39. K. Guo, P. Ishwar, J. Konrad, "Action recognition using sparse representation on covariance manifolds of optical flow," in Proc. 7th IEEE Int. Conf. Adv. Video Signal Based Surveill. (AVSS), Aug./Sep. 2010, pp. 188-195.
40. H. Wang, A. Klaser, C. Schmid, C.-L. Liu, "Action recognition by dense trajectories," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 3169-3176.