CSMMI: Class-specific maximization of mutual information for action and gesture recognition

IEEE Transactions on Image Processing

Volumn 23, Issue 7, 2014, Pages 3152-3165

  Wan, Jun ^a   Athitsos, Vassilis ^b   Jangyodsuk, Pat ^b   Escalante, Hugo Jair ^c   Ruan, Qiuqi ^a   Guyon, Isabelle ^d  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b University of Texas at Arlington   (United States)

^c INSTITUTO NACIONAL DE ASTROFÍSICA   (Mexico)

^d ChaLearn   (United States)

Author keywords

Action recognition; Class specific dictionary; Dictionary learning; Gaussian process; Gesture recognition; Inter class mutual information; Intra class mutual information; Sparse coding

Indexed keywords

CODING ERRORS; FEATURE EXTRACTION;

ACTION RECOGNITION; CLASS-SPECIFIC DICTIONARIES; DICTIONARY LEARNING; GAUSSIAN PROCESSES; MUTUAL INFORMATIONS; SPARSE CODING;

GESTURE RECOGNITION;

ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; FACTUAL DATABASE; GESTURE; HUMAN; IMAGE PROCESSING; MOVEMENT (PHYSIOLOGY); PROCEDURES; SPORT;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DATABASES, FACTUAL; GESTURES; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MOVEMENT; PATTERN RECOGNITION, AUTOMATED; SPORTS;

EID: 84903153641     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2328181     Document Type: Article

References (54)

1. T. Guha and R. K. Ward, "Learning sparse representations for human action recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 8, pp. 1576-1588, Aug. 2012.
2. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
3. Q. Qiu, Z. Jiang, and R. Chellappa, "Sparse dictionary-based representation and recognition of action attributes," in Proc. IEEE ICCV, Nov. 2011, pp. 707-714.
4. S. Lazebnik and M. Raginsky, "Supervised learning of quantizer codebooks by information loss minimization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 7, pp. 1294-1309, Jul. 2009.
5. H. Peng, F. Long, and C. Ding, "Feature selection based on mutual information criteria of max-dependency, max-relevance, and minredundancy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1226-1238, Aug. 2005. (Pubitemid 41245053)
6. J. Liu and M. Shah, "Learning human actions via information maximization," in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
7. J. K. Aggarwal and M. S. Ryoo, "Human activity analysis: A review," ACM Comput. Surv., vol. 43, no. 3, p. 16, 2011.
8. R. Poppe, "A survey on vision-based human action recognition," Image Vis. Comput., vol. 28, no. 6, pp. 976-990, 2010.
9. R. Fergus, L. Fei-Fei, P. Perona, and A. Zisserman, "Learning object categories from Google's image sesarch," in Proc. IEEE ICCV, vol. 2. Oct. 2005, pp. 1816-1823. (Pubitemid 44042397)
10. H. Jégou, M. Douze, and C. Schmid, "Packing bag-of-features," in Proc. 12th IEEE Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 2357-2364.
11. H. Su, M. Sun, L. Fei-Fei, and S. Savarese, "Learning a dense multiview representation for detection, viewpoint classification and synthesis of object categories," in Proc. 12th IEEE Int. Conf. Comput. Vis., Sep/Oct. 2009, pp. 213-220.
12. J. C. Niebles and L. Fei-Fei, "A hierarchical model of shape and appearance for human action classification," in Proc. IEEE Int. Conf. CVPR, Jun. 2007, pp. 1-8.
13. B. Yao, X. Jiang, A. Khosla, A. L. Lin, L. Guibas, and L. Fei-Fei, "Human action recognition by learning bases of action attributes and parts," in Proc. IEEE ICCV, Nov. 2011, pp. 1331-1338.
14. Z. Jiang, Z. Lin, and L. S. Davis, "Learning a discriminative dictionary for sparse coding via label consistent K-SVD," in Proc. IEEE Int. Conf. CVPR, Jun. 2011, pp. 1697-1704.
15. W. Dong, X. Li, D. Zhang, and G. Shi, "Sparsity-based image denoising via dictionary learning and structural clustering," in Proc. IEEE Int. Conf. CVPR, Jun. 2011, pp. 457-464.
16. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Discriminative learned dictionaries for local image analysis," in Proc. IEEE Int. Conf. CVPR, Jun. 2008, pp. 1-8.
17. J. Zheng and Z. Jiang, "Learning view-invariant sparse representations for cross-view action recognition," in Proc. IEEE ICCV, Dec. 2013, pp. 533-547.
18. L. Yang, R. Jin, R. Sukthankar, and F. Jurie, "Unifying discriminative visual codebook generation with classifier training for object category recognition," in Proc. IEEE Int. Conf. CVPR, Jun. 2008, pp. 1-8.
19. P. Dollár, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior recognition via sparse spatio-temporal features," in Proc. 2nd Joint IEEE Int. Workshop Vis. Surveill. Perform. Eval. Tracking Surveill., Oct. 2005, pp. 65-72. (Pubitemid 46178025)
20. M. Yang, L. Zhang, X. Feng, and D. Zhang, "Fisher discrimination dictionary learning for sparse representation," in Proc. IEEE ICCV, Nov. 2011, pp. 543-550.
21. J. Wan, Q. Ruan, S. Deng, and W. Li, "One-shot learning gesture recognition from RGB-D data using bag of features," J. Mach. Learn. Res., vol. 14, no. 1, pp. 2549-2582, 2013.
22. J. C. Niebles, H.Wang, and L. Fei-Fei, "Unsupervised learning of human action categories using spatial-temporal words," Int. J. Comput. Vis., vol. 79, no. 3, pp. 299-318, 2008.
23. A. Krause, A. Singh, and C. Guestrin, "Near-optimal sensor placements in Gaussian processes: Theory, efficient algorithms and empirical studies," J. Mach. Learn. Res., vol. 9, pp. 235-284, Jun. 2008. (Pubitemid 351469021)
24. I. Laptev, "On space-time interest points," Int. J. Comput. Vis., vol. 64, nos. 2-3, pp. 107-123, 2005. (Pubitemid 41314645)
25. L. Xia, C.-C. Chen, and J. K. Aggarwal, "View invariant human action recognition using histograms of 3D joints," in Proc. IEEE Conf. CVPRW, Jun. 2012, pp. 20-27.
26. Z. Jiang, Z. Lin, and L. S. Davis, "Recognizing human actions by learning and matching shape-motion prototype trees," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 533-547, Mar. 2012.
27. T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. New York, NY, USA: Wiley, 2006.
28. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Actions as space-time shapes," in Proc. 10th IEEE ICCV, vol. 2. Oct. 2005, pp. 1395-1402. (Pubitemid 44042342)
29. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning realistic human actions from movies," in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
30. M. D. Rodriguez, J. Ahmed, and M. Shah, "Action mach a spatio-temporal maximum average correlation height filter for action recognition," in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
31. J. Liu, Y. Yang, I. Saleemi, and M. Shah, "Learning semantic features for action recognition via diffusion maps," Comput. Vis. Image Understand., vol. 116, no. 3, pp. 361-377, 2012.
32. M. Marszalek, I. Laptev, and C. Schmid, "Actions in context," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 2929-2936.
33. I. Guyon, V. Athitsos, P. Jangyodsuk, B. Hamner, and H. J. Escalante, "Chalearn gesture challenge: Design and first results," in Proc. IEEE Int. Conf. CVPRW, Jun. 2012, pp. 1-6.
34. S. Escalera et al., "Chalearn multi-modal gesture recognition 2013: Grand challenge and workshop summary," in Proc. ACM Int. Conf. Multimodal Interact., Dec. 2013, pp. 365-368.
35. S. Maji, A. C. Berg, and J. Malik, "Classification using intersection kernel support vector machines is efficient," in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
36. Z. Jiang, G. Zhang, and L. S. Davis, "Submodular dictionary learning for sparse coding," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 3418-3425.
37. K. Guo, P. Ishwar, and J. Konrad, "Action recognition from video using feature covariance matrices," IEEE Trans. Image Process., vol. 22, no. 6, pp. 2479-2494, Jun. 2013.
38. L. Gorelick, M. Blank, E. Shechtman, M. Irani, and R. Basri, "Actions as space-time shapes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 12, pp. 2247-2253, Dec. 2007. (Pubitemid 350124072)
39. S. Ali and M. Shah, "Human action recognition in videos using kinematic features and multiple instance learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 2, pp. 288-303, Feb. 2010.
40. I. N. Junejo, E. Dexter, I. Laptev, and P. Pérez, "View-independent action recognition from temporal self-similarities," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 172-185, Jan. 2011.
41. A. Oikonomopoulos, I. Patras, and M. Pantic, "Spatiotemporal localization and categorization of human actions in unsegmented image sequences," IEEE Trans. Image Process., vol. 20, no. 4, pp. 1126-1140, Apr. 2011.
42. Q. V. Le, W. Y. Zou, S. Y. Yeung, and A. Y. Ng, "Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 3361-3368.
43. A. Kovashka and K. Grauman, "Learning a hierarchy of discriminative space-time neighborhood features for human action recognition," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 2046-2053.
44. A. Yao, J. Gall, and L. Van Gool, "A hough transform-based voting framework for action recognition," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 2061-2068.
45. J. Liu, J. Luo, and M. Shah, "Recognizing realistic actions from videos 'in the wild'," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 1996-2003.
46. M. Jain, H. Jégou, and P. Bouthemy, "Better exploiting motion for better action recognition," in Proc. IEEE Conf. CVPR, Jun. 2013, pp. 2555-2562.
47. H. Wang, M. M. Ullah, A. Klaser, I. Laptev, and C. Schmid, "Evaluation of local spatio-temporal features for action recognition," in Proc. Brit. Mach. Vis. Conf., 2009.
48. H. Wang, A. Klaser, C. Schmid, and C.-L. Liu, "Action recognition by dense trajectories," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 3169-3176.
49. Y. M. Lui, "Human gesture recognition on product manifolds," J. Mach. Learn. Res., vol. 13, no. 1, pp. 3297-3321, 2012.
50. Y. Ming, Q. Ruan, and A. Hauptmann, "Activity recognition from RGB-D camera with 3D local spatio-temporal features," in Proc. IEEE ICME, Jul. 2012, pp. 344-349.
51. I. Guyon, V. Athitsos, P. Jangyodsuk, H. Escalante, and B. Hamner, "Results and analysis of the chalearn gesture challenge 2012," in Proc. Int. Workshop Adv. Depth Image Anal. Appl., vol. 7854. 2013, pp. 186-204.
52. M. R. Malgireddy, I. Inwogu, and V. Govindaraju, "A temporal Bayesian model for classifying, detecting and localizing activities in video sequences," in Proc. IEEE Int. Conf. CVPRW, Jun. 2012, pp. 43-48.
53. T. Giannakopoulos. (2010). A Method for Silence Removal and Segmentation of Speech Signals, Implemented in Matlab [Online]. Available: http://www.mathworks.com/matlabcentral/fileexchange/28826-silenceremoval-in- speech-signals
54. J. Wan, Q. Ruan, W. Li, G. An, and R. Zhao, "3D SMoSIFT: Three-dimensional sparse motion scale invariant feature transform for activity recognition from RGB-D videos," J. Electron. Imag., vol. 23, no. 2, pp. 023017-1-023017-14, Apr. 2014.