Human action recognition with video data: Research and evaluation challenges

IEEE Transactions on Human-Machine Systems

Volumn 44, Issue 5, 2014, Pages 650-663

  Ramanathan, Manoj ^a   Yau, Wei Yun ^b   Teoh, Eam Khwang ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

Author keywords

Action recognition; anthropometric variations; camera motion; execution rate; view invariance

Indexed keywords

ACTION RECOGNITION; ANTHROPOMETRIC VARIATIONS; CAMERA MOTIONS; HUMAN-ACTION RECOGNITION; RESEARCH AND EVALUATION; VIDEO DATA; VIEW INVARIANCE;

EID: 84907224726     PISSN: 21682291     EISSN: None     Source Type: Journal    
DOI: 10.1109/THMS.2014.2325871     Document Type: Article

References (176)

1. M. Ryoo and J. Aggarwal, "Human activity analysis: A Review, " ACM Comput. Surveys, vol. 43, pp. 161-16:43, Apr. 2011.
2. D. Siewiorek, A. Smailagic, and A. Dey, "Architecture and applications of virtual coaches, " Proc. IEEE, vol. 100, no. 8, pp. 2472-2488, Aug. 2012.
3. T. Kanade and M. Hebert, "First-person vision, " Proc. IEEE, vol. 100, pp. 2442-2453, Aug. 2012.
4. T. Shibata, "Therapeutic Seal robot biofeedback medical device: qualitative and quantitative evaluations of robot therapy in dementia care, " Proc. IEEE, vol. 100, pp. 2527-2538, Aug. 2012.
5. K. Yamazaki, R. Ueda, S. Nozawa, M. Kojima, K. Okada, K. Matsumoto, M. Ishikawa, I. Shimoyama, and M. Inaba, "Home-assistant robot for an aging society, " Proc. IEEE, vol. 100, pp. 2429-2441, Aug. 2012.
6. P. Kelly, A. Healy, K. Moran, and N. E. O'Connor, "A virtual coaching environment for improving golf swing technique, " in Proc. ACM Multimedia Workshop Surreal Media Virtual Cloning, Oct. 2010, pp. 51-56.
7. L. Palafox and H. Hashimoto, "Human action recognition using wavelet signal analysis as an input in 4W1H, " in Proc. IEEE Int. Conf. Ind. Informat., Jul. 2010, pp. 679-684.
8. R. Poppe, "A survey on vision-based human action recognition, " Image Vision Comput., vol. 28, pp. 976-990, Jun. 2010.
9. Y. Li and Y. Kuai, "Action recognition based on spatio-temporal interest points, " in Proc. Int. Conf. BioMed. Eng. Informat., Oct. 2012, pp. 181-185.
10. X. Ji and H. Liu, "Advances in view-invariant human motion analysis- A Review, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 40, pp. 13-24, Jan. 2012.
11. N. Gkalelis, H. Kim, A. Hilton, N. Nikolaidis, and I. Pitas, "The i3DPost multi-view and 3D human action/interaction database, " in Proc. Conf. Visual Media Production, Nov. 2009, pp. 159-168.
12. A. F. Bobick and J. W. Davis, "The recognition of human movement using temporal templates, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, pp. 257-267, Mar. 2001.
13. T. Darell and A. Pentland, "Space-time gestures, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., 1993, pp. 335-340.
14. G. Rogez, J. Guerrero, and C. Orrite, "View-invariant human feature extraction for video-surveillance applications, " in Proc. IEEE Conf. Adv. Video Signal Based Surveillance, 2007, pp. 324-329.
15. H. Ragheb, S. Velastin, P. Remagnino, and T. Ellis, "Human action recognition using robust power spectrum features, " in Proc. IEEE Conf. Image Process., Oct. 2008, pp. 753-756.
16. Y. Lu, Y. Li, Y. Chen, F. Ding, X. Wang, J. Hu, and S. Ding, "A Human action recognition method based on Tchebichef moment invariants and temporal templates, " in Proc. Int. Conf. Intell. Human-Mach. Syst. Cybern., Aug. 2012, pp. 76-79.
17. A. Iosifidis, A. Tefas, and I. Pitas, "Neural representation and learning for multi-view human action recognition, " in Proc. IEEE World Congr. Comput. Intell., Jun. 2012, pp. 1-6.
18. K. Huang, D. Tao, Y. Yuan, X. Li, and T. Tan, "View-independent behavior analysis, " IEEE Trans. Syst., Man Cybern.- Part B: Cybern., vol. 39, pp. 1028-1035, Aug. 2009.
19. J. Gall, A. Yao, N. Razavi, L. V. Gool, and V. Lempitsky, "Hough forests for object detection, tracking and action recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, pp. 2188-2202, Nov. 2011.
20. B. Chakraborty, O. Rudovic, and J. Gonzalez, "View-invariant humanbody detection with extension to human action recognition using component-wise HMM of body parts, " in Proc. IEEE Int. Conf. Autom. Face Gesture Recog., Sep. 2008, pp. 1-6.
21. V. Parameswaran and R. Chellappa, "Quasi-invariants for human action representation and recognition, " in Proc. Int. Conf. Pattern Recog., Aug. 2002, vol. 1, pp. 307-310.
22. F. Lv and R. Nevatia, "Single view human action recognition using key pose matching and Viterbi path searching, " in Proc. IEEE Conf. Comput. Vision Pattern Recog., Jun. 2007, pp. 1-8.
23. D. Gavrilla and L. Davis, "Towards 3-D model-based tracking and recognition of human movement, " in Proc. Int. Workshop Face Gesture Recog., 1995, pp. 272-277.
24. Y. Yacoob and M. J. Black, "Parameterized modeling and recognition of activities, " in Proc. IEEE Int. Conf. Comput. Vision, 1998, pp. 120-127.
25. P. Peursum, G. West, and S. Venkatesh, "Combining image regions and human activity for indirect object recognition in indoor wide-angle views, " in Proc. IEEE Int. Conf. Comput. Vision, Oct. 2005, vol. 1, pp. 82-89.
26. A. S. Ogale, A. Karapurkar, andY. Aloimonos, "View-invariantmodeling and recognition of human actions using grammars, " in Proc. IEEE Int. Conf. Comput. Vision, 2005, vol. 5, pp. 115-126.
27. I. Haritaoglu, D. Harwood, and L. S. Davis, " W 4: Real-time surveillance of people and their activities, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 809-830, Aug. 2000.
28. D. Weinland, R. Ronfard, and E. Boyer, "Free viewpoint action recognition using motion history volumes, " Comput. Vis. Image Understanding, vol. 104, pp. 249-257, Oct. 2006.
29. D. Weinland, R. Ronfard, and E. Boyer, "Automatic discovery of action taxonomies from multiple views, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2006, pp. 1639-1645.
30. Y. Shen and H. Foroosh, "View-invariant action recognition using fundamental ratios, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-6.
31. F. Zhang, Y. Wang, and Z. Zhang, "View-invariant action recognition in surveillance videos, " in Proc. 1st Asian Conf. Pattern Recog., Nov. 2011, pp. 580-583.
32. F. Huang and G. Xu, "Action recognition unrestricted by location and viewpoint variation, " in Proc. IEEE 8th Int. Conf. Comput. Inf. Technol. Workshops, Jul. 2008, pp. 433-438.
33. M. N. Kumar and D. Madhavi, "Improved discriminative model for viewinvariant human action recognition, " Int. J. Comput. Sci. Eng. Technol., vol. 4, pp. 1263-1270, Sep. 2013.
34. A. Yilmaz andM. Shah, "Recognizing human actions in videos acquired by uncalibrated moving cameras, " in Proc. IEEE Int. Conf. Comput. Vis., 2005, vol. 1, pp. 150-157.
35. Y. Sheikh, M. Sheikh, and M. Shah, "Exploring the space of human action, " in Proc. IEEE 10th Int. Conf. Comput. Vis., Oct.. 2005, vol. 1, pp. 144-149.
36. S. M. Khan and M. Shah, "Detecting group activities using rigidity of formation, " in Proc. ACM 13th Annu. Int. Conf. Multimedia, 2005, pp. 403-406.
37. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, "Action as space-time shapes, " in Proc. IEEE 10th Int. Conf. Comput. Vis., Oct. 2005, vol. 2, pp. 1395-1402.
38. C. Rao and M. Shah, "View-invariance in action recognition, " in Proc. IEEE Comput. Sci. Conf. Comput. Vis. Pattern Recog., 2001, vol. 2, pp. II-316-II-322.
39. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning realistic human actions from movies, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2008, pp. 1-8.
40. T. Syeda-Mahmood, and A. Vasilescu, "Recognizing action events from multiple viewpoints, " in Proc. IEEE Workshop Detection Recog. Events Videos, 2001, pp. 64-72.
41. I. N. Junejo, E. Dexter, I. Laptev, and P. Perez, "View-independent action recognition from temporal self-similarities, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 172-185, Jan. 2011.
42. Anwaar-Ul-Haq, I. Gondal, andM. Murshed, "On temporal order invariance for view-invariant action recognition, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 2, pp. 203-211, Feb. 2013.
43. Y. Wang, K. Huang, and T. Tan, "Human activity recognition based on - transform, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2007, pp. 1-8.
44. T. Ang, W. Tan, C. Loo, and W. Wong, "Wavelet MACH filter for omnidirectional human activity recognition, " Int. J. Innovative Comput., Inf. Control, vol. 8, pp. 1-20, Jun. 2012.
45. R. Souvenir and J. Babbs, "Learning the viewpoint manifold for action recognition, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2008, pp. 1-7.
46. K. G. Derpanis, M. Sizintsev, K. J. Cannons, and R. P. Wildes, "Action spotting and recognition based on spatiotemporal orientation analysis, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 3, pp. 527-540, Mar. 2013.
47. L. Liu, L. Shao, and P. Rockett, "Boosted key-frame selection and correlated pyramidal motion-feature representation for human action recognition, " Pattern Recog., vol. 46, pp. 1810-1818, Jul. 2013.
48. L. Liu, L. Shao, X. Zhen, and X. Li, "Learning discriminative key poses for action recognition, " IEEE Trans. Cybern., vol. 43, no. 6, pp. 1860-1870, Dec. 2013.
49. M. Raptis and S. Soatto, "Tracklet descriptors for action modeling and video analysis, " in Proc. 11th Eur. Conf. Comput. Vis., Sep. 2010, pp. 577-590.
50. R. Minhas, A. Baradarani, S. Seifzadeh, and Q. M. J. Wu, "Human action recognition using extreme learning machine based on visual vocabularies, " Neurocomputing, vol. 73, pp. 1906-1917, Mar. 2010.
51. A. Gilbert, J. Illingworth, and R. Bowden, "Action recognition using mined hierarchical compound features, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 883-897, May 2011.
52. O. Chomat and J. L. Crowley, "Probabilistic recognition of activity using local appearance, " in Proc. IEEE Comput. Sci. Conf. Comput. Vis. Pattern Recog., Jun. 1999, vol. 2, pp. 2104-2109.
53. H. Jiang, M. S. Drew, and Z.-N. Li, "Successive convex matching for action detection, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2006, pp. 1646-1653.
54. C. Schuldt, I. Laptev, and B. Caputo, "Recognizing human actions: A localSVMapproach, " in Proc. 17th Int. Conf. Pattern Recog., Aug. 2004, vol. 3, pp. 32-36.
55. P. Dollar, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior recognition via sparse spatio-temporal features, " in Proc. IEEE 2nd Joint Int. Workshop Vis. Surveillance Perform. Eval. Tracking Surveillance, Oct. 2005, pp. 65-72.
56. I. Laptev and T. Lindeberg, "Space-time interest points, " in Proc. IEEE 9th Int. Conf. Comput. Vis., Oct. 2003, vol. 1, pp. 432-439.
57. J. C. Niebles, H. Wang, and L. Fei-Fei, "Unsupervised learning of human action categories using spatio-temporal words, " in Proc. British Mach. Vision Conf., Sep. 2006, vol. 3, pp. 1249-1258.
58. J. C. Niebles, H. Wang, and L. Fei-Fei, "Unsupervised learning of human action categories using spatio-temporal words, " Int. J. Comput. Vis., vol. 79, pp. 299-318, Sep. 2008.
59. A. Gupta, P. Srinivasan, J. Shi, and L. S. Davis, "Understanding videos, constructing plots. Learning a visually grounded storyline model from annotated videos, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 2012-2019.
60. T. Guha and R. K. Ward, "Learning sparse representations for human action recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 8, pp. 1576-1588, Aug. 2012.
61. X. Wu, D. Xu, L. Duan, J. Luo, and Y. Jia, "Action recognition using multilevel features and latent structural SVM, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 8, pp. 1422-1431, Aug. 2013.
62. J. Liu, J. Luo, and M. Shah, "Action recognition in unconstrained amateur videos, " in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Apr. 2009, pp. 3549-3552.
63. K. K. Reddy, J. Liu, andM. Shah, "Incremental action recognition using feature-tree, " in Proc. IEEE 12th Int. Conf. Comput. Vis., Sep. 2009, pp. 1010-1017.
64. B. Jun, I. Choi, and D. Kim, "Local transform features and hybridization for accurate face and human detection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 6, pp. 1423-1436, Jun. 2013.
65. S. Park and J. Aggarwal, "A hierarchical Bayesian network for event recognition of human actions and interactions, " Multimedia Syst., vol. 10, pp. 164-179, 2004.
66. D. J. Moore, I. A. Essa, and M. H. Hayes, "Exploiting human actions and object context for recognition tasks, " in Proc. IEEE 7th Int. Conf. Comput. Vision, 1999, vol. 1, pp. 80-86.
67. P. Peursum, H. H. Bui, S. Venkatesh, and G. West, "Human action segmentation via controlled use of missing data in HMMs, " in Proc. IEEE 17th Int. Conf. Pattern Recog, Aug. 2004, vol. 4, pp. 440-445.
68. N. T. Nguyen, D. Q. Phung, S. Venkatesh, and H. Bui, "Learning and detecting activities from movement trajectories using the hierarchical hidden Markov model, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2005, vol. 2, pp. 955-960.
69. N. M. Oliver, B. Rosario, and A. P. Pentland, "A Bayesian computer vision system for modeling human interactions, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 831-843, Aug. 2000.
70. S. A. Rahman, S. Y. Cho, and M. K. H. Leung, "Recognising human actions by analysing negative spaces, " IET Comput. Vis., vol. 6, pp. 197-213, May 2012.
71. M. Raptis, K. Wnuk, and S. Soatto, "Flexible dictionaries for action classification, " in Proc. Int. Workshop Mach. Learning Vis.-based Motion Anal., Oct. 2008, pp. 1-12.
72. L. Bourdev and J. Malik, "Poselets: Body part detectors trained using 3D human pose annotations, " in Proc. IEEE Int. Conf. Comput. Vis., Sep. 2009, pp. 1365-1372.
73. M. Raptis and L. Sigal, "Poselet key-framing: A model for human activity recognition, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Oct. 2013, pp. 2650-2657.
74. B. Yao, X. Jiang, A. Khosla, A. L. Lin, L. Guibas, and L. Fei-Fei, "Human action recognition by learning bases of action attributes and parts, " in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1331-1338.
75. S. Maji, L. Bourdev, and J. Malik, "Action recognition from a distributed representation of pose and appearance, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2011, pp. 3177-3184.
76. L. Bourdev, S. Maji, T. Brox, and J. Malik, "Detecting people using mutually consistent poselet activations, " in Proc. Eur. Conf. Comput. Vision: Part VI, Sep. 2010, pp. 168-181.
77. B. Yao and L. Fei-Fei, "Modeling mutual context of object and human pose in human-object interaction activities, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2010, pp. 17-24.
78. B. Yao and L. Fei-Fei, "Recognizing human-object interactions in still images by modeling the mutual context of objects and human poses, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 9, pp. 1691-1703, Sep. 2012.
79. J. Yamato, J. Ohya, and K. Ishii, "Recognizing human action in timesequential images using hidden Markov model, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 1992, pp. 379-385.
80. T. Starner and A. Pentland, "Real-time American sign language recognition from video using hidden Markov model, " in Proc. Int. Symp. Comput. Vis., 1995, pp. 265-270.
81. P. Natarajan and R. Nevatia, "Coupled hidden semi-Markov models for activity recognition, " in Proc. IEEE Workshop Motion Video Comput., 2007, pp. 10-17.
82. Y. Yang, I. Saleemi, and M. Shah, "Discovering motion primitives for unsupervised grouping and one-shot learning of human actions, gestures, and expressions, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 7, pp. 1635-1648, Jul. 2013.
83. M. Ahmad and S.-W. Lee, "Human action recognition using multi-view image sequences features, " in Proc. 7th Int. Conf. Autom. Face Gesture Recog., Apr. 2006, pp. 523-528.
84. X. Ji, C. Wang, Y. Li, and Q. Wu, "Hidden Markov model-based human action recognition using mixed features, " J. Comput. Inf. Syst., vol. 9, pp. 3659-3666, May 2013.
85. A. F. Bobick and A. D. Wilson, "A state-based approach to the representation and recognition of gesture, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 12, pp. 1325-1337, Dec. 1997.
86. A. Gupta and L. S. Davis, "Objects in action: An approach for combining action understanding and object perception, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2007, pp. 1-8.
87. N. Ikizler-Cinbis and S. Scarloff, "Web-based classifiers for human action recognition, " IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1031-1045, Aug. 2012.
88. J. Zhang, B. Yao, and Y. Wang, "Auto learning temporal atomic actions for activity classification, " Pattern Recog., vol. 46, pp. 1789-1798, Jul. 2013.
89. Y. Zhang, Y. Zhang, E. Swears, N. Larios, Z. Wang, and Q. Ji, "Modeling temporal interaction with interval temporal Bayesian networks for complex activity recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 10, pp. 2468-2483, Oct. 2013.
90. G. Lavee, M. Rudzsky, and E. Rivlin, "Propagating certainty in Petri nets for activity recognition, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 2, pp. 326-337, Feb. 2013.
91. G. Lin, Y. Fan, and E. Zhang, "Human action recognition using latentdynamic condition random fields, " in Proc. Int. Conf. Artif. Intell. Comput. Intell., Nov. 2009, vol. 3, pp. 147-151.
92. Y. Wang and G. Mori, "Hidden part models for human action recognition: Probabilistic versus max margin, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 7, pp. 1310-1323, Jul. 2011.
93. Y. Song, L.-P. Morency, and R. Davis, "Action recognition by hierarchical sequence summarization, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2013, pp. 3562-3569.
94. J.-Y. Chang, J.-J. Shyu, and C.-W. Cho, "Fuzzy rule inference based human activity recognition, " in Proc. IEEE Control Appl., Intell. Control, Jul. 2009, pp. 211-215.
95. K. Subramanian and S. Suresh, "Human action recognition using metacognitive neuro-fuzzy inference system, " in Proc. Int. Joint Conf. Neural Netw., Jun. 2012, pp. 1-8.
96. W. Huang and Q. J. Wu, "Human action recognition based on self organizing map, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Mar. 2010, pp. 2130-2133.
97. W. Huang and J. Wu, "Human action recognition using recursive self organizing map and longest common subsequence matching, " in Proc. Workshop Appl. Comput. Vis., Dec. 2009, pp. 1-6.
98. H. Liu, "Exploring human hand capabilities into embeddedmultifingered object manipulation, " IEEE Trans. Ind. Informat., vol. 7, no. 3, pp. 389-398, Aug. 2011.
99. Z. Ju and H. Liu, "A unified fuzzy framework for human-hand motion recognition, " IEEE Trans. Fuzzy Syst., vol. 19, no. 5, pp. 901-913, Oct. 2011.
100. M. Ryoo and J. Aggarwal, "Spatio-temporal relationship match: video structure comparison for recognition of complex human activities, " in Proc. IEEE 12th Int. Conf. Comput. Vis., Oct. 2009, pp. 1593-1600.
101. C. S. Pinhanez and A. F. Bobick, "Human action detection using PNF propagation of temporal constraints, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 1998, pp. 898-904.
102. Z. Jiang, Z. Lin, and L. S. Davis, "Recognizing human actions by learning and matching shape-motion prototype trees, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 533-547, Mar. 2012.
103. A. Oikonomopoulos, I. Patras, and M. Pantic, "Spatiotemporal salient points for visual recognition of human actions, " IEEE Trans. Syst., Man, Cybern. B: Cybern., vol. 36, no. 3, pp. 710-719, Jun. 2006.
104. A. Veeraraghavan, R. Chellappa, and A. K. R. Chowdhury, "The function space of an activity, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2006, vol. 1, pp. 959-968.
105. S. A. Rahman, L. Li, and M. K. H. Leung, "Human action recognition by negative space analysis, " in Proc. Int. Conf. Cyberworlds, Oct. 2010, pp. 354-359.
106. M. Marsza?ek, I. Laptev, and C. Schmid, "Actions in context, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2009, pp. 2929-2936.
107. J. Liu, J. Luo, and M. Shah, "Recognizing realistic actions from videos "in the wild", " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2009, pp. 1996-2003.
108. H. Wang, C. Yuan, G. Luo, W. Hu, and C. Sun, "Action recognition using linear dynamic systems, " Pattern Recognition, vol. 46, pp. 1710-1718, Jun. 2013.
109. D. Wu and L. Shao, "Silhouette analysis-based action recognition via exploiting human poses, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 2, pp. 236-243, Feb. 2013.
110. W. Bian, D. Tao, and Y. Rui, "Cross-Domain human action recognition, " IEEE Trans. Syst., Man, Cybern., B: Cybern., vol. 42, no. 2, pp. 298-307, Apr. 2012.
111. C. Thurau andV. Hlavac, "Pose primitive based human action recognition in videos or still images, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2008, pp. 1-8.
112. P. Bilinski and F. Bremond, "Contextual statistics of space-time ordered features for human action recognition, " in Proc. IEEE 9th Int. Conf. Adv. Video Signal-Based Surveillance, Sep. 2012, pp. 228-233.
113. A.-P. Ta, C. Wolf, G. Lavoue, A. Baskurt, and J.-M. Jolion, "Pairwise features for human action recognition, " in Proc. 20th Int. Conf. Pattern Recog., Aug. 2010, pp. 3224-3227.
114. Y.-H. Qin, H.-L. Li, G.-H. Liu, and Z.-N. Wang, "Human action recognition usingPEMhistogram, " in Proc. Int. Conf. Comput. Problem-Solving, Dec. 2010, pp. 323-325.
115. H. J. Seo and P. Milanfar, "Action recognition from one example, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 867-882, May 2011.
116. L. W. Campbell and A. F. Bobick, "Recognition of human body motion using phase space constraints, " in Proc. IEEE Int. Conf. Comput. Vis., Jun. 1995, pp. 624-630.
117. Anwaar-Ul-Haq, I. Gondal, and M. Marshed, "Action recognition using spatio-temporal distance classifier correlation filter, " in Proc. Int. Conf. Digital Image Comput. Techn. Appl., 2011, pp. 474-479.
118. Y. Ke, R. Sukthankar, and M. Hebert, "Spatio-temporal shape and flow correlation for action recognition, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
119. L. Zelnik-Manor and M. Irani, "Event-based analysis of video, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2001, vol. 2, pp. II-123-II-130.
120. R. Filipovych and E. Ribeiro, "Determining the scale of interest regions in videos, " in Proc. IEEE Int. Conf. Image Process., Nov. 2009, pp. 985-988.
121. R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, "Detecting moving objects, ghosts, and shadows in video streams, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 10, pp. 1337-1342, Oct. 2003.
122. S. Kumari and S. K. Mitra, "Human action recognition using DFT, " in Proc. 3rd Nat. Conf. Comput. Vis., Pattern Recognit., Image Process. Graph., 2011, pp. 239-242.
123. K. Schindler and L. van Gool, "Action Snippets: how many frames does human action recognition require?" in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
124. L. He, D. Wang, and H. Wang, "Human abnormal action identification method in different scenarios, " in Proc. Int. Conf. Digit. Manuf. Autom., Aug. 2011, pp. 594-597.
125. R. Lublinerman, N. Ozay, D. Zarpalas, and O. Camps, "Activity recognition from silhouettes using linear systems and model (in) validation techniques, " in Proc. Int. Conf. Pattern Recognit., 2006, pp. 347-350.
126. N. Vaswani, A. R. Chowdhury, and R. Chellappa, "Activity recognition using the dynamics of the configuration of interacting objects, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2003, vol. 2, pp. II-633-II-640.
127. S. Cheema, A. Eweiwi, C. Thurau, and C. Bauckhage, "Action recognition by learning discriminative key poses, " in Proc. IEEE Int. Conf. Comput. Vis. Workshops, Nov. 2011, pp. 1302-1309.
128. J. Wu, A. Osuntogun, T. Choudhury, M. Philipose, and J. M. Rehg, "A scalable approach to activity recognition based on object use, " in Proc. IEEE 11th Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.
129. A. A. Efros, A. C. Berg, G. Mori, and J. Malik, "Recognizing action at a distance, " in Proc. IEEE Int. Conf. Comput. Vis., 2003, vol. 2, pp. 726-733.
130. E. Shechtman and M. Irani, "Space-time behavior based correlation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2005, vol. 1, pp. 405-412.
131. M. D. Rodriguez, J. Ahmed, and M. Shah, "Action MACH: A spatiotemporal maximum average correlation height filter for action recognition, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
132. S.-F. Wong, T.-K. Kim, and R. Cipolla, "Learning motion categories using both semantic and structural information, " in Proc. IEEE Conf. Comput. Vis. Pattern Recogit., Jun. 2007, pp. 1-6.
133. J. Rittscher, A. Blake, A. Hoogs, and G. Stein, "Mathematical modelling of animate and intentional motion, " Philosoph. Trans. Roy. Soc. London. (Series B), Biol. Sci., vol. 358, pp. 475-490, Mar. 2003.
134. S.-Y. Lin, C.-K. Shie, S.-C. Chen, M.-S. Lee, and Y.-P. Hung, "Human action recognition using action trait code, " in Proc. Int. Conf. Pattern Recognit., Nov. 2012, pp. 3456-3459.
135. L. Wang, Y. Wang, T. Jiang, D. Zhao, andW. Gao, "Learning discriminative features for fast frame-based action recognition, " Pattern Recognit., vol. 46, pp. 1832-1840, Jul. 2013.
136. K. Guo, P. Ishwar, and J. Konrad, "Action recognition from video using feature covariance matrices, " IEEE Trans. Image Process., vol. 22, no. 6, pp. 2479-2494, Jun. 2013.
137. Y. Chen, Z. Li, X. Guo, Y. Zhao, and A. Cai, "A spatio-temporal interest point detector based on vorticity for action recognition, " in Proc. IEEE Int. Conf. Multimedia Expo Workshops, Jul. 2013, pp. 1-6.
138. H. Zhang and L. E. Parker, "4-Dimensional local spatio-temporal features for human activity recognition, " in Proc. IEEE Int. Conf. Intell. Robots Syst., Sep. 2011, pp. 2044-2049.
139. Q. V. Le, W. Y. Zou, S. Y. Yeung, andA. Y. Ng, "Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis, " in Proc. IEEE Conf. Comput. Vis. Pattern Recogit., Jun. 2011, pp. 3361-3368.
140. K. Ramirez-Amaro, E.-S. Kim, J. Kim, B.-T. Zhang, M. Beetz, and G. Cheng, "Enhancing human action recognition through spatio-temporal feature learning and semantic rules, " in Proc. IEEE-RAS Int. Conf. Humanoid Robots, Oct. 2013. Available: http://bi. snu. ac. kr/Publications/ Conferences/International/Humanoids2013-ESKim-JKim. pdf
141. K. Mikolajczyk and H. Uemura, "Action recognition with motionappearance vocabulary forest, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2008, pp. 1-8.
142. S. Calderara, R. Cucchiara, and A. Prati, "Action signature: A novel holistic representation for action recognition, " in Proc. IEEE 5th Int. Conf. Adv. Video Signal Based Surveillance, Sep. 2008, pp. 121-128.
143. Z. Kalal, K. Mikolajczyk, and J. Matas, "Tracking-learning-detection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 7, pp. 1409-1422, Jul. 2012.
144. Z. Ju and H. Liu, "Fuzzy Gaussian mixture models, " Pattern Recogit., vol. 45, pp. 1146-1158, Mar. 2012.
145. L. Wang, L. Cheng, T. H. Thi, and J. Zhang, "Human action recognition from boosted pose estimation, " in Proc. Int. Conf. Dig. Image Comput., Techn. Appl., Dec. 2010, pp. 308-313.
146. Y. Zhu and G. Guo, "A study on visible to infrared action recognition, " IEEE Signal Process. Lett., vol. 20, no. 9, pp. 897-900, Sep. 2013.
147. J.-H. Wang, J.-J. Ding, Y. Chen, and H.-H. Chen, "Real time accelerometer-based gait recognition using adaptive windowed wavelet transforms, " in Proc. IEEE Asia Pacific Conf. Circuits Syst., Dec. 2012, pp. 591-594.
148. A. Gilbert, J. Illingworth, and R. Bowden, "Scale invariant action recognition using compound features mined from dense spatiotemporal corners, " in Proc. 10th Eur. Conf. Comput. Vis., I, 2008, pp. 222-233.
149. H. Bouma, G. Burghouts, L. de Penning, P. Hanckmann, J.-M. ten Hove, S. Korzec, M. Kruithof, S. Landsmeer, C. van Leeuwen, S. van den Broek, A. Halma, R. den Hollander, and K. Schutte, "Recognition and localization of relevant human behavior in videos, " Proc. SPIE, vol. 8711, pp. 87110B. 1-87110B. 10, Apr. 1-10, 2013.
150. F. Ofli, R. Chaudhry, G. Kurillo, R. Vidal, and R. Bajcsy, "Sequence of the most informative joints (SMIJ): A new representation for human skeletal action recognition, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog. Workshops, Jun. 2012, pp. 8-13.
151. Z. Zhang and D. Tao, "Slow feature analysis for human action recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 436-450, Mar. 2012.
152. B. Yousefi, C. K. Loo, andA. Memariani, "Biological inspired human action recognition, " in Proc. IEEEWorkshop Robot. Intell. Informationally Struct. Space, Apr. 2013, pp. 58-65.
153. S. Ali, A. Basharat, and M. Shah, "Chaotic invariants for human action recognition, " in Proc. IEEE Int. Conf. Comput. Vis, Oct. 2007, pp. 1-8.
154. C.-A. Lin, Y.-Y. Lin, H.-Y. M. Liao, and S.-K. Jeng, "Action recognition using instance-specific and class-consistent cues, " in Proc. IEEE Int. Conf. Image Process., Sep. 2012, pp. 1373-1376.
155. M. Shimosaka, T. Nishimura, Y. Nejigane, T. Mori, and T. Sato, "Fast online action recognition with boosted combinational motion features, " in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Oct. 2006, pp. 5851-5858.
156. V. Vo and N. Ly, "An effective approach for human actions recognition based on optical flow and edge features, " in Proc. Int. Conf. Control, Autom. Inf. Sci., Nov. 2012, pp. 24-29.
157. T. Dean, R. Washington, and G. Corrado, " Sparse spatiotemporal coding for activity recognition. " Dept. Comput. Sci., Brown Univ., Providence, RI, USA, Tech. Rep. CS 10-02, Mar. 2010.
158. Q. Wu, Z. Wang, F. Deng, Z. Chi, and D. D. Feng, "Realistic human action recognition with multimodal feature selection and fusion, " IEEE Trans. Syst., Man, Cybern., Syst., vol. 43, no. 4, pp. 875-885, Jul. 2013.
159. Z. Gao, A. A. Liu, H. Zhang, G. P. Xu, and Y. B. Xue, "Human action recognition based on sparse representation induced by L1/L2 regulations, " in Proc. 21st Int. Conf. Pattern Recog., Nov. 2012, pp. 1868-1871.
160. H. Liu, S. Chen, and N. Kubota, "Intelligent video systems and analytics: ASurvey, " IEEE Trans. Ind. Informat., vol. 9, no. 3, pp. 1222-1233, Aug. 2013.
161. X. M. Lin and S. Z. Li, "Transfer AdaBoost learning for action recognition, " in Proc. IEEE Int. Symp. IT Med. Edu., Aug. 2009, vol. 1, pp. 659-664.
162. A. P. B. Lopes, E. R. da S. Santos, E. A. do Valle Jr., J. M. de Almeida, and A. A. de Araujo, "Transfer learning for human action recognition, " in Proc. 24th SIBGRAPI Conf. Graph., Patterns Images, Aug. 2011, pp. 352-359.
163. R. Liu, T. Chen, and L. Huang, "Research on human activity recognition based on active learning, " in Proc. 9th Int. Conf. Mach. Learn. Cybern., Jul. 2010, pp. 285-290.
164. S. Kaski and J. Peltonen, "Learning from relevant tasks only, " in Proc. Eur. Conf. Mach. Learn., , 2007, pp. 608-615.
165. T. Yeh, J. Lee, and T. Darrell, "Adaptive vocabulary forests by dynamic indexing and category learning, " in Proc. IEEE 11th Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.
166. J. A. Iglesias, P. Angelov, A. Ledezma, and A. Sanchis, "Creating evolving user behavior profile automatically, " IEEE Trans. Knowl. Data Eng., vol. 24, no. 5, pp. 854-867, May 2012.
167. G.-B. Huang, L. Chen, and C.-K. Siew, "Universal approximation using incremental constructive feedforward networks with random hidden nodes, " IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 879-892, Jul. 2006.
168. M. A. R. Ahad, J. Tan, H. Kim, and S. Ishikawa, "Action dataset-A Survey, " in Proc. SICE Annu. Conf.,, Sep. 2011, pp. 1650-1655.
169. S. Singh, S. A. Velastin, and H. Ragheb, "MuHAVi: A multicamera human action video dataset for the evaluation of action recognition methods, " in Proc. IEEE Int. Conf. Adv. Video Signal Based Surveillance, Aug. 2010, pp. 48-55.
170. H. Ragheb, S. Velastin, P. Remagnino, and T. Ellis, "VIHASI: Virtual human action silhouette data for the performance evaluation of silhouette based action recognition methods, " in Proc. ACM/IEEE 2nd Int. Conf. Distrib. Smart Cameras, Sep. 2008, pp. 1-10.
171. H. Ragheb, S. Velastin, P. Remagnino, and T. Ellis, "VIHASI: Virtual human action silhouette data for the performance evaluation of silhouette based action recognition methods, " in Proc. ACM 1st Int. Workshop Vis. Netw. Behavior Anal., Oct. 2008, pp. 77-84.
172. S. Ramagiri, R. Kavi, and V. Kulathumani, "Real-timemulti-view human action recognition using awireless camera network, " in Proc. ACM/IEEE 5th Int. Conf. Distrib. Smart Cameras, Aug. 2011, pp. 1-6.
173. C.-C. Chen, M. S. Ryoo, and J. K. Aggarwal. (2010, Aug. ). UT-Tower Dataset: Aerial View Activity Classification Challenge. [Online]. Available: http://cvrc. ece. utexas. edu/SDHA2010/Aerial-View-Activity. html
174. I. Guyon, V. Athitsos, P. Jangyodsuk, B. Hamner, and H. J. Escalante, "Chalearn gesture challenge: Design and first results, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 1-6.
175. V. Bloom, D. Makris, and V. Argyriou, "G3D: A Gaming action dataset and real time action recognition evaluation framework, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog. Workshops, Jun. 2012, pp. 7-12.
176. Z. Lin, Z. Jiang, and L. S. Davis, "Recognizing actions by shape-motion prototype trees, " in Proc. IEEE Int. Conf. Comput. Vis., Sep. 2009, pp. 444-451.