A review of motion analysis methods for human nonverbal communication computing

Image and Vision Computing

Volumn 31, Issue 6-7, 2013, Pages 421-433

  Metaxas, Dimitris ^a   Zhang, Shaoting ^a  

^a RUTGERS UNIVERSITY   (United States)

Author keywords

Face tracking; Facial expression recognition; Gesture recognition; Group activity analysis; Motion analysis; Nonverbal communication computing

Indexed keywords

FACE RECOGNITION; GESTURE RECOGNITION; INFORMATION ANALYSIS;

EMOTIONAL EXPRESSIONS; EXPRESSION RECOGNITION; FACE TRACKING; FACIAL EXPRESSION RECOGNITION; GROUP ACTIVITIES; IMPRESSION MANAGEMENT; NON-VERBAL COMMUNICATIONS; SOCIAL RELATIONSHIPS;

MOTION ANALYSIS;

EID: 84886716503     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2013.03.005     Document Type: Review

References (189)

1. L. Wang, W. Hu, T. Tan, Recent developments in human motion analysis, Pattern Recognit. 36 (3) (2003) 585-601.
2. X. Yu, S. Zhang, Z. Yan, F. Yang, J. Huang, N. Dunbar, M. Jensen, J. Burgoon, D. Metaxas, Is interactional dissynchrony a clue to deception: Insights from automated analysis of nonverbal visual cues, The Hawaii International Conference on System Sciences (HICSS), 2013.
3. N. Michael, F. Yang, D. Metaxas, D. Dinges, Development of optical computer recognition (ocr) for monitoring stress and emotions in space, 18th IAA Humans in Space Symposium, 2011.
4. J. Liu, B. Liu, S. Zhang, F. Yang, P. Yang, D. Metaxas, C. Neidle, Recognizing eyebrow and periodic head gestures using CRFs for non-manual grammatical marker detection in ASL, International Conference on Automatic Face and Gesture Recognition, 2013.
5. F. Yang, J. Wang, E. Shechtman, L. Bourdev, D. Metaxas, Expression flow for 3D-aware face component transfer, ACM Trans. Graph. (Proc. SIGGRAPH) 27 (3) (2011) 60.
6. S. Lu, G. Tsechpenakis, D.N. Metaxas, M.L. Jensen, J. Kruse, Blob analysis of the head and hands: a method for deception detection, The 38th Annual Hawaii International Conference on System Sciences, IEEE, 2005.
7. G. Tsechpenakis, D. Metaxas, C. Neidle, Learning-based dynamic coupling of discrete and continuous trackers, Comput. Vis. Image Underst. 104 (2) (2006) 140-156. (Pubitemid 44573867)
8. A. Azarbayejani, B. Horowitz, A. Pentland, Recursive estimation of structure and motion using relative orientation constraints, Computer Vision and Pattern Recognition, 1993. Proceedings CVPR'93., 1993 IEEE Computer Society Conference on, IEEE, 1993, pp. 294-299.
9. A. Azarbayejani, T. Starner, B. Horowitz, A. Pentland, Visually controlled graphics, IEEE Trans. Pattern Anal. Mach. Intell. 15 (6) (1993) 602-605. (Pubitemid 23675483)
10. A. Yuille, P. Hallinan, Active vision, Ch. Deformable Templates, MIT Press, 1993. 21-38.
11. D. Terzopoulos, K. Waters, Analysis and synthesis of facial image sequences using physical and anatomical models, IEEE Trans. Pattern Anal. Mach. Intell. 15 (6) (1993) 569-579. (Pubitemid 23675487)
12. M.J. Black, Y. Yacoob, Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion, Computer Vision, 1995. Proceedings., Fifth International Conference on, IEEE, 1995, pp. 374-381.
13. M.J. Black, Y. Yacoob, Recognizing facial expressions in image sequences using local parameterized models of image motion, Int. J. Comput. Vis. 25 (1) (1997) 23-48. (Pubitemid 127506559)
14. D. DeCarlo, D. Metaxas, The integration of optical flow and deformable models with applications to human face shape and motion estimation, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE, 1996, pp. 231-238.
15. D. Decarlo, D. Metaxas, Optical flow constraints on deformable models with applications to face tracking, Int. J. Comput. Vis. 38 (2) (2000) 99-127.
16. F. Pighin, R. Szeliski, D.H. Salesin, Resynthesizing facial animation through 3d model-based tracking, ICCV 1999, vol. 1, IEEE, 1999, pp. 143-150. (Pubitemid 32080032)
17. V. Blanz, T. Vetter, A morphable model for the synthesis of 3d faces, Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co, 1999, pp. 187-194.
18. V. Blanz, C. Basso, T. Poggio, T. Vetter, Reanimating faces in images and video, Computer Graphics Forum, vol. 22, Wiley Online Library, 2003, pp. 641-650.
19. T. Cootes, C. Taylor, D. Cooper, J. Graham, et al., Active shape models-their training and application, Comput. Vis. Image Underst. 61 (1) (1995) 38-59.
20. A. Kanaujia, D. Metaxas, Recognizing facial expressions by tracking feature shapes, 18th International Conference on Pattern Recognition, vol. 2, IEEE, 2006, pp. 33-38. (Pubitemid 46532137)
21. C. Vogler, Z. Li, A. Kanaujia, S. Goldenstein, D. Metaxas, The best of both worlds: combining 3D deformable models with active shape models, IEEE 11th International Conference on Computer Vision, IEEE, 2007, pp. 1-7.
22. F. Yang, J. Wang, E. Shechtman, L. Bourdev, D. Metaxas, Expression flow for 3D-aware face component transfer, ACM Trans. Graph. (Proc. SIGGRAPH) 27 (3) (2011) 60.
23. F. Yang, L. Bourdev, E. Shechtman, J. Wang, D. Metaxas, Facial expression editing in video using a temporally-smooth factorization, Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, IEEE, 2012, pp. 861-868.
24. Y. Huang, Q. Liu, D. Metaxas, A component based deformable model for generalized face alignment, IEEE 11th International Conference on Computer Vision, IEEE, 2007, pp. 1-8.
25. F. Yang, J. Huang, D. Metaxas, Sparse shape registration for occluded facial feature localization, 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops, IEEE, 2011, pp. 272-277.
26. S. Zhang, Y. Zhan, M. Dewan, J. Huang, D. Metaxas, X. Zhou, Sparse shape composition: a new framework for shape prior modeling, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2011, pp. 1025-1032.
27. S. Zhang, Y. Zhan, M. Dewan, J. Huang, D. Metaxas, X. Zhou, Towards robust and effective shape modeling: sparse shape composition, Med. Image Anal. (2012) 265-277.
28. S. Zhang, Y. Zhan, D.N. Metaxas, Deformable segmentation via sparse representation and dictionary learning, Med. Image Anal. 16 (7) (2012) 1385-1396.
29. D. Cristinacce, T.F. Cootes, Feature detection and tracking with constrained local models, BMVC, 2006, 2006, pp. 929-938.
30. C. Basso, T. Vetter, V. Blanz, Regularized 3D morphable models, Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003. First IEEE International Workshop on, IEEE, 2003, pp. 3-10.
31. L. Gu, T. Kanade, A generative shape regularization model for robust face alignment, ECCV (1), 2008, pp. 413-426.
32. Y. Wang, S. Lucey, J.F. Cohn, Enforcing convexity for improved alignment with constrained local models, CVPR, 2008, 2008.
33. X.S. Zhou, D. Comaniciu, A. Gupta, An information fusion framework for robust shape tracking, IEEE Trans. Pattern Anal. Mach. Intell. 27 (1) (2005) 115-129. (Pubitemid 40195902)
34. J.M. Saragih, S. Lucey, J.F. Cohn, Face alignment through subspace constrained mean-shifts, ICCV, 2009, 2009, pp. 1034-1041.
35. J.M. Saragih, S. Lucey, J.F. Cohn, Deformable model fitting by regularized landmark mean-shift, Int. J. Comput. Vis. 91 (2) (2011) 200-215.
36. T.F. Cootes, G.J. Edwards, C.J. Taylor, Active appearance models, IEEE Trans. Pattern Anal. Mach. Intell. 23 (6) (2001) 681-685. (Pubitemid 32585279)
37. I. Matthews, S. Baker, Active appearance models revisited, Int. J. Comput. Vis. 60 (2) (2004) 135-164.
38. S. Baker, I. Matthews, Lucas-Kanade 20 years on: a unifying framework, Int. J. Comput. Vis. 56 (3) (2004) 221-255.
39. T.F. Cootes, G. Wheeler, K. Walker, C. Taylor, View-based active appearance models, Image Vis. Comput. 20 (9) (2002) 657-664. (Pubitemid 34862736)
40. J. Sung, T. Kanade, D. Kim, Pose robust face tracking by combining active appearance models and cylinder head models, Int. J. Comput. Vis. 80 (2) (2008) 260-274.
41. J. Xiao, S. Baker, I. Matthews, T. Kanade, Real-time combined 2D + 3D active appearance models, CVPR, 2, 2004, pp. 535-542.
42. I. Matthews, J. Xiao, S. Baker, 2D vs. 3D deformable face models: representational power, construction, and real-time fitting, Int. J. Comput. Vis. 75 (1) (2007) 93-113. (Pubitemid 47120247)
43. M. Zhou, L. Liang, J. Sun, Y. Wang, AAM based face tracking with temporal matching and face segmentation, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2010, pp. 701-708.
44. X. Gao, Y. Su, X. Li, D. Tao, A review of active appearance models, IEEE Trans. Syst. Man Cybern. C Appl. Rev. 40 (2) (2010) 145-158.
45. M. Proesmans, L. Van Gool, A. Oosterlinck, One-shot active 3D shape acquisition, Pattern Recognition, 1996, Proceedings of the 13th International Conference on, vol. 3, IEEE, 1996, pp. 336-340.
46. P.S. Huang, C. Zhang, F.-P. Chiang, High-speed 3-D shape measurement based on digital fringe projection, Opt. Eng. 42 (1) (2003) 163-168.
47. L. Zhang, N. Snavely, B. Curless, S.M. Seitz, Spacetime faces: high-resolution capture for modeling and animation, ACM Annual Conference on Computer Graphics, 2004, pp. 548-558.
48. G. Fanelli, T. Weise, J. Gall, L.J.V. Gool, Real time head pose estimation from consumer depth cameras, Proc. DAGM-Symposium, 2011, pp. 101-110.
49. Q. Cai, D. Gallup, C. Zhang, Z. Zhang, 3D deformable face tracking with a commodity depth camera, Proc. ECCV, 2010, pp. 229-242.
50. T. Weise, S. Bouaziz, H. Li, M. Pauly, Realtime performance-based facial animation, ACM Trans. Graph. 30 (4) (2011) 77.
51. T. Baltrusaitis, P. Robinson, L. Morency, 3D constrained local model for rigid and non-rigid facial tracking, Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, IEEE, 2012, pp. 2610-2617.
52. Z. Zhang, Microsoft kinect sensor and its effect, IEEE Multimedia 19 (2) (2012) 4-10.
53. Z. Zeng, M. Pantic, G. Roisman, T. Huang, A survey of affect recognition methods: audio, visual, and spontaneous expressions, IEEE Trans. Pattern Anal. Mach. Intell. 31 (1) (2009) 39-58.
54. P. Yang, Q. Liu, D. Metaxas, Dynamic soft encoded patterns for facial event analysis, Comput. Vis. Image Underst. 115 (3) (2011) 456-465.
55. X. Huang, G. Zhao, W. Zheng, M. Pietikainen, Spatiotemporal local monogenic binary patterns for facial expression recognition, IEEE Signal Process. Lett. 19 (5) (2012) 243-246.
56. G. Zhao, X. Huang, M. Taini, S. Li, M. Pietikäinen, Facial expression recognition from near-infrared videos, Image Vis. Comput.
57. O. Rudovic, I. Patras, M. Pantic, Coupled Gaussian process regression for pose-invariant facial expression recognition, European Conference on Computer Vision, 2010, pp. 350-363.
58. G. Zhao, M. Pietikäinen, Boosted multi-resolution spatiotemporal descriptors for facial expression recognition, Pattern Recognit. Lett. 30 (12) (2009) 1117-1127.
59. G. Littlewort, M. Bartlett, I. Fasel, J. Susskind, J. Movellan, Dynamics of facial expression extracted automatically from video, Image Vis. Comput. 24 (6) (2006) 615-625. (Pubitemid 43867835)
60. C. Shan, S. Gong, P. McOwan, Conditional mutual information based boosting for facial expression recognition, British Machine Vision Conference, vol. 1, 2005.
61. Y. Tian, Evaluation of face resolution for expression analysis, Conference on Computer Vision and Pattern Recognition Workshop, 2004. CVPRW'04, IEEE, 2004, pp. 82-88.
62. B. Fasel, J. Luettin, Automatic facial expression analysis: a survey, Pattern Recognit. 36 (1) (2003) 259-275.
63. M. Pantic, L. Rothkrantz, Automatic analysis of facial expressions: the state of the art, IEEE Trans. Pattern Anal. Mach. Intell. 22 (12) (2000) 1424-1445. (Pubitemid 32088469)
64. M. Bartlett, G. Littlewort, I. Fasel, J. Movellan, Real time face detection and facial expression recognition: development and applications to human computer interaction, Conference on Computer Vision and Pattern Recognition Workshop, 2003. CVPRW'03, vol. 5, IEEE, 2003, pp. 53-60.
65. M. Pantic, L. Rothkrantz, Facial action recognition for facial expression analysis from static face images, IEEE Trans. Syst. Man Cybern. B Cybern. 34 (3) (2004) 1449-1461.
66. C. Shan, S. Gong, P. McOwan, Robust facial expression recognition using local binary patterns, IEEE International Conference on Image Processing (ICIP), vol. 2, IEEE, 2005, (II-370).
67. J. Whitehill, C. Omlin, Haar features for FACS AU recognition, 7th International Conference on Automatic Face and Gesture Recognition, 2006. FGR 2006, IEEE, 2006, (5 pp.).
68. X. Feng, M. Pietikainen, A. Hadid, Facial expression recognition with local binary patterns and linear programming, Pattern Recognition and Image Analysis C/C of Raspoznavaniye Obrazov I Analiz Izobrazhenii, 15 (2), 2005, p. 546.
69. J. Bassili, Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face, J. Pers. Soc. Psychol. 37 (11) (1979) 2049.
70. Y. Yacoob, L. Davis, Computing spatio-temporal representations of human faces, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE, 1994, pp. 70-75.
71. H. Gu, Q. Ji, Facial event classification with task oriented dynamic bayesian network, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, IEEE, 2004, (II-870).
72. M. Valstar, I. Patras, M. Pantic, Facial action unit detection using probabilistic actively learned support vector machines on tracked facial point data, IEEE Computer Society Conference on Computer Vision and Pattern Recognition- Workshops, 2005. CVPR Workshops, IEEE, 2005, pp. 76-83.
73. Y. Chang, C. Hu, M. Turk, Manifold of facial expression, IEEE International Workshop on Analysis and Modeling of Faces and Gestures, 2003, pp. 28-35.
74. C. Lee, A. Elgammal, Facial expression analysis using nonlinear decomposable generative models, Analysis and Modelling of Faces and Gestures, 2005, pp. 17-31.
75. G. Zhao, M. Pietikainen, Dynamic texture recognition using local binary patterns with an application to facial expressions, IEEE Trans. Pattern Anal. Mach. Intell. 29 (6) (2007) 915-928. (Pubitemid 46667407)
76. Y. Ke, R. Sukthankar, M. Hebert, Efficient visual event detection using volumetric features, IEEE International Conference on Computer Vision, vol. 1, IEEE, 2005, pp. 166-173. (Pubitemid 44054955)
77. A. Hadid, M. Pietikäinen, S. Li, Learning personal specific facial dynamics for face recognition from videos, Analysis and Modeling of Faces and Gestures, 2007, pp. 1-15.
78. X. Cui, Y. Liu, S. Shan, X. Chen, W. Gao, 3D haar-like features for pedestrian detection, IEEE International Conference on Multimedia and Expo, IEEE, 2007, pp. 1263-1266.
79. S. Kumano, K. Otsuka, J. Yamato, E. Maeda, Y. Sato, Pose-invariant facial expression recognition using variable-intensity templates, Int. J. Comput. Vis. 83 (2) (2009) 178-194.
80. G. Sandbach, S. Zafeiriou, M. Pantic, L. Yin, Static and dynamic 3d facial expression recognition: A comprehensive survey, Image Vis. Comput.
81. S. Zafeiriou, L. Yin, 3D facial behaviour analysis and understanding, Image Vis. Comput. 30 (10) (2012) 681-682.
82. L. Yin, X. Wei, Y. Sun, J. Wang, M. Rosato, A 3d facial expression database for facial behavior research, International Conference on Automatic Face and Gesture Recognition, IEEE, 2006, pp. 211-216. (Pubitemid 44711352)
83. L. Yin, X. Chen, Y. Sun, T. Worm, M. Reale, A high-resolution 3D dynamic facial expression database, International Conference on Automatic Face and Gesture Recognition, IEEE, 2008, pp. 1-6.
84. H. Soyel, H. Demirel, Facial expression recognition using 3D facial feature distances, Image Anal. Recognit. (2007) 831-838.
85. H. Tang, T. Huang, 3D facial expression recognition based on properties of line segments connecting facial feature points, International Conference on Automatic Face and Gesture Recognition, IEEE, 2008, pp. 1-6.
86. X. Li, Q. Ruan, Y. Ming, 3D facial expression recognition based on basic geometric features, International Conference on Signal Processing (ICSP), IEEE, 2010, pp. 1366-1369.
87. A. Maalej, B. Amor, M. Daoudi, A. Srivastava, S. Berretti, et al., Local 3D shape analysis for facial expression recognition, 20th International Conference on Pattern Recognition, 2010, pp. 4129-4132.
88. A. Savran, B. Sankur, M. Taha Bilge, Comparative evaluation of 3D vs. 2D modality for automatic detection of facial action units, Pattern Recognit. 45 (2) (2012) 767-782.
89. Y. Sun, L. Yin, Facial expression recognition based on 3D dynamic range model sequences, European Conference on Computer Vision, 2008, pp. 58-71.
90. F. Tsalakanidou, S. Malassiotis, Robust facial action recognition from real-time 3D streams, IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, IEEE, 2009, pp. 4-11.
91. S. Canavan, Y. Sun, X. Zhang, L. Yin, A dynamic curvature based approach for facial activity analysis in 3D space, IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, IEEE, 2012, pp. 14-19.
92. N. Michael, M. Dilsizian, D. Metaxas, J. Burgoon, Motion profiles for deception detection using visual cues, European Conference on Computer Vision, 2010, pp. 462-475.
93. M. Shreve, S. Godavarthy, D. Goldgof, S. Sarkar, M. Shreve, S. Godavarthy, D. Goldgof, S. Sarkar, Macro- and micro-expression spotting in long videos using spatio-temporal strain, IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, IEEE, 2011, pp. 51-56.
94. Q.Wu, X. Shen, X. Fu, Themachine knowswhat you are hiding: an automaticmicroexpression recognition system, Affect. Comput. Intell. Interact. (2011) 152-162.
95. H. Dibeklioglu, A. Salah, T. Gevers, Are you really smiling at me? Spontaneous versus posed enjoyment smiles, European Conference on Computer Vision, 2012, pp. 525-538.
96. X. Li, T. Pfister, X. Huang, G. Zhao, M. Pietikäinen, A spontaneous microexpression database: inducement, collection and baseline, IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, 2013.
97. Y. Wang, X. Huang, C. Lee, S. Zhang, Z. Li, D. Samaras, D. Metaxas, A. Elgammal, P. Huang, High resolution acquisition, learning and transfer of dynamic 3-D facial expressions, Computer Graphics Forum, vol. 23, Wiley Online Library, 2004, pp. 677-686.
98. C. Lee, A. Elgammal, D. Metaxas, Synthesis and control of high resolution facial expressions for visual interactions, IEEE International Conference on Multimedia and Expo, IEEE, 2006, pp. 65-68. (Pubitemid 46679655)
99. P. Yang, Q. Liu, D. Metaxas, Boosting coded dynamic features for facial action units and facial expression recognition, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2007, pp. 1-6.
100. P. Yang, Q. Liu, D. Metaxas, Boosting encoded dynamic features for facial expression recognition, Pattern Recognit. Lett. 30 (2) (2009) 132-139.
101. P. Yang, Q. Liu, X. Cui, D. Metaxas, Facial expression recognition using encoded dynamic features, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2008, pp. 1-8.
102. P. Yang, Q. Liu, D. Metaxas, Exploring facial expressions with compositional features, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2010, pp. 2638-2644.
103. P. Yang, Q. Liu, D. Metaxas, RankBoost with l1 regularization for facial expression recognition and intensity estimation, IEEE 12th International Conference on Computer Vision, IEEE, 2009, pp. 1018-1025.
104. S. Mitra, T. Acharya, Gesture recognition: a survey, IEEE Trans. Syst. Man Cybern. B Cybern. 37 (3) (2007) 311-324. (Pubitemid 46621535)
105. N. Howe, M. Leventon, W. Freeman, Bayesian reconstruction of 3D human motion from single-camera video, Neural Information Processing Systems, vol. 1999, 1999, p. 1, (Cambridge, MA).
106. R. Kehl, M. Bray, L. Van Gool, Full body tracking from multiple views using stochastic sampling, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, Ieee, 2005, pp. 129-136.
107. R. Plankers, P. Fua, Articulated soft objects for video-based body modeling, IEEE International Conference on Computer Vision, vol. 1, IEEE, 2001, pp. 394-401. (Pubitemid 32794983)
108. G. Loy, M. Eriksson, J. Sullivan, S. Carlsson, Monocular 3D reconstruction of human motion in long action sequences, The European Conference on Computer Vision, 2004, pp. 442-455.
109. J. Alon, V. Athitsos, Q. Yuan, S. Sclaroff, A unified framework for gesture recognition and spatiotemporal gesture segmentation, IEEE Trans. Pattern Anal. Mach. Intell. 31 (9) (2009) 1685-1699.
110. V. Ferrari, M. Marin-Jimenez, A. Zisserman, Progressive search space reduction for human pose estimation, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2008, pp. 1-8.
111. Y. Yang, D. Ramanan, Articulated pose estimation with flexible mixtures-ofparts, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2011, pp. 1385-1392.
112. B. Sapp, D. Weiss, B. Taskar, Parsing human motion with stretchable models, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2011, pp. 1281-1288.
113. L. Bourdev, J. Malik, Poselets: body part detectors trained using 3D human pose annotations, International Conference on Computer Vision, IEEE, 2009, pp. 1365-1372.
114. V. Singh, R. Nevatia, C. Huang, Efficient inference with multiple heterogeneous part detectors for human pose estimation, European Conference on Computer Vision, 2010, pp. 314-327.
115. D. Park, D. Ramanan, N-best maximal decoders for part models, IEEE International Conference on Computer Vision, IEEE, 2011, pp. 2627-2634.
116. M. Sun, S. Savarese, Articulated part-based model for joint object detection and pose estimation, IEEE International Conference on Computer Vision, IEEE, 2011, pp. 723-730.
117. M. Isard, A. Blake, Condensation-conditional density propagation for visual tracking, Int. J. Comput. Vis. 29 (1) (1998) 5-28. (Pubitemid 128523364)
118. J. Deutscher, A. Blake, I. Reid, Articulated body motion capture by annealed particle filtering, IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, IEEE, 2000, pp. 126-133.
119. L. Sigal, S. Bhatia, S. Roth, M.J. Black, M. Isard, Tracking loose-limbed people, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, IEEE, 2004, (I-421).
120. A.O. Balan, L. Sigal, M.J. Black, J.E. Davis, H.W. Haussecker, Detailed human shape and pose from images, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2007, pp. 1-8.
121. R. Rosales, S. Sclaroff, Learning body pose via specialized maps, NIPS, vol. 1, 2002, p. 2.
122. C. Sminchisescu, A. Kanaujia, Z. Li, D. Metaxas, Discriminative density propagation for 3D human motion estimation, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, IEEE, 2005, pp. 390-397.
123. A. Agarwal, B. Triggs, 3D human pose from silhouettes by relevance vector regression, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, IEEE, 2004, (II-882).
124. L. Sigal, A. Balan, M. Black, Combined discriminative and generative articulated pose and non-rigid shape estimation, Adv. Neural Inf. Process. Syst. 20 (2007) 1337-1344.
125. M.W. Lee, I. Cohen, Proposal maps driven MCMC for estimating human body pose in static images, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, IEEE, 2004, (II-334).
126. E. Simo-Serra, A. Ramisa, G. Alenya, C. Torras, F. Moreno-Noguer, Single image 3D human pose estimation from noisy observations, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2012, pp. 2673-2680.
127. L. Zelnik-Manor, On sifts and their scales, IEEE Conference on Computer Vision and Pattern Recognition, IEEE Computer Society, 2012, pp. 1522-1528.
128. B. Liu, S. Gould, D. Koller, B. Liu, S. Gould, D. Koller, Single image depth estimation from predicted semantic labels, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2010, pp. 1253-1260.
129. Behave, http://homepages.inf.ed.ac.uk/rbf/behave/.
130. R. Poppe, A survey on vision-based human action recognition, Image Vis. Comput. 28 (6) (2010) 976-990.
131. J. Liu, Y. Yang, I. Saleemi, M. Shah, Learning semantic features for action recognition via diffusion maps, Comput. Vis. Image Underst. 116 (3) (2012) 361-377.
132. V. Kellokumpu, G. Zhao, M. Pietikäinen, Recognition of human actions using texture descriptors, Mach. Vis. Appl. 22 (5) (2011) 767-780.
133. S. Ali, M. Shah, Human action recognition in videos using kinematic features and multiple instance learning, IEEE Trans. Pattern Anal. Mach. Intell. 32 (2) (2010) 288-303.
134. D. Metaxas, S. Zhang / Image and Vision Computing 31 (2013) 421-433.
135. J. Liu, M. Shah, B. Kuipers, S. Savarese, Cross-view action recognition via view knowledge transfer, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2011, pp. 3209-3216.
136. V. Kellokumpu, G. Zhao, M. Pietikäinen, Human activity recognition using a dynamic texture based method, BMVC08, 2008. 1-10.
137. A. Oikonomopoulos, M. Pantic, I. Patras, Sparse B-spline polynomial descriptors for human activity recognition, Image Vis. Comput. 27 (12) (2009) 1814-1825.
138. R. Souvenir, J. Babbs, Learning the viewpoint manifold for action recognition, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2008, pp. 1-7.
139. R. Souvenir, K. Parrigan, Viewpoint manifolds for action recognition, J. Image Video Process. 2009 (2009) 1.
140. J. Konrad, Motion detection and estimation, Handbook of Image and Video Processing, 2nd Edition, 2010.
141. N. Friedman, S. Russell, Image segmentation in video sequences: a probabilistic approach, Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann Publishers Inc., 1997, pp. 175-181.
142. I. Haritaoglu, D. Harwood, L. Davis, W4: real-time surveillance of people and their activities, IEEE Trans. Pattern Anal. Mach. Intell. 22 (8) (2000) 809-830.
143. K. Smith, P. Quelhas, D. Gatica-Perez, Detecting abandoned luggage items in a public space, Proceedings of the 9th IEEE International Workshop on Performance Evaluation in Tracking and Surveillance (PETS'06), 2006, pp. 75-82.
144. Y. Zhou, S. Yan, T. Huang, Pair-activity classification by bi-trajectories analysis, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2008, pp. 1-8.
145. B. Ni, S. Yan, A. Kassim, Recognizing human group activities with localized causalities, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2009, pp. 1470-1477.
146. T. Yu, S. Lim, K. Patwardhan, N. Krahnstoever, Monitoring, recognizing and discovering social networks, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2009, pp. 1462-1469.
147. Q. Yu, G. Medioni, Motion pattern interpretation and detection for tracking moving vehicles in airborne video, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2009, pp. 2671-2678.
148. E. Swears, A. Hoogs, Functional scene element recognition for video scene analysis, Workshop on Motion and Video Computing, 2009.WMVC'09, IEEE, 2009, pp. 1-8.
149. I. Laptev, T. Lindeberg, Space-time interest points, Proceedings of the International Conference on Computer Vision, 2003, pp. 432-439.
150. C. Harris, M. Stephens, A combined corner and edge detector, Proceedings of the Alvey Vision Conference, 1988, pp. 147-151.
151. P. Dollár, V. Rabaud, G. Cottrell, S. Belongie, Behavior recognition via sparse spatio-temporal features, International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS¡05), 2005, pp. 65-72. (Pubitemid 46178025)
152. K. Rapantzikos, Y. Avrithis, S. Kollias, Dense saliency-based spatiotemporal feature points for action recognition, Proceedings of the Conference on Computer Vision and Pattern Recognition, 2009, pp. 1454-1461.
153. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local SVM approach, Proceedings of International Conference on Pattern Recognition, 2004, pp. 32-36.
154. J. Niebles, H. Wang, L. Fei-Fei, Unsupervised learning of human action categories using spatial-temporal words, Int. J. Comput. Vis. 79 (3) (2008) 299-318.
155. K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, L.V. Gool, A comparison of affine region detectors, Int. J. Comput. Vis. 65 (2005) 43-72. (Pubitemid 43281159)
156. N. Ikizler, P. Duygulu, Histogram of oriented rectangles: a new pose descriptor for human action recognition, Image Vis. Comput. 27 (10) (2009) 1515-1526.
157. Z. Zhao, A. Elgammal, Human activity recognition from frame's spatiotemporal representation, Proceedings of the International Conference on Pattern Recognition, 2008, pp. 1-4.
158. S. Nowozin, G. Bakir, K. Tsuda, Discriminative subsequence mining for action classification, Proceedings of the International Conference on Computer Vision, 2007, pp. 1-8.
159. P. Scovanner, S. Ali, M. Shah, A 3-dimensional sift descriptor and its application to action recognition, International Conference on Multimedia, 2007, pp. 357-360.
160. J. Liu, S. Ali, M. Shah, Recognizing human actions using multiple features, Proceedings of the Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
161. I. Laptev, M. Marszałek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, Proceedings of the Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
162. J. Liu, J. Luo, M. Shah, Recognizing realistic actions from videos 'in the wild', Proceedings of the Conference on Computer Vision and Pattern Recognition, 2009, pp. 1996-2003.
163. G. Medioni, I. Cohen, F. Brémond, S. Hongeng, R. Nevatia, Event detection and analysis from video streams, IEEE Trans. Pattern Anal. Mach. Intell. 23 (8) (2001) 873-889. (Pubitemid 32780014)
164. A. Prati, S. Calderara, R. Cucchiara, Using circular statistics for trajectory shape analysis, Proceedings of the Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
165. E.L. Andrade, S. Blunsden, R.B. Fisher, Modelling crowd scenes for event detection, Proceedings of the International Conference on Pattern Recognition, 2006, pp. 175-178. (Pubitemid 46531871)
166. J. Wu, A. Osuntogun, T. Choudhury, M. Philipose, J. Rehg, A scalable approach to activity recognition based on object use, Proceedings of the International Conference on Computer Vision, 2007, pp. 1-8.
167. D. Helbing, P. Molnar, Social forcemodel for pedestrian dynamics, Physical Review E. [168] W. Yu, A. Johansson, Modeling crowd turbulence by many-particle simulations, Phys. Rev. E 76 (4) (2007) 046105.
168. W. Yu, A. Johansson, Modeling crowd turbulence by many-particle simulations, Phys. Rev. E 76 (4) (2007) 046105.
169. A. Treuille, S. Cooper, Z. Popovic, Continuum crowds, ACM Trans. Graph. 25 (3) (2006) 1160-1168. (Pubitemid 44481080)
170. S. Ali, M. Shah, Floor fields for tracking in high density crowd scenes, Proceedings of the European Conference on Computer Vision, 2008, pp. 1-14.
171. G. Antonini, S.V. Martinez, M. Bierlaire, J.P. Thiran, Behavioral priors for detection and tracking of pedestrians in video sequences, Int. J. Comput. Vis. (2006) 159-180. (Pubitemid 43814116)
172. P. Scovanner, M.F. Tappen, Learning pedestrian dynamics from the real world, Proceedings of the International Conference on Computer Vision, 2009, pp. 381-388.
173. S. Pellegrini, A. Ess, K. Schindler, L.V. Gool, You'll never walk alone: modeling social behavior for multi-target tracking, Proceedings of the International Conference on Computer Vision, 2009, pp. 261-268.
174. R. Mehran, A. Oyama, M. Shah, Abnormal crowd behavior detection using social force model, Proceedings of the Conference on Computer Vision and Pattern Recognition, 2009, pp. 935-942.
175. S. Wu, B. Moore, M. Shah, Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes, Proceedings of the Conference on Computer Vision and Pattern Recognition, 2010, pp. 2054-2060.
176. X. Cui, Q. Liu, M. Gao, D. Metaxas, Abnormal detection using interaction energy potentials, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2011, pp. 3161-3167.
177. S. Lu, D. Metaxas, D. Samaras, J. Oliensis, Using multiple cues for hand tracking and model refinement, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, IEEE, 2003, pp. 443-450.
178. D. Metaxas, Physics-based Deformable Models: Applications to Computer Vision, Graphics, and Medical Imaging, vol. 389, Springer, 1997.
179. L. Kakadiaris, D. Metaxas, Model-based estimation of 3D human motion, IEEE Trans. Pattern Anal. Mach. Intell. 22 (12) (2000) 1453-1459. (Pubitemid 32088471)
180. D. Metaxas, B. Liu, F. Yang, P. Yang, N. Michael, C. Neidle, Recognition of nonmanual markers in American Sign Language (ASL) using non-parametric adaptive 2D-3D face tracking, The International Conference on Language Resources and Evaluation, 2012.
181. J. Liu, B. Liu, S. Zhang, F. Yang, P. Yang, D.N. Metaxas, C. Neidle, Recognizing eyebrow and periodic head gestures using CRFs for non-manual grammatical marker detection in ASL, IEEE International Conference on Automatic Face and Gesture Recognition, 2013.
182. J. Huang, S. Zhang, H. Li, D. Metaxas, Composite splitting algorithms for convex optimization, Comput. Vis. Image Underst. 115 (12) (2011) 1610-1622.
183. J. Huang, S. Zhang, D. Metaxas, Fast optimization for mixture prior models, European Conference on Computer Vision, 2010, pp. 607-620.
184. M. Yuan, Y. Lin, Model selection and estimation in regression with grouped variables, J. R. Stat. Soc. B (Stat. Methodol.) 68 (1) (2005) 49-67.
185. J. Huang, T. Zhang, The benefit of group sparsity, Ann. Stat. 38 (4) (2010) 1978-2004.
186. S. Zhang, J. Huang, Y. Huang, Y. Yu, H. Li, D. Metaxas, Automatic image annotation using group sparsity, IEEE Conference on Computer Vision and Pattern Recognition, IEEE, 2010, pp. 3312-3319.
187. C. Neidle, C. Vogler, A new web interface to facilitate access to corpora: development of the ASLLRP data access interface, Proceedings of the 5th Workshop on the Representation and Processing of Sign Languages: Interactions Between Corpus and Lexicon, 2012.
188. V. Athitsos, C. Neidle, S. Sclaroff, J. Nash, A. Stefan, Q. Yuan, A. Thangali, The American Sign Language lexicon Video Dataset, IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2008. CVPRW'08, IEEE, 2008, pp. 1-8.
189. D. Metaxas, S. Zhang / Image and Vision Computing 31 (2013) 421-433.