Silhouette-based gesture and action recognition via modeling trajectories on Riemannian shape manifolds

Computer Vision and Image Understanding

Volumn 115, Issue 3, 2011, Pages 439-455

  Abdelkader, Mohamed F ^a   Abd Almageed, Wael ^a   Srivastava, Anuj ^b   Chellappa, Rama ^a  

^a UNIVERSITY OF MARYLAND   (United States)

^b FLORIDA STATE UNIVERSITY   (United States)

Author keywords

Action recognition; Gesture recognition; Riemannian manifolds; Shape space; Silhouette based approaches

Indexed keywords

ACTION RECOGNITION; BACKGROUND SUBTRACTION; CLOSED CURVE; DATA SETS; DYNAMIC TIME WARPING; EXEMPLAR-BASED HIDDEN MARKOV MODELS; GEODESIC DISTANCES; GRAPHICAL MODEL; HUMAN GESTURES; HUMAN POSE; HUMAN SILHOUETTE; MARKOV MODEL; NON-PARAMETRIC; RIEMANNIAN GEOMETRY; RIEMANNIAN MANIFOLDS; SHAPE MANIFOLD; SHAPE SPACE; SILHOUETTE-BASED APPROACHES; STATISTICAL MODELS; TEMPLATE-BASED; TEMPORAL SEQUENCES;

GEOMETRY; HIDDEN MARKOV MODELS; SPEECH RECOGNITION; TRAJECTORIES;

GESTURE RECOGNITION;

EID: 79951632091     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2010.10.006     Document Type: Article

References (68)

1. M. Hasanuzzaman, T. Zhang, V. Ampornaramveth, H. Gotoda, Y. Shirai, and H. Ueno Adaptive visual gesture recognition for human-robot interaction using a knowledge-based software platform Robot. Auton. Syst. 55 2007 643 657 (Pubitemid 47068927)
2. M.-A. Bhuiyan, M. Islam, N. Begum, M. Hasanuzzaman, C.H. Liu, H. Ueno, Vision based gesture recognition for human-robot symbiosis, in: Tenth International Conference on Computer and Information Technology, ICCIT 2007, 2007, pp. 1-6.
3. J.K. Aggarwal, S. Park, Human motion: modeling and recognition of actions and interactions, in: Proceedings of the Second International Symposium on 3D Data Processing, Visualization, and Transmission, 3DPVT 2004, Washington, DC, USA, 2004, pp. 640-647. (Pubitemid 40456354)
4. D. Gavrila The visual analysis of human movement: a survey Comput. Vis. Image Underst. 73 1999 82 98
5. W. Hu, T. Tan, L. Wang, and S. Maybank A survey on visual surveillance of object motion and behaviors IEEE Trans. Syst. Man Cybern. - C: Appl. Rev. 34 2004 334 352
6. T.B. Moeslund, A. Hilton, and V. Krüger A survey of advances in vision-based human motion capture and analysis Comput. Vis. Image Underst. 104 2006 90 126 (Pubitemid 44573873)
7. D. Weinland, E. Boyer, Action recognition using exemplar-based embedding, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, 2008, pp. 1-7.
8. A. Efros, A. Berg, G. Mori, J. Malik, Recognizing action at a distance, in: Proceedings of IEEE International Conference on Computer Vision, Nice, France, 2003, pp. 726-733.
9. Y. Sheikh, M. Sheikh, M. Shah, Exploring the space of a human action, in: Proceedings of IEEE International Conference on Computer Vision, vol. 1, Beijing, China, 2005, pp. 144-149. (Pubitemid 44054952)
10. C. Bregler, Learning and recognizing human dynamics in video sequences, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 1997, pp. 568-574.
11. A. Bobick, and J. Davis The recognition of human movement using temporal templates IEEE Trans. Pattern Anal. Machine Intell. 23 2001 257 267 (Pubitemid 32286632)
12. A. Veeraraghavan, A. Roy-Chowdhury, and R. Chellappa Matching shape sequences in video with an application to human movement analysis IEEE Trans. Pattern Anal. Machine Intell. 27 2005 1896 1909 (Pubitemid 43051387)
13. L. Wang, and D. Suter Learning and matching of dynamic shape manifolds for human action recognition IEEE Trans. Image Process. 16 2007 1646 1661 (Pubitemid 46796060)
14. H. Freeman On the encoding of arbitrary geometric configurations IRE Trans. Electron. Comput. 10 1961 260 268
15. C. Zahn, and R. Roskies Fourier descriptors for plane closed curves IEEE Trans. Comput. 21 1972 269 281
16. M. Hu Visual pattern recognition by moment invariants IEEE Trans. Inform. Theory 8 1962 179 187
17. S. Belongie, J. Malik, and J. Puzicha Shape matching and object recognition using shape contexts IEEE Trans. Pattern Anal. Machine Intell. 24 2002 509 522 (Pubitemid 34448769)
18. A. Elgammal, C. Lee, Inferring 3D body pose from silhouettes using activity manifold learning, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC, pp. 681-688.
19. M. Black, Y. Yacoob, Parameterized modeling and recognition of activities, in: Proceedings of IEEE International Conference on Computer Vision, Bombay, 1998, pp. 120-127.
20. O. Tuzel, F. Porikli, P. Meer, Learning on lie groups for invariant detection and tracking, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, AK, 2008, pp. 1-8.
21. E. Begelfor, M. Werman, Affine invariance revisited, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Miami, FL, 2006, pp. 2087-2094. (Pubitemid 44931572)
22. P. Turaga, A. Veeraraghavan, R. Chellappa, Statistical analysis on Stiefel and Grassmann manifolds with applications in computer vision, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, 2008, pp. 1-8.
23. U. Grenander, M.I. Miller, and A. Srivastava Hilbert-Schmidt lower bounds for estimators on matrix Lie groups for ATR IEEE Trans. Pattern Anal. Machine Intell. 20 1998 790 802 (Pubitemid 128741342)
24. A. Srivastava, and E. Klassen Monte Carlo extrinsic estimators for manifold-valued parameters IEEE Trans. Signal Process. 50 2001 299 308
25. A. Goh, R. Vidal, Clustering and dimensionality reduction on riemannian manifolds, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, 2008, pp. 1-7.
26. O. Tuzel, F. Porikli, and P. Meer Pedestrian detection via classification on riemannian manifolds IEEE Trans. Pattern Anal. Machine Intell. 30 2008 1713 1727
27. P. Fletcher, S. Venkatasubramanian, S. Joshi, Robust statistics on riemannian manifolds via the geometric median, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, 2008, pp. 1-8.
28. A. Veeraraghavan, A. Roy-Chowdhury, R. Chellappa, Role of shape and kinematics in human movement analysis, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, Washington, DC, 2004, pp. 730-737.
29. L. Rabiner A tutorial on hidden Markov models and selected applications in speech recognition Proc. IEEE 77 1989 257 286
30. J. Yamato, J. Ohya, K. Ishii, Recognizing human action in time-sequential images using hidden Markov model, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Urbana-Champaign, IL, 1992, pp. 379-385.
31. M. Brand, N. Oliver, A. Pentland, Coupled hidden Markov models for complex action recognition, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 1997, pp. 994-999.
32. S. Hongeng, R. Nevatia, Large-scale event detection using semi-hidden Markov models, in: Proceedings of IEEE International Conference on Computer Vision, Nice, France, 2003, pp. 1455-1462.
33. S. Wang, A. Quattoni, L. Morency, D. Demirdjian, T. Darrell, Hidden conditional random fields for gesture recognition, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, New York, NY, 2006, pp. 1521-1527. (Pubitemid 44931500)
34. L. Wang, D. Suter, Recognizing human activities from silhouettes: motion subspace and factorial discriminative graphical model, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, 2007, pp. 1-8.
35. A. Veeraraghavan, A. Srivastava, A. Roy-Chowdhury, and R. Chellappa Rate-invariant recognition of humans and their activities IEEE Trans. Image Process. 18 2009 1326 1339
36. S. Joshi, E. Klassen, A. Srivastava, I. Jermyn, A novel representation for riemannian analysis of elastic curves in Rn, in: Proceedings of IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, Minneapolis, MN, 2007, pp. 1-7.
37. S. Joshi, E. Klassen, A. Srivastava, I. Jermyn, Removing shape-preserving transformations in square-root elastic (SRE) framework for shape analysis of curves, in: Proceedings of International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR), Ezhou, China, 2007, pp. 387-398.
38. A. Srivastava, E. Klassen, S.H. Joshi, I.H. Jermyn, Shape analysis of elastic curves in euclidean spaces, IEEE Trans. Pattern Anal. Machine Intell., Accepted for publication, 2010.
39. E. Klassen, A. Srivastava, and W. Mio Analysis of planar shapes using geodesic paths on shape spaces IEEE Trans. Pattern Anal. Machine Intell. 26 2004 372 383
40. L. Younes Computable elastic distance between shapes SIAM J. Appl. Math. 58 1998 565 586
41. L. Younes, P.W. Michor, J. Shah, D. Mumford, and R. Lincei A metric on shape space with explicit geodesics Matematica E Applicazioni 19 2008 25 57
42. A. Srivastava, S.H. Joshi, W. Mio, and X. Liu Statistical shape analysis: clustering, learning, and testing IEEE Trans. Pattern Anal. Machine Intell. 27 2005 590 602 (Pubitemid 40556113)
43. B.J. Frey, and D. Dueck Clustering by passing messages between data points Science 315 2007 972 976 (Pubitemid 46281181)
44. A. Elgammal, V. Shet, Y. Yacoob, L. Davis, Learning dynamics for exemplar-based gesture recognition, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, Madison, WI, 2003, pp. 571-578.
45. D. Weinland, E. Boyer, R. Ronfard, Action recognition from arbitrary views using 3d exemplars, in: Proceedings of IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil, 2007, pp. 1-7.
46. Z. Lin, Z. Jiang, L. Davis, Recognizing actions by shape-motion prototype trees, in: Proceedings of IEEE International Conference on Computer Vision, Kyoto, Japan, 2009, pp. 444-451.
47. B. Frey, N. Jojic, Flexible models: a powerful alternative to exemplars and explicit models, in: IEEE Computer Society Workshop on Models vs. Exemplars in Computer Vision, Honolulu, Hawaii, 2001, pp. 34-41.
48. K. Toyama, and A. Blake Probabilistic tracking with exemplars in a metric space Int. J. Comput. Vis. 48 2002 9 19 (Pubitemid 34491072)
49. H. Yang, A. Park, and S. Lee Gesture spotting and recognition for human-robot interaction IEEE Trans. Robot. 23 2007 256 270 (Pubitemid 46621552)
50. D. Kendall, D. Barden, T. Carne, and H. Le Shape and Shape Theory 1999 John Wiley and Sons
51. I. Dryden, and K. Mardia Statistical Shape Analysis 1998 John Wiley and Sons
52. D. Kendall, D. Barden, T. Carne, and H. Le Shape and Shape Theory 1999 John Wiley and Sons
53. V. Patrangenaru, K. Mardia, Affine shape analysis image analysis, Stochastic Geometry, Biological Structure and Images, Dept. of Statistics, University of Leeds, 2003, pp. 56-62.
54. C. Goodall, and K. Mardia Projective shape analysis J. Comput. Graph. Stat. 1999 143 168
55. T. Cootes, C. Taylor, D. Cooper, and J. Graham Active shape models: their training and application Comput. Vis. Image Underst. 61 1995 38 59
56. U. Grenander General Pattern Theory 1993 Oxford university Press
57. N. Vaswani, A. Roy-Chowdhury, R. Chellappa, Activity recognition using the dynamics of the configuration of interacting objects, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, Madison, WI, 2003, pp. 633-640.
58. S. Das, and N. Vaswani Nonstationary shape activities: dynamic models for landmark shape change and applications IEEE Trans. Pattern Anal. Machine Intell. 32 2009 579 592
59. W. Mio, A. Srivastava, and S. Joshi On shape of plane elastic curves Int. J. Comput. Vis. 73 2007 307 324 (Pubitemid 46227277)
60. M. do Carmo Riemannian Geometry 1992 BirkhSuser Englewoods Cliffs
61. X. Pennec, I.P. Epidaure, Probabilities and statistics on riemannian manifolds: Basic tools for geometric measurements, in: IEEE Workshop on Nonlinear Signal and Image Processing, Antalya, Turkey, 1999, pp. 194-198.
62. H. Le Locating frechet means with application to shape spaces Adv. Appl. Prob. 33 2001 324 338 (Pubitemid 32699242)
63. P. Fletcher, C. Lu, S. Pizer, and S. Joshi Principal geodesic analysis for the study of nonlinear statistics of shape IEEE Trans. Med. Imag. 23 2004 995 1005
64. E. Klassen, A. Srivastava, Geodesics between 3d closed curves using path-straightening, in: Proceedings of European Conference on Computer Vision, Graz, Austria, 2006, pp. 95-106. (Pubitemid 44029771)
65. L. Rabiner, and B.-H. Juang Fundamentals of speech recognition 1993 Prentice-Hall, Inc. Upper Saddle River, NJ, USA
66. P. Maurel, G. Sapiro, Dynamic shapes average, in: Proceedings of Second IEEE Workshop Variational, Geometric and Level Set Methods in Computer Vision, Nice, France, 2003.
67. L. Baum, T. Petrie, G. Soules, and N. Weiss A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains Ann. Math. Stat. 41 1970 164 171
68. A. Veeraraghavan, R. Chellappa, A.K. Roy-Chowdhury, The function space of an activity, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC, USA, 2006, pp. 959-968.