Model-based segmentation and recognition of dynamic gestures in continuous video streams

Pattern Recognition

Volumn 44, Issue 8, 2011, Pages 1614-1628

  Li, Hong ^a   Greenspan, Michael ^a  

^a QUEEN S UNIVERSITY   (Canada)

Author keywords

Continuous gesture recognition; Dynamic Programming; Dynamic Time Warping; Gesture Model; Gesture segmentation; Motion Signature

Indexed keywords

CONTINUOUS GESTURE RECOGNITION; DYNAMIC TIME WARPING; GESTURE MODEL; GESTURE SEGMENTATION; MOTION SIGNATURE;

DYNAMIC PROGRAMMING; THREE DIMENSIONAL;

GESTURE RECOGNITION;

EID: 79953048246     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2010.12.014     Document Type: Article

References (45)

1. S. Mitra, and T. Acharya Gesture recognition: a survey IEEE Trans. Syst. Man Cybern Part C Appl. Rev. 37 3 2007 311 324 (Pubitemid 46621535)
2. S. Ong, and S. Ranganath Automatic sign language analysis: a survey and the future beyond lexical meaning IEEE Trans. Pattern Anal. Mach. Intell. 27 6 2005 873 891 (Pubitemid 40889839)
3. V. Pavlovic, R. Sharma, and T. Huang Visual interpretation of hand gestures for humancomputer interaction: a review IEEE Trans. Pattern Anal. Mach. Intell. 19 7 1997 677 695 (Pubitemid 127762261)
4. J. Alon, V. Athitsos, Q. Yuan, and S. Sclaroff A unified framework for gesture recognition and spatiotemporal gesture segmentation IEEE Trans. Pattern Anal. Mach. Intell. 31 9 2009 1685 1699
5. H.-K. Lee, and J.H. Kim An HMM-based threshold model approach for gesture recognition IEEE Trans. Pattern Anal. Mach. Intell. 21 10 1999 961 973
6. B. Bauer, and K.-F. Kraiss Video-based sign recognition using self-organizing subunits 16th International Conference on Pattern Recognition vol. 2 2002
7. A.F. Bobick, and J.W. Davis The recognition of human movement using temporal templates IEEE Trans. Pattern Anal. Mach. Intell. 23 2001 257 267 (Pubitemid 32286632)
8. K. Derpanis, R. Wildes, and J. Tsotsos Hand gesture recognition within a linguistics-based framework European Conference on Computer Vision 2004 282 296
9. A. Mokhber, C. Achard, and M. Milgram Recognition of human behavior by space-time silhouette characterization Pattern Recognition Lett. 29 2008 81 89 (Pubitemid 350026665)
10. P. Peixoto, J. Goncalves, and H. Araujo Real-time gesture recognition system based on contour signatures IEEE International Conference on Pattern Recognition vol. 1 2002 447 450 (Pubitemid 44845034)
11. M.-H. Yang, N. Ahuja, and M. Tabb Extraction of 2D motion trajectories and its application to hand gesture recognition IEEE Trans. Pattern Anal. Mach. Intell. 24 8 2002 1061 1074
12. J. Lichtenauer, E. Hendriks, and M. Reinders Sign language recognition by combining statistical DTW and independent classification IEEE Trans. Pattern Anal. Mach. Intell. 30 11 2008 2040 2046
13. H. Yoon, J. Soh, Y.J. Bae, and H.S. Yang Hand gesture recognition using combined features of location, angle and velocity Pattern Recognition 34 2001 1491 1501 (Pubitemid 32424914)
14. Y. Zhu, G. Xu, and D.J. Kriegman A real-time approach to the spotting, representation, and recognition of hand gestures for humancomputer interaction Comput. Vision Image Understanding 85 2002 189 208
15. H. Kang, C.W. Lee, and K. Jung Recognition-based gesture spotting in video games Pattern Recognition 25 2004 1701 1714
16. P. Morguet, and M. Lang Spotting dynamic hand gestures in video image sequences using hidden Markov models International Conference on Image Processing vol. 3 1998 193 197
17. D. Kim, J. Song, and D. Kim Simultaneous gesture segmentation and recognition based on forward spotting accumulative hmms Pattern Recognition 40 2007 3012 3026 (Pubitemid 46990423)
18. M. Roh, B. Christmas, J. Kittler, and S. Lee Gesture spotting for low-resolution sports for video annotation Pattern Recognition 41 2008 1124 1137 (Pubitemid 47632673)
19. G. Fang, W. Gao, and D. Zhao Large-vocabulary continuous sign language recognition based on transition-movement models IEEE Trans. Syst Man Cybern. Part A Syst. Humans 37 1 2007 1 9 (Pubitemid 46002473)
20. H. Li, and M. Greenspan Multi-scale gesture recognition from time-varying contours International Conference on Computer Vision vol. I 2005 236 243 (Pubitemid 44054964)
21. H. Li, and M. Greenspan Continuous time-varying gesture segmentation by dynamic time warping of compound gesture models International Workshop on Human Activity Recognition and Modelling (HARAM) 2005 35 42
22. H. Li, and M. Greenspan Segmentation and recognition of continuous gestures International Conference on Image Processing vol. 1 2007 I365 I368
23. L.R. Rabiner A tutorial on hidden Markov models and selected applications in speech recognition Proc. IEEE 77 2 1989 257 286
24. R.-H. Liang, and M. Ouhyoung A real-time continuous gesture recognition system for sign language IEEE International Conference Automatic Face and Gesture Recognition 1998 558 563
25. H. Silverman, and D. Morgan The application of dynamic programming to connected speech recognition IEEE ASSP Mag. 7 3 1990 6 25 (Pubitemid 20724374)
26. C. Myers, L.R. Rabiner, and A.E. Rosenberg Performance tradeoffs in dynamic time warping algorithms for isolated word recognition IEEE Trans. Acoust. Speech Signal Process. 28 6 1980 623 635 (Pubitemid 11475385)
27. A. Corradini Dynamic time warping for off-line recognition of a small gesture vocabulary IEEE ICCV Workshop on Recognition Analysis and Tracking of Faces and Gestures in Real-Time Systems 2001 82 89
28. Y. Chen, Q. Wu, and X.J. He Using dynamic programming to match human behavior sequences 10th International Conference on Control, Automation, Robotics and Vision 2008 1498 1503
29. C. Myers, and L.R. Rabiner Connected digit recognition using a level-building DTW algorithm IEEE Trans. Acoust. Speech Signal Process. 29 3 1981 351 363 (Pubitemid 11520517)
30. R. Yang, S. Sarkar, and B. Loeding Enhanced level building algorithm for the movement epenthesis problem in sign language recognition Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 2007 1 8
31. R. Yang, S. Sarkar, and B. Loeding Handling movement epenthesis and hand segmentation ambiguities in continuous sign language recognition using nested dynamic programming IEEE Trans. Pattern Anal. Mach. Intell. 32 3 2010 462 477
32. A.F. Bobick, and A.D. Wilson A state-based approach to the representation and recognition of gesture IEEE Trans. Pattern Anal. Mach. Intell. 19 1997 1325 1337 (Pubitemid 127762325)
33. J. Alon, V. Athitsos, and S. Sclaroff Accurate and efficient gesture spotting via pruning and subgesture reasoning ICCV 2005 HCI Workshop 2005 189 198 (Pubitemid 43741582)
34. R. Oka Spotting method for classification of real world data Comput. J. 41 8 1998 559 565
35. Y. Yacoob, and M.J. Black Parameterized modeling and recognition of activities Comput. Vision Image Understanding 73 2 1999 232 247
36. B. Bauer, and H. Hienz Relevant features for video-based continuous sign language recognition IEEE International Conference on Automatic Face and Gesture Recognition 2000 440 445
37. T. Starner, J. Weaver, and A. Pentland Real-time American sign language recognition using desk and wearable computer based video IEEE Trans. Pattern Anal. Mach. Intell. 20 12 1998 1371 1375 (Pubitemid 128741382)
38. S. Nayak, S. Sarkar, and B. Loeding Automated extraction of signs from continuous sign language sentences using iterated conditional modes Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2009 2583 2590
39. L.F. Costa, R.M. Cesar Jr., Shape Analysis and Classification: Theory and Practice, CRC Press, 2001.
40. S. Belongie, J. Malik, and J. Puzicha Shape matching and object recognition using shape contexts IEEE Trans. Pattern Anal. Mach. Intell. 24 24 2002 509 522 (Pubitemid 34448769)
41. L. Wang, W. Hu, and T. Tan Recent development in human motion analysis Pattern Recognition 36 2003 581 601
42. S. Suzuki, and K. Abe Topological structural analysis of digitized binary images by border following Comput. Vision Graphics Image Process. 30 1985 32 46 (Pubitemid 15490080)
43. J. Pluim, J.B.A. Maintz, and M.A. Viergever Mutual-information-based registration of medical images: a survey IEEE Trans. Med. Imaging 22 8 2003 986 1004
44. P. Thénaz, and M. Unser Optimization of mutual information for multiresolution image registration IEEE Trans. Image Process. 9 12 2000 2083 2099
45. W.C. Stokoe, D. Casterline, and C.C. Croneberg A Dictionary of American Sign Language 1965 Linstok Press Washington, DC