Hand gesture recognition based on dynamic Bayesian network framework

Pattern Recognition

Volumn 43, Issue 9, 2010, Pages 3059-3072

  Suk, Heung Il ^a   Sin, Bong Kee ^b   Lee, Seong Whan ^a  

^a Korea University   (South Korea)

^b Pukyong National University   (South Korea)

Author keywords

Continuous gesture spotting; Coupled hidden Markov model; Dynamic Bayesian network; Hand gestures recognition

Indexed keywords

BAYESIAN NETWORKS; HIDDEN MARKOV MODELS; MARKOV PROCESSES; PALMPRINT RECOGNITION; VIDEO STREAMING;

COUPLED HIDDEN MARKOV MODELS; CROSS VALIDATION; DECODING ALGORITHM; DYNAMIC BAYESIAN NETWORKS; GESTURE SPOTTING; HAND GESTURE; HAND-GESTURE RECOGNITION; SIGN LANGUAGE RECOGNITION;

GESTURE RECOGNITION;

EID: 78049504839     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2010.03.016     Document Type: Article

References (39)

1. G. Johansson, Visual perception of biological motion and a model for its analysis, Perception and Psychophysics 14 (1973) 201-211.
2. J. Aggarwal, Q. Cai, Human motion analysis-a review, Computer Vision and Image Understanding 73 (3) (1999) 428-440.
3. V. Pavlovic, R. Sharma, T. Huang, Visual interpretation of hand gestures for human-computer interaction: a review, IEEE Transactions on Pattern Analysis and Machine Intelligence 19 (7) (1997) 677-695. (Pubitemid 127762261)
4. M. Brand, N. Oliver, A. Pentland, Coupled hidden Markov models for complex action recognition, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, June 1997, pp. 994-999.
5. V. Pavlovic, Dynamic Bayesian networks for information fusion with applications to human-computer interfaces, Ph. D. Dissertation, University of Illinois at Urbana-Champaign, 1999.
6. A. Wilson, Adaptive models for the recognition of human gestures, Ph. D. Dissertation, Massachusetts Institute of Technology, 2000.
7. M. Yang, N. Ahuja, Recognizing hand gestures using motion trajectories, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Fort Collins, USA, vol. 1, June 1999, pp. 23-25.
8. B. Miners, O. Basir, M. Kernel, Understanding hand gestures using approximate graph matching, IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 35 (2) (2005) 239-248. (Pubitemid 40324806)
9. T.-P. Tian, S. Sclaroff, Handsignals recognition from video using 3D motion capture data, in: Proceedings of IEEE Workshop on Motion and Video Computing, vol. 2, 2005, pp. 189-194.
10. A. Just, S. Marcel, A comparative study of two state-of-the-art sequence processing techniques for hand gesture recognition, Computer Vision and Image Understanding 113 (2009) 532-543.
11. H.-K. Lee, J.-H. Kim, An HMM-based threshold model approach for gesture recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence 21 (10) (1999) 961-973.
12. C. Voglar, D. Metaxas, A framework for recognizing the simultaneous aspects of American sign language, Computer Vision and Image Understanding 81 (3) (2001) 358-384. (Pubitemid 32415981)
13. R. León, Continuous activity recognition with missing data, in: Proceedings of IEEE International Conference on Pattern Recognition, Quebec, Canada, vol. 1, August 2002, pp. 439-446.
14. M. Bhuyan, D. Ghosh, P. Bora, Continuous hand gesture segmentation and coarticulation detection, Lecture Notes in Computer Science: Computer Vision, Graphics and Image Processing 4338(2006), pp. 564-575.
15. J. Yamato, J. Ohya, K. Ishii, Recognizing human action in time-sequential images using hidden Markov Model, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Urbana-Champaign, USA, June 1992, pp. 379-385.
16. H.-I. Suk, B.-K. Sin, HMM-based gait recognition with human profiles, in: Proceedings of Joint IAPR International Workshops SSPR2006 and SPR2006, Hong Kong, China, August 2006, pp. 596-603. (Pubitemid 44543151)
17. A. Kale, A. Rajagopalan, A. Sundaresan, N. Cuntoor, A. RoyChowdhury, V. Krueger, R. Chellappa, Identification of humans using gait, IEEE Transactions on Image Processing 13 (9) (2004) 1163-1173.
18. Y. Du, F. Chen, W. Xu, Y. Li, Recognizing interaction activities using dynamic Bayesian network, in: Proceedings of IEEE International Conference on Pattern Recognition, Hong Kong, China, vol. 1, August 2006, pp. 618-621.
19. S.-H. Park, J. Aggarwal, A hierarchical Bayesian network for event recognition of human actions and interactions, ACM Journal of Multimedia Systems 10 (2) (2004) 164-179.
20. H. Avilés-Arriaga, L. Sucar, C. Mendoza, Visual recognition of similar gestures, in: Proceedings of IEEE International Conference on Pattern Recognition, vol. 1, Hong Kong, China, August 2006, pp. 1100-1103. (Pubitemid 46532091)
21. A. Nefina, L. Liang, X. Pi, X. Liu, K. Murphy, Dynamic Bayesian networks for audio-visual speech recognition, Journal of Applied Signal Processing 11 (1) (2002) 1-15.
22. Q. Shi, L. Wang, L. Cheng, A. Smola, Discriminative human action segmentation and recognition using semi-Markov model, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, USA, June 2008, pp. 1-8.
23. H.-D. Yang, S. Sclaroff, S.-W. Lee, Sign language spotting with a threshold model based on conditional random fields, IEEE Transactions on Pattern Analysis and Machine Intelligence 31 (7) (2009) 1264-1277.
24. H.-I. Suk, B.-K. Sin, S.-W. Lee, Robust modeling and recognition of hand gestures with dynamic Bayesian network, in: Proceedings of 19th IAPR/IEEE International Conference on Pattern Recognition, Tampa, USA, December 2008, pp. 1-4.
25. H.-I. Suk, B.-K. Sin, S.-W. Lee, Recognizing hand gestures using dynamic Bayesian network, in: Proceedings of 8th IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam, The Netherlands, September 2008, pp. 1-4.
26. P. Kakumanu, S. Makrogiannis, N. Bourbakis, A survey on pixel-based skin color detection techniques, Pattern Recognition 40 (3) (2007) 1106-1122.
27. P. Viola, M. Jones, Robust real-time face detection, International Journal of Computer Vision 57 (2) (2004) 137-154.
28. G. Bradski, Computer vision face tracking for use in a perceptual user interface, Intel Technology Journal 2 (1998) 1-15.
29. A. Argyros, M. Lourakis, Real-time tracking of multiple skin-colored objects with a possibly moving camera, in: Proceedings of European Conference on Computer Vision, Prague, Czech Republic, vol. 3, May 2004, pp. 368-379.
30. S. Beauchemin, J. Barron, The computation of optical flow, ACM Computing Survey 27 (3) (1995) 433-466.
31. L. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, Proceedings of the IEEE 77 (1989) 257-285.
32. K. Murphy, Dynamic Bayesian network: representation, inference and learning, Ph. D. Dissertation, University of California, Berkeley, 2002.
33. F. Jensen, Bayesian networks and decision graphs, Springer, 2001 (Chapter 1, pp. 3-34).
34. A. Dempster, N. Laird, D. Rubin, Maximum likelihood from incomplete data via the EM algorithm, Journal of the Royal Statistical Society 39 (1) (1977) 1-38.
35. C. Lee, L. Rabiner, A frame-synchronous network search algorithm for connected word recognition, IEEE Transactions on Acoustics, Speech, and Signal Processing 37 (11) (1989) 1649-1658. (Pubitemid 20652954)
36. H. Ney, S. Ortmanns, Progress in dynamic programming search for LVCSR, Proceedings of the IEEE 88 (8) (2000) 1224-1240.
37. .
38. .
39. C. Huang, A. Darwiche, Inference in belief networks: a procedural guide, International Journal of Approximate Reasoning 15 (3) (1994) 225-263.