Gesture spotting and recognition for human-robot interaction

IEEE Transactions on Robotics

Volumn 23, Issue 2, 2007, Pages 256-270

  Yang, Hee Deok ^a   Park, A Yeon ^a,b   Lee, Seong Whan ^a  

^a Korea University   (South Korea)

^b LS Industrial Systems Co Ltd   (South Korea)

Author keywords

Gesture spotting; Hidden Markov model (HMM); Human robot interaction (HRI); Mobile robot; Transition gesture model; Whole body gesture recognition

Indexed keywords

GESTURE RECOGNITION; HIDDEN MARKOV MODELS; MAN MACHINE SYSTEMS; MOBILE ROBOTS; VECTOR QUANTIZATION;

GESTURE SPOTTING; HUMAN-ROBOT INTERACTION; KEY GESTURES; MOTION SEQUENCE;

HUMAN COMPUTER INTERACTION;

EID: 34247223015     PISSN: 15523098     EISSN: None     Source Type: Journal    
DOI: 10.1109/TRO.2006.889491     Document Type: Article

References (32)

1. J. K. Aggarwal and Q. Cai, "Human motion analysis: A review," Comput. Vis. Image Understanding, vol. 73, no. 3, pp. 428-440, 1999.
2. J. Barbic, N. S. Pollard, J. K. Hodgins, C. Faloutsos, J. Y. Pan, and A. Safonova, "Segmenting motion capture data into distinct behaviors," in Proc. Int. Conf. Graphics Interface, 2004, pp. 17-19.
3. A. F. Bobick and J. W. Davis, "The recognition of human movement using temporal templates," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 3, pp. 257-267, Mar. 2001.
4. A. Bruce and G. Gordon, "Better motion prediction for people tracking," in Proc. Int. Conf. Robot. Autom., New Orleans, LA, Apr. 2004, pp. 1418-1423.
5. J. A. De Preez, "Efficient training of high-order hidden Markov models using first-order representations," Comput. Speech Lang., vol. 12, pp. 23-39, 1998.
6. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc., vol. 39, no. 1, pp. 1-38, 1977.
7. T. Fong, I. Nourbakhsh, and K. Dautenhahn, "A survey of socially interactive robots," Robot. Auton. Syst., vol. 42, pp. 143-166, 2003.
8. B.-W. Hwang, S. Kim, and S.-W. Lee, "2D and 3D full-body gesture database for analyzing daily human gestures," in Advances in Intelligent Computing. New York: Springer, 2005, vol. 3644, Lecture Notes in Computer Science, pp. 611-620.
9. K. Kahol, "Gesture segmentation in complex motion sequences," Master's thesis, Arizona State Univ., Tempe, AZ, 2003.
10. K. Kahol, P. Tripath, and S. Panchanthan, "Automated gesture segmentation from dance sequences," in Proc. 6th IEEE Int. Conf. Autom. Face Gesture Recog., Seoul, Korea, 2004, pp. 883-888.
11. K. Kahol, P. Tripath, and S. Panchanthan, "Documenting motion sequences: Development of a personalized annotation system," IEEE Multimedia Mag., vol. 13, no., pp. 35-47, 2006.
12. D. Kortenkamp, E. Huber, and R. P. Bonasso, "Recognizing and interpreting gestures on a mobile robot," in Proc. Amer. Conf. Artif. Intell., Portland, OR, Aug. 1996, pp. 915-921.
13. H.-K. Lee and J. H. Kim, "An HMM-based threshold model approach for gesture recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 10, pp. 961-973, Oct. 1999.
14. Y. Nakauchi and R. Simmons, "A social robot that stands in line," Auton. Robots, vol. 12, no. 3, pp. 313-324, 2002.
15. K. Nickel and R. Stiefelhagen, "Real-time person tracking and pointing gesture recognition for human-robot interaction," in Computer Vision in Human-Computer Interaction. New York: Springer-Verlag, 2004, vol. 3058, Lecture Notes in Computer Science, pp. 28-38.
16. V. Pavlovic, R. Sharma, and T. Huang, "Visual interpretation of hand gestures for human-computer interaction: A review," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 677-695, Jul. 1997.
17. D. Perzanowski, D. Brock, S. Blisard, W. Adams, M. Bugajska, A. Schultz, G. Trafton, and M. Skubic, "Finding the FOO: A pilot study for a multimodal interface," in Proc. IEEE Syst., Man, Cybern. Conf., Washington, DC, Oct. 2003, pp. 3218-3223.
18. J. Pineau, M. Montemerlo, M. Pollack, N. Roy, and S. Thrun, "Towards robotic assistants in nursing homes: Challenges and results," Robot. Auton. Syst., vol. 42, pp. 271-281, 2003.
19. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
20. B. Rime and L. Schiaratura, Fundamentals of Nonverbal Behavior. Cambridge, U.K.: Cambridge Univ. Press, 1991.
21. T. Starner, J. Weaver, and A. Pentland, "Real-time American Sign Language recognition using desk and wearable computer based video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 12, pp. 1371-1375, Dec. 1998.
22. B. Stenger, V. Ramesh, N. Paragios, F. Coetzee, and J. M. Buhmann, "Topology free hidden Markov models: Application to background modeling," in Proc. Int. Conf. Comput. Vis., Vancouver, BC, Canada, Jul. 2001, pp. 294-301.
23. R. Stiefelhagen, C. Fügen, P. Gieselmann, H. Holzapfel, K. Nickel, and A. Waibel, "Natural human-robot interaction using speech, gaze and gestures," in Proc. Int. Conf. Intell. Robots Syst., Sendai, Japan, 2004, pp. 2422-2427.
24. K. Takahashi, S. Seki,and R. Oka, "Spotting recognition of human gestures from motion images," (in Japanese) Inst. Electron., Inf. Commun. Eng., Japan, Tech. Rep. IE92-134, 1992.
25. S. Thrun, "Toward a framework for human-robot interaction," Human-Computer Interaction, vol. 19, no. 1, pp. 9-24, 2004.
26. T-Rot: Thinking Robot KIST, Center for Intelligent Robotics [Online]. Available: http://www.irobotics.re.kr
27. United Nations and the International Federation of Robotics: World Robotics 2002. New York/Geneva, 2002.
28. T. Varga and H. Bunke, "Generation of synthetic training data for an HMM-based handwriting recognition system," in Proc. 7th Int. Conf. Document Anal. Recog., Edinburgh, U.K., Aug. 2003, pp. 618-622.
29. A. J. Viterbi, "Error bounds for convolution codes and an asymptotically optimum decoding algorithm," IEEE Trans. Inf. Theory, vol. 13, no. 2, pp. 260-269, Feb. 1967.
30. S. Waldherr, R. Romero, and S. Thrun, "A gesture based interface for human-robot interaction," Auton. Robots, vol. 9, no. 2, pp. 151-173, 2000.
31. S. Waldherr, "Gesture recognition on a mobile robot," Master's thesis, Carnegie Mellon Univ., Pittsburgh, PA, 1998.
32. H.-D. Yang, S.-K. Park, and S.-W. Lee, "Reconstruction of 3D human body pose for gait recognition," in Biometrics. New York: Springer-Verlag, 2006, vol. 3832, Lecture Notes in Computer Science, pp. 619-625.