HMM-based Temporal Difference Learning with State Transition Updating for Tracking Human Communicational Behaviors

Journal of Robotics and Mechatronics

Volumn 15, Issue 3, 2003, Pages 271-277

  Ho, Minh Anh T ^a   Yamada, Yoji ^a   Umetani, Yoji ^a  

^a TOYOTA TECHNOLOGICAL INSTITUTE   (Japan)

Author keywords

hidden Markov model; intended gestures; reinforcement learning; state transition update; visual tracking

Indexed keywords

BEHAVIORAL RESEARCH; REINFORCEMENT LEARNING;

ACTION MODELING; HIDDEN-MARKOV MODELS; INTENDED GESTURES; MODEL-BASED OPC; ORIGINAL SYSTEMS; REINFORCEMENT LEARNINGS; STATE TRANSITION UPDATE; STATE TRANSITIONS; TEMPORAL DIFFERENCE LEARNING; VISUAL TRACKING;

HIDDEN MARKOV MODELS;

EID: 20844444372     PISSN: 09153942     EISSN: 18838049     Source Type: Journal    
DOI: 10.20965/jrm.2003.p0271     Document Type: Article

References (23)

1. A. Pentland, "Looking at People: Sensing for Ubiquitous and Wearable Computing", IEEE Trans, on PAMI, Vol. 22. No. 1.pp. 107-119, January2000.
2. V Pavlovic, R. Sharma, T. S. Huang, "Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review". IEEE Trans. on PAMI. Vol. 19, No. 7, pp. 677-695, Julyl997.
3. J. K. Aggarwal and Q. Cai, "Human Motion Analysis: A Review", Computer Vision and Image Understanding, Vol. 73, No. 3, pp. 428440 (1999).
4. S. Baron-Cohen, "Mindblindness: An essayon Autism and Theory of Mind", Chapter 3: Mindreading: Nature's Choice, The MIT Press (1996).
5. T. Sato et. al., "Active Understanding of Human Intention by a Robot through Monitoring of Human Behavior", Proc. of IROS'94, pp. 405-414 (1994).
6. M. Mistuishi et. al, "DexterityEnhancement for a Tele-micro Co-located Operation Point Manipulators and Understanding of the Operator's Intention", Lecture Notes on Computer Sciences, France. No. 1205, pp. 822-830(1997).
7. J. Yamato, J. Ohya et. al, "Recognizing Human Action in Time-Sequential Images using Hidden Markov Models", Proc. of ICCV'1992, pp. 379-385, IEEE Press, 1992.
8. T. Startner and A. Pentland, "Visual recognition of American Sign Language using Hidden Markov Models". Proc. of FGR'95, pp. 189194 (1995).
9. N. M. Oliver, B. Rosario, A. P. Pentland, "A Bayesian Computer Vision System for Modeling Human Interactions", IEEE Trans. Pattern Analysis and Machine Learning, Vol. 22, No. 8 (2000).
10. Patric Jensfelt and Henrik I. Christensen, "Pose Tracking Using Scanning and Minimalistic Environment Models", IEEE Trans. on Robotics and Automation. Vol. 17, No. 2, pp. 138-147, April 2001.
11. L. R. Rabiner, "A tutorial on Hidden Markov Models and Selected Applications in Speech Recognition", Proc. of the IEEE, Vol. 77, No. 2, pp. 257-285, February 1989.
12. L. R. Rabiner, B. H. Juang, S. E. Levinson, "Recognition of Isolated Digits Using Hidden Markov Models With Continuous Mixture Densities", AT&T Technical Journal, Vol. 64, No. 6, pp. 1211-1233 (1985).
13. M. A. T. Ho, Y Yamada, T. Sakai, T. Morizono, Y. Umetani, "Proposal of An Adaptive Vision-based Interactional Intention Inference System in Human/Robot Coexistence," Special Issue on Machine Vision Applications, IEICE Trans. on Information and Systems, Vol.E84-D, No. 12, pp. 1596-1602 (2001).
14. R. D. Rimeyand C. M. Brown, "Selective Attention as Sequential Behavior: Modeling Eye Movements with an Augmented Hidden Markov Model", Proc. DARPA, Image Understanding Workshop, pp. 840-849 (1990).
15. S. Minut and S. Mahadevan, "Reinforcement Learning Model of Selective Visual Attention", Proc. Fifth Int'l Conf. on Autonomous Agents, Montreal (2001).
16. R. S. Sutton and A. G. Barto, Reinforcement Learning: An introduction, The MIT Press (1998).
17. C. Gaskett, D. Wettergreen, and A. Zelinsky, "Q-leaming in continuous state and action spaces", Proc. of the 12th Australian Joint Conference on Arti cial Intelligence, Australia. Lecture Notes in Computer Science, Springer-Verlag.(1999).
18. M. Hauskrecht, "Value function Approximations for Partially Observable Markov Decision Processes", Journal of Arti.cial Intelligence Research, Vol. 13, pp. 33-94 (2000).
19. V Tadic, "On the Convergence of Temporal-Di.erence Learning with Linear Function Approximation". Machine Learning, Vol. 42, pp. 241267 (2001).
20. M. A. T. Ho,.Y Yamada, T. Morizono, Y. Umetani, "Proposal of An Adaptive Vision-based Attentive Tracker for Human Intended Actions", Proc. IEEE Int'l Conf. on Robotics and Automation, Seoul, pp. 1239-1244 (2001).
21. S. Mallat, "A wavelet tour of signal processing", Academic Press. Second Edition (1998).
22. V. Athitsos and S. Scharo., "An Appearance-Based Framework for 3D Hand Shape Classi.cation and Camera Viewpoint Estimation", Proc. Fifth IEEE Int. Conf. on Automatic Face and Gesture Recognition, pp. 45-50 (2002).
23. J. C. Terrillon, M. David and S. Akamatsu, "Automatic Detection of Human Faces in Natural Scene Images by Use of a Skin Color Model and of Invariant Moments", IEEE Proc. on Automatic Face and Gesture Recognition (1998).