Adapting robot behavior for human-robot interaction

IEEE Transactions on Robotics

Volumn 24, Issue 4, 2008, Pages 911-916

  Mitsunaga, Noriaki ^a,b   Smith, Christian ^c   Kanda, Takayuki ^b   Ishiguro, Hiroshi ^b,d   Hagita, Norihiro ^b  

^a KANAZAWA INSTITUTE OF TECHNOLOGY   (Japan)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^c ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^d OSAKA UNIVERSITY   (Japan)

Author keywords

Behavior adaptation; Human robot interactions; Policy gradient reinforcement learning (PGRL); Proxemics

Indexed keywords

FLOW INTERACTIONS; HUMAN COMPUTER INTERACTION; MAN MACHINE SYSTEMS; MECHANISMS; REINFORCEMENT; REINFORCEMENT LEARNING; ROBOTICS;

ADAPTATION MECHANISMS; BEHAVIOR ADAPTATION; HUMAN BEINGS; HUMAN MOVEMENTS; HUMAN-ROBOT INTERACTION; HUMAN-ROBOT INTERACTIONS; HUMANOID ROBOT; INDIVIDUAL PREFERENCES; INTERACTION BEHAVIORS; INTERACTION DISTANCES; PILOT STUDIES; POLICY GRADIENT REINFORCEMENT LEARNING (PGRL); PROXEMICS; RESEARCH WORKS; ROBOT BEHAVIORS;

ROBOTS;

EID: 50649121596     PISSN: 15523098     EISSN: None     Source Type: Journal    
DOI: 10.1109/TRO.2008.926867     Document Type: Article

References (17)

1. E. T. Hall, The Hidden Dimension. New York: DoubleDay, 1966.
2. S. Duncan, Jr. and D.W. Fiske, Face-to-Face Interaction: Research, Methods, and Theory. Hillsdale, NJ: Lawrence Erlbaum, 1977.
3. E. Sundstrom and I. Altman, "Interpersonal relationships and personal space: Research review and theoretical model," Human Ecol., vol. 4, no. 1, pp. 47-67, 1976.
4. B. Reeves and C. Nass, The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Cambridge, U.K.: Cambridge Univ. Press, 1996.
5. T. Inamura, M. Inaba, and H. Inoue, "Acquisition of probabilistic behavior decision model based on the interactive teaching method," in Proc. 1999 Int. Conf. Adv. Robot., pp. 523-528.
6. C. Isbell, C. R. Shelton, M. Kearns, S. Singh, and P. Stone, "A social reinforcement learning agent," in Proc. 5th Int. Conf. Auton. Agents J. P. Müller, E. Andre, S. Sen, and C. Frasson, Eds. Montreal, QC, Canada: ACM Press, 2001, pp. 377-384.
7. K. Nakashima and H. Sato, "Personal distance against mobile robot," Jpn. J. Ergonom., vol. 35, no. 2, pp. 87-95, 1999.
8. T. Tasaki, S. Matsumoto, K. Komatani, T. Ogata, and H. G. Okuno, "Dynamic communication of humanoid robot with multiple people based on interaction distance," in Proc. Int. Workshop Robot Human Interact (Ro-Man 2004), pp. 81-86.
9. Y. Nakauchi and R. Simmons, "A social robot that stands in line," Auton. Robots, vol. 12, no. 3, pp. 313-324, 2002.
10. T. Kanda, H. Ishiguro, M. Imai, and T. Ono, "Body movement analysis of human-robot interactions," in Proc. Int. Joint Conf. Artif. Intell. (IJCAI 2003), pp. 177-182.
11. C. Watkins and P. Dayan, "Q-learning," Mach. Learn., vol. 8, pp. 279-292, 1992.
12. N. Kohl and P. Stone, "Machine learning for fast quadrupedal locomotion," in Proc. 19th Nat. Conf. Artif. Intell., 2004, pp. 611-616.
13. R. S. Sutton, D. McAllester, S. Singh, and Y. Mansour, "Policy gradient methods for reinforcement learning with function approximation," in Advances in Neural Information Processing Systems, vol. 12, Cambridge, MA: MIT Press, 2000, pp. 1057-1063.
14. J. Baxter and P. L. Bartlett, "Infinite-horizon policy-gradient estimation," J. Artif. Intell. Res., vol. 15, pp. 319-350, 2001.
15. N. Kohl and P. Stone, "Policy gradient reinforcement learning for fast quadrupedal locomotion," in Proc. IEEE Int. Conf. Robot. Autom., 2004, vol. 3, pp. 2619-2624.
16. T. Kanda, H. Ishiguro, T. Ono, M. Imai, and R. Nakatsu, "Development and evaluation of an interactive humanoid robot "Robovie"," in Proc. IEEE Int. Conf. Robot. Autom., 2002, pp. 1848-1855.
17. L. Tickle-Degnen and R. Rosenthal, "The nature of rapport and its nonverbal correlates," Psychol. Inquiry, vol. 1, no. 4, pp. 285-293, 1990.