Affective state estimation for human-robot interaction

IEEE Transactions on Robotics

Volumn 23, Issue 5, 2007, Pages 991-1000

  Kulíc, Dana ^a,b   Croft, Elizabeth ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b UNIVERSITY OF TOKYO   (Japan)

Author keywords

Affective state estimation; Human robot interaction; Physiological signals

Indexed keywords

FUZZY INFERENCE; HIDDEN MARKOV MODELS; HUMAN COMPUTER INTERACTION; MANIPULATORS; MOTION COMPENSATION; STATE ESTIMATION;

HUMAN-ROBOT INTERACTION; PHYSIOLOGICAL SIGNALS; ROBOT MOTIONS;

ANTHROPOMORPHIC ROBOTS;

EID: 35348845820     PISSN: 15523098     EISSN: None     Source Type: Journal    
DOI: 10.1109/TRO.2007.904899     Document Type: Conference Paper

References (48)

1. A. Pentland, "Perceptual intelligence," Commun. ACM, vol. 43, no. 3, pp. 35-44, 2000.
2. Y. Matsumoto, J. Heinzmann, and A. Zelinsky, "The essential components of human-friendly robot systems," in Proc. Int. Conf. Field Service Robot., 1999, pp. 43-51.
3. V. J. Traver, A. P. del Pobil, and M. Perez-Francisco, "Making service robots human-safe," in Proc. IEEE RSJ Int. Conf. Intell. Robots Syst., 2000, vol. 1, pp. 696-701.
4. J. M. Weiner, R. J. Hanley, R. Clark, and J. F. Van Nostrand, "Measuring the activities of daily living: Comparisons across national surveys," J. Gerontology: Social Sci., vol. 45, no. 6, pp. 229-237, 1990.
5. A. J. Bearveldt, "Cooperation between man and robot: Interface and safety," in Proc. IEEE Int. Workshop Robot Human Commun., 1993, pp. 183-187.
6. H. Arai, T. Takubo, Y. Hayashibara, and K. Tanie, "Human - robot cooperative manipulation using a virtual nonholonomic constraint," in Proc. IEEE Int. Conf. Robot. Autom., 2000, pp. 4063-4069.
7. V. Fernandez, C. Balaguer, D. Blanco, and M. A. Salichs, "Active human-mobile manipulator cooperation through intention recognition," in Proc. IEEE Int. Conf. Robot. Autom., 2001, pp. 2668-2673.
8. E. Guglielmelli, P. Dario, C. Laschi, and R. Fontanelli, "Humans and technologies at home: From friendly appliances to robotic interfaces," in Proc. IEEE Int. Workshop Robot Human Commun., 1996, pp. 71-79.
9. K. Kawamura, S. Bagchi, M. Iskarous, and M. Bishay, "Intelligent robotic systems in service of the disabled," IEEE Trans. Rehabil. Eng., vol. 3, no. 1, pp. 14-21, Mar. 1995.
10. R. Picard, Affective Computing. Cambridge, MA: MIT Press, 1997.
11. P. Ekman, W. V. Friesen, and P. Ellsworth, Emotion in the Human Face New York: Pergamon, 1972.
12. I. Essa and A. Pentland, "Coding, analysis, interpretation, and recognition of facial expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 757-763, Jul. 1997.
13. M. Pantic and L. J. M. Rothkrantz, "Automatic analysis of facial expressions: The state of the art," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 12, pp. 1424-1445, Dec. 2000.
14. D. Kulić and E. Croft, "Estimating intent for human-robot interaction," in Proc. IEEE Int. Conf. Adv. Robot., 2003, pp. 810-815.
15. R. Picard, "Toward machine emotional intelligence: Analysis of affective physiological state," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 10, pp. 1175-1191, Oct. 2001.
16. P. Rani, N. Sarkar, C. A. Smith, and L. D. Kirby, "Anxiety detecting robotic system - Towards implicit human-robot collaboration," Robotica, vol. 22, pp. 85-95, 2004.
17. N. Sarkar, "Psychophysiological control architecture for human-robot coordination - Concepts and initial experiments," in Proc. IEEE Int. Conf. Robot. Autom., 2002, vol. 4, pp. 3719-3724.
18. M. M. Bradley and P. J. Lang, "Measuring emotion: Behavior, feeling and physiology," in Cognitive Neuroscience of Emotion, R. D. Lane and L. Nadel, Eds. New York, NY: Oxford University Press, 2000.
19. D. Kulić and E. Croft, "Physiological and subjective responses to articulated robot motion," Robotica, vol. 25, no. 1, pp. 13-27, 2007.
20. D. Kulić and E. Croft, "Pre-collision safety strategies for human-robot interaction," Auton. Robots, vol. 22, no. 2, pp. 149-164, 2007.
21. K. A. Brownley, "Cardiovascular psychophysiology," in Handbook of Psychophysiology, J. T. Cacioppo, L. G. Tassinary, and G. G. Berntson, Eds. Cambridge, U.K.: Cambridge University Press, 2000.
22. M. E. Dawson, "The electrodermal system," in Handbook of Psychophysiology, J. T. Cacioppo, L. G. Tassinary, and G. G. Berntson, Eds. Cambridge, U.K.: Cambridge University Press, 2000.
23. M. M. Bradley, "Emotion and motivation," in Handbook of Psychophysiology, J. T. Cacioppo, L. G. Tassinary, and G. G. Berntson, Eds. Cambridge, U.K.: Cambridge University Press, 2000, pp. 602-642.
24. J. T. Cacioppo and L. G. Tassinary, "Inferring psychological significance from physiological signals," Am. Psychol., vol. 45, no. 1, pp. 16-28, 1990.
25. P. J. Lang, "The emotion probe: Studies of motivation and attention," Amer. Psychol., vol. 50, no. 5, pp. 372-385, 1995.
26. Z. Z. Bien, J. B. Kim, D. J. Kim, J. S. Han, and J. H. Do, "Soft computing based emotion/intention reading for service robot," Lecture Notes Comput. Sci., vol. 2275, pp. 121-128, 2002.
27. P. Rani, J. Sims, R. Brackin, and N. Sarkar, "Online stress detection using phychophysiological signals for implicit human-robot cooperation," Robotica, vol. 20, pp. 673-685, 2002.
28. K. Wada, T. Shibata, T. Saito, and K. Tanie, "Effects of robot-assisted activity for elderly people and nurses at a day service center," Proc. IEEE, vol. 92, no. 11, pp. 1780-1788, 2004.
29. T. Saito, T. Shibata, K. Wada, and H. Tanie, "Examination of change of stress reaction by urinary tests of elderly before and after introduction of mental commit robot to an elderly institution," in Proc. 7th Int. Symp. Artif. Life Robot., 2002, pp. 316-319.
30. T. Kanda, H. Ishiguro, M. Imai, and T. Ono, "Development and evaluation of interactive humanoid robots," in Proc. IEEE, vol. 92, no. 11, Nov. 2004, pp. 1839-1850.
31. S. Nonaka, K. Inoue, T. Arai, and Y. Mae, "Evaluation of human sense of security for coexisting robots using virtual reality," in Proc. IEEE Int. Conf. Robot. Autom., 2004, vol. 3, pp. 2770-2775.
32. K. L. Koay, M. L. Walters, and K. Dautenhahn, "Methodological issues using a comfort level device in human-robot interactions," in Proc. IEEE Int. Workshop Robot Human Interactive Commun., Aug. 2005, pp. 359-364.
33. K. H. Kim, S. W. Bang, and S. R. Kim, "Emotion recognition system using short-term monitoring of physiological signals," Med. Biol. Eng. Comput., vol. 42, pp. 419-427, 2004.
34. C. Liu, P. Rani, and N. Sarkar, "An empirical study of machine learning techniques for affect recognition in human-robot interaction," in Proc. IEEE Conf. Intell. Robots Syst., 2005, pp. 2051-2056.
35. P. Rani, C. Liu, N. Sarkar, and E. Vanman, "An empirical study of machine learning techniques for affect recognition in human-robot interaction," Pattern Anal. Appl., vol. 9, no. 58-69, 2006.
36. O. Villon and C. Lisetti, "A user-modeling approach to build user's psychophysiological maps of emotions using bio-sensors," in Proc. IEEE Int. Workshop Robot Human Interactive Commun., 2006, pp. 269-276.
37. L. R. Rabiner, "A tutorial on hidden Markov models and seecte applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 252-286, Feb. 1989.
38. T. Inamura, I. Toshima, H. Tanie, and Y. Nakamura, "Embodied symbol emergence based on mimesis theory," Int. J. Robot. Res., vol. 23, no. 4-5, pp. 363-377, 2004.
39. J. Scheirer, R. Fernandez, J. Klein, and R. Picard, "Frustrating the user on purpose: A step toward building an affective computer," Interacting Comput., vol. 14, pp. 93-118, 2002.
40. A. Kapoor and R. W. Picard, "Multimodal affect recognition in learning environments," in Proc. ACM Int. Conf. Multimedia, pp. 677-682, 2005.
41. B. Schuller, G. Rigoll, and M. Lang, "Hidden Markov model-based speech emotion recognition," in Proc. Int. Conf. Multimedia Expo., 2003, pp. 401-404.
42. J. J. Lien, T. Kanade, J. F. Cohn, and L. Ching-Chung, "Automated facial expression recognition based on FACS action units," in Proc. IEEE Int. Conf. Autom. Face Gesture Recog., 1998, pp. 390-395.
43. D. Kulić and E. Croft, "Anxiety detection during human-robot interaction," in Proc. IEEE Int. Conf. Intell. Robots Syst., 2005, pp. 389-394.
44. P. Ekman, R. W. Levenson, and W. V. Friesen, "Autonomic nervous system activity distinguishes among emotions," Science, vol. 221, pp. 1208-1210, 1983.
45. O. Khatib, "Real-time obstacle avoidance for manipulators and mobile robots," Int. J. Robot. Res., vol. 5, no. 1, pp. 90-98, 1986.
46. D. Kulić and E. Croft, "Safe planning for human-robot interaction," in Proc. IEEE Int. Conf. Robot. Autom., 2004, vol. 2, pp. 1882-1887.
47. D. Kulić, "Safety for human-robot interaction," Ph.D. dissertation, Dept. Mech. Eng., Univ. British Columbia, Vancouver, BC, Canada, 2005.
48. Thought Technology Ltd. [Online]. Available: www.thoughttechnology.com.