Interaction between human and robot: An effect-inspired approach

Interaction Studies

Volumn 9, Issue 2, 2008, Pages 230-257

  Agrawal, Pramila ^a   Liu, Changchun ^b   Sarkar, Nilanjan ^b  

^a Metis Design Incorporation ^*  (United States)

^b VANDERBILT UNIVERSITY   (United States)

Author keywords

Affective computing; Anxiety; Closed loop interaction; Human robot interaction; Implicit communication; Physiological sensing

Indexed keywords

EID: 49849097306     PISSN: 15720373     EISSN: 15720381     Source Type: Journal    
DOI: 10.1075/is.9.2.05agr     Document Type: Article

References (43)

1. Backs, R. W., Lenneman, J. K., Wetzel, J. M., & Green, P. (2003). Cardiac measures of driver workload during simulated driving with and without visual occlusion. Human Factors, 45(4), 525-538.
2. Bartlett, M. S., Littlewort, G., Fasel, I., & Movellan, J. R. (2003). Real time face detection and expression recognition: Development and application to human-computer interaction, Conference on Computer Vision and Pattern Recognition Workshop (Vol. 5). Wisconsin, USA.
3. Bradley, M. M. (2000). Emotion and motivation. Handbook of Psychophysiology. In J. T. Cacioppo, L. G. Tassinary & Gary G. Berntson (Eds.), Handbook of Psychophysiology (pp. 602-642). New York: Cambridge University Press.
4. Breazeal, C., & Aryananda, L. (2002). Recognition of affective communicative intent in robot-directed speech. Autonomous Robots, 12(1), 83-104.
5. Breiman, L., Friedman, J., Stone, C. J., & Olshen, R. A. (1984). Classification and Regression Trees. Belmont, CA: Wadsworth International Group.
6. Brown, R. M., Hall, L. R., Holtzer, R., Brown, S. L., & Brown, N. L. (1997). Gender and video game performance. Sex Roles, 36(11-12), 793-812.
7. Conati, C. (2002). Probabilistic assessment of user's emotions in educational games. Applied Artificial Intelligence, 16(7-8), 555-575.
8. Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W, & Taylor, J. G. (2001). Emotion recognition in human-computer interaction. leee Signal Processing Magazine, 18(1), 32-80.
9. Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003). A survey of socially interactive robots. Robotics and Autonomous Systems, 42(3-4), 143-166.
10. Graesser, A., C., Wiemer-Hastings, K., Wiemer-Hastings, P., & Kreuz, R. (1999). AutoTutor: A simulation of a human tutor. Journal of Cognitive Systems Research, 35-51.
11. Hanajima, N., Ohta, Y., Hikita, H., & Yamashita, M. (2005). Investigation of impressions on approach motion of a mobile robot based on psychophysiological analysis, IEEE International Workshop on Robot and Human Interactive Communication (pp. 79-84). Nashville, USA.
12. Haritaoglu, I., Cozzi, A., Koons, D., Flickner, M., Yacoob, Y., Zotkin, D., & Duriswami, R. (2001). Attentive toys, International Conference on Multimedia and Expo (Vol. 22-25, pp. 917-920). Tokyo, Japan.
13. Hirata, K. (1990). The concept of computer anxiety and measurement of it. Bulletin of Aichi University of Education, 39, 203-212.
14. Hoffman G., & Breazeal C. (2004). Robots that Work in Collaboration with People, AAAI Fall Symposium on the Intersection of Cognitive Science and Robotics: From Interfaces to Intelligence. Washington DC.
15. Iszo, L., Mischinger, G., & Lang. E. (1999). Validating a new method for ergonomic evaluation of human computer interfaces. Periodica Polytechnica Ser Soc. Man. Sci., 7(2), 119-134.
16. Kanda, T., Ishiguro, H., Ono, T., Imai, M., & Nakatsu, R. (2002). Development and evaluation of an interactive humanoid robot "Robovie", IEEE International Conference on Robotics and Automation (pp. 1848-1855), Washington, D.C., USA.
17. Kapoor, A., Mota, S., & Picard, R. (2001). Towards a Learning Companion that Recognizes Affect, Proceedings of Emotional and Intelligence II: The Tangled Knot of Social Cognition, AAAI Fall Symposium (pp. 67-72), North Falmouth, MA, USA.
18. Kapur, A., Kapur, A., Naznin, V., George, T., & Peter, D. (2005). Gesture-based affective computing on motion capture data, International Conference on Affective Computing and Intelligent Interaction (ACII) (pp. 1-7). Beijing, China.
19. Kleinsmith, A., Fushimi, T., & Bianchi-Berthouze, N. (2005). An incremental and interactive affective posture recognition system, UM 2005 Workshop: Adapting the Interaction Style to Affective Factors. Edinburgh, UK.
20. Kleinsmith, A., Ravindra De Silva, P., & Bianchi-Berthouze, N. (2005). Recognizing emotion from postures: cross-cultural differences in user modeling, Proc. 10th Interaction Conference on User Modeling (pp. 50-59). Edinburgh, Scotland, UK.
21. Kokol, P., Mernik, M., Zavržnik, J., Kancler, K., & Malčic, I. (1994). Decision trees based on automatic learning and their use in cardiology. Journal of Medical Systems, 9(4), 201-206.
22. Kramer, A. F., Sirevaag, F. J., & Braune, R. (1987). A Psychophysiological Assessment of Operator Workload during Simulated Flight Missions. Human Factors, 29(2), 145-160.
23. Kulic, D., & Croft, E. (2003). Estimating Intent for Human-Robot Interaction. Proceedings of International Conference on Advanced Robotics, (pp. 810-815), Coimbra, Portugal.
24. Lacey, J. I., & Lacey, B. C. (1958). Verification and extension of the principle of autonomic response-stereotypy. The American Journal of Psychology, 71(1), 50-73.
25. Lee, C. M., & Narayanan, S. S. (2005). Toward detecting emotions in spoken dialogs. IEEE Transactions on Speech and Audio Processing, 13(2), 293-303.
26. Leon, E., Clarke, G., Callaghan, V., & Sepulveda, E (2007). A user-independent real-time emotion recognition system for software agents in domestic environments. Engineering Applications of Artificial Intelligence, 20(3), 337-345.
27. Liu, C., Rani, P., & Sarkar, N. (2005). Comparison of Machine Learning Techniques for Affect Detection in Human Robot Interaction, IEEE/RSJ International Conference on Intelligent Robots and Systems, (pp. 2662-2667) Alberta, Canada.
28. Mehrabian A., & Friar, J. T. (1969). Encoding of attitude by a seated communicator via postures and position cues. Journal of Consulting and Clinical Psychology, 33, 330-336.
29. Nasoz, E, Ozyer, O., Lisetti, C. L., & Finkelstein, N. (2002). Multimodal Affective Driver Interfaces for Future Cars, Proceedings of the tenth ACM international conference on Multimedia, (pp. 319-322). France.
30. Pantic, M., & Rothkrantz, L. J. M. (2000). Automatic analysis of facial expressions: The state of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12), 1424-1445.
31. Pecchinenda, A., & Smith, C. A. (1996). The affective significance of skin conductance activity during a difficult problem-solving task. Cognition and Emotion, 10(5), 481-504.
32. Picard, R. W. (1997). Affective Computing. Cambridge: The MIT Press.
33. Picard, R. W., Vyzas, E., & Healey, J. (2001). Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(10), 1175-1191.
34. Prinzel, L. J., Freeman, F. G., Scerbo, M. W., Mikulka, P. J., & Pope, A. T. (2003). Effects of a psychophysiological system for adaptive automation on performance, workload, and the event-related potential P300 component. Human Factors, 45(4), 601-613.
35. Rani, P. (2005). Psychophysiology based Affective Communication for Implicit human-Robot Interaction, Doctoral Dissertation, Vanderbilt University.
36. Rani, P., Liu, C. C., Sarkar, N., & Vanman, E. (2006). An empirical study of machine learning techniques for affect recognition in human-robot interaction. Pattern Analysis and Applications, 9(1), 58-69.
37. Rani, P., Sarkar, N., Smith, C. A., & Kirby, L. D. (2004). Anxiety detecting robotic system - towards implicit human-robot collaboration. Robotica, 22, 85-95.
38. Reeves, B., & Nass, C. I. (1996). The media equation: how people treat computers, televisions, and new media as real people and places. New York: Cambridge University Press.
39. Rohrmann, S., Hennig, J., & Netter, P. (1999). Changing psychobiological stress reactions by manipulating cognitive processes. International Journal of Psychophysiology, 33(2), 149-161.
40. Sweetser, P., & Wyeth, P. (2005). GameFlow: a model for evaluating player enjoyment in games. ACM Computers in Entertainment, 3(3), 1-24.
41. Vicente, K. J., Thornton, D. C., & Moray, N. (1987). Spectral-Analysis of Sinus Arrhythmia - a Measure of Mental Effort. Human Factors, 29(2), 171-182.
42. Wiberg, C. (2005). Affective computing vs. usability? Insights of using traditional usability evaluation methods, Computer Human Interaction (CHI) Workshop on Innovative Approaches to Evaluating Affective Interfaces, Portland, Oregon, USA.
43. Wilson, G. F. (2002). An analysis of mental workload in pilots during flight using multiple Psychophysiological measures. The International Journal of Aviation Psychology, 12(1), 3-18.