Emotion-sensitive robots-a new paradigm for human-robot interaction

2004 4th IEEE-RAS International Conference on Humanoid Robots

Volumn 1, Issue , 2004, Pages 149-167

  Rani, Pramila ^a   Sarkar, Nilanjan ^a  

^a VANDERBILT UNIVERSITY   (United States)

Author keywords

Emotion detection; Human robot interfaces; Personal and service robotics; Physiological sensing

Indexed keywords

EMOTION DETECTION; HUMAN-ROBOT INTERFACES; PERSONAL AND SERVICE ROBOTICS; PHYSIOLOGICAL SENSING;

ARTIFICIAL INTELLIGENCE; BIOSENSORS; HUMAN COMPUTER INTERACTION; INTERFACES (COMPUTER); MILITARY OPERATIONS; MOBILE ROBOTS; PHYSIOLOGY;

ROBOTICS;

EID: 17144372984     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (64)

1. R. Malone, The Robot Book, Push Pin Press, New York, 1978.
2. R. Picard. Affective Computing, MIT press, 1997.
3. K. R. Scherer, On the nature and junction of emotion: A component process approach, In K. R. Scherer and P. Ekman (Eds.), Approaches to emotion, (Hillsdale, NJ, Erlbaum, 1984), pp. 293-317.
4. C. A. Smith and R. S. Lazarus, Emotion and adaptation, In L. A. Pervin (Ed.), Handbook of personality: Theory and research, (New York, Guilford, 1990), pp. 609-637.
5. Nursebot Project, http://www-2.cs.cmu.edu/~nursebot/
6. P. Rani, N. Sarkar, and C. A. Smith, Affect-Sensitive Human-Robot Cooperation -Theory and Experiments, in IEEE International Conference on Robotics and Automation, (IEEE Press, Taipei, Taiwan, 2003), pp. 2382-2387.
7. rd Annual Meeting, pp. 124-129, 1989
8. B. C. Wortman, E. F. Loftus, and C. Weaver, Psychology, (McGraw-Hill, 5th edition, 1998)
9. B. Reeves and C. Nass. The Media Equation, (Cambridge University press, 1996)
10. A. R. Damasio, Descartes' error, (New York, Grosset/Putnam, 1994)
11. N. Tsapatsoulis, K. Karpouzis, G Stamou, F. Piat, and S. Kollias. A fuzzy system for emotion classification based on the MPEG-4 facial definition parameter set, European Signal Processing Conference, (Tampere, Finland, 2000).
12. D.W. Massaro. Multimodal emotion perception: analogous to speech processes, in Proceedings of ISCA Workshop on Speech and Emotion, (Newcastle, Northern Ireland, 2000), pp. 114-121.
13. P. Rani, N. Sarkar, C. Smith, and L. Kirby, Anxiety Detecting Robotic Systems - Towards Implicit Human-Robot Collaboration, Robotica, 22(1), 85-95 (2004).
14. E. Hudlicka and M.D. McNeese. Assessment of user affective and belief states for inference adaptation: application to an air force pilot task." User Modeling and User Adapted Interaction, 12,1-47 (2002).
15. V.A. Petrushin, Emotion recognition agents in real world, in AAAI Fall Symposium on Socially Intelligent Agents: Human in the Loop, (North Falmouth, Massachusetts, 2000), pp. 136-138.
16. T. Moriyama, H. Saito, and S. Ozawa, Evaluation of the relation between emotional concepts and emotional parameters on speech, IEICE Journal, J82-DII(10), 1710-1720 (1999)
17. W. Ark, D.C. Dryer, and D.J. Lu, The emotion mouse, in Proc. HCI International, Volume 1,(Lawrence Erlbaum Associates, Inc. Mahwah, NJ, USA, 1999) pp. 818-823.
18. R.W. Picard, E. Vyzas, and J. Healy, Toward machine emotional intelligence: analysis of affective psychological states, IEEE Trans. Pattern Analysis and Machine Intelligence, 23(10): 1175-1191 (2001).
19. J. Zhao and G. Kearney, Classifying facial movement by backpropagation neural networks with fuzzy inputs, in Proc. Int. Conf. Neural Information Processing, (MIT Press, Co, USA, 1997), pp. 454-457.
20. W.A. Fellenz et. al, On emotion recognition of faces and of speech using neural networks, fuzzy logic and the ASSESS systems, IEEE-INNS-ENNS Int. Joint Conf. on Neural Networks, (Como, Italy 2000), pp. 24-27.
21. V.A. Petrushin. "Emotion recognition in speech signal: experimental study, development and application." 6th Int. Conf. on Spoken Language processing, (Beijing, China, 2000), pp. 454-457.
22. N. Bianchi-Berthouze and C.L. Lisetti, Modeling multimodal expression of user's affective subjective experience, User Modelling and User-Adapted Interaction, 12, 49-84 (2002)
23. Y. Ishikawa, H. Yokoi, and Y. Kakazu, Adaptive learning interface used physiological signals, IEEE Conf. on Systems, Man and Cybernetics, (Nashville, USA, 2000), pp. 32-37.
24. P. Rani and N. Sarkar, An adaptive neuro-fuzzy technique for emotion recognition, TR: 1-04, Robotics and Autonomous System Lab, Vanderbilt University, 2004.
25. Y. Hayakawa and S. Sugano, Real-time simple measurement of mental strain in machine operation, 1998 Japan-U.S.A. Symposium on Flexible Automation, (Ohtsu, Japan, 1998), pp. 35-42.
26. D. Heckerman. A Tutorial on Learning with Bayesian Networks. In Learning in Graphical Models, M. Jordan, (Ed.), MIT Press, Cambridge, MA, 1999.
27. Y. Qi and R. W. Picard, Context-sensitive Bayesian Classifiers and Application to Mouse Pressure Pattern Classification, International Conference on Pattern Recognition (Vol. 3), (Quebec City, Canada, 2002), pp. 448-451.
28. Y. Qi, C. Reynolds, and R. W. Picard, The Bayes Point Machine for Computer-User Frustration Detection via Pressure Mouse, Proceedings from the Workshop on Perceptive User Interfaces, (Orlando, USA 2001), pp. 1-5.
29. N. Sebe, I. Cohen, A. Garg, and T. S. Huang, Emotion Recognition using a Cauchy Naive Bayes Classifier, International conference on Pattern Recognition (Vol. 1) (Quebec City, Canada, 2002), pp. 17-20
30. G Ball, and J. Breese, Emotion and Personality in a Conversational Agent, in Cassell, J. et al. (eds.), Embodied Conversational Agents. Cambridge, MA: MIT Press, 2000.
31. J. Breese and G Ball, Modeling Emotional State and Personality for Conversational Agents, Technical Report. MSR-TR-98-41. Microsoft Corporation.
32. C. Conati. Probabilistic Assessment of User's Emotions in Educational Games, in Journal of Applied Artificial Intelligence, special issue on "Merging Cognition and Affect in HCI", 16 (7-8), 2002.
33. C. Conati and X. Zhou. Modeling Students' Emotions from Cognitive Appraisal in Educational Games, in Proceedings of ITS 2002, 6th International Conference on Intelligent Tutoring Systems, Biarritz, France, 2002.
34. J. Qiang, W. Gray, M. Guhu, and M. Schoelles, Towards an Integrated Cognitive Architecture for Modeling and Recognizing User Affect, AAAI Spring Symposium on Architectures for Modeling emotion: cross-disciplinary foundations, Stanford, March, 2004
35. J.R. Anderson and C. Lebiere (eds.) The atomic components of thought, (Hillsdale, NJ: Lawrence Erlbaum, 1998)
36. N. Oliver, B. Rosario, and A. Pentland. A Bayesian Computer Vision System for Modeling Human Interactions, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22(8), 831-843 (1999)
37. A. Jameson, Numerical Uncertainty Management in User and Student Modeling: An Overview of Systems and Issues, in User Modeling and User Adapted Interaction, 5(4), 193-251 (1995).
38. C. Conati, A. Gertner, K. Vanlehn, Using Bayesian Networks to Manage Uncertainty in Student Modeling, User Modeling and User-Adapted Interaction, 12 (4): 371-417 (2002).
39. C. Muller, B. Großmann-Hutter, A. Jameson, R. Rummer, and F. Wittig, Recognizing Time Pressure and Cognitive Load on the Basis of Speech: An Experimental Study, In Julita Vassileva, Piotr Gmytrasiewicz, and Mathias Bauer (Eds.). UM2001, User Modeling: Proceedings of the Eighth International Conference. Berlin: Springer, 2001.
40. I. Cohen, A. Garg, and T.S. Huang, Emotion recognition using multilevel HMM, NIPS Workshop on Affective Computing, Colorado, 2000.
41. F.E. Gomer, L.D. Silverstein, W.K. Berg, and D.L. Lassiter, Changes in electromyographic activity associated with occupational stress and poor performance in the workplace, Human Factors, 29(2), 131-143 (1987).
42. A.F. Kramer, E.J. Sirevaag, and R. Braune, Psychophysiological assessment of operator workload during simulated flight missions, Human Factors, 29(2), 145-160 (1987).
43. J. Aasman, G. Mulder, and L.J.M. Mulder, Operator effort and the measurement of heart-rate variability, Human Factors, 29(2), 161-170, 1987.
44. K.J. Vicente, D.C. Thornton, and N. Moray, Spectral analysis of sinus arrhythmia: a measure of mental effort, Human Factors, 29(2), 171-182 (1987).
45. K.K. Tripathi, C.R. Mukundan, and T.L. Mathew, Attentional modulation of heart rate variability during PC-based cognitive tasks, Indian J. of Aerospace. Med. 4791 (2003).
46. G.F. Wilson, An analysis of mental workload in pilots during flight using multiple Psychophysiological measures, The International Journal of Aviation Psychology, 12(1), 3-18 (2002).
47. L. Iszo, G. Mischinger, and E. Lang, Validating a new method for ergonomic evaluation of human computer interfaces, Periodica Polytechnica Ser. Soc. Man. Sci. 7(2), 119-134 (1999).
48. A.L. Garlach, F.H. Wilhelm, and W.T. Roth, Embarrassment and Social Phobia: the role of parasympathetic activation, (in press) Behaviour Modification.
49. J. Rottenberg, F.H. Wilhelm, and W.T. Roth. Vagal rebound during resolution of tearful crying among depressed and nondepressed individuals, Psychophysiology, 40(1), 1-6 (2003).
50. Thought Technology Ltd. http://www.thoughttechnology.com/
51. J. Healy and R. W. Picard, Digital Processing of Affective Signals, Technical Reports#444, Vision and Modeling Group, Media Lab, MIT, 1998 (Also appeared in the Proceedings of the ICASSP'98).
52. J. Healy and R. W. Picard, Digital Processing of Affective Signals, Technical Reports#444, Vision and Modeling Group, Media Lab, MIT, 1998 (Also appeared in the Proceedings of the ICASSP'98).
53. E. Vyzas and R. W. Picard, Offline and Online Recognition of Emotion Expression from Physiological Data, in the Proceedings of the Workshop on Emotion-Based Agent Architectures at the Third International Conference on Autonomous Agents, WA, May 1999. Also MIT Media Lab Tech. Report # 488.
54. E. Vyzas and R. W. Picard, Offline and Online Recognition of Emotion Expression from Physiological Data, in the Proceedings of the Workshop on Emotion-Based Agent Architectures at the Third International Conference on Autonomous Agents, WA, May 1999. Also MIT Media Lab Tech. Report # 488.
55. N. H. Frijda. The Emotions, chapter Physiology of Emotion, pages 124-175. Studies in Emotion and Social Interaction, (Cambridge University Press, Cambridge, 1986)
56. M. Helander. Applicability of drivers' electrodermal response to the design of the traffic environment. Journal of Applied Psychology, 63(4):481-488, (1978).
57. nd Ed, (New York, Cambridge University Press, 2000), pp. 533-575.
58. C. A. Smith, Dimensions of appraisal and physiological response in emotion, Journal of Personality and Social Psychology, 56(3), pp. 339-353 (1989).
59. J. I. Lacey, and B. C. Lacey, Verification and extension of the principle of autonomic response-stereotypy, American Journal of Psychology, 71(1), pp. 50-73 (1958).
60. W. L. Libby, B. C. Lacey, and J. I. Lacey, Pupillary and cardiac activity during visual attention, Psychophysiology, 10(3), pp. 270-294 (1973).
61. P. Rani, N. Sarkar, C. A. Smith, L. D. Kirby, Online Stress Detection using Psychophysiological Signal for Implicit Human-Robot Cooperation, Robotica, 20(6), 673-686 (2002).
62. www.mathworks.com
63. R. A. Brooks, Intelligence without representation. Artificial Intelligence. 47, pp. 139-159 (1987).
64. http://www.robotics.com/trilobot/index.html