Psychological responses to simulated displays of mismatched emotional expressions

Interacting with Computers

Volumn 20, Issue 2, 2008, Pages 225-239

  Creed, Chris ^a   Beale, Russell ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

Affective computing; Characters; Embodied agents; Emotion; HCI; Virtual humans

Indexed keywords

ANIMATION; CHARACTER RECOGNITION; SOFTWARE AGENTS; USER INTERFACES;

AFFECTIVE COMPUTING; AUDIO DIMENSIONS; VIRTUAL HUMANS;

PSYCHOLOGY COMPUTING;

EID: 39149085699     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intcom.2007.11.004     Document Type: Article

References (56)

1. Aronson E. Back to the future: retrospective review of Leon Festinger's "A Theory of Cognitive Dissonance". The American Journal of Psychology 110 1 (1997) 127-137
2. Baron R.A. Interviewer's mood and reaction to job applicants. Journal of Applied Social Psychology 17 (1987) 911-926
3. Bartneck C. How convincing is Mr. Data's smile: affective expressions of machines. User Modeling and User-Adapted Interaction 11 4 (2001) 279-295
4. Beskow J., and Mcglashan S. Olga - a conversational agent with gestures. In: André E., Lester J.C., Rist T., and Takeuchi A. (Eds). Proceedings of the IJCAI'97 workshop on Animated Interface Agents - Making them intelligent (1997), Morgan-Kaufmann Publishers, San Francisco, Nagoya, Japan
5. Bickmore, T. 2003. Relational Agents: Effecting Change through Human-Computer Relationships. Ph.D. Thesis, Department of Media Arts and Sciences, Massachusetts Institute of Technology.
6. Bickmore T., and Cassell J. Relational agents: a model and implementation of building user trust. In: Beaudouin-Lafon M., and Jacob R. (Eds). Proceedings of the ACM CHI 2001 Human Factors in Computing Systems Conference (2001), ACM Press, Seattle, Washington, United States 396-403
7. Bickmore T., and Picard R. Establishing and maintaining long-term human-computer relationships. ACM Transactions on Computer-Human Interaction (TOCHI) 12 2 (2005) 293-327
8. Bos P., Reidsma H., Ruttkay Z., and Nijholot A. Interacting with a virtual conductor. 5th International Conference on Entertainment Computing, LNCS 4161 (2006), Springer-Verlag
9. Bower G.H. Mood and memory. American Psychologist 36 2 (1981) 129-148
10. Brave S., Nass C., and Hutchinson K. Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent. International Journal of Human-Computer Studies 62 2 (2005) 161-178
11. British HCI Group 2007. Usability News Website. http://www.usabilitynews.com/ (24th August 2007).
12. Burleson, W. & Picard, R. 2004. Affective agents: sustaining motivation to learn through failure and a state of stuck. Social and Emotional intelligence in learning environments workshop, in conjunction with the 7th International Conference on Intelligent Tutoring Systems, August 31st 2004, http://affect.media.mit.edu/pdfs/04.burleson-picard.pdf (24th August 2007).
13. Cassell, J., Stocky, T., Bickmore, T., Gao, Y., Nakano, Y., Ryokai, K., Tversky, D. & Vilhjalmsson, C.V.H. 2002. Mack: Media lab autonomous conversational kiosk. Paper presented at International Festival for Digital Images (IMAGINA'02), 12th-15th February 2002, http://www.soc.northwestern.edu/justine/publications/imagina02.pdf (24th August 2007).
14. Chen, L. 2000. Joint processing of audio-visual information for the recognition of emotional expressions in human-computer interaction. Ph.D. Thesis, University of Illinois at Urbana-Champaign.
15. Christianson S.A., and Loftus E. Remembering emotional events: the fate of detailed information. Cognition and Emotion 5 (1991) 81-108
16. Creed C. Using computational agents to motivate diet change. In: Ijsselsteijn W., De Kort Y., Midden C., and Van Den Hoven E. (Eds). First international conference on Persuasive Technology for human well-being (2006), Springer-Verlag, Eindhoven University of Technology, the Netherlands 100-103
17. De Gelder B., and Vroomen J. The perception of emotions by ear and by eye. Cognition and Emotion 14 3 (2000) 289-311
18. De Rosis, F., Carolis, B. & De Carofiglio, V. 2004. Shallow and inner forms of emotional intelligence in advisory dialogue simulation. In: Prendinger, H. & Ishizuka, M. (Eds.), Life-life Characters. Tools, Affective Functions and Applications, pp. 271-294.
19. Ekman P. Universals and cultural differences in facial expressions of emotion. In: Cole J. (Ed). Nebraska Symposium on Motivation (1972), University of Nebraska Press, Lincoln 207-283
20. Ekman P. Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life (2004), Henry Holt & Co
21. Ekman P., Davidson R.J., and Friesen W.V. The Duchenne smile: emotional expression and brain physiology. Journal of Personality and Social Psychology 58 2 (1990) 342-353
22. Evans D. Emotion: the science of sentiment (2001), Oxford University Press, New York
23. Fabrigar L.R., and Petty R.E. The role of the affective and cognitive bases of attitudes in susceptibility to affectively and cognitively based persuasion. Personality and Social Psychology Bulletin 25 3 (1999) 363-381
24. Fogg, B. 2003. Prominence-Interpretation Theory: Explaining How People Access Credibility Online. In: CHI'03 extended abstracts on Human factors in computing systems, Florida, USA, pp. 722 - 723
25. Goleman D. Emotional Intelligence: Why it can Matter More Than IQ & Working with Emotional Intelligence (2004), Bloomsbury, London
26. Grolleman J., Van Dijk B., Nijolt A., and Van Emst A. Break the habit! Designing an e-therapy intervention using a virtual coach aid of smoking cessation. In: Ijsselsteijn W., De Kort Y., and Van Den Hoven E. (Eds). Persuasive Technology: First International Conference on Persuasive Technology for Human Well-Being (2006), Springer, Eindhoven, Netherlands
27. Hook K. User-centred design and evaluation of affective interfaces. In: Ruttkay Z., and Pelachaud C. (Eds). From Brows to Trust: Evaluating Embodied Conversational Agents Vol. 7 (2004), Kluwer 127-160
28. Isbister K. Better Game Characters by Design: A Psychological Approach (2006), Morgan Kaufmann
29. Isbister K., and Nass C. Consistency of personality in interactive characters: verbal cues, non-verbal cues, and user characteristics. International Journal of Human-Computer Studies 53 2 (2000) 251-267
30. Isen A.M., Daubman K.A., and Nowicki G.P. Positive affect facilitates creative problem solving. Journal of Personality and Social Psychology 52 6 (1987) 1122-1131
31. Johnson W.L., Rickel J., and Lester J.C. Animated pedagogical agents: face-to-face interaction in interactive learning environments. International Journal of Artificial Intelligence in Education 11 (2000) 47-78
32. Lester J., Converse S., Kahler S., Barlow T., Stone B., and Bhogal R. The persona effect: affective impact of animated pedagogical agents. In: Pemberton S. (Ed). CHI'97: Proceedings of the SIGCHI conference on Human factors in computing systems (1997), ACM Press, New York, Atlanta, Georgia, USA 359-366
33. Lester J.C., Stone B., and Stelling G. Lifelike pedagogical agents for mixed-initiative problem solving in constructivist learning environments. User Modeling and User - Adapted Interaction 9 1-2 (1999) 1-44
34. Maes P. Agents that reduce work and information overload. Communications of the ACM 37 7 (1994) 30-40
35. Maldonado H., Lee J.R., Brave S., Nass C., Nakajima H., Yamada R., Iwamura K., and Morishima Y. We learn better together: enhancing eLearning with emotional characters. In: Koschmann T., Suthers D., and Chan T.W. (Eds). Computer Supported Collaborative eLearning 2005: The Next 10 Years! (2005), Lawrence Erlbaum Associates Mahwah, NJ
36. Marsella, S., Gratch, J. & Rickel, J. 2004. Expressive behaviors for virtual worlds. In: Prendinger, H. Ishizuka, M. (Eds.), Life-Like Characters. Tools, Affective Functions and Applications, pp. 317-360.
37. Massaro D.W., and Egan P.B. Perceiving affect from the voice and the face. Psychonomic Bulletin & Review 3 2 (1996) 215-221
38. Mazzotta, I. & De Rosis, F. 2006. Artifices for persuading to improve eating habits. In: AAAI Spring Symposium on "Argumentation for consumers of health care, http://www.di.uniba.it/intint/people/papers/SS0601MazzottaI.pdf (24th August 2007).
39. Murray I.R., and Arnott J.L. Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. Journal of the Acoustical Society of America 93 2 (1993) 1097-1108
40. Nass, C., Foehr, U. & Somoza, M. 2001. The effects of emotion of voice in synthesized and recorded speech. In: Proceedings of the AAAI Symposium Emotional and Intelligent II: The Tangled Knot of Social Cognition. North Falmouth, MA.
41. Nass C., and Lee K.M. Does computer-synthesized speech manifest personality? Experimental tests of recognition, similarity-attraction, and consistency-attraction. Journal of Experimental Psychology: Applied 7 3 (2001) 171-181
42. Pelachaud C., Carofiglio V., De Carolis B., De Rosis F., and Poggi I. Embodied contextual agent in information delivering application. Proceedings of the first international joint conference on Autonomous agents and multiagent systems (2002), ACM Press, Bologna, Italy 758-765
43. Picard R. Affective Computing (1997), The MIT Press, Massachusetts, USA
44. Prendinger, H., Saeyor, S. & Ishizuka, M. 2004. MPML and SCREAM: Scripting the bodies and minds of life-like characters. In: Prendinger, H. & Ishizuka, M. (Eds.), Life-Like Characters. Tools, Affective Functions and Applications, pp. 213-242.
45. Rickel J., and Johnson W.L. Animated agents for procedural training in virtual reality: perception, cognition, and motor control. Applied Artificial Intelligence 13 (1999) 343-382
46. Rubio S., Diaz E., Martin J., and Puente J.M. Evaluation of subjective mental workload: a comparison of SWAT, NASA-TLX, and workload profile methods. Applied Psychology 53 1 (2004) 61-86
47. Ruttkay Z., Reidsma H., and Nijholot A. Human computing, virtual humans and artificial imperfections. Proceedings of the 8th international conference on Multimodal interfaces (2006), ACM Press, Alberta, Canada
48. Sebe, N., Cohen, I., Gevers, T. & Huang, T.S. 2006. Emotion Recognition Based on Joint Visual and Audio Cues. In: Proceedings of 18th International Conference on Pattern Recognition (ICPR'06), pp. 1136-1139.
49. Second Life, 2007. Second Life: Basic Overview. http://secondlife.com/whatis/ (24th August 2007).
50. Song, M., Bu, J., Chen, C., Li, N. 2004. Audio-visual based emotion recognition - a new approach. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1020-1025.
51. Stroop J.R. Studies of interference in serial verbal reactions. Journal of Experimental Psychology 18 (1935) 643-662
52. There.Com, 2007. There.com: Basic Overview. http://www.there.com/whatIsThere.html (24th August 2007).
53. Thorisson K.R. A mind model for multimodal communicative creatures and humanoids. Applied Artificial Intelligence 13 4-5 (1999) 449-486
54. Van Mulken S., Andrè E., and Muller J. The persona effect: how substantial is it?. In: Johnson H., Laurence N., and Roast C. (Eds). HCI'98: Proceedings of HCI on People and Computers XIII (1998), Springer-Verlag, London, Sheffield, UK 53-66
55. Yee N. The psychology of MMORPGs: emotional investment, motivations, relationship formation, and problematic usage. In: Scroeder R., and Axelsson A. (Eds). Social Life of Avatars II (2006), Springer-Verlag, London 187-207
56. Yee, N., Bailenson, J., Urbanek, M., Chang, F. & Merget, D. 2006. The Unbearable Likeness of Being Digital: The Persistence of Nonverbal Social Norms in Online Virtual Environments. The Journal of CyberPsychology and Behavior, http://www.nickyee.com/daedalus/archives/001539.php (24th August 2007).