Auditory-induced emotion: A neglected channel for communication in human-computer interaction

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4868 LNCS, Issue , 2008, Pages 63-74

  Tajadura Jiménez, Ana ^a   Västfjäll, Daniel ^a,b  

^a CHALMERS UNIVERSITY OF TECHNOLOGY   (Sweden)

^b UNIVERSITY OF GOTHENBURG   (Sweden)

Author keywords

Auditory induced emotion; Embodiment; Emotional intelligence; Self representation sounds; Sound quality

Indexed keywords

COMPUTERS; FLOW INTERACTIONS; HUMAN ENGINEERING; INFORMATION MANAGEMENT; INTELLIGENT SYSTEMS; KNOWLEDGE MANAGEMENT;

AFFECTIVE STATES; AUDITORY INDUCED-EMOTION; AUDITORY STIMULUS; EMBODIMENT; EMOTIONAL INTELLIGENCE; EMOTIONAL REACTIONS; EMOTIONAL STATES; INDIVIDUAL DIFFERENCES; PHYSICAL PROPERTIES; RESEARCH METHODOLOGIES; SELF-REPRESENTATION SOUNDS; SENSORY MODALITIES; SOUND QUALITY; SPATIAL DIMENSIONS;

HUMAN COMPUTER INTERACTION;

EID: 51849157856     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-85099-1_6     Document Type: Conference Paper

References (76)

1. Lang, P.J., Bradley, M.M., Cuthbert, B.N.: Emotion, Attention, and the Startle reflex. Psychological Review 97, 377-395 (1990)
2. Phelps, E.A., LeDoux, J.E.: Contributions of the Amygdala to Emotion Processing: From Animal Models to Human Behavior. Neuron 48, 175-187 (2005)
3. Reeves, B., Nass, C.: The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Cambridge University Press, New York (1996)
4. Picard, R.W., Daily, S.B.: Evaluating Affective Interactions: Alternatives to Asking What Users Feel. In: CHI Workshop on Evaluating Affective interfaces: Innovative Approaches, Portland (April 2005)
5. Juslin, P., Västfjäll, D.: All Emotions are not Created Equal: Mechanism Underlying Musical Emotions. Behavioral Brain Sciences (in press)
6. Sköld, A., Bergman, P., Västfjäll, D., Tajadura-Jiménez, A., Larsson, P.: Emotional Reactions to Information and Warning Sounds. Acta Acustica (submitted)
7. Västfjäll, D., Kleiner, M.: Emotion in Product Sound Design. In: Proceedings of Journées Design Sonore, Paris, March 20-21 (2002)
8. Västfjäll, D., Tajadura-Jiménez, A., Väljamäe, A., Juslin, P.: Non-Vocal, Non-Musical Determinants of Auditory Induced Emotions (in preparation)
9. Jäncke, L., Vogt, J., Musial, F., Lutz, K., Kalveram, K.T.: Facial EMG Responses to Auditory Stimuli. International Journal of Psychophysiology 22, 85-96 (1996)
10. De Gelder, B., Bertelson, P.: Multisensory Integration, Perception and Ecological Validity. Trends in Cognitive Sciences 7, 460-467 (2003)
11. Levenson, R.W.: Human emotions: A functional view. In: Ekman, P., Davidson, R.J. (eds.) The Nature of Emotion: Fundamental Questions, pp. 123-126. Oxford University Press, New York (1994)
12. Lazarus, R.S.: Emotion and Qdaptation. Oxford University Press, New York (1991)
13. Shiv, B., Fedorikhin, A.: Heart and Mind in Conflict: Interplay of Affect and Cognition in Consumer Decision Making. Journal of Consumer Research 26, 278-282 (1999)
14. Ekman, P., Friesen, W.V., Ancoli, S.: Facial Signs of Emotional Experience. Journal of Personality and Social Psychology 39, 1125-1134 (1980)
15. LeDoux, J.E.: The Emotional Brain: The mysterious Underpinnings of Emotional Life. Simon & Schuster, New York (1996)
16. Levenson, R.W.: Emotion and the Autonomic Nervous System: A Prospectus for Research on Autonomic Specificity. In: Wagner, H. (ed.) Social Psychology: Perspectives of Theory and Clinical Applications, pp. 17-42. Wiley, London (1988)
17. Wundt, W.: Lectures on Human and Animal Psychology. Macmillan, New York (1896) (J.E. Creighton & E.B Titchener, Trans.)
18. Osgood, C., Suci, G., Tannenbaum, P.: The Measurement of Meaning. University of Illinois Press, Urbana (1957)
19. Lang, P.J.: The Emotion Probe: Studies of Motivation and Attention. American Psychologist 50, 372-385 (1995)
20. Russell, J.A.: The Circumplex Model of Affect. Journal of Personality and Social Psychology 39, 1161-1178 (1980)
21. Palen, L., Bølen, S.: Don't Get Emotional. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868. Springer, Heidelberg (2008)
22. Bainbridge, W.S.: Computational Affective Sociology. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868. Springer, Heidelberg (2008)
23. Lichtenstein, A., Oehme, A., Kupschick, S., Jürgensohn, T.: Comparing Two Emotion Models for Deriving Affective States from Physiological Data. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868. Springer, Heidelberg (2008)
24. Mahlke, S., Minge, M.: Consideration of Multiple Components of Emotions in Human-Technology Interaction. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868. Springer, Heidelberg (2008)
25. Blauert, J., Jekosch, U.: Sound-Quality Evaluation: A Multi-Layered Problem. Acta Acustica 83, 747-753 (1997)
26. Guski, R.: Psychological Methods for Evaluating Sound Quality and Assessing Acoustic Information. Acta Acustica 83, 765-774 (1997)
27. Widman, U.: Aurally Adequate Evaluation of Sounds. In: Proc. of Euro Noise, vol. 98, pp. 29-46 (1998)
28. Todd, N.: Evidence for a Behavioral Significance of Saccular Acoustic Sensitivity in Humans. Journal of the Acoustical Society of America 110, 380-390 (2001)
29. Sokolov, E.N.: Perception and the Conditioned Reflex. Pergamon Press, Oxford (1963)
30. Dimberg, U.: Facial Electromyography and Emotional Reactions. Psychophysiology 27(5), 481-494 (1990)
31. Kjellberg, A., Skoldstrom, B., Tesarz, M., Dallner, M.: Facial EMG Responses to Noise. Percept Mot Skills 79(3 Pt 1), 1203-1216 (1994)
32. Bisping, R.: Emotional Effect of Car Interior Sounds: Pleasantness and Power and their Relation to Acoustic Key Features. SAE paper 951284, 1203-1209 (1995)
33. Bisping, R.: Car Interior Sound Quality: Experimental Analysis by Synthesis. Acta Acustica 83, 813-818 (1997)
34. Björk, E.A.: The Perceived Quality of Natural Sounds. Acustica 57, 185-188 (1985)
35. Bradley, M.M., Lang, P.J.: Affective Reactions to Acoustic Stimuli. Psychophysiology 37, 204-215 (2000)
36. Bradley, M.M., Lang, P.J.: International Affective Digitized Sounds (IADS): Stimuli, Instruction Manual and Affective Ratings (Tech. Rep. No. B-2). Gainesville, FL: The Center for Research in Psychophysiology. University of Florida (1999)
37. Schröder, M.: Emotional Speech Synthesis: A Review. In: Proceedings of Eurospeech 2001, Scandinavia (2001)
38. Hermann, T., Ritter, H.: Sound and Meaning in Auditory Data Display. Proceedings of the IEEE 92(4) (2004)
39. Vogt, T., André, E., Wagner, J.: Automatic Recognition of Emotions from Speech: a Review of the Literature and Recommendations for Practical Realisation. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868. Springer, Heidelberg (2008)
40. Jones, C., Deeming, A.: Affective Human-Robotic Interaction. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868. Springer, Heidelberg (2008)
41. Jones, C., Sutherland, J.: Acoustic Emotion Recognition for Affective Computer Gaming. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868.Springer, Heidelberg (2008)
42. Wexler, B.E., Warrenburg, S., Schwartz, G.E., Janer, L.D.: EEG and EMG Responses to Emotion-Evoking Stimuli Processed Without Conscious Awareness. Neuropsychologia 30(12), 1065-1079 (1992)
43. Hietanen, J.K., Surakka, V., Linnankoski, L.: Facial Electromyographic Responses to Vocal Affect Expressions. Psychophysiology, 35, 530-536 (1998)
44. Scherer, K.R.: Acoustic Concomitants of Emotion Dimensions: Judging Affect from Synthesized Tone Sequences. In: Weitz, S. (ed.) Nonverbal Communication: Readings with Commentary, pp. 249-253. Oxford University Press, New York (1974)
45. Väljamäe, A., Larsson, P., Västfjäll, D., Kleiner, M.: Sound Representing Self-Motion in Virtual Environments Enhances Linear Vection. Presence: Teleoperators and Virtual Environments (to appear)
46. Whalen, D.H., Hoequist, C.E., Sheffert, S.M.: The Effects of Breath Sounds on the Perception of Synthetic Speech. Journal of Acoustic Society of America 97, 3147-3153 (1995)
47. Albers, S.: Eating Mindfully: How to End Mindless Eating and Enjoy a Balanced Relationship with Food. New Harbinger Publications (2003)
48. Woll, S.B., McFall, M.E.: The Effects of False Feedback on Attributed Arousal and Rated Attractiveness in Female Subjects. Journal of Personality 47, 214-229 (1979)
49. Scherer, K.R., Zentner, M.R.: Emotional Effects of Music: Production Rules. In: Juslin, P.N., Sloboda, J.A. (eds.) Music and Emotion: Theory and Research. Oxford University Press, New York (2001)
50. James, W.: The Principles of Psychology. Holt, New York (1890)
51. Schachter, S., Singer, J.E.: Cognitive, Social and Physiological Determinants of Emotional State. Psychol. Review 69, 379-399 (1962)
52. Juslin, P.N., Västfjäll, D.: Lost in a Feeling? A Model that can Guide the Study of Music and Emotion (submitted)
53. Thaut, M.H.: Neuropsychological Processes in Music Perception and their Relevance in Music Therapy. In: Unkeler, R.F. (ed.) Music Therapy in the Treatment of Adults with Mental disorders, pp. 3-31. Schirmer books, New York (1990)
54. Juslin, P.N., Sloboda, J.A.: Music and Emotion. In: Theory and Research. Oxford University Press, New York (2001)
55. Loviscach, J., Oswald, D.: In the Mood: Tagging Music with Affects. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868. Springer, Heidelberg (2008)
56. Västfjäll, D.: The Subjective Sense of Presence, Emotion Recognition, and Experienced Emotions in Auditory Virtual Environments. CyberPsychology & Behavior 6(2), 181-188 (2003)
57. Freeman, J., Avons, S.E., Pearson, D.E., Ijsselsteijn, W.A.: Effects of Sensory Information and Prior Experience on Direct Subjective Ratings of Presence. Presence: Teleoperators and Virtual Environments 8(1), 1-13 (1999)
58. Frijda, N.H.: Emotions are Functional, Most of the Time. In: Ekman, P., Davidson, R.J. (eds.) The nature of emotion, pp. 112-122. Oxford University Press, New York (1994)
59. Hendrix, C., Barfield, W.: The sense of Presence Within Auditory Virtual Environments. Presence: Teleoperators and Virtual Environments 3, 290-301 (1996)
60. Larsson, P., Väjamäe, V.D., Kleiner, M.: Auditory Induced Presence in Mediated Environments and Related Technology. In: Biocca, F., IJsselsteijn, W.A., Freeman, J.J. (eds.) Handbook of Presence. Lawrence Erlbaum, Mahwah (in press)
61. Kallinen, K., Ravaja, N.: Comparing Speakers versus Headphones in Listening to News from a Computer: Individual Differences and Psychophysiological Responses. Computers in Human Behavior 23, 303-317 (2007)
62. Spence, C., Driver, J. (eds.): Crossmodal Space and Cross-modal Attention. Oxford University Press, Oxford (2004)
63. Poliakoff, E., Miles, E., Li, X., Blanchette, I.: The effect of Visual Threat on Spatial Attention to Touch. Cognition 102(3), 405-414 (2007)
64. Västfjäll, D.: Influences of Current Mood and Noise Sensitivity on Judgments of noise annoyance. The Journal of Psychology 136, 357-370 (2002)
65. Tajadura-Jiménez, A., Väljamäe, A., Västfjäll, D.: Self-Representation in Mediated Environments: The Experience of Emotions Modulated by Auditory-Vibrotactile Heartbeat (in press)
66. Lang, P.J., Bradley, M.M., Cuthbert, B.N.: International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual. Technical Report A-6. Univ. Florida, Gainesville, FL (2005)
67. Lang, P.J.: Behavioral Treatment and Bio-Behavioral Assessment: Computer Applications. In: Sidowski, J.B., Johnson, J.H., Williams, T.A. (eds.) Technology in Mental Health Care Delivery Systems, pp. 119-137. Ablex Publishing, Norwood (1980)
68. Slater, M., Usoh, M.: Body Centred Interaction in Immersive Virtual Environments. In: Magnenat Thalmann, N., Thalmann, D. (eds.) Artificial Life and Virtual Reality, pp. 125-148. John Wiley and Sons, Chichester (1994)
69. Watson, D., Tellegen, A.: Toward a Consensual Structure of Mood. Psychological Bulletin 98, 219-235 (1985)
70. Graf, C., Niebuhr, S., Kohler, K.: Enhancing Business Software through Fun-of-Use: A Pattern-based approach. In: Position Paper for Workshop on The Role of Emotion in HCI 2006, London, September 12-15 (2006)
71. Walkinshaw, O.: A Photo a Day: Is it Work, Rest or Play? In: Position Paper for Workshop on The Role of Emotion in HCI 2006, London (September 12-15, 2006)
72. Harbich, S., Hassenzahl, M.: Beyond Task Completition in the Workplace: Execute, Engage, Evolve, Expand. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868. Springer, Heidelberg (2008)
73. Creed, C., Beale, R.: Simulated Emotion in Affective Embodied Agents. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868. Springer, Heidelberg (2008)
74. Millard, N., Hole, L.: In the Moodie: Using Affective Widgets to Help Contact Centre Advisors Fight Stress. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868. Springer, Heidelberg (2008)
75. Pertaub, D.P., Slater, M., Barker, C.: An Experiment on Public Speaking Anxiety in Response to Three Different Types of Virtual Audience. Presence: Teleoperators and Virtual Environments 11, 68-78 (2002)
76. Shick, A.: Duckie and Dudle: a preliminary demonstration using affective display to communicate task status. In: Position Paper for Workshop on the Role of Emotion in HCI 2006: Engage, London, September 12-15 (2006)