Musical Emotions: Predicting Second-by-Second Subjective Feelings of Emotion From Low-Level Psychoacoustic Features and Physiological Measurements

Emotion

Volumn 11, Issue 4, 2011, Pages 921-937

  Coutinho, Eduardo ^a   Cangelosi, Angelo ^b  

^a UNIVERSITY OF LIVERPOOL   (United Kingdom)

^b UNIVERSITY OF PLYMOUTH   (United Kingdom)

Author keywords

Arousal and valence; Emotion; Neural networks; Physiology; Psychoacoustics

Indexed keywords

ACCURACY; ADULT; AFFECT; AROUSAL; ARTICLE; AUDITORY FEEDBACK; AUDITORY STIMULATION; CONTROLLED STUDY; DECISION MAKING; EMOTION; EXPERIMENTAL DESIGN; EXPERIMENTAL WORK; FEMALE; HEART RATE; HUMAN; HUMAN EXPERIMENT; HUMAN RELATION; LOUDNESS; MALE; MATHEMATICAL COMPUTING; METHODOLOGY; MUSIC; MUSIC THERAPY; MUSICAL EMOTION; NORMAL HUMAN; PHYSIOLOGY; PITCH; PITCH CONTOUR; PREDICTION; PSYCHOLOGY; PSYCHOPHYSICS; RESEARCH; SHARPNESS; SKIN CONDUCTANCE; SOUND INTENSITY; SPATIOTEMPORAL DYNAMICS; TEMPO; TEXTURE;

ACOUSTIC STIMULATION; ADULT; EMOTIONS; FEMALE; GALVANIC SKIN RESPONSE; HEART RATE; HUMANS; MALE; MIDDLE AGED; MUSIC; NEURAL NETWORKS (COMPUTER); PSYCHOACOUSTICS; YOUNG ADULT;

EID: 80052277872     PISSN: 15283542     EISSN: 19311516     Source Type: Journal    
DOI: 10.1037/a0024700     Document Type: Article

References (78)

1. Balkwill L.-L., Thompson W.F. A cross-cultural investigation of the perception of emotion in music: Psychophysical and cultural cues. Music Perception 1999, 17:43-64.
2. Balkwill L.-L., Thompson W.F., Matsunaga R. Recognition of emotion in Japanese, Western, and Hindustani music by Japanese listeners. Japanese Psychological Research 2004, 46:337-349.
3. Bechara A., Damasio H., Damasio A. Role of the amygdala in decision-making. Annals of the New York Academy of Sciences 2003, 985:356-369.
4. Berntson G., Shafi R., Knox D., Sarter M. Blockade of epinephrine priming of the cerebral auditory evoked response by cortical cholinergic deafferentation. Neuroscience 2003, 116:179-186.
5. Bigand E., Vieillard S., Madurell F., Marozeau J., Dacquet A. Multidimensional scaling of emotional responses to music: The effect of musical expertise and of the duration of the excerpts. Cognition & Emotion 2005, 19:1113-1139.
6. Blood A., Zatorre R.J. Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion. Proceedings of the National Academy of Sciences, USA 2001, 98:11818-11823.
7. Blood A., Zatorre R.J., Bermudez P., Evans A. Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nature Neuroscience 1999, 2:382-387.
8. Bradley M., Lang P. Measuring emotion: The Self-Assessment Manikin and the Semantic Differential. Journal of Behavior Therapy and Experimental Psychiatry 1994, 25:49-59.
9. Cabrera D., Ferguson S., Schubert E. PsySound3: Software for acoustical and psychoacoustical analysis of sound recordings. Proceedings of the 13th International Conference on Auditory Display 2007, 356-363. McGill University, Montreal, Canada. W.L. Martens, G. Scavone, R. Quesnel (Eds.).
10. Clynes M. Sentics: The touch of emotions 1977, Anchor Press, New York.
11. Colibazzi T., Posner J., Wang Z., Gorman D., Gerber A., Yu S., Peterson B. Neural systems subserving valence and arousal during the experience of induced emotions. Emotion 2010, 10:377-389.
12. Coutinho E. Modeling psycho-physiological measurements of emotional responses to multiple music genres. Proceedings of the 11th international conference of music perception and cognition (ICMPC11) 2010, 53. University of Washington, Seattle, WA. S.M. Demorest, S.J. Morrison, P.S. Campbell (Eds.).
13. Coutinho E., Cangelosi A. The use of spatio-temporal connectionist models in psychological studies of musical emotions. Music Perception 2009, 27:1-15.
14. Coutinho E., Cangelosi A. A neural network model for the prediction of musical emotions. Advances in cognitive systems 2010, 331-368. IET Publisher, London, ISBN: 978-1849190756. S. Nefti-Meziani, J.G. Grey (Eds.).
15. Coutinho E., Dibben N. Music, Speech and Emotion: Psycho-physiological and computational investigations. Proceedings of the Conference on interdisciplinary musicology: Nature versus culture 2010, 47-48. University of Sheffield, Sheffield, U.K., (CIM10). N. Dibben, R. Timmers (Eds.).
16. Damasio A. The feeling of what happens: Body, emotion and the making of consciousness 2000, Vintage, London.
17. Dainow E. Physical Effects and Motor Responses to Music. Journal of Research in Music Education 1977, 25:211-221. 10.2307/3345305.
18. Dibben N. The role of peripheral feedback in emotional experience with music. Music Perception 2004, 22:79-115.
19. Dissanayake, E. (2008). If music is the food of love, what about survival and reproductive success? Musicae Scientiae, Special Issue, 169-195.
20. Dittmar C., Dressler K., Rosenbauer K. A toolbox for automatic transcription of polyphonic music. Proceedings of audio mostly: 2nd conference on interaction with sound 2007, 58-65. Fraunhofer IDMT, Ilmenau, Germany.
21. Dixon S. MIREX 2006 audio beat tracking evaluation: BeatRoot http://www.music-ir.org/evaluation/MIREX/2006abstracts/BTdixon.pdf.
22. Ekman P., Levenson R.W., Friesen W. Autonomic nervous system activity distinguishes among emotions. Science 1983, 221:1208-1210.
23. Elman J. Finding structure in time. Cognitive Science 1990, 14:179-211.
24. Evans P., Schubert E. Relationships between expressed and felt emotions in music. Musicae Scientiae 2008, 12:75-99.
25. Fritz T., Jentschke S., Gosselin N., Sammler D., Peretz I., Turner R., Koelsch S. Universal recognition of three basic emotions in music. Current biology 2009, 19:573-576.
26. Gabrielsson, A. (2002). Emotion perceived and emotion felt: Same or different? Musicae Scientiae, Special Issue 2001-2002, 123-147.
27. Gabrielsson A., Lindström E. The role of structure in the musical expression. Handbook of music and emotion 2010, 367-400. Oxford University Press, Oxford, U.K. P. Juslin, J. Sloboda (Eds.).
28. Glasberg B.R., Moore B.C. Derivation of auditory filter shapes from notched-noise data. Hearing Research 2002, 47:103-138.
29. Gomez P., Danuser B. Relationships between musical structure and psychophysiological measures of emotion. Emotion 2007, 7:377-387.
30. Grewe O., Nagel F., Kopiez R., Altenmüller E. How does music arouse "chills" ? investigating strong emotions, combining psychological, physiological, and psychoacoustical methods. Annals of the New York Academy of Sciences 2005, 1060:446-449.
31. Grewe O., Nagel F., Kopiez R., Altenmüller E. Listening to music as a re-creative process: Physiological, psychological, and psychoacoustical correlates of chills and strong emotions. Music Perception 2007, 24:297-314.
32. Grewe O., Nagel F., Kopiez R., Altenmüller E. Emotions over time: Synchronicity and development of subjective, physiological, and facial affective reactions to music. Emotion 2007, 7:774-788.
33. Guhn M., Hamm A.O., Zentner M. Physiological and musico-acoustic correlates of the chill response. Music Perception 2007, 24:473-483.
34. Gupta U., Gupta B. Psychophysiological responsivity to Indian instrumental music. Psychology of Music 2005, 33:363-372.
35. Hammer B. On the approximation capability of recurrent neural networks. Neurocomputing 2000, 31:107-123.
36. Harrer G., Harrer H. Music, emotion and autonomic function. Music and the brain: Studies in the neurology of music 1977, 202-216. William Heinemann Medical Books Limited, London, U.K. M. Critchley, R.A. Henson (Eds.).
37. Hevner K. Experimental studies of the elements of expression in music. The American Journal of Psychology 1936, 48:246-268.
38. Hevner K. The affective value of pitch and tempo in music. American Journal of Psychology 1937, 49:621-630.
39. Iwanaga M., Kobayashi A., Kawasaki C. Heart rate variability with repetitive exposure to music. Biological Psychology 2005, 70:61-66.
40. Iwanaga M., Moroki Y. Subjective and physiological responses to music stimuli controlled over activity and preference. Journal of Music Therapy 1999, 36:26-38.
41. Jänig W. The autonomic nervous system and its coordination by the brain. Handbook of affective sciences 2003, 135-186. Oxford University Press, New York. R.J. Davidson, K.R. Scherer, H.H. Goldsmith (Eds.).
42. Juslin P.N., Laukka P. Expression, perception, and induction of musical emotions: A review and a questionnaire study of everyday listening. Journal of New Music Research 2004, 33:217-238.
43. Juslin P.N., Sloboda J. Handbook of music and emotion 2010, Oxford University Press, Oxford, U.K.
44. Juslin P.N., Västfjäll D. Emotional responses to music: The need to consider underlying mechanisms. The Behavioral and Brain Sciences 2008, 31:559-575. (discussion 575-621).
45. Khalfa S., Isabelle P., Blondin J.-P., Manon R. Event-related skin conductance responses to musical emotions in humans. Neuroscience Letters 2002, 328:145-149.
46. Kivy P. Music alone: Philosophical reflections on the purely musical experience 1990, Cornell University Press, Ithaca, NY.
47. Koelsch S., Fritz T., Cramon D., Müller K., Friederici A.D. Investigating emotion with music: An fMRI study. Human Brain Mapping 2006, 27:239-250.
48. Koneîcni V.J. Review of P. N. Juslin and J. A. Sloboda (Eds.). "Music and emotion: Theory and research." Music Perception 2003, 20:332-341.
49. Korhonen, M. (2004). Modeling continuous emotional appraisals of music using system identification. (Unpublished master's thesis). University of Waterloo, Canada.
50. Krumhansl C.L. An exploratory study of musical emotions and psychophysiology. Canadian Journal of Experimental Psychology 1997, 51:336-353.
51. Lang P.J., Bradley M.M., Cuthbert B.N. International affective picture system (IAPS): Technical manual and affective ratings 2005, University of Florida; The Center for Research in Psychophysiology, Gainesville, FL.
52. Lang P.J., Greenwald M.K., Bradley M.M., Hamm A.O. Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology 1993, 30:261-273.
53. Levitin D.J. This is your brain on music: The science of a human obsession 2006, Plume, New York.
54. McCulloch W.S., Pitts W.H. A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics 1943, 5:115-133.
55. McLachlan G. Discriminant analysis and statistical pattern recognition 1992, Wiley InterScience, New York.
56. Meyer L. Emotion and meaning in music 1956, Chicago University Press, Chicago, IL, USA.
57. Nagel F., Kopiez R., Grewe O., Altenmüller E. EMuJoy: Software for continuous measurement of perceived emotions in music. Behavior Research Methods 2007, 39:283-290.
58. Oatley K., Jenkins J.M. Understanding emotions 1996, Blackwell Publishers, Cambridge, MA, USA.
59. Panksepp J., Bernatzky G. Emotional sounds and the brain: The neuro-affective foundations of musical appreciation. Behavioral Processes 2002, 60:133-155.
60. Parncutt R. Harmony: A psychoacoustical approach 1989, Springer-Verlag, Berlin, Germany.
61. Peretz I. Brain specialization for music: New evidence from congenital amusia. Annals of the New York Academy of Sciences 2001, 930:153.
62. Peretz I., Gagnon L., Bouchard B. Music and emotion: Perceptual determinants, immediacy, and isolation after brain damage. Cognition 1998, 68:111-141.
63. Rickard N. Intense emotional responses to music: A test of the physiological arousal hypothesis. Psychology of Music 2004, 32:371-388.
64. Robazza C., Macaluso C., D'Urso V. Emotional reactions to music by gender, age, and expertise. Perceptual and Motor Skills 1994, 79:939-944.
65. Rosenblatt F. Principles of neurodynamics 1963, Spartan, New York, NY, USA.
66. Rumelhart D., Hintont G., Williams R. Learning representations by back-propagating errors. Nature 1986, 323:533-536.
67. Russell J. A circumplex model of affect. Journal of Personality and Social Psychology 1980, 39:1161-1178.
68. Scherer K.R. Appraisal theory. Handbook of cognition and emotion 1999, 637-663. John Wiley & Sons, Chichester, UK. T. Dalgleish, M. Power (Eds.).
69. Scherer K.R. Why music does not produce basic emotions: A plea for a new approach to measuring emotional effects of music. Proceedings of the Stockholm Music Acoustics Conference 2003 2003, 25-28. Royal Institute of Technology, Stockholm. R. Bresin (Ed.).
70. Scherer K.R., Zentner M.R. Emotion effects of music: Production rules. Music and emotion: Theory and research 2001, 361-392. Oxford University Press, Oxford, U.K. P.N. Juslin, J. Sloboda (Eds.).
71. Schubert E. Modeling perceived emotion with continuous musical features. Music Perception 2004, 21:561-585.
72. Stemmler G. Introduction: Autonomic psychophysiology. Handbook of affective sciences 2003, 131-134. Oxf ord University Press, New York. R.J. Davidson, K.R. Scherer, H.H. Goldsmith (Eds.).
73. Sze J.A., Gyurak A., Yuan J.W., Levenson R.W. Coherence between emotional experience and physiology: Does body awareness training have an impact?. Emotion 2010, 10:803-814.
74. Thayer, J. (1986). Multiple indicators of affective response to music. (Unpublished doctoral dissertation). New York University.
75. Trainor L.J., Schmidt L.A. Processing emotions induced by music. The cognitive neuroscience of music 2003, 310-324. Oxford University Press, Oxford, U.K. I. Peretz, R. Zatorre (Eds.).
76. Tzanetakis G., Cook P. Marsyas: A framework for audio analysis. Organised sound 2000, 4:169-175.
77. Witvliet C., Vrana S. Psychophysiological responses as indices of affective dimensions. Psychophysiology 1995, 32:436-443.
78. Zwicker E., Fastl H. Psychoacoustics: Facts and models 1990, Springer-Verlag, New York, NY, USA.