Hidden sources of joy, fear, and sadness: Explicit versus implicit neural processing of musical emotions

Neuropsychologia

Volumn 89, Issue , 2016, Pages 393-402

  Bogert, Brigitte ^a   Numminen Kontti, Taru ^a   Gold, Benjamin ^a,b   Sams, Mikko ^c   Numminen, Jussi ^a   Burunat, Iballa ^d   Lampinen, Jouko ^c   Brattico, Elvira ^a,c,e  

^a UNIVERSITY OF HELSINKI   (Finland)

^b MCGILL UNIVERSITY   (Canada)

^c AALTO UNIVERSITY   (Finland)

^d UNIVERSITY OF JYVÄSKYLÄ   (Finland)

^e Det Jyske Musikkonservatorium   (Denmark)

Author keywords

Caudate; Emotion; Explicit processing; Implicit processing; Music

Indexed keywords

ANTERIOR CINGULATE; ATTENTION; AUDITORY CORTEX; CORPUS STRIATUM; DOWN REGULATION; FEAR; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HAPPINESS; HUMAN; INFERIOR PARIETAL LOBULE; MAJOR CLINICAL STUDY; MIDDLE FRONTAL GYRUS; MUSIC; ORBITAL CORTEX; PARAHIPPOCAMPAL GYRUS; PREMOTOR CORTEX; RECOGNITION; SADNESS; STIMULUS; SUPPLEMENTARY MOTOR AREA; ADULT; AUDITORY STIMULATION; BLOOD; BRAIN; BRAIN MAPPING; DIAGNOSTIC IMAGING; EMOTION; FEMALE; IMAGE PROCESSING; MALE; MIDDLE AGED; NUCLEAR MAGNETIC RESONANCE IMAGING; PHOTOSTIMULATION; PHYSIOLOGY; YOUNG ADULT;

OXYGEN;

ACOUSTIC STIMULATION; ADULT; ATTENTION; BRAIN; BRAIN MAPPING; EMOTIONS; FEAR; FEMALE; HAPPINESS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; MUSIC; OXYGEN; PHOTIC STIMULATION; YOUNG ADULT;

EID: 84979268215     PISSN: 00283932     EISSN: 18733514     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2016.07.005     Document Type: Article

References (83)

1. Alluri, V., Toiviainen, P., Jaaskelainen, I.P., Glerean, E., Sams, M., Brattico, E., Large-scale brain networks emerge from dynamic processing of musical timbre, key and rhythm. NeuroImage 59:4 (2012), 3677–3689.
2. Alluri, V., Brattico, E., Toiviainen, P., Burunat, I., Bogert, B., Numminen, J., Kiuchko, M., Musical expertise modulates functional connectivity of limbic regions during continuous music listening. Psychomusicol.: Music Mind Brain 25:4 (2015), 443–454.
3. Aucouturier, J.J., Bigand, E., Seven problems that keep MIR from attracting the interest of cognition and neuroscience. J. Intell. Inf. Syst. 41:3 (2013), 483–497, 10.1007/s10844-013-0251-x.
4. Bach, D.R., Grandjean, D., Sander, D., Herdener, M., Strik, W.K., Seifritz, E., The effect of appraisal level on processing of emotional prosody in meaningless speech. NeuroImage 42:2 (2008), 919–927.
5. Berridge, K.C., Kringelbach, M.L., Neuroscience of affect: brain mechanisms of pleasure and displeasure. Curr. Opin. Neurobiol. 23:3 (2013), 294–303.
6. Blood, A.J., Zatorre, R.J., Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion. Proc. Natl. Acad. Sci. USA, 98(20), 2001, 11818, 10.1073/pnas.191355898.
7. Blood, A.J., Zatorre, R.J., Bermudez, P., Evans, A.C., Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nat. Neurosci., 2(4), 1999, 382, 10.1038/7299.
8. Bouhuys, A.L., Bloem, G.M., Groothuis, T.G., Induction of depressed and elated mood by music influences the perception of facial emotional expressions in healthy subjects. J. Affect. Disord., 33(4), 1995, 215.
9. Brattico, E., From pleasure to liking and back: bottom-up and top-down neural routes to the aesthetic enjoyment of music. Nadal, M., Houston, J.P., Agnati, L., Mora, F., Cela Conde, C.J., (eds.) Art, Aesthetics and the Brain, 2015, Oxford University Press, Oxford, New York, 303–318.
10. Brattico, E., Alluri, V., Bogert, B., Jacobsen, T., Vartiainen, N., Nieminen, S., Tervaniemi, M., A functional MRI study of happy and sad emotions in music with and without lyrics. Front. Psychol., 2, 2011, 308, 10.3389/fpsyg.2011.00308.
11. Brattico, E., Bogert, B., Jacobsen, T., Toward a neural chronometry for the aesthetic experience of music. Front. Psychol., 4, 2013, 206, 10.3389/fpsyg.2013.00206.
12. Brattico, E., Bogert, B., Alluri, V., Tervaniemi, M., Eerola, T., Jacobsen, T., It's sad but I like it: the neural dissociation between musical emotions and liking in experts and laypersons. Front. Hum. Neurosci., 9, 2016, 676, 10.3389/fnhum.2015.00676.
13. Brett, M., Anton, J.-L., Valabregue, R., Poline, J.-B., 2002. Region of interest analysis using an SPM toolbox. Presented at the 8th International Conference on Functional Mapping of the Human Brain, Sendai, Japan, vol. 16, No. 2, June 2–6, 2002. Available on CD-ROM in NeuroImage.
14. Bunge, S.A., Hazeltine, E., Scanlon, M.D., Rosen, A.C., Gabrieli, J., Dissociable contributions of prefrontal and parietal cortices to response selection. NeuroImage 17:3 (2002), 1562–1571.
15. Burunat, I., Alluri, V., Toiviainen, P., Numminen, J., Brattico, E., Dynamics of brain activity underlying working memory for music in a naturalistic condition. Cortex 57 (2014), 254–269.
16. Chapin, H., Jantzen, K., Kelso, J.A., Steinberg, F., Large, E., Dynamic emotional and neural responses to music depend on performance expression and listener experience. PLoS ONE, 5(12), 2010, e13812, 10.1371/journal.pone.0013812.
17. Critchley, H., Daly, E., Phillips, M., Brammer, M., Bullmore, E., Williams, S., Murphy, D., Explicit and implicit neural mechanisms for processing of social information from facial expressions: a functional magnetic resonance imaging study. Hum. Brain Mapp., 9(2), 2000, 93.
18. Damasio, A., Carvalho, G.B., The nature of feelings: evolutionary and neurobiological origins. Nat. Rev. Neurosci. 14 (2013), 143–152.
19. Delgado, M.R., Stenger, V.A., Fiez, J.A., Motivation-dependent responses in the human caudate nucleus. Cereb. Cortex 14:9 (2004), 1022–1030.
20. Eerola, T., Vuoskoski, J.K., A comparison of the discrete and dimensional models of emotion in music. Psychol. Music 39:1 (2011), 18–49.
21. Ethofer, T., Kreifelts, B., Wiethoff, S., Wolf, J., Grodd, W., Vuilleumier, P., Wildgruber, D., Differential influences of emotion, task, and novelty on brain regions underlying the processing of speech melody. J. Cognit. Neurosci. 21:7 (2009), 1255–1268.
22. Etkin, A., Egner, T., Kalisch, R., Emotional processing in anterior cingulate and medial prefrontal cortex. Trends Cognit. Sci. 15:2 (2011), 85–93.
23. Filipic, S., Tillmann, B., Bigand, E., Judging familiarity and emotion from very brief musical excerpts. Psychon. Bull. Rev. 17:3 (2010), 335–341.
24. Flores-Gutierrez, E.O., Diaz, J.L., Barrios, F.A., Favila-Humara, R., Guevara, M.A., del Rio-Portilla, Y., Corsi-Cabrera, M., Metabolic and electric brain patterns during pleasant and unpleasant emotions induced by music masterpieces. Int. J. Psychophysiol. 65:1 (2007), 69–84.
25. Frühholz, S., Ceravolo, L., Grandjean, D., Specific brain networks during explicit and implicit decoding of emotional prosody. Cereb. Cortex 22:5 (2012), 1107–1117.
26. Fusar-Poli, P., Placentino, A., Carletti, F., Landi, P., Allen, P., Surguladze, S., Politi, P., Functional atlas of emotional faces processing: a voxel-based meta-analysis of 105 functional magnetic resonance imaging studies. J. Psychiatry Neurosci. 34:6 (2009), 418–432.
27. Gold, B., Frank, M., Bogert, B., Brattico, E., Pleasurable music influences reinforcement learning behavior. Front. Psychol. 4:541 (2013), 1–19.
28. Grandjean, D., Sander, D., Pourtois, G., Schwartz, S., Seghier, M.L., Scherer, K.R., Vuilleumier, P., The voices of wrath: brain responses to angry prosody in meaningless speech. Nat. Neurosci. 8:2 (2005), 145–146.
29. Green, A.C., Baerentsen, K.B., Stodkilde-Jorgensen, H., Wallentin, M., Roepstorff, A., Vuust, P., Music in minor activates limbic structures: a relationship with dissonance?. NeuroReport 19:7 (2008), 711–715.
30. Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., Kawato, M., A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task. J. Neurosci. 24:7 (2004), 1660–1665.
31. Hsieh, S., Hornberger, M., Piguet, O., Hodges, J.R., Brain correlates of musical and facial emotion recognition: evidence from the dementias. Neuropsychologia 50:8 (2012), 1814–1822.
32. Juslin, P.N., What does music express? Basic emotions and beyond. Front. Psychol., 4, 2013, 596, 10.3389/fpsyg.2013.00596.
33. Smithz, T.W., Johnson, S.C., Relevance to self: a brief review and framework of neural systems underlying appraisal. Neurosci. Biobehav. Rev. 31:4 (2007), 585–596.
34. Keightley, M.L., Winocur, G., Graham, S.J., Mayberg, H.S., Hevenor, S.J., Grady, C.L., An fMRI study investigating cognitive modulation of brain regions associated with emotional processing of visual stimuli. Neuropsychologia 41:5 (2003), 585–596.
35. Khalfa, S., Schon, D., Anton, J.L., Liegeois-Chauvel, C., Brain regions involved in the recognition of happiness and sadness in music. NeuroReport 16:18 (2005), 1981–1984.
36. Khalfa, S., Guye, M., Peretz, I., Chapon, F., Girard, N., Chauvel, P., Liegeois-Chauvel, C., Evidence of lateralized anteromedial temporal structures involvement in musical emotion processing. Neuropsychologia 46:10 (2008), 2485–2493, 10.1016/j.neuropsychologia.2008.04.009.
37. Kober, H., Barrett, L.F., Joseph, J., Bliss-Moreau, E., Lindquist, K., Wager, T.D., Functional grouping and cortical-subcortical interactions in emotion: a meta-analysis of neuroimaging studies. NeuroImage 42:2 (2008), 998–1031.
38. Koelsch, S., Brain correlates of music-evoked emotions. Nat. Rev. Neurosci. 15:3 (2014), 170–180.
39. Koelsch, S., Fritz, T., von Cramon, D.Y., Muller, K., Friederici, A.D., Investigating emotion with music: an fMRI study. Hum. Brain Mapp. 27:3 (2006), 239–250.
40. Koelsch, S., Skouras, S., Fritz, T., Herrera, P., Bonhage, C., Kussner, M.B., Jacobs, A.M., The roles of superficial amygdala and auditory cortex in music-evoked fear and joy. NeuroImage 81 (2013), 49–60.
41. Kohn, N., Eickhoff, S.B., Scheller, M., Laird, A.R., Fox, P.T., Habel, U., Neural network of cognitive emotion regulation – an ALE meta-analysis and MACM analysis. NeuroImage 87 (2014), 345–355.
42. Lane, R.D., Neural substrates of implicit and explicit emotional processes: a unifying framework for psychosomatic medicine. Psychosom. Med. 70:2 (2008), 214–231.
43. Lartillot, O., Toiviainen, P., 2007. A Matlab toolbox for musical feature extraction from audio. Paper presented at the Proceedings of the 10th International Conference on Digital Audio Effects, Bordeaux, France.
44. Lindquist, K.A., Wager, T.D., Kober, H., Bliss-Moreau, E., Barrett, L.F., The brain basis of emotion: a meta-analytic review. Behav. Brain Sci. 35:3 (2012), 121–143.
45. Lonsdale, A.J., North, A.C., Why do we listen to music? A uses and gratifications analysis. Br. J. Psychol. 102 (2011), 108–134.
46. Mansouri, F.A., Tanaka, K., Buckley, M.J., Conflict-induced behavioural adjustment: a clue to the executive functions of the prefrontal cortex. Nat. Rev. Neurosci. 10 (2009), 141–152.
47. Menon, V., Levitin, D.J., The rewards of music listening: response and physiological connectivity of the mesolimbic system. NeuroImage 28:1 (2005), 175–184.
48. Milliman, R.E., Using background music to affect the behavior of supermarket shoppers. J. Mark. 46:3 (1982), 86–91.
49. Milliman, R.E., The influence of background music on the behavior of restaurant patrons. J. Consum. Res. 13:2 (1986), 286–289.
50. Mitterschiffthaler, M.T., Fu, C.H., Dalton, J.A., Andrew, C.M., Williams, S.C., A functional MRI study of happy and sad affective states induced by classical music. Hum. Brain Mapp. 28:11 (2007), 1150–1162.
51. Mizuno, T., Sugishita, M., Neural correlates underlying perception of tonality-related emotional contents. NeuroReport 18:16 (2007), 1651–1655.
52. Neufeld, J., Sinke, C., Dillo, W., Emrich, H.M., Szycik, G.R., Dima, D., Zedler, M., The neural correlates of coloured music: a functional MRI investigation of auditory-visual synaesthesia. Neuropsychologia 50:1 (2012), 85–89.
53. North, A.C., Hargreaves, D.J., The Social and Applied psychology of Music. 2008, Oxford University Press, Oxford.
54. North, A.C., Hargreaves, D.J., Hargreaves, J.J., Uses of music in everyday life. Music Percept. 22:1 (2004), 41–77.
55. Omar, R., Henley, S.M., Bartlett, J.W., Hailstone, J.C., Gordon, E., Sauter, D.A., Warren, J.D., The structural neuroanatomy of music emotion recognition: evidence from frontotemporal lobar degeneration. NeuroImage 56:3 (2011), 1814–1821.
56. Pallesen, K.J., Brattico, E., Bailey, C.J., Korvenoja, A., Gjedde, A., Cognitive and emotional modulation of brain default operation. J. Cognit. Neurosci. 21 (2009), 1065–1080.
57. Pallesen, K.J., Brattico, E., Bailey, C.J., Korvenoja, A., Koivisto, J., Gjedde, A., Carlson, S., Emotion processing of major, minor, and dissonant chords: a functional magnetic resonance imaging study. Ann. N.Y. Acad. Sci. 1060 (2005), 450–453.
58. Panksepp, J., Bernatzky, G., Emotional sounds and the brain: the neuro-affective foundations of musical appreciation. Behav. Process. 60:2 (2002), 133–155.
59. Park, M., Gutyrchik, E., Bao, Y., Zaytseva, Y., Carl, P., Welker, L., Meindl, T., Differences between musicians and non-musicians in neuro-affective processing of sadness and fear expressed in music. Neurosci. Lett. 566C (2014), 120–124.
60. Pereira, C.S., Teixeira, J., Figueiredo, P., Xavier, J., Castro, S.L., Brattico, E., Music and emotions in the brain: familiarity matters. PLoS ONE, 6(11), 2011, e27241, 10.1371/journal.pone.0027241.
61. Peretz, I., The nature of music from a biological perspective. Cognition 100:1 (2006), 1–32.
62. Peretz, I., Towards a neurobiology of musical emotions. Juslin, P.N., Sloboda, J.A., (eds.) Handbook of Music and Emotion: Theory, Research, Applications, 2010, Oxford University Press, Oxford, 99–126.
63. Peretz, I., Gagnon, L., Bouchard, B., Music and emotion: perceptual determinants, immediacy, and isolation after brain damage. Cognition 68:2 (1998), 111–141.
64. Phan, K.L., Wager, T., Taylor, S.F., Liberzon, I., Functional neuroanatomy of emotion: a meta-analysis of emotion activation studies in PET and fMRI. Neuroimage 16:2 (2002), 331–348.
65. Ptak, R., The frontoparietal attention network of the human brain: action, saliency, and a priority map of the environment. Neuroscientist 18:5 (2012), 502–515.
66. Puce, A., Allison, T., Bentin, S., Gore, J.C., McCarthy, G., Temporal cortex activation in humans viewing eye and mouth movements. J. Neurosci. 18:6 (1998), 2188–2199.
67. Quarto, T., Blasi, G., Pallesen, K.J., Bertolino, A., Brattico, E., Implicit processing of visual emotions is affected by sound-induced affective states and individual affective traits. Plos ONE, 9(7), 2014, e103278, 10.1371/journal.pone.0103278.
68. Salimpoor, V.N., Benovoy, M., Larcher, K., Dagher, A., Zatorre, R.J., Anatomically distinct dopamine release during anticipation and experience of peak emotion to music. Nat. Neurosci. 14:2 (2011), 257–262.
69. Salimpoor, V.N., van den Bosch, I., Kovacevic, N., McIntosh, A.R., Dagher, A., Zatorre, R.J., Interactions between the nucleus accumbens and auditory cortices predict music reward value. Science 340:6129 (2013), 216–219.
70. Sander, D., Grandjean, D., Pourtois, G., Schwartz, S., Seghier, M.L., Scherer, K.R., Vuilleumier, P., Emotion and attention interactions in social cognition: brain regions involved in processing anger prosody. NeuroImage 28:4 (2005), 848–858.
71. Satoh, M., Nakase, T., Nagata, K., Tomimoto, H., Musical anhedonia: selective loss of emotional experience in listening to music. Neurocase 17:5 (2011), 410–417.
72. Scheuerecker, J., Frodl, T., Koutsouleris, N., Zetzsche, T., Wiesmann, M., Kleemann, A.M., Meisenzahl, E.M., Cerebral differences in explicit and implicit emotional processing–an fMRI study. Neuropsychobiology 56:1 (2007), 32–39.
73. Schirmer, A., Kotz, S.A., Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing. Trends Cognit. Sci. 10:1 (2006), 24–30.
74. Schmahmann, J.D., Disorders of the cerebellum: ataxia, dysmetria of thought, and the cerebellar cognitive affective syndrome. J. Neuropsychiatry Clin. Neurosci. 16:3 (2004), 367–378.
75. Schulze, K., Mueller, K., Koelsch, S., Neural correlates of strategy use during auditory working memory in musicians and non-musicians. Eur. J. Neurosci. 33:1 (2010), 189–196.
76. Seger, C.A., Cincotta, C.M., The roles of the caudate nucleus in human classification learning. J. Neurosci. 25:11 (2005), 2941–2951.
77. Sloboda, J.A., O'Neill, S.A., Ivaldi, A., Function of music in everday life: an exploratory study using the experience sampling method. Music. Sci. 5:1 (2001), 9–32.
78. Smith, E.E., Jonides, J., Storage and executive processes in the frontal lobes. Science 283:5408 (1999), 1657–1661.
79. Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Étard, O., Delcroix, N., Mazoyer, B., Joliot, M., Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage 15 (2002), 273–289.
80. Vytal, K., Hamann, S., Neuroimaging support for discrete neural correlates of basic emotions: a voxel-based meta-analysis. J. Cognit. Neurosci. 22:12 (2010), 2864–2885.
81. Wildgruber, D., Pihan, H., Ackermann, H., Erb, M., Grodd, W., Dynamic brain activation during processing of emotional intonation: influence of acoustic parameters, emotional valence, and sex. NeuroImage 15:4 (2002), 856–869.
82. Wildgruber, D., Riecker, A., Hertrich, I., Erb, M., Grodd, W., Ethofer, T., Ackermann, H., Identification of emotional intonation evaluated by fMRI. NeuroImage 24:4 (2005), 1233–1241.
83. Williams, L.M., Liddell, B.J., Kemp, A.H., Bryant, R.A., Meares, R.A., Peduto, A.S., Gordon, E., Amygdala-prefrontal dissociation of subliminal and supraliminal fear. Hum. Brain Mapp. 27:8 (2006), 652–661.