Pleasurable music affects reinforcement learning according to the listener

Frontiers in Psychology

Volumn 4, Issue AUG, 2013, Pages

  Gold, Benjamin P ^a,b   Frank, Michael J ^c   Bogert, Brigitte ^a,b   Brattico, Elvira ^a,b,d  

^a UNIVERSITY OF HELSINKI   (Finland)

^b UNIVERSITY OF JYVÄSKYLÄ   (Finland)

^c BROWN UNIVERSITY   (United States)

^d AALTO UNIVERSITY   (Finland)

Author keywords

Dopamine; Listening strategy; Music; Musical experience; Pleasure; Reinforcement learning; Reward; Subjectivity

Indexed keywords

EID: 84885349267     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2013.00541     Document Type: Article

References (74)

1. Ashby, F. G., Isen, A. M., and Turken, A. U. (1999). A neuropsychological theory of positive affect and its influence on cognition. Psychol. Rev. 106, 529-550. doi: 10.1037/0033-295X.106.3.529
2. Badre, D., and Frank, M. J. (2012). Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 2: evidence from fMRI. Cereb. Cortex 22, 527-536. doi: 10.1093/cercor/bhr117
3. Bengtsson, S., Nagy, Z., Skare, S., Forsman, L., Forssberg, H., and Ullén, F. (2005). Extensive piano practicing has regionally specific effects on white matter development. Nat. Neurosci. 8, 1148-1150. doi: 10.1038/nn1516
4. Berridge, K. C., and Kringelbach, M. L. (2013). Neuroscience of affect: brain mechanisms of pleasure and displeasure. Curr. Opin. Neurobiol. 23, 294-303. doi: 10.1016/j.conb.2013.01.017
5. Bharucha, J. J. (1994). "Tonality and expectation," in Musical Perceptions, ed R. Aiello (New York, NY: Oxford University Press), 213-239.
6. Bigand, E., and Poulin-Charronnat, B. (2006). Are we "experienced listeners?" A review of the musical capacities that do not depend on formal musical training. Cognition 100, 100-130. doi: 10.1016/j.cognition.2005.11.007
7. Blood, A. J., and Zatorre, R. J. (2001). Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion. Proc. Natl. Acad. Sci. U.S.A. 98, 11818-11823. doi: 10.1073/pnas.191355898
8. Blood, A. J., Zatorre, R. J., Bermudez, P., and Evans, A. C. (1999). Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions. Nat. Neurosci. 2, 382-387. doi: 10.1038/7299
9. Brattico, E., and Pearce, M. (2012). The neuroaesthetics of music. Psychol. Aesthet. Crea. Arts 7, 48-61. doi: 10.1037/a0031624
10. Brown, S., Gao, X., Tisdelle, L., Eickhoff, S. B., and Liotti, M. (2011). Naturalizing aesthetics: brain areas for aesthetic appraisal across sensory modalities. Neuroimage 58, 250-258. doi: 10.1016/j.neuroimage.2011.06.012
11. Caldú, X., Vendrell, P., Bartrés-Faz, D., Clemente, I., Bargalló, N., Jurado, M. A., et al. (2007). Impact of the COMT Val108/158 Met and DAT genotypes on prefrontal function in healthy subjects. Neuroimage 4, 1437-1444. doi: 10.1016/j.neuroimage.2007.06.021
12. Caplin, A., Dean, M., Glimcher, P. W., and Rutledge, R. B. (2010). Measuring beliefs and rewards: a neuroeconomic approach. Q. J. Econ. 125, 923-960. doi: 10.1162/qjec.2010.125.3.923
13. Carpenter, S. M., Peters, E., Västfjäll, D., and Isen, A. M. (2013). Positive feelings facilitate working memory and complex decision making among older adults. Cogn. Emot. 27, 184-192. doi: 10.1080/02699931.2012.698251
14. Chamorro-Premuzic, T., and Furnham, A. (2007). Personality and music: can traits explain how people use music in everyday life? Br. J. Psychol. 98, 175-185. doi: 10.1348/000712606X111177
15. Chamorro-Premuzic, T., Swami, V., and Cermakova, B. (2012). Individual differences in music consumption are predicted by uses of music and age rather than emotional intelligence, neuroticism, extraversion or openness. Psychol. Music 40, 285-300. doi: 10.1177/0305735610381591
16. Chapin, H., Jantzen, K., Kelso, J. A., Steinberg, F., and Large, E. (2010). Dynamic emotional and neural responses to music depend on performance expression and listener experience. PLoS ONE 5:e13812. doi:10.1371/journal.pone.0013812
17. Chase, H. W., Frank, M. J., Michael, A., Bullmore, E. T., Sahakian, B. J., and Robbins, T. W. (2010). Approach and avoidance learning in patients with major depression and healthy controls: relation to anhedonia. Psychol. Med. 40, 433-440. doi: 10.1017/S0033291709990468
18. Chen, J. L., Penhune, V. B., and Zatorre, R. J. (2008). Moving on time: brain network for auditory-motor synchronization is modulated by rhythm complexity and musical training. J. Cogn. Neurosci. 20, 226-239. doi: 10.1162/jocn.2008.20018
19. Collins, A. G. E., and Frank, M. J. (2013). Cognitive control over learning: creating, clustering and generalizing task-set structure. Psychol. Rev. 120, 190-229. doi: 10.1037/a0030852
20. D'Ardenne, K., McClure, S. M., Nystrom, L. E., and Cohen, J. D. (2008). BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319, 1264-1267. doi: 10.1126/science.1150605
21. Daw, N. D., and Doya, K. (2006). The computational neurobiology of learning and reward. Curr. Opin. Neurobiol. 16, 199-204. doi: 10.1016/j.conb.2006.03.006
22. Dellacherie, D., Roy, M., Hugueville, L., Peretz, I., and Samson, S. (2011). The effect of musical experience on emotional self-reports and psychophysiological responses to dissonance. Psychophysiology 48, 337-349. doi: 10.1111/j.1469-8986.2010.01075.x
23. Doll, B. B., Hutchison, K. E., and Frank, M. J. (2011). Dopaminergic genes predict individual differences in susceptibility to confirmation bias. J. Neurosci. 31, 6188-6198. doi: 10.1523/JNEUROSCI.6486-10.2011
24. Dubé, L., and Le Bel, J. (2003). The categorical structure of pleasure. Cogn. Emot. 17, 263-297. doi: 10.1080/02699930302295
25. Eerola, T., and Vuoskoski, J. K. (2011). A comparison of the discrete and dimensional models of emotion in music. Psychol. Music 39, 18-49. doi: 10.1177/0305735610362821
26. Fabry, G., and Giesler, M. (2012). Novice medical students: individual patterns in the use of learning strategies and how they change during the first academic year. GMS Z. Med. Ausbild. 29, Doc56. doi:10.3205/zma000826
27. Frank, M. J., Doll, B. B., Oas-Terpstra, J., and Moreno, F. (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat. Neurosci. 12, 1062-1068. doi: 10.1038/nn.2342
28. Frank, M. J., Moustafa, A. A., Haughey, H., Curran, T., and Hutchison, K. (2007a). Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proc. Natl. Acad. Sci. U.S.A. 104, 16311-16316. doi: 10.1073/pnas.0706111104
29. Frank, M. J., Samanta, J., Moustafa, A. A., and Sherman, S. J. (2007b). Hold your horses: impulsivity, deep brain stimulation and medication in Parkinsonism. Science 318, 1309-1312. doi: 10.1126/science.1146157
30. Frank, M. J., Seeberger, L., and O'Reilly, R. C. (2004). By carrot or by stick: cognitive reinforcement learning in Parkinsonism. Science 306, 1940-1943. doi: 10.1126/science.1102941
31. Gaser, C., and Schlaug, G. (2003). Brain structures differ between musicians and non-musicians. J. Neurosci. 23, 9240-9245.
32. Grob, S., Pizzagalli, D. A., Dutra, S. J., Stern, J., Mörgeli, H., Milos, G., et al. (2012). Dopamine-related deficit in reward learning after catecholamine depletion in unmedicated, remitted subjects with bulimia nervosa. Neuropsychopharmacology 37, 1945-1952. doi: 10.1038/npp.2012.41
33. Hollerman, J. R., and Schultz, W. (1998). Dopamine neurons report an error in the temporal prediction of reward during learning. Nat. Neurosci. 1, 304-309. doi: 10.1038/1124
34. Huron, D. (2006). Sweet Anticipation: Music and the Psychology of Expectation. Cambridge, MA: MIT Press.
35. Hyde, K. L., Lerch, J., Norton, A., Forgeard, M., Winner, E., Evans, A. C., et al. (2009). Musical training shapes structural brain development. J. Neurosci. 29, 3019-3025. doi: 10.1523/JNEUROSCI.5118-08.2009
36. Istók, E., Brattico, E., Jacobsen, T., Krohn, K., Müller, M., and Tervaniemi, M. (2009). Aesthetic responses to music: a questionnaire study. Music. Sci. 13, 183-206. doi: 10.1177/102986490901300201
37. Jocham, G., Klein, T. A., and Ullsperger, M. (2011). Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices. J. Neurosci. 31, 1606-1613. doi: 10.1523/JNEUROSCI.3904-10.2011
38. Koelsch, S., Schröger, E., and Tervaniemi, M. (1999). Superior pre-attentive auditory processing in musicians. Neuroreport 10, 1309-1313. doi: 10.1097/00001756-199904260-00029
39. Koeneke, S., Lutz, K., Wustenberg, T., and Jancke, L. (2004). Long-term training affects cerebellar processing in skilled keyboard players. Neuroreport 15, 1279-1282. doi: 10.1097/01.wnr.0000127463.10147.e7
40. Kühn, S., and Gallinat, J. (2012). The neural correlates of subjective pleasantness. Neuroimage 61, 289-294. doi: 10.1016/j.neuroimage.2012.02.065
41. LeDoux, J. (2012). Rethinking the emotional brain. Neuron 73, 653-676. doi: 10.1016/j.neuron.2012.02.004
42. Levitin, D. J. (2012). What does it mean to be musical? Neuron 73, 633-637. doi: 10.1016/j.neuron.2012.01.017
43. Lindquist, K. A., Wager, T. D., Kober, H., Bliss-Moreau, E., and Barrett, L. F. (2012). The brain basis of emotion: a meta-analytic review. Behav. Brain Sci. 35, 121-202. doi: 10.1017/S0140525X11000446
44. Menon, V., and Levitin, D. J. (2005). The rewards of music listening: response and physiological connectivity of the mesolimbic system. Neuroimage 28, 175-184. doi: 10.1016/j.neuroimage.2005.05.053
45. Meyer, L. B. (1956). Emotions and Meaning in Music. Chicago, IL: Chicago University Press.
46. Montague, P. R., Dayan, P., and Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16, 1936-1947.
47. Müller, M., Höfel, L., Brattico, E., and Jacobsen, T. (2010). Aesthetic judgments of music in experts and laypersons-an ERP study. Int. J. Psychophysiol. 76, 40-51. doi: 10.1016/j.ijpsycho.2010.02.002
48. Niv, Y., Daw, N. D., Joel, D., and Dayan, P. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology 191, 507-520. doi: 10.1007/s00213-006-0502-4
49. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., and Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304, 452-454. doi: 10.1126/science.1094285
50. Oechslin, M. S., Van De Ville, D., Lazeyras, F., Hauert, C. A., and James, C. E. (2012). Degree of musical expertise modulates higher order brain functioning. Cereb. Cortex 23, 2213-2224. doi: 10.1093/cercor/bhs206
51. Overton, D. A. (1966). State-dependent learning produced by depressant and atropine-like drugs. Psychopharmacologia 10, 6-31. doi: 10.1007/BF00401896
52. Pacchetti, C., Mancini, F., Aglieri, R., Fundaró, C., Martignoni, E., and Nappi, G. (2000). Active music therapy in Parkinson's disease: an integrative method for motor and emotional rehabilitation. Psychosom. Med. 62, 386-393.
53. Pereira, C. S., Teixeira, J., Figueiredo, P., Xavier, J., Castro, S. L., and Brattico, E. (2011). Music and emotions in the brain: familiarity matters. PLoS ONE 6:e27241. doi:10.1371/journal.pone.0027241
54. Rauscher, F. H., Shaw, G. L., and Ky, K. N. (1993). Music and spatial task performance. Nature 365, 611. doi: 10.1038/365611a0
55. Rentfrow, P. J., and Gosling, S. D. (2003). The do re mi's of everyday life: the structure and personality correlates of music preferences. J. Pers. Soc. Psychol. 84, 1236-1256. doi: 10.1037/0022-3514.84.6.1236
56. Robinson, T. E., and Berridge, K. C. (1993). The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain Res. Rev. 18, 247-291. doi: 10.1016/0165-0173(93)90013-P
57. Rodrigues, A. C., Loureiro, M. A., and Caramelli, P. (2010). Musical training, neuroplasticity and cognition. Dement. Neuropsychol. 4, 277-286.
58. Saarikallio, S., and Erkkilä, J. (2007). The role of music in adolescents' mood regulation. Psychol. Music 35, 88-109. doi: 10.1177/0305735607068889
59. Salimpoor, V. N., Benovoy, M., Larcher, K., Dagher, A., and Zatorre, R. J. (2011). Anatomically distinct dopamine release during anticipation and experience of peak emotion to music. Nat. Neurosci. 14, 257-262. doi: 10.1038/nn.2726
60. Salimpoor, V. N., Benevoy, M., Longo, G., Cooperstock, J. R., and Zatorre, R. J. (2009). The rewarding aspects of music listening are related to degree of emotional arousal. PLoS ONE 4:e7487. doi: 10.1371/journal.pone.0007487
61. Salimpoor, V. N., van den Bosch, I., Kovacevic, N., McIntosh, A. R., Dagher, A., and Zatorre, R. J. (2013). Interactions between nucleus accumbens and auditory cortices predict music reward value. Science 340, 216-219. doi: 10.1126/science.1231059
62. Schott, B. H., Minuzzi, L., Krebs, R. M., Elmenhorst, D., Lang, M., Winz, O. H., et al. (2008). Mesolimbic functional magnetic resonance imaging activations during reward anticipation correlate with reward-related ventral striatal dopamine release. J. Neurosci. 28, 14311-14319. doi: 10.1523/JNEUROSCI.2058-08.2008
63. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron 36, 241-263. doi: 10.1016/S0896-6273(02)00967-4
64. Seger, C. A., Spiering, B. J., Sares, A. G., Quraini, S. I., Alpeter, C., David, J., et al. (2013). Corticostriatal contributions to musical expectancy perception. J. Cogn. Neurosci. 25, 1062-1077. doi: 10.1162/jocn_a_00371
65. Shiner, T., Seymour, B., Wunderlich, K., Hill, C., Bhatia, K. P., Dayan, P., et al. (2012). Dopamine and performance in a reinforcement learning task: evidence from Parkinson's disease. Brain 135, 1871-1883. doi: 10.1093/brain/aws083
66. Sloboda, J. A. (1991). Music structure and emotional response: some empirical findings. Psychol. Music 19, 110-120. doi: 10.1177/0305735691192002
67. Sloboda, J. A., and Juslin, P. N. (2001). "Psychological perspectives on music and emotion," in Music and Emotion: Theory and Research, eds P. N. Juslin and J. A. Sloboda (Oxford: Oxford University Press), 415-430.
68. Sloboda, J. A., and O'Neill, S. A. (2001). "Emotions in everyday listening to music," in Music and Emotion: Theory and Research, eds P. N. Juslin and J. A. Sloboda (Oxford: Oxford University Press), 415-430.
69. Tervaniemi, M., Castaneda, A., Knoll, M., and Uther, M. (2006). Sound processing in amateur musicians and nonmusicians: event-related potential and behavioral indices. Neuroreport 17, 1225-1228. doi: 10.1097/01.wnr.0000230510.55596.8b
70. Tervaniemi, M., Just, V., Koelsch, S., Widmann, A., and Schröger, E. (2005). Pitch discrimination accuracy in musicians vs. nonmusicians: an event-related potential and behavioral study. Exp. Brain Res. 161, 1-10. doi: 10.1007/s00221-004-2044-5
71. Van de Cruys, S., and Wagemans, J. (2011). Putting reward in art: a tentative prediction error account of visual art. Iperception 2, 1035-1062.
72. Vuust, P., and Kringelbach, M. L. (2010). "The pleasure of music," in Pleasures of the Brain, eds M. L. Kringelbach and K. C. Berridge (Oxford: Oxford University Press), 255-269.
73. Worbe, Y., Palminteri, S., Hartmann, A., Vidailhet, M., Lehéricy, S., and Pessiglione, M. (2011). Reinforcement learning and Gilles de la Tourette syndrome: dissociation of clinical phenotypes and pharmacological treatments. Arch. Gen. Psychiatry 68, 1257-1266. doi: 10.1001/archgenpsychiatry.2011.137
74. Zatorre, R. J., Evans, A. C., and Meyer, E. (1994). Neural mechanisms underlying melodic perception and memory for pitch. J. Neurosci. 14, 1908-1919.