Your choice motivates you in the brain: The emergence of autonomy neuroscience

Advances in Motivation and Achievement

Volumn 19, Issue , 2016, Pages 95-125

  Murayama, Kou ^a   Izuma, Keise ^a   Aoki, Ryuta ^a   Matsumoto, Kenji ^a  

^a NONE

Author keywords

Intrinsic motivation; Reward network; Self determination; Social neuroscience

Indexed keywords

EID: 84997235967     PISSN: 07497423     EISSN: None     Source Type: Book Series    
DOI: 10.1108/S0749-742320160000019004     Document Type: Article

References (109)

1. Adcock, R. A., Thangavel, A., Whitfield-Gabrieli, S., Knutson, B., & Gabrieli, J. D. E. (2006). Reward-motivated learning: Mesolimbic activation precedes memory formation. Neuron, 50(3), 507-517. doi:10.1016/j.neuron.2006.03.036
2. Aoki, R., Matsumoto, M., Yomogida, Y., Izuma, K., Murayama, K., Sugiura, A.,.. Adolphs, R. (2014). Social equality in the number of choice options is represented in the ventromedial prefrontal cortex. Journal of Neuroscience, 34, 6413-6421.
3. Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Educational Psychology Review, 84, 191-215.
4. Bartra, O., McGuire, J. T., & Kable, J. W. (2013). The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage, 76, 412-427.
5. Bartling, B., Fehr, E., & Herz, H. (2014). The intrinsic value of decision rights. Econometrica, 82(6), 2005-2039. doi:10.3982/ECTA11573
6. Bhanji, J. P., & Delgado, M. R. (2014). Perceived control influences neural responses to setbacks and promotes persistence. Neuron, 83, 1369-1375.
7. Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: Beliefs, techniques, and illusions. Annual Review of Psychology, 64, 417-444.
8. Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004). Conflict monitoring and anterior cingulate cortex: An update. Trends in Cognitive Sciences, 8, 539-546.
9. Botvinick, M. M., Huffstetler, S., & McGuire, J. T. (2009). Effort discounting in human nucleus accumbens. Cognitive, Affective & Behavioral Neuroscience, 9(1), 16-27. doi:10.3758/CABN.9.1.16
10. Bown, N. J., Read, D., & Summers, B. (2003). The lure of choice. Journal of Behavioral Decision Making, 16(4), 297-308. doi:10.1002/bdm.447
11. Brehm, J. W. (1956). Post-decision changes in the desirability of choice alternatives. Journal of Abnormal Psychology, 52, 384-389.
12. Cacioppo, J. T., & Petty, R. E. (1985). Central and peripheral routes to persuasion: The role of message repetition. In L. Alwitt & A. Mitchell (Eds.), Psychological processes and advertising effects (pp. 91-111). Hillsdale, NJ: Lawrence Erlbaum Associates.
13. Chen, M. K., & Risen, J. L. (2010). How choice affects and reflects preferences: Revisiting the free-choice paradigm. Journal of Personality and Social Psychology, 99(4), 573-594. doi:10.1037/a0020217
14. Chernev, A., Bockenholt, U., & Goodman, J. (2015). Choice overload: A conceptual review and meta-analysis. Journal of Consumer Psychology, 25(2), 333-358. doi:10.1016/j.jcps.2014.08.002
15. Cockburn, J., Collins, A. G. E., & Frank, M. J. (2014). A reinforcement learning mechanism responsible for the valuation of free choice. Neuron, 83(3), 551-557. doi:10.1016/j.neuron.2014.06.035
16. Cordova, D. I., & Lepper, M. R. (1996). Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. Journal of Educational Psychology, 88(4), 715-730.
17. Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011). Model-based influences on humans' choices and striatal prediction errors. Neuron, 69(6), 1204-1215. doi:10.1016/j.neuron.2011.02.027
18. Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self determination in human behavior. New York, NY: Plenum.
19. Festinger, L. (1957). A theory of cognitive dissonance. Stanford: Stanford University Press.
20. Fujiwara, J., Usui, N., Park, S. Q., Williams, T., Iijima, T., Taira, M.,.. Tobler, P. N. (2013). Value of freedom to choose encoded by the human brain. Journal of Neurophysiology, 110(8), 1915-1929. doi:10.1152/jn.01057.2012
21. Geers, A., & Rose, J. (2011). Treatment choice and placebo expectation effects. Social and Personality Psychology Compass, 5(10), 734-750. doi:10.1111/j.1751-9004.2011.00385.x
22. Gerard, H. B., & White, G. L. (1983). Post-decisional reevaluation of choice alternatives. Personality and Social Psychology Bulletin, 9(3), 365-369. doi:10.1177/0146167283093006
23. Gilbert, D. T., & Ebert, J. E. J. (2002). Decisions and revisions: The affective forecasting of changeable outcomes. Journal of Personality and Social Psychology, 82, 503-514. doi:10.1037/0022-3514.82.4.503
24. Haber, S. N., & Knutson, B. (2010). The reward circuit: Linking primate anatomy and human imaging. Neuropsychopharmacology, 35(1), 4-26. doi:10.1038/npp.2009.129
25. Haggard, P. (2008). Human volition: Towards a neuroscience of will. Nature Reviews Neuroscience, 9, 934-946. doi:10.1038/nrn2497
26. Hajcak, G., & Foti, D. (2008). Errors are aversive: Defensive motivation and the error-related negativity. Psychological Science, 19(2), 103-108. doi:10.1111/j.1467-9280.2008.02053.x
27. Hall, L., Johansson, P., & Strandberg, T. (2012). Lifting the veil of morality: Choice blindness and attitude reversals on a self-transforming survey. PLoS One, 7(9), e45457. doi:10.1371/journal.pone.0045457
28. Hall, L., Strandberg, T., Parnamets, P., Lind, A., Tarning, B., & Johansson, P. (2013). How the polls can be both spot on and dead wrong: Using choice blindness to shift political attitudes and voter intentions. PLoS One, 8(4), e60554. doi:10.1371/journal. pone.0060554
29. Hare, T. A., O'Doherty, J., Camerer, C. F., Schultz, W., & Rangel, A. (2008). Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. Journal of Neuroscience, 28(22), 5623-5630. doi:10.1523/jneurosci.1309-08.2008
30. Harmon-Jones, E. (2004). Contributions from research on anger and cognitive dissonance to understanding the motivational functions of asymmetrical frontal brain activity. Biological Psychology, 67(1-2), 51-76. doi:10.1016/j.biopsycho.2004.03.003
31. Heekeren, H. R., Wartenburger, I., Schmidt, H., Schwintowski, H.-P., & Villringer, A. (2003). An fMRI study of simple ethical decision-making. Neuroreport, 14(9), 1215-1219.
32. Heine, S. J., & Lehman, D. R. (1997). Culture, dissonance, and self-affirmation. Personality and Social Psychology Bulletin, 23(4), 389-400. doi:10.1177/0146167297234005
33. Hidi, S. (2016). Revisiting the role of rewards in motivation and learning: Implications of neu-roscientific research. Educational Psychology Review, 28, 1-33. doi:10.1007/s10648-015-9307-5
34. Holroyd, C. B., & Coles, M. G. H. (2002). The basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709.
35. Iyengar, S. S., & Lepper, M. R. (1999). Rethinking the value of choice: A cultural perspective on intrinsic motivation. Journal of Personality and Social Psychology, 76, 349-366.
36. Iyengar, S. S., & Lepper, M. R. (2000). When choice is demotivating: Can one desire too much of a good thing? Journal of Personality and Social Psychology, 79(6), 995-1006. doi:10.1037/0022-3514.79.6.995
37. Izuma, K. (2013). The neural basis of social influence and attitude change. Current Opinion in Neurobiology, 23(3), 456-462. doi:10.1016/j.conb.2013.03.009
38. Izuma, K., & Adolphs, R. (2013). Social manipulation of preference in the human brain. Neuron, 78(3), 563-573. doi:10.1016/j.neuron.2013.03.023
39. Izuma, K., Akula, S., Murayama, K., Wu, D.-A., Iacoboni, M., & Adolphs, R. (2015). A causal role for posterior medial frontal cortex in choice-induced preference change. Journal of Neuroscience, 35(8), 3598-3606. doi:10.1523/jneurosci.4591-14.2015
40. Izuma, K., Matsumoto, M., Murayama, K., Samejima, K., Sadato, N., & Matsumoto, K. (2010). Neural correlates of cognitive dissonance and choice-induced preference change. PNAS Proceedings of the National Academy of Sciences of the United States of America, 107(51), 22014-22019.
41. Izuma, K., Matsumoto, M., Murayama, K., Samejima, K., Sadato, N., & Matsumoto, K. (2013). Neural correlates of cognitive dissonance and decision conflict. Advances in Cognitive Neurodynamics (Vol. 3, pp. 623-628). Netherlands: Springer.
42. Izuma, K., & Murayama, K. (2013). Choice-induced preference change in the free-choice paradigm: A critical methodological review. Front Psychology, 4, 41. doi:10.3389/fpsyg.2013.00041
43. Jarcho, J. M., Berkman, E. T., & Lieberman, M. D. (2011). The neural basis of rationalization: Cognitive dissonance reduction during decision-making. Social Cognitive and Affective Neuroscience, 6(4), 460-467. doi:10.1093/scan/nsq054
44. Johansson, P., Hall, L., Sikstrom, S., & Olsson, A. (2005). Failure to detect mismatches between intention and outcome in a simple decision task. Science, 310, 116-119.
45. Kable, J. W., & Glimcher, P. W. (2009). The neurobiology of decision: Consensus and controversy. Neuron, 63(6), 733-745. doi:10.1016/j.neuron.2009.09.003
46. Kahneman, D. (2003). A perspective on judgment and choice-Mapping bounded rationality. American Psychologist, 58(9), 697-720. doi:10.1037/0003-066x.58.9.697
47. Katz, I., & Assor, A. (2007). When choice motivates and when it does not. Educational Psychology Review, 19, 429-442. doi:10.1007/s10648-006-9027-y
48. Kenworthy, J. B., Miller, N., Collins, B. E., Read, S. J., & Earleywine, M. (2011). A trans-paradigm theoretical synthesis of cognitive dissonance theory: Illuminating the nature of discomfort. European Review of Social Psychology, 22(1), 36-113. doi:10.1080/10463283.2011.580155
49. Kitayama, S., Chua, H. F., Tompson, S., & Han, S. (2013). Neural mechanisms of dissonance: An fMRI investigation of choice justification. Neuroimage, 69, 206-212. doi:10.1016/j. neuroimage.2012.11.034
50. Knutson, B., & Cooper, J. C. (2005). Functional magnetic resonance imaging of reward prediction. Current Opinion in Neurology, 18(4), 411-417. doi:10.1097/01.wco.0000173463.24758.f6
51. Knutson, B., Fong, G. W., Adams, C. M., Varner, J. L., & Hommer, D. (2001). Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport, 12(17), 3683-3687. doi:10.1097/00001756-200112040-00016
52. Kool, W., Getz, S. J., & Botvinick, M. M. (2013). Neural representation of reward probability: Evidence from the illusion of control. Journal of Cognitive Neuroscience, 25(6), 852-861. doi:10.1162/jocn-a-00369
53. Kool, W., McGuire, J. T., Rosen, Z. B., & Botvinick, M. M. (2010). Decision making and the avoidance of cognitive demand. Journal of Experimental Psychology: General, 139(4), 665-682. doi:10.1037/a0020198
54. Kornell, N., & Bjork, R. A. (2008). Optimising self-regulated study: The benefits-and costs-of dropping flashcards. Memory, 16(2), 125-136.
55. Langer, E. J. (1975). Illusion of control. Journal of Personality and Social Psychology, 32(2), 311-328. doi:10.1037//0022-3514.32.2.311
56. Legault, L., & Inzlicht, M. (2013). Self-determination, self-regulation, and the brain: Autonomy improves performance by enhancing neuroaffective responsiveness to self-regulation failure. Journal of Personality and Social Psychology, 105(1), 123-138. doi:10.1037/a0030426
57. Leotti, L. A., Cho, C, & Delgado, M. R. (2015). The neural basis underlying the experience of control in the human brain. In P. Haggard & B. Eitam (Eds.), The sense of agency (pp. 145-176). Oxford: Oxford University Press.
58. Leotti, L. A., & Delgado, M. R. (2011). The inherent reward of choice. Psychological Science.
59. Leotti, L. A., & Delgado, M. R. (2014). The value of exercising control over monetary gains and losses. Psychological Science, 22, 1310-1318. doi:10.1177/0956797613514589
60. Leotti, L. A., Iyengar, S. S., & Ochsner, K. N. (2010). Born to choose: The origins and value of the need for control. Trends in Cognitive Sciences, 14(10), 457-463. doi:10.1016/j.tics.2010.08.001
61. Lisman, J. E., & Grace, A. A. (2005). The hippocampal-vta loop: Controlling the entry of information into long-term memory. Neuron, 46(5), 703-713. doi:10.1016/j.neuron.2005.05.002
62. Litt, A., Plassmann, H., Shiv, B., & Rangel, A. (2011). Dissociating valuation and saliency signals during decision-making. Cerebral Cortex, 21(1), 95-102. doi:10.1093/cercor/bhq065
63. Luu, P., Collins, P. F., & Tucker, D. M. (2000). Mood, personality, and self-monitoring: Negative affect and emotionality in relation to frontal lobe mechanisms of error monitoring. Journal of Experimental Psychology: General, 129(1), 43-60. doi:10.1037/0096-3445.129.1.43
64. Mengarelli, F., Spoglianti, S., Avenanti, A., & di Pellegrino, G. (2015). Cathodal tdcs over the left prefrontal cortex diminishes choice-induced preference change. Cerebral Cortex, 25(5), 1219-1227. doi:10.1093/cercor/bht314
65. Montague, P. R., & Berns, G. S. (2002). Neural economics and the biological substrates of valuation. Neuron, 36, 265-284.
66. Monty, R. A., & Permuter, L. C. (1975). Persistence of the effects of choice on paired-associate learning. Memory & Cognition, 3(2), 183-187.
67. Monty, R. A., Rosenberger, M. A., & Perlmuter, L. C. (1973). Amount of locus of choice as sources of motivation in paired-associate learning. Journal of Experimental Psychology, 97(1), 16.
68. Murayama, K., Blake, A. B., Kerr, T., & Castel, A. D. (2016). When enough is not enough: Information overload and metacognitive decisions to stop studying information. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42, 914-924.
69. Murayama, K., & Kitagami, S. (2014). Consolidation power of extrinsic rewards: Reward cues enhance long-term memory for irrelevant past events. Journal of Experimental Psychology: General, 143, 15-20.
70. Murayama, K., & Kuhbandner, C. (2011). Money enhances memory consolidation-But only for boring material. Cognition, 119(1), 120-124. doi:10.1016/j.cognition.2011.01.001
71. Murayama, K., Matsumoto, M., Izuma, K., Sugiura, A., Ryan, R. M., Deci, E. L., & Matsumoto, K. (2015). How self-determined choice facilitates performance: A key role of the ventromedial prefrontal cortex. Cerebral Cortex, 25(5), 1241-1251. doi:10.1093/cercor/bht317
72. Murty, V. P., DuBrow, S., & Davachi, L. (2015). The simple act of choosing influences declarative memory. The Journal of Neuroscience, 35(16), 6255-6264.
73. Noonan, M. P., Mars, R. B., & Rushworth, M. F. S. (2011). Distinct roles of three frontal cortical areas in reward-guided behavior. Journal of Neuroscience, 31(40), 14399-14412.
74. O'Doherty, J. P. (2012). Beyond simple reinforcement learning: The computational neurobiology of reward-learning and valuation. European Journal of Neuroscience, 35(7), 987-990. doi:10.1111/j.1460-9568.2012.08074.x
75. Patall, E. A. (2012). The motivational complexity of choosing: A review of theory and research. In R. M. Ryan (Ed.), Oxford handbook of motivation (pp. 248-279). Oxford: Oxford University Press.
76. Patall, E. A., Cooper, H., & Robinson, J. C. (2008). The effects of choice on intrinsic motiva-tion and related outcomes: A meta-analysis of research findings. Psychological Bulletin, 134(2), 270-300. doi:10.1037/0033-2909.134.2.270
77. Perdue, B., Evans, T., Washburn, D., Rumbaugh, D., & Beran, M. (2014). Do monkeys choose to choose? Learning & Behavior, 42(2), 164-175. doi:10.3758/s13420-014-0135-0
78. Perlmuter, L., Monty, R. A., & Kimble, G. A. (1971). Effect of choice on paired-associate learning. Journal of Experimental Psychology, 91(1), 47-53.
79. Perlmuter, L. C, Scharff, K., Karsh, R., & Monty, R. A. (1980). Perceived control: A generalized state of motivation. Motivation and Emotion, 4(1), 35-45.
80. Poldrack, R. A. (2006). Can cognitive processes be inferred from neuroimaging data? Trends in Cognitive Sciences, 10(2), 59-63. doi:10.1016/j.tics.2005.12.004
81. Qin, J., Kimel, S., Kitayama, S., Wang, X., Yang, X., & Han, S. (2011). How choice modifies preference: Neural correlates of choice justification. Neuroimage, 55(1), 240-246. doi:10.1016/j.neuroimage.2010.11.076
82. Reeve, J., Nix, G., & Hamm, D. (2003). The experience of self-determination in intrinsic motivation and the conundrum of choice. Journal of Educational Psychology, 95, 375-392.
83. Rilling, J. K., & Sanfey, A. G. (2011). The neuroscience of social decision-making. Annual Review of Psychology, 62, 23-48.
84. Risen, J. L., & Chen, M. K. (2010). How to study choice-induced attitude change: Strategies for fixing the free-choice paradigm. Social and Personality Psychology Compass, 4(12), 1151-1164. doi:10.1111/j.1751-9004.2010.00323.x
85. Rose, J. P., Geers, A. L., Rasinski, H. M., & Fowler, S. L. (2012). Choice and placebo expec-tation effects in the context of pain analgesia. Journal of Behavioral Medicine, 35(4), 462-470. doi:10.1007/s10865-011-9374-0
86. Rotter, J. B. (1966). Generalized expectancies for internal versus external control of reinforcement. Psychological Monographs: General & Applied, 80(1), 1-28.
87. Ryan, R. M., & Deci, E. L. (2000). Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Educational Psychology, 25, 54-67.
88. Salomons, T. V., Johnstone, T., Backonja, M. M., & Davidson, R. J. (2004). Perceived con-trollability modulates the neural response to pain. Journal of Neuroscience, 24(32), 7199-7203. doi:10.1523/jneurosci.1315-04.2004
89. Salomons, T. V., Johnstone, T., Backonja, M. M., Shackman, A. J., & Davidson, R. J. (2007). Individual differences in the effects of perceived controllability on pain perception: Critical role of the prefrontal cortex. Journal of Cognitive Neuroscience, 19(6), 993-1003. doi:10.1162/jocn.2007.19.6.993
90. Salomons, T. V., Nusslock, R., Detloff, A., Johnstone, T., & Davidson, R. J. (2014). Neural emotion regulation circuitry underlying anxiolytic effects of perceived control over pain. Journal of Cognitive Neuroscience, 27(2), 222-233. doi:10.1162/jocn-a-00702
91. Savani, K., Markus, H. R., & Conner, A. L. (2008). Let your preference be your guide? Preferences and choices are more tightly linked for north Americans than for Indians. Journal of Personality and Social Psychology, 95(4), 861-876. doi:10.1037/a0011618
92. Sharot, T., De Martino, B., & Dolan, R. J. (2009). How choice reveals and shapes expected hedonic outcome. Journal of Neuroscience, 29(12), 3760-3765. doi:10.1523/jneurosci.4972-08.2009
93. Shimojo, S., Simion, C, Shimojo, E., & Scheier, C. (2003). Gaze bias both reflects and influences preference. Nature Neuroscience, 6, 1317-1322.
94. Shohamy, D., & Adcock, R. A. (2010). Dopamine and adaptive memory. Trends in Cognitive Sciences, 14(10), 464-472. doi:10.1016/j.tics.2010.08.002
95. Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014). P-curve and effect size: Correcting for publication bias using only significant results. Perspectives on Psychological Science, 9(6), 666-681. doi:10.1177/1745691614553988
96. Steele, C. M., Spencer, S. J., & Lynch, M. (1993). Self-image resilience and dissonance: The role of affirmational resources. Journal of Personality and Social Psychology, 64(6), 885-896. doi:10.1037/0022-3514.64.6.885
97. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning. Cambridge, MA: MIT Press.
98. Suzuki, S. (1997). Effects of number of alternatives on choice in humans. Behavioural Processes, 39(2), 205-214.
99. Suzuki, S. (2000). Choice between single-response and multichoice tasks in humans. Psychological Record, 50, 105-115.
100. Takahashi, M. (1992). Memorial consequences of choosing nonwords-Implication for interpretations of the self-choice effect. Japanese Psychological Research, 34(1), 35-38.
101. Tolman, E. C. (1948). Cognitive maps in rats and men. Psychological Review, 55, 189-208. doi:10.1037/h0061626.
102. Toyota, H. (2013). The self-choice effects on memory and individual differences in emotional intelligence. Japanese Psychological Research, 55(1), 45-57. doi:10.1111/j.1468-5884.2012.00530.x
103. van Veen, V., Krug, M. K., Schooler, J. W., & Carter, C. S. (2009). Neural activity predicts attitude change in cognitive dissonance. Nature Neuroscience, 12(11), 1469-1474. Retrieved from http://www.nature.com/neuro/journal/v12/n11/suppinfo/nn.2413-S1.html
104. Vassena, E., Krebs, R. M., Silvetti, M., Fias, W., & Verguts, T. (2014). Dissociating contributions of acc and vmpfc in reward prediction, outcome, and choice. Neuropsychologia, 59, 112-123. doi:10.1016/j.neuropsychologia.2014.04.019
105. Vohs, K. D., Baumeister, R. F., Schmeichel, B. J., Twenge, J. M., Nelson, N. M., & Tice, D. M. (2008). Making choices impairs subsequent self-control: A limited-resource account of decision making, self-regulation, and active initiative. Journal of Personality and Social Psychology, 94(5), 883-898. doi:10.1037/0022-3514.94.5.883
106. Wegner, D. M. (2003). The illusion of conscious will. Cambridge, MA: MIT Press.
107. Wittmann, B. C, Schott, B. H., Guderian, S., Frey, J. U., Heinze, H. J., & Duzel, E. (2005). Reward-related fmri activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron, 45(3), 459-467. doi:10.1016/j.neuron.2005.01.010
108. Zhang, Y., & Risen, J. L. (2014). Embodied motivation: Using a goal systems framework to understand the preference for social and physical warmth. Journal of Personality and Social Psychology, 107, 965-977.
109. Zuckerman, M., Porac, J., Lathin, D., & Deci, E. L. (1978). On the importance of self-determination for intrinsically-motivated behavior. Personality and Social Psychology Bulletin, 4(3), 443-446. doi:10.1177/014616727800400317