Neuroscientific model of motivational process

Frontiers in Psychology

Volumn 4, Issue MAR, 2013, Pages

  Kim, Sung il ^a  

^a Korea University   (South Korea)

Author keywords

Decision making; Educational neuroscience; Goal; Motivation; Neuroeducation; Reward; Self regulation; Value

Indexed keywords

EID: 84878800163     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2013.00098     Document Type: Article

References (84)

1. Aharon, I., Etcoff, N., Ariely, D., Chabris, C. F., O'connor, E., and Breiter, H. C. (2001). Beautiful faces have variable reward value: fMRI and behavioral evidence. Neuron 32, 537-551.
2. Anderson, A. K., Christoff, K., Stappen, I., Panitz, D., Ghahremani, D. G., Glover, G., et al. (2003). Dissociated neural representations of intensity and valence in human olfaction. Nat. Neurosci. 6, 196-202.
3. Ansari, D., De Smedt, B., and Grabner, R. H. (2012). Neuroeducation - a critical overview of an emerging field. Neuroethics 5, 105-117.
4. Aron, A., Fisher, H. E., Mashek, D. J., Strong, G., Li, H. F., and Brown, L. L. (2005). Reward, motivation, and emotion systems associated with early-stage intense romantic love: an fMRI study. J. Neurophysiol. 94, 327-337.
5. Bechara, A., Damasio, A. R., Damasio, H., and Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50, 7-15.
6. Berlyne, D. E. (1974). "Novelty, complexity, and interestingness," in Studies in the New Experimental Aesthetics, ed. D. E. Berlyne (New York: Wiley), 175-180.
7. Berridge, K. C. (2000). Measuring hedonic impact in animals and infants: microstructure of affective taste reactivity patterns. Neurosci. Biobehav. Rev. 24, 173-198.
8. Berridge, K. C. (2003). Pleasures of the brain. Brain Cogn. 52, 106-128.
9. Berridge, K. C. (2007). The debate over dopamine's role in reward: the case for incentive salience. Psychopharmacology 191, 391-431.
10. Berridge, K. C., and Aldridge, J. W. (2008). Decision utility, the brain and pursuit of hedonic goals. Soc. Cogn. 26, 621-646.
11. Berridge, K. C., and Robinson, T. E. (2003). Parsing reward. Trends Neurosci. 26, 507-513.
12. Berridge, K. C., and Valenstein, E. S. (1991). What psychological process mediates feeding evoked by electrical stimulation of the lateral hypothalamus? Behav. Neurosci. 105, 3-14.
13. Bjork, J. M., Knutson, B., Fong, G. W., Caggiano, D. M., Bennett, S. M., and Hommer, D. W. (2004). Incentive-elicited brain activation in adolescents: similarities and differences from young adults. J. Neurosci. 24, 1793-1802.
14. Brand, M., and Markowitch, H. J. (2010). Aging and decision-making: a neurocognitive perspective. Gerontology 56, 319-324.
15. Bush, G., Luu, P., and Posner, M. I. (2000). Cognitive and emotional influences in anterior cingulated cortex. Trends Cogn. Sci. 4, 215-222.
16. Camille, N., Coricelli, G., Sallet, J., Pradat-Diehl, P., Duhamel, J. R., and Sirigu, A. (2004). The involvement of the orbitofrontal cortex in the experience of regret. Science 304, 1167-1170.
17. Casey, B. J., Getz, S., and Galvan, A. (2008). The adolescent brain. Dev. Rev. 28, 62-77.
18. Cole, M., and Schneider, W. (2007). The cognitive control network: integrated cortical regions with dissociable functions. Neuroimage 37, 343-360.
19. Crone, E. A., Zanolie, K., Van Leijenhorst, L., Westenberg, P. M., and Rombouts, S. A. R. B. (2008). Neural mechanisms supporting flexible performance adjustment during development. Cogn. Affect. Behav. Neurosci. 8, 165-177.
20. Csikszentmihalyi, M. (2000). Happiness, flow, and human economic equality. Am. Psychol. 55, 1163-1164.
21. Dagher, A., and Robbins, T. A. (2009). Personality, addiction, dopamine: insights from Parkinson's disease. Neuron 61, 502-510.
22. Damasio, A. R. (1996). The somatic marker hypothesis and the possible functions of the prefrontal cortex. Philos. Trans. R. Soc. Lond. B Biol. Sci. 351, 1413-1420.
23. Daw, N. D., O'doherty, J. P., Dayan, P., Seymour, B., and Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature 441, 876-879.
24. Duijvenvoorde, A. C. K., Zanolie, K., Rombouts, S. A. R. B., Raijmakers, M. E. J., and Crone, E. A. (2008). Evaluating the negative or valuing the positive? Neural mechanisms supporting feedback-based learning across development. J. Neurosci. 28, 9495-9503.
25. Ernst, M., and Frudge, J. L. (2009). A developmental neurobiological model of motivated behavior: anatomy, connectivity and ontogeny of the triadic nodes. Neurosci. Biobehav. Rev. 33, 367-382.
26. Ernst, M., Pine, D. S., and Hardin, M. (2005). Triadic model of the neurobiology of motivated behavior in adolescence. Psychol. Med. 36, 299-312.
27. Galvan, A., Hare, T. A., Parra, C. E., Penn, J., Voss, H., Glover, G., et al. (2006). Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents. J. Neurosci. 26, 6885-6892.
28. Grabenhorst, F., and Rolls, E. T. (2011). Value, pleasure and choice in the ventral prefrontal cortex. Trends Cogn. Sci. 15, 56-67.
29. Grant, J. E., Brewer, J. A., and Potenza, M. N. (2006). The neurobiology of substance and behavioral addictions. CNS Spectr. 11, 924-930.
30. Haber, S. N., and Knutson, B. (2010). The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 35, 4-26.
31. Hare, T. A., Camerer, C. F., and Rangel, A. (2009). Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324, 646-648.
32. Heatherton, T. F. (2011). Neuroscience of self and self-regulation. Annu. Rev. Psychol. 62, 363-390.
33. Hidi, S., and Renninger, K. A. (2006). A four-phase model of interest development. Educ. Psychol. 41, 111-127.
34. Holroyd, C. B., and Coles, M. G. H. (2002). The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109, 679-709.
35. Hyman, S. E., Malenka, R. C., and Nestler, E. J. (2006). Neural mechanisms of addiction: the role of reward-related learning and memory. Annu. Rev. Neurosci. 29, 565-598.
36. Izquierdo, A., Suda, R. K., and Murrey, E. A. (2004). Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J. Neurosci. 24, 7540-7548.
37. Izuma, K., Saito, D. N., and Sadato, N. (2008). Processing of social and monetary rewards in the human striatum. Neuron 58, 284-294.
38. Jaeggi, S. M., Buschkuehl, M., Jonides, J., and Perrig, W. J. (2008). Improving fluid intelligence with training on working memory. Proc. Natl. Acad. Sci. U.S.A. 105, 6829-6833.
39. Kamin, L. J. (1969). "Predictability, surprise, attention and conditioning," in Punishment and Aversive Behavior, ed. R. M. Church (New York: Appleton-Century-Crofts), 279-296.
40. Kim, S. (1999). Inference: a cause of story interestingness. Br. J. Psychol. 90, 57-71.
41. Kim, S. (2012). "Neuroeducational approaches on learning," in Encyclopedia of the Sciences of Learning, ed. N. M. Seel (New York: Springer), 2448-2451.
42. Kim, S., Lee, M. J., Chung, Y., and Bong, M. (2010). Comparison of brain activation during norm-referenced versus criterion-referenced feedback: the role of perceived competence and performance-approach goals. Contemp. Educ. Psychol. 35, 141-152.
43. Klingberg, T., Fernell, E., Olesen, P. J., Johnson, M., Gustafsson, P., Dahlstrom, K., et al. (2005). Computerized training of working memory in children with ADHD - a randomized, controlled trial. J. Am. Acad. Child Adolesc. Psychiatry 44, 177-186.
44. Klingberg, T., Forssberg, H., and Westerberg, H. (2002). Training of working memory in children with ADHD. J. Clin. Exp. Neuropsychol. 24, 781-791.
45. Knoch, D., and Fehr, E. (2007). Resisting the power of temptations: the right prefrontal cortex and self-control. Ann. N. Y. Acad. Sci. 1104, 123-134.
46. Knutson, B., Taylor, J., Kaufman, M., Peterson, R., and Glover, G. (2005). Distributed neural representation of expected value. J. Neurosci. 25, 4806-4812.
47. Kringelbach, M. L. (2005). The human orbitofrontal cortex: linking reward to hedonic experience. Nat. Rev. Neurosci. 6, 691-702.
48. Kringelbach, M. L., O'doherty, J., Rolls, E. T., and Andrews, C. (2003). Activation of the human orbitofrontal cortex to a liquid food stimulus is correlated with its subjective pleasantness. Cereb. Cortex 13, 1064-1071.
49. Leotti, L. A., and Delgado, M. R. (2011). The inherent reward of choice. Psychol. Sci. 22, 1310-1318.
50. Leotti, L. A., Iyengar, S. S., and Ochsner, K. N. (2010). Born to choose: the origins and value of the need for control. Trends Cogn. Sci. 14, 457-463.
51. Lieberman, M. D., and Eisenberger, N. I. (2009). Neuroscience: pains and pleasures of social life. Science 323, 890-891.
52. McClure, S. M., Laibson, D. I., Loewenstein, G., and Cohen, J. D. (2004). Separate neural systems value immediate and delayed monetary rewards. Science 306, 503-507.
53. Miller, E. K., and Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 24, 167-202.
54. Mischel, W., and Gilligan, C. (1964). Delay of gratification, motivation for the prohibited gratification, and responses to temptation. J. Abnorm. Soc. Psychol. 69, 411-417.
55. Mishkin, M. (1964). "Perseveration of central sets after frontal lesions in monkeys," in The Frontal Granular Cortex and Behavior, eds J. M. Warren and K. Akert (New York: McGraw-Hill), 219-241.
56. Mobbs, D., Greicius, M. D., Abdel-Azim, E., Menon, V., and Reiss, A. L. (2003). Humor modulates the mesolimbic reward centers. Neuron 40, 1041-1048.
57. Montague, P. R., and Berns, G. S. (2002). Neural economics and the biological substrates of valuation. Neuron 36, 265-284.
58. Montague, P. R., Dayan, P., and Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16, 1936-1947.
59. O'doherty, J. P., Dayan, P., Friston, K., Critchley, H., and Dolan, R. J. (2003). Temporal difference models and reward-related learning in the human brain. Neuron 38, 329-337.
60. Olds, J., and Milner, P. (1954). Positive reinforcement produced by electrical stimulation of the septal area and other regions of rat brain. J. Comp. Physiol. Psychol. 47, 419-427.
61. Rachlin, H. (1995). Self-control: beyond commitment. Behav. Brain Sci. 18, 109-159.
62. Rangel, A., Camerer, C., and Montague, P. R. (2008). A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9, 545-556.
63. Rescorla, R. A., and Wagner, A. R. (1972). "A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement," in Classical Conditioning II: Current Research and Theory, eds A. Black and W. F. Prokasy (New York: Appleton-Century-Crofts), 64-99.
64. Rilling, J. K., Gutman, D. A., Zeh, T. R., Pagnoni, G., Berns, G. S., and Kilts, C. D. (2002). A neural basis for social cooperation. Neuron 35, 395-405.
65. Rolls, E. T., and Grabenhorst, F. (2008). The orbitofrontal cortex and beyond: from affect to decision-making. Prog. Neurobiol. 86, 216-244.
66. Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., and Rushworth, M. F. S. (2006). Separate neural pathways process different decision costs. Nat. Neurosci. 9, 1161-1168.
67. Ryan, R. M., and Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am. Psychol. 55, 68-78.
68. Salamone, J. D., Correa, M., Farrar, A., and Mingote, S. M. (2007). Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191, 461-482.
69. Salamone, J. D., Correa, M., Mingote, S. M., and Weber, S. M. (2005). Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. Curr. Opin. Pharmacol. 5, 34-41.
70. Schoenbaum, G., Saddoris, M. P., and Stalnaker, T. A. (2007). Reconciling the roles of orbitofrontal cortex in reversal learning and the encoding of outcome expectancies. Ann. N. Y. Acad. Sci. 1121, 320-335.
71. Schultz, W. (2004). Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology. Curr. Opin. Neurobiol. 14, 139-147.
72. Schultz, W. (2006). Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 57, 87-115.
73. Schultz, W., Dayan, P., and Montague, R. R. (1997). A neural substrate of predict and reward. Science 275, 1593-1599.
74. Self, D. (2003). Dopamine as chicken and egg. Nature 422, 573-574.
75. Shamosh, N. A., DeYoung, C. G., Green, A. E., Reis, D. L., Johnson, M. R., Conway, A. R. A., et al. (2008). Individual differences in delay discounting: relation to intelligence, working memory, and anterior prefrontal cortex. Psychol. Sci. 19, 904-911.
76. Shamosh, N. A., and Gray, J. R. (2008). Delay discounting and intelligence: a meta-analysis. Intelligence 36, 289-305.
77. Small, D. M., Gregory, M. D., Mak, Y. E., Gitelman, D., Mesulam, M. M., and Parrish, T. (2003). Dissociation of neural representation of intensity and affective valuation in human gustation. Neuron 39, 701-711.
78. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
79. Tanji, J., and Hoshi, E. (2008). Role of the lateral prefrontal cortex in executive behavioral control. Physiol. Rev. 88, 37-57.
80. Tremblay, L., and Schultz, W. (1999). Relative reward preference in primate orbitofrontal cortex. Nature 398, 704-708.
81. Van Leijenhorst, L., Zanolie, K., Van Meel, C. S., Westenberg, P. M., Rombouts, S. A. R. B., and Crone, E. A. (2010). What motivates the adolescent? Brain regions mediating reward sensitivity across adolescence. Cereb. Cortex 20, 61-69.
82. Wallis, J. D. (2007). Orbitofrontal cortex and its contribution to decision-making. Annu. Rev. Neurosci. 30, 31-56.
83. Walter, H., Abler, B., Ciaramidaro, A., and Erk, S. (2005). Motivating forces of human actions: neuroimaging reward and social interaction. Brain Res. Bull. 67, 368-381.
84. Wise, R. A. (2004). Dopamine, learning, and motivation. Nat. Rev. Neurosci. 5, 483-494.