Anterior prefrontal cortex contributes to action selection through tracking of recent reward trends

Journal of Neuroscience

Volumn 32, Issue 25, 2012, Pages 8434-8442

  Kovach, Christopher K ^a,b   Daw, Nathaniel D ^c   Rudrauf, David ^b   Trane, Daniel ^b   O'Doherty, John P ^a   Adolphs, Ralph ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF IOWA HOSPITALS AND CLINICS   (United States)

^c NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BRAIN CORTEX LESION; CLINICAL ARTICLE; CONTROLLED STUDY; DECISION MAKING; FEMALE; GENDER; HUMAN; MALE; NONBIOLOGICAL MODEL; PREFRONTAL CORTEX; PRIORITY JOURNAL; PSYCHOMOTOR PERFORMANCE; REINFORCEMENT; RESPONSE TIME; REWARD; SIMULATION; TASK PERFORMANCE; VISUAL STIMULATION;

ALGORITHMS; ANALYSIS OF VARIANCE; BRAIN DAMAGE, CHRONIC; COMPUTER SIMULATION; DECISION MAKING; EXPLORATORY BEHAVIOR; FEMALE; FUNCTIONAL LATERALITY; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; INTELLIGENCE TESTS; LEARNING; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; MODELS, NEUROLOGICAL; NEUROPSYCHOLOGICAL TESTS; NEUROSURGICAL PROCEDURES; PREFRONTAL CORTEX; PSYCHOMOTOR PERFORMANCE; REWARD; SEX CHARACTERISTICS;

EID: 84862835850     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.5468-11.2012     Document Type: Article

References (34)

1. Amati D, Shallice T (2007) On the emergence of modern humans. Cognition 103:358-385.
2. Barberis N, Shleifer A, Vishny R (1998) A model of investor sentiment. J Financial Econ 49:307-343.
3. Bechara A, Damasio AR, Damasio H, Anderson SW (1994) Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50:7-15.
4. Bechara A, Tranel D, Damasio H (2000) Characterization of the decision making deficit of patients with ventromedial prefrontal cortex lesions. Brain 123:2189-2202.
5. Boorman ED, Behrens TE, Woolrich MW, Rushworth MF (2009) How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62:733-743.
6. Burgess PW (2000) Strategy application disorder: the role of the frontal lobes in human multitasking. Psychol Res 63:279-288.
7. Burgess PW, Veitch E, de Lacy Costello A, Shallice T (2000) The cognitive and neuroanatomical correlates of multitasking. Neuropsychologia 38:848-863.
8. Burgess PW, Gilbert SJ, Dumontheil I (2007) Function and localization within rostral prefrontal cortex (area 10). Philos Trans R Soc Lond B Biol Sci 362:887-899.
9. Camille N, Griffiths CA, Vo K, Fellows LK, Kable JW (2011) Ventromedial frontal lobe damage disrupts value maximization in humans. J Neurosci 31:7527-7532.
10. Daw ND (2011) Trial-by-trial data analysis using computational models (tutorial review). In: Decision making, affect, and learning: attention and performance XXIII, Sec 1 (Delgado MR, Phelps, EA, Robbins TW, eds), p 3. Oxford: Oxford UP.
11. Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006) Cortical substrates for exploratory decisions in humans. Nature 441:876-879.
12. Dreher JC, Koechlin E, Tierney M, Grafman J (2008) Damage to the frontopolar cortex is associated with impaired multitasking. PLoS One 3:e3227.
13. Fellows LK, Farah MJ (2005) Different underlying impairments in decisionmaking following ventromedial and dorsolateral frontal lobe damage in humans. Cereb Cortex 15:58-63.
14. Holmes AP, Friston KJ (1998) Generalisability, random effects and population inference. Neuroimage 7:S754.
15. Koechlin E, Hyafil A (2007) Anterior prefrontal function and the limits of human decision-making. Science 318:594-598.
16. Koechlin E, Basso G, Pietrini P, Panzer S, Grafman J (1999) The role of the anterior prefrontal cortex in human cognition. Nature 399:148-151.
17. Lau B, Glimcher PW (2005) Dynamic response-by-response models of matching behavior in rhesus monkeys. J Exp Anal Behav 84:555-579.
18. McCullagh P, Nelder JA (1999) Generalized linear models, Ed 2. Boca Raton, FL: Chapman and Hall.
19. McFadden D (1974) Conditional logit analysis of qualitative choice behavior. In: Frontiers in econometrics (Zarembka P, ed), pp 105-142. New York: Academic.
20. Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24:167-202.
21. Noonan MP, Walton ME, Behrens TE, Sallet J, Buckley MJ, Rushworth MF (2010) Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc Natl Acad Sci U S A 107:20547-20552.
22. O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-337.
23. Pollmann S, Manginelli AA (2009) Early implicit contextual change detection in anterior prefrontal cortex. Brain Res 1263:87-92.
24. Pollmann S, Mahn K, Reimann B, Weidner R, Tittgemeyer M, Preul C, Müller HJ, von Cramon DY (2007) Selective visual dimension weighting deficit after left lateral frontopolar lesions. J Cogn Neurosci 19:365-375.
25. Ramnani N, Owen AM (2004) Anterior prefrontal cortex: insights into function from anatomy and neuroimaging. Nat Rev Neurosci 5:184-194.
26. Schönberg T, Daw ND, Joel D, O'Doherty JP (2007) Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J Neurosci 27:12860-12867.
27. Semendeferi K, Armstrong E, Schleicher A, Zilles K, Van Hoesen GW (2001) Prefrontal cortex in humans and apes: a comparative study of area 10. Am J Phys Anthropol 114:224-241.
28. Shallice T, Burgess PW (1991) Deficits in strategy application following frontal lobe damage in man. Brain 114:727-741.
29. Shiv B, Loewenstein G, Bechara A, Damasio H, Damasio AR (2005) Investment behavior and the negative side of emotion. Psychol Sci 16:435-439.
30. Strange BA, Henson RN, Friston KJ, Dolan RJ (2001) Anterior prefrontal cortex mediates rule learning in humans. Cereb Cortex 11:1040-1046.
31. Sutton RS (1988) Learning to predict by the methods of temporal differences. Machine Learning 3:9-44.
32. Tsujimoto S, Genovesio A, Wise SP (2010) Evaluating self-generated decisions in frontal pole cortex of monkeys. Nat Neurosci 13:120-126.
33. Walton ME, Behrens TE, Buckley MJ, Rudebeck PH, Rushworth MF (2010) Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65:927-939.
34. Wunderlich K, Rangel A, O'Doherty JP (2009) Neural computations underlying action-based decision making in the human brain. Proc Natl Acad Sci U S A 106:17199-17204.