Parsing decision making processes in prefrontal cortex: Response inhibition, overcoming learned avoidance, and reversal learning

NeuroImage

Volumn 54, Issue 2, 2011, Pages 1432-1441

  Greening, Steven G ^a   Finger, Elizabeth C ^a,b   Mitchell, Derek G V ^a  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

^b WESTERN UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AVOIDANCE BEHAVIOR; BRAIN FUNCTION; BRAIN REGION; COGNITION; CONTROLLED STUDY; DECISION MAKING; FEEDBACK SYSTEM; FEMALE; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMPULSIVENESS; INHIBITION (PSYCHOLOGY); LEARNING; MALE; NORMAL HUMAN; PREFRONTAL CORTEX; PRIORITY JOURNAL; REWARD; SOCIAL BEHAVIOR; STIMULUS RESPONSE; TASK PERFORMANCE; VOLUNTEER;

AVOIDANCE LEARNING; BRAIN MAPPING; DECISION MAKING; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; PREFRONTAL CORTEX; REVERSAL LEARNING;

EID: 78649683403     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2010.09.017     Document Type: Article

References (76)

1. Aron A.R., Fletcher P.C., Bullmore E.T., Sahakian B.J., Robbins T.W. Stop-signal inhibition disrupted by damage to right inferior frontal gyrus in humans. Nat. Neurosci. 2003, 6(2):115-116.
2. Berlin H.A., Rolls E.T., Kischka U. Impulsivity, time perception, emotion and reinforcement sensitivity in patients with orbitofrontal cortex lesions. Brain 2004, 127(Pt 5):1108-1126.
3. Blair K., Marsh A.A., Morton J., Vythilingam M., Jones M., Mondillo K., et al. Choosing the lesser of two evils, the better of two goods: specifying the roles of ventromedial prefrontal cortex and dorsal anterior cingulate in object choice. J. Neurosci. 2006, 26(44):11379-11386.
4. Boorman E.D., Behrens T.E., Woolrich M.W., Rushworth M.F. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 2009, 62(5):733-743.
5. Botvinick M.M., Cohen J.D., Carter C.S. Conflict monitoring and anterior cingulate cortex: an update. Trends Cogn. Sci. 2004, 8(12):539-546.
6. Budhani S., Blair R.J. Response reversal and children with psychopathic tendencies: success is a function of salience of contingency change. J. Child Psychol. Psychiatry 2005, 46(9):972-981.
7. Budhani S., Richell R.A., Blair R.J. Impaired reversal but intact acquisition: probabilistic response reversal deficits in adult individuals with psychopathy. J. Abnorm. Psychol. 2006, 115(3):552-558.
8. Budhani S., Marsh A.A., Pine D.S., Blair R.J. Neural correlates of response reversal: considering acquisition. Neuroimage 2007, 34(4):1754-1765.
9. Carter C.S., Braver T.S., Barch D.M., Botvinick M.M., Noll D., Cohen J.D. Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 1998, 280(5364):747-749.
10. Casey B.J., Forman S.D., Franzen P., Berkowitz A., Braver T.S., Nystrom L.E., et al. Sensitivity of prefrontal cortex to changes in target probability: a functional MRI study. Hum. Brain Mapp. 2001, 13(1):26-33.
11. Chamberlain S.R., Muller U., Blackwell A.D., Clark L., Robbins T.W., Sahakian B.J. Neurochemical modulation of response inhibition and probabilistic learning in humans. Science 2006, 311(5762):861-863.
12. Clarke H.F., Dalley J.W., Crofts H.S., Robbins T.W., Roberts A.C. Cognitive inflexibility after prefrontal serotonin depletion. Science 2004, 304(5672):878-880.
13. Clarke H.F., Walker S.C., Crofts H.S., Dalley J.W., Robbins T.W., Roberts A.C. Prefrontal serotonin depletion affects reversal learning but not attentional set shifting. J. Neurosci. 2005, 25(2):532-538.
14. Clarke H.F., Walker S.C., Dalley J.W., Robbins T.W., Roberts A.C. Cognitive inflexibility after prefrontal serotonin depletion is behaviorally and neurochemically specific. Cereb. Cortex 2007, 17(1):18-27.
15. Cools R., Clark L., Owen A.M., Robbins T.W. Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging. J. Neurosci. 2002, 22(11):4563-4567.
16. Cox R. AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 1996, 29(3):162-173.
17. Daw N.D., O'Doherty J.P., Dayan P., Seymour B., Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature 2006, 441(7095):876-879.
18. Dias R., Robbins T.W., Roberts A.C. Dissociation in prefrontal cortex of affective and attentional shifts. Nature 1996, 380(6569):69-72.
19. Dickstein D.P., Finger E.C., Brotman M.A., Rich B.A., Pine D.S., Blair J.R., et al. Impaired probabilistic reversal learning in youths with mood and anxiety disorders. Psychol. Med. 2009, 1-12.
20. Dodds C.M., Muller U., Clark L., van Loon A., Cools R., Robbins T.W. Methylphenidate has differential effects on blood oxygenation level-dependent signal related to cognitive subprocesses of reversal learning. J. Neurosci. 2008, 28(23):5976-5982.
21. Elliott R., Newman J.L., Longe O.A., William Deakin J.F. Instrumental responding for rewards is associated with enhanced neuronal response in subcortical reward systems. Neuroimage 2004, 21(3):984-990.
22. Fellows L.K. The role of orbitofrontal cortex in decision making: a component process account. Ann. N. Y. Acad. Sci. 2007, 1121:421-430.
23. Fellows L.K., Farah M.J. Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. Brain 2003, 126(Pt 8):1830-1837.
24. Fellows L.K., Farah M.J. Different underlying impairments in decision-making following ventromedial and dorsolateral frontal lobe damage in humans. Cereb. Cortex 2005, 15(1):58-63.
25. Finger E.C., Marsh A.A., Buzas B., Kamel N., Rhodes R., Vythilingham M., et al. The impact of tryptophan depletion and 5-HTTLPR genotype on passive avoidance and response reversal instrumental learning tasks. Neuropsychopharmacology 2007, 32(1):206-215.
26. Finger E.C., Marsh A.A., Mitchell D.G., Reid M.E., Sims C., Budhani S., et al. Abnormal ventromedial prefrontal cortex function in children with psychopathic traits during reversal learning. Arch. Gen. Psychiatry 2008, 65(5):586-594.
27. Finger E.C., Mitchell D.G., Jones M., Blair R.J. Dissociable roles of medial orbitofrontal cortex in human operant extinction learning. Neuroimage 2008, 43(4):748-755.
28. First M.B., Spitzer R.L., Gibbon M. Structured clinical interview for DSM-IV Axis I Disorders-Clinician Version (SCID-CV) 1997, American Psychiatric Press, Washington DC.
29. Glascher J., Hampton A.N., O'Doherty J.P. Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb. Cortex 2009, 19(2):483-495.
30. Grinband J., Wager T.D., Lindquist M., Ferrera V.P., Hirsch J. Detection of time-varying signals in event-related fMRI designs. Neuroimage 2008, 43(3):509-520.
31. Hampshire A., Owen A.M. Fractionating attentional control using event-related fMRI. Cereb. Cortex 2006, 16(12):1679-1689.
32. Hampshire A., Thompson R., Duncan J., Owen A.M. Selective tuning of the right inferior frontal gyrus during target detection. Cogn. Affect. Behav. Neurosci. 2009, 9(1):103-112.
33. Hampshire A., Chamberlain S.R., Monti M.M., Duncan J., Owen A.M. The role of the right inferior frontal gyrus: inhibition and attentional control. Neuroimage 2010, 50(3):1313-1319.
34. Hampton A.N., O'Doherty J.P. Decoding the neural substrates of reward-related decision making with functional MRI. Proc. Natl. Acad. Sci. U. S. A. 2007, 104(4):1377-1382.
35. Hariri A.R., Drabant E.M., Munoz K.E., Kolachana B.S., Mattay V.S., Egan M.F., et al. A susceptibility gene for affective disorders and the response of the human amygdala. Arch. Gen. Psychiatry 2005, 62(2):146-152.
36. Hester R., D'Esposito M., Cole M.W., Garavan H. Neural mechanisms for response selection: comparing selection of responses and items from working memory. Neuroimage 2007, 34(1):446-454.
37. Hornak J., O'Doherty J., Bramham J., Rolls E.T., Morris R.G., Bullock P.R., et al. Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolateral prefrontal cortex in humans. J. Cogn. Neurosci. 2004, 16(3):463-478.
38. Izquierdo A., Murray E.A. Combined unilateral lesions of the amygdala and orbital prefrontal cortex impair affective processing in rhesus monkeys. J. Neurophysiol. 2004, 91(5):2023-2039.
39. Izquierdo A., Murray E.A. Selective bilateral amygdala lesions in rhesus monkeys fail to disrupt object reversal learning. J. Neurosci. 2007, 27(5):1054-1062.
40. Izquierdo A., Suda R.K., Murray E.A. Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J. Neurosci. 2004, 24(34):7540-7548.
41. Kringelbach M.L., Rolls E.T. Neural correlates of rapid reversal learning in a simple model of human social interaction. Neuroimage 2003, 20(2):1371-1383.
42. Liu X., Banich M.T., Jacobson B.L., Tanabe J.L. Functional dissociation of attentional selection within PFC: response and non-response related aspects of attentional selection as ascertained by fMRI. Cereb. Cortex 2006, 16(6):827-834.
43. Manes F., Sahakian B., Clark L., Rogers R., Antoun N., Aitken M., et al. Decision-making processes following damage to the prefrontal cortex. Brain 2002, 125(Pt 3):624-639.
44. Marschner A., Kalisch R., Vervliet B., Vansteenwegen D., Buchel C. Dissociable roles for the hippocampus and the amygdala in human cued versus context fear conditioning. J. Neurosci. 2008, 28(36):9030-9036.
45. Milad M.R., Wright C.I., Orr S.P., Pitman R.K., Quirk G.J., Rauch S.L. Recall of fear extinction in humans activates the ventromedial prefrontal cortex and hippocampus in concert. Biol. Psychiatry 2007, 62(5):446-454.
46. Mitchell D.G.V., Colledge E., Leonard A., Blair R.J. Risky decisions and response reversal: is there evidence of orbitofrontal cortex dysfunction in psychopathic individuals?. Neuropsychologia 2002, 40(12):2013-2022.
47. Mitchell D.G.V., Avny S.B., Blair R.J. Divergent patterns of aggressive and neurocognitive characteristics in acquired versus developmental psychopathy. Neurocase 2006, 12(3):164-178.
48. Mitchell D.G.V., Rhodes R.A., Pine D.S., Blair R.J.R. The role of ventrolateral and dorsolateral prefrontal cortex in response reversal. Behav. Brain Res. 2008, 187(1):80-87.
49. Mitchell D.G.V., Luo Q., Avny S.B., Kasprzycki T., Gupta K., Chen G., et al. Adapting to dynamic stimulus-response values: differential contributions of inferior frontal, dorsomedial, and dorsolateral regions of prefrontal cortex to decision making. J. Neurosci. 2009, 29(35):10827-10834.
50. Murphy F.C., Michael A., Robbins T.W., Sahakian B.J. Neuropsychological impairment in patients with major depressive disorder: the effects of feedback on task performance. Psychol. Med. 2003, 33(3):455-467.
51. Nagahama Y., Okada T., Katsumi Y., Hayashi T., Yamauchi H., Oyanagi C., et al. Dissociable mechanisms of attentional control within the human prefrontal cortex. Cereb. Cortex 2001, 11(1):85-92.
52. O'Doherty J.P. Lights, camembert, action! The role of human orbitofrontal cortex in encoding stimuli, rewards, and choices. Ann. N. Y. Acad. Sci. 2007, 1121:254-272.
53. O'Doherty J.P., Kringelbach M.L., Rolls E.T., Hornak J., Andrews C. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 2001, 4(1):95-102.
54. O'Doherty J.P., Critchley H., Deichmann R., Dolan R.J. Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J. Neurosci. 2003, 23(21):7931-7939.
55. O'Doherty J.P., Dayan P., Friston K., Critchley H., Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 2003, 38(2):329-337.
56. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 1971, 9:97-113.
57. Paton J.J., Belova M.A., Morrison S.E., Salzman C.D. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 2006, 439(7078):865-870.
58. Petrides M. Lateral prefrontal cortex: architectonic and functional organization. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2005, 360(1456):781-795.
59. Phelps E.A., Delgado M.R., Nearing K.I., LeDoux J.E. Extinction learning in humans: role of the amygdala and vmPFC. Neuron 2004, 43(6):897-905.
60. Pochon J.B., Riis J., Sanfey A.G., Nystrom L.E., Cohen J.D. Functional imaging of decision conflict. J. Neurosci. 2008, 28(13):3468-3473.
61. Rahman S., Sahakian B.J., Hodges J.R., Rogers R.D., Robbins T.W. Specific cognitive deficits in mild frontal variant frontotemporal dementia. Brain 1999, 122(Pt 8):1469-1493.
62. Remijnse P.L., Nielen M.M., Uylings H.B., Veltman D.J. Neural correlates of a reversal learning task with an affectively neutral baseline: an event-related fMRI study. Neuroimage 2005, 26(2):609-618.
63. Roberts A.C. Primate orbitofrontal cortex and adaptive behaviour. Trends Cogn. Sci. 2006, 10(2):83-90.
64. Rogers R.D., Tunbridge E.M., Bhagwagar Z., Drevets W.C., Sahakian B.J., Carter C.S. Tryptophan depletion alters the decision-making of healthy volunteers through altered processing of reward cues. Neuropsychopharmacology 2003, 28(1):153-162.
65. Rogers R.D., Ramnani N., Mackay C., Wilson J.L., Jezzard P., Carter C.S., et al. Distinct portions of anterior cingulate cortex and medial prefrontal cortex are activated by reward processing in separable phases of decision-making cognition. Biol. Psychiatry 2004, 55(6):594-602.
66. Rolls E.T., Hornak J., Wade D., McGrath J. Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. J. Neurol. Neurosurg. Psychiatry 1994, 57(12):1518-1524.
67. Rudebeck P.H., Murray E.A. Amygdala and orbitofrontal cortex lesions differentially influence choices during object reversal learning. J. Neurosci. 2008, 28(33):8338-8343.
68. Rushworth M.F., Buckley M.J., Gough P.M., Alexander I.H., Kyriazis D., McDonald K.R., et al. Attentional selection and action selection in the ventral and orbital prefrontal cortex. J. Neurosci. 2005, 25(50):11628-11636.
69. Schoenbaum G., Roesch M. Orbitofrontal cortex, associative learning, and expectancies. Neuron 2005, 47(5):633-636.
70. Schultz W., Tremblay L., Hollerman J.R. Reward processing in primate orbitofrontal cortex and basal ganglia. Cereb. Cortex 2000, 10(3):272-284.
71. Serences J.T. A comparison of methods for characterizing the event-related BOLD timeseries in rapid fMRI. Neuroimage 2004, 21(4):1690-1700.
72. Tanaka S.C., Balleine B.W., O'Doherty J.P. Calculating consequences: brain systems that encode the causal effects of actions. J. Neurosci. 2008, 28(26):6750-6755.
73. Tobler P.N., O'Doherty J.P., Dolan R.J., Schultz W. Human neural learning depends on reward prediction errors in the blocking paradigm. J. Neurophysiol. 2006, 95(1):301-310.
74. Tobler P.N., Christopoulos G.I., O'Doherty J.P., Dolan R.J., Schultz W. Risk-dependent reward value signal in human prefrontal cortex. Proc. Natl. Acad. Sci. U. S. A. 2009, 106(17):7185-7190.
75. Tsujimoto S., Genovesio A., Wise S.P. Evaluating self-generated decisions in frontal pole cortex of monkeys. Nat. Neurosci. 2010, 13(1):120-126.
76. Ward D.B. Simultaneous Inference for FMRI Data 2000, http://afni.nimh.nih.gov/pub/dist/doc/manual/AlphaSim.pdf.