Dopamine, locus of control, and the exploration-exploitation tradeoff

Neuropsychopharmacology

Volumn 40, Issue 2, 2015, Pages 454-462

  Kayser, Andrew S ^a,b,c   Mitchell, Jennifer M ^a,b   Weinstein, Dawn ^a,b   Frank, Michael J ^d  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA SAN FRANCISCO   (United States)

^c VA NORTHERN CALIFORNIA HEALTH CARE SYSTEM   (United States)

^d BROWN UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENZOPHENONE DERIVATIVE; CATECHOL METHYLTRANSFERASE; CATECHOL METHYLTRANSFERASE INHIBITOR; COMT PROTEIN, HUMAN; DOPAMINE; NITROPHENOL; TOLCAPONE;

ADULT; CONTROL; CONTROLLED STUDY; DOUBLE BLIND PROCEDURE; DRUG EFFECTS; EXPLORATORY BEHAVIOR; FEMALE; GENETICS; GENOTYPING TECHNIQUE; HUMAN; MALE; METABOLISM; MIDDLE AGED; NEUROPSYCHOLOGICAL TEST; PHYSIOLOGY; RANDOMIZED CONTROLLED TRIAL; REWARD; UNCERTAINTY; YOUNG ADULT;

ADULT; BENZOPHENONES; CATECHOL O-METHYLTRANSFERASE; CATECHOL O-METHYLTRANSFERASE INHIBITORS; DOPAMINE; DOUBLE-BLIND METHOD; EXPLORATORY BEHAVIOR; FEMALE; GENOTYPING TECHNIQUES; HUMANS; INTERNAL-EXTERNAL CONTROL; MALE; MIDDLE AGED; NEUROPSYCHOLOGICAL TESTS; NITROPHENOLS; REWARD; UNCERTAINTY; YOUNG ADULT;

EID: 84939880228     PISSN: 0893133X     EISSN: 1740634X     Source Type: Journal    
DOI: 10.1038/npp.2014.193     Document Type: Article

References (28)

1. Apud JA, Mattay V, Chen J, Kolachana BS, Callicott JH, Rasetti R et al (2007). Tolcapone improves cognition and cortical information processing in normal human subjects. Neuropsychopharmacology 32: 1011-1020.
2. Badre D, Doll BB, Long NM, Frank MJ (2012). Rostrolateral prefrontal cortex and individual differences in uncertaintydriven exploration. Neuron 73: 595-607.
3. Cavanagh JF, Figueroa CM, Cohen MX, Frank MJ (2012). Frontal theta reflects uncertainty and unexpectedness during exploration and exploitation. Cereb Cortex 22: 2575-2586.
4. Ceravolo R, Piccini P, Bailey DL, Jorga KM, Bryson H, Brooks DJ (2002). 18F-dopa PET evidence that tolcapone acts as a central COMT inhibitor in Parkinson's disease. Synapse 43: 201-207.
5. Chen J, Lipska BK, Halim N, Ma QD, Matsumoto M, Melhem S et al (2004). Functional analysis of genetic variation in catechol-Omethyltransferase (COMT): effects on mRNA, protein, and enzyme activity in postmortem human brain. Am J Hum Genet 75: 807-821.
6. Collins AG, Frank MJ (2014). Opponent Actor Learning (OpAL): modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive. Psychol Rev 121: 337-366.
7. Cools R, D'Esposito M (2011). Inverted-U-shaped dopamine actions on human working memory and cognitive control. Biol Psychiatry 69: e113-e125.
8. Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006). Cortical substrates for exploratory decisions in humans. Nature 441: 876-879.
9. De Brabander B, Declerck CH (2004). A possible role of central dopamine metabolism associated with individual differences in locus of control. Personality and Individual Differences 37: 735-750.
10. Declerck CH, Boone C, De Brabander B (2006). On feeling in control: a biological theory for individual differences in control perception. Brain Cogn 62: 143-176.
11. Dumontheil I, Burgess PW, Blakemore SJ (2008). Development of rostral prefrontal cortex and cognitive and behavioural disorders. Dev Med Child Neurol 50: 168-181.
12. Frank MJ, Doll BB, Oas-Terpstra J, Moreno F (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat Neurosci 12: 1062-1068.
13. Frank MJ, Fossella JA (2011). Neurogenetics and pharmacology of learning, motivation, and cognition. Neuropsychopharmacology 36: 133-152.
14. Gogos JA, Morgan M, Luine V, Santha M, Ogawa S, Pfaff D et al (1998). Catechol-O-methyltransferase-deficient mice exhibit sexually dimorphic changes in catecholamine levels and behavior. Proc Natl Acad Sci USA 95: 9991-9996.
15. Kalidindi K, Bowman H (2007). Using epsilon-greedy reinforcement learning methods to further understand ventromedial prefrontal patients' deficits on the Iowa Gambling Task. Neural Netw 20: 676-689.
16. Kayser AS, Allen DC, Navarro-Cebrian A, Mitchell JM, Fields HL (2012). Dopamine, corticostriatal connectivity, and intertemporal choice. J Neurosci 32: 9402-9409.
17. Kimberg DY, D'Esposito M, Farah MJ (1997). Effects of bromocriptine on human subjects depend on working memory capacity. Neuroreport 8: 3581-3585.
18. Maia TV, Frank MJ (2011). From reinforcement learning models to psychiatric and neurological disorders. Nat Neurosci 14: 154-162.
19. Mitchell JM, Fields HL, D'Esposito M, Boettiger CA (2005). Impulsive responding in alcoholics. Alcohol Clin Exp Res 29: 2158-2169.
20. Moustafa AA, Cohen MX, Sherman SJ, Frank MJ (2008). A role for dopamine in temporal decision making and reward maximization in parkinsonism. J Neurosci 28: 12294-12304.
21. Patton JH, Stanford MS, Barratt ES (1995). Factor structure of the Barratt impulsiveness scale. J Clin Psychol 51: 768-774.
22. Ramnani N, Owen AM (2004). Anterior prefrontal cortex: insights into function from anatomy and neuroimaging. Nat Rev Neurosci 5: 184-194.
23. Rotter JB (1966). Generalized expectancies for internal versus external control of reinforcement. Psychol Monogr 80: 1-28.
24. Smith CT, Boettiger CA (2012). Age modulates the effect of COMT genotype on delay discounting behavior. Psychopharmacology (Berl) 222: 609-617.
25. Spielberger CD (1983). Manual for the state-trait anxiety inventory. Consulting Psychologists Press.
26. Stelzel C, Basten U, Montag C, Reuter M, Fiebach CJ (2009). Effects of dopamine-related gene-gene interactions on working memory component processes. Eur J Neurosci 29: 1056-1063.
27. Strauss GP, Frank MJ, Waltz JA, Kasanova Z, Herbener ES, Gold JM (2011). Deficits in positive reinforcement learning and uncertainty-driven exploration are associated with distinct aspects of negative symptoms in schizophrenia. Biol Psychiatry 69: 424-431.
28. Vytlacil J, Kayser A, Miyakawa A, D'Esposito M (2014). An approach for identifying brainstem dopaminergic pathways using resting state functional MRI. PLoS One 9: e87109.