Biases in the Explore-Exploit Tradeoff in Addictions: The Role of Avoidance of Uncertainty

Neuropsychopharmacology

Volumn 41, Issue 4, 2016, Pages 940-948

  Morris, Laurel S ^a   Baek, Kwangyeol ^b,c   Kundu, Prantik ^b,c,d   Harrison, Neil A ^e   Frank, Michael J ^f   Voon, Valerie ^a,b,c,g  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^c NATIONAL INSTITUTE OF MENTAL HEALTH   (United States)

^d BRIGHTON AND SUSSEX MEDICAL SCHOOL   (United Kingdom)

^e BROWN UNIVERSITY   (United States)

^f CAMBRIDGESHIRE AND PETERBOROUGH NHS FOUNDATION TRUST   (United Kingdom)

^g NIHR Cambridge Biomedical Research Centre   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ACAMPROSATE; DISULFIRAM;

ADULT; ALCOHOL USE DISORDER; ANTERIOR INSULA; ARTICLE; BINGE EATING DISORDER; CEREBELLUM; CONTROLLED STUDY; DECISION MAKING; DISEASE ASSOCIATION; DISEASE CLASSIFICATION; DORSOLATERAL PREFRONTAL CORTEX; ECHO PLANAR IMAGING; EXPLORATORY BEHAVIOR; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; INFERIOR PARIETAL CORTEX; LONG TERM CARE; MAJOR CLINICAL STUDY; MALE; MENTAL DISEASE; OBESITY; OUTCOME ASSESSMENT; PARIETAL CORTEX; POSTERIOR CINGULATE; PRECUNEUS; PRIORITY JOURNAL; REWARD; SMOKING; STATISTICAL SIGNIFICANCE; TEMPORAL CORTEX; UNCERTAINTY; VENTRAL STRIATUM; ALCOHOLISM; BRAIN; BRAIN MAPPING; FRONTAL LOBE; MIDDLE AGED; NUCLEAR MAGNETIC RESONANCE IMAGING; PARIETAL LOBE; PATHOPHYSIOLOGY; PHYSIOLOGY; PSYCHOLOGY;

ADULT; ALCOHOL-RELATED DISORDERS; BINGE-EATING DISORDER; BRAIN; BRAIN MAPPING; DECISION MAKING; EXPLORATORY BEHAVIOR; FEMALE; FRONTAL LOBE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; OBESITY; PARIETAL LOBE; REWARD; UNCERTAINTY;

EID: 84957839467     PISSN: 0893133X     EISSN: 1740634X     Source Type: Journal    
DOI: 10.1038/npp.2015.208     Document Type: Article

References (43)

1. Association AP (2000). Diagnostic and Statistical Manual of Mental Disorders. 4th edn, Text rev. American Psychiatric Association: Washington, DC.
2. Badre D, Doll BB, Long NM, Frank MJ (2012). Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration. Neuron 73: 595-607.
3. Bechara A, Dolan S, Denburg N, Hindes A, Anderson SW, Nathan PE (2001). Decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in alcohol and stimulant abusers. Neuropsychologia 39: 376-389.
4. Boorman ED, Behrens TE, Woolrich MW, Rushworth MF (2009). How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62: 733-743.
5. Cavanagh JF, Figueroa CM, Cohen MX, Frank MJ (2012). Frontal theta reflects uncertainty and unexpectedness during exploration and exploitation. Cereb Cortex 22: 2575-2586.
6. Cavanna AE, Trimble MR (2006). The precuneus: a review of its functional anatomy and behavioural correlates. Brain 129: 564-583.
7. Chakravarty S, Roy J (2009). Recursive expected utility and the separation of attitudes towards risk and ambiguity: an experimental study. Theor Decis 66: 199-228.
8. Christoff K, Gabrieli JDE (2000). The frontopolar cortex and human cognition: evidence for a rostrocaudal hierarchical organization within the human prefrontal cortex. Psychobiology 28: 168-186.
9. Culham JC, Brandt SA, Cavanagh P, Kanwisher NG, Dale AM, Tootell RB (1998). Cortical fMRI activation produced by attentive tracking of moving targets. J Neurophysiol 80: 2657-2670.
10. Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006). Cortical substrates for exploratory decisions in humans. Nature 441: 876-879.
11. Dayan P, Sejnowski TJ (1996). Exploration bonuses and dual control. Mach Learn 25: 5-22.
12. Edwards S, Koob GF (2010). Neurobiology of dysregulated motivational systems in drug addiction. Future Neurol 5: 393-401.
13. Frank MJ, Doll BB, Oas-Terpstra J, Moreno F (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat Neurosci 12: 1062-1068.
14. Goudriaan AE, Oosterlaan J, de Beurs E, van den Brink W (2005). Decision making in pathological gambling: a comparison between pathological gamblers, alcohol dependents, persons with Tourette syndrome, and normal controls. Brain Res Cogn Brain Res 23: 137-151.
15. Hascoet M, Bourin M, Nic Dhonnchadha BA (2001). The mouse light-dark paradigm: a review. Prog Neuropsychopharmacol Biol Psychiatry 25: 141-166.
16. Hefner KR, Curtin JJ (2012). Alcohol stress response dampening: selective reduction of anxiety in the face of uncertain threat. J Psychopharmacol 26: 232-244.
17. Ho JLY, Keller LR, Keltyka P (2002). Effects of outcome and probabilistic ambiguity on managerial choices. J Risk Uncertain 24: 47-74.
18. Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, Quinn K et al (2010). Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am J Psychiatry 167: 748-751.
19. Kahneman D, Tversky A (1979). Prospect Theory-analysis of decision under risk. Econometrica 47: 263-291.
20. Karnath HO, Perenin MT (2005). Cortical control of visually guided reaching: evidence from patients with optic ataxia. Cereb Cortex 15: 1561-1569.
21. Kayser AS, Mitchell JM, Weinstein D, Frank MJ (2015). Dopamine, locus of control, and the exploration-exploitation tradeoff. Neuropsychopharmacology 40: 454-462.
22. Koechlin E, Hyafil A (2007). Anterior prefrontal function and the limits of human decision-making. Science 318: 594-598.
23. Kolling N, Behrens TEJ, Mars RB, Rushworth MFS (2012). Neural mechanisms of foraging. Science 336: 95-98.
24. Kolling N, Wittmann M, Rushworth MFS (2014). Multiple neural mechanisms of decision making and their competition under changing risk pressure. Neuron 81: 1190-1202.
25. Koob GF (2013). Negative reinforcement in drug addiction: the darkness within. Curr Opin Neurobiol 23: 559-563.
26. Koob GF, Le Moal M (2005). Plasticity of reward neurocircuitry and the 'dark side' of drug addiction. Nat Neurosci 8: 1442-1444.
27. Kundu P, Inati SJ, Evans JW, Luh WM, Bandettini PA (2012). Differentiating BOLD and non-BOLD signals in fMRI time series using multi-echo EPI. Neuroimage 60: 1759-1770.
28. Liu H, Qin W, Li W, Fan L, Wang J, Jiang T et al (2013). Connectivity-based parcellation of the human frontal pole with diffusion tensor imaging. J Neurosci 33: 6782-6790.
29. Ludvig EA, Spetch ML (2011). Of black swans and tossed coins: is the description-experience gap in risky choice limited to rare events? PloS One 6: e20262.
30. Morrison I, Tipper SP, Fenton-Adams WL, Bach P (2013). 'Feeling' others' painful actions: the sensorimotor integration of pain and action information. Hum Brain Mapp 34: 1982-1998.
31. Okuda J, Fujii T, Ohtake H, Tsukiura T, Tanji K, Suzuki K et al (2003). Thinking of the future and past: the roles of the frontal pole and the medial temporal lobes. Neuroimage 19: 1369-1380.
32. Ramnani N, Owen AM (2004). Anterior prefrontal cortex: insights into function from anatomy and neuroimaging. Nat Rev Neurosci 5: 184-194.
33. Robbins TW, Gillan CM, Smith DG, de Wit S, Ersche KD (2012). Neurocognitive endophenotypes of impulsivity and compulsivity: towards dimensional psychiatry. Trends Cogn Sci 16: 81-91.
34. Robinson JD, Lam CY, Carter BL, Minnix JA, Cui Y, Versace F et al (2011). A multimodal approach to assessing the impact of nicotine dependence, nicotine abstinence, and craving on negative affect in smokers. Exp Clin Psychopharmacol 19: 40-52.
35. Rose EJ, Ross TJ, Salmeron BJ, Lee M, Shakleya DM, Huestis MA et al (2013). Acute nicotine differentially impacts anticipatory valence- and magnitude-related striatal activity. Biol Psychiatry 73: 280-288.
36. Selemon LD, Goldman-Rakic PS (1988). Common cortical and subcortical targets of the dorsolateral prefrontal and posterior parietal cortices in the rhesus monkey: evidence for a distributed neural network subserving spatially guided behavior. J Neurosci 8: 4049-4068.
37. Slotnick SD, Moo LR, Segal JB, Hart J Jr (2003). Distinct prefrontal cortex activity associated with item memory and source memory for visual shapes. Brain Res Cogn Brain Res 17: 75-82.
38. Tom SM, Fox CR, Trepel C, Poldrack RA (2007). The neural basis of loss aversion in decision-making under risk. Science 315: 515-518.
39. Voon V, Derbyshire K, Rück C, Irvine MA, Worbe Y, Enander J et al (2014a). Disorders of compulsivity: a common bias towards learning habits. Mol Psychiatry 20: 345-352.
40. Voon V, Irvine MA, Derbyshire K, Worbe Y, Lange I, Abbott S et al (2014b). Measuring 'waiting' impulsivity in substance addictions and binge eating disorder in a novel analogue of rodent serial reaction time task. Biol Psychiatry 75: 148-155.
41. Voon V, Morris LS, Irvine MA, Ruck C, Worbe Y, Derbyshire K et al (2014c). Risk-taking in disorders of natural and drug rewards: neural correlates and effects of probability, valence, and magnitude. Neuropsychopharmacology 40: 804-812.
42. Whitfield-Gabrieli S, Nieto-Castanon A (2012). Conn: a functional connectivity toolbox for correlated and anticorrelated brain networks. Brain Connect 2: 125-141.
43. Wilson RC, Geana A, White JM, Ludvig EA, Cohen JD (2014). Humans use directed and random exploration to solve the explore-exploit dilemma. J Exp Psychol Gen 143: 2074-2081.