Altered risk-based decision making following adolescent alcohol use results from an imbalance in reinforcement learning in rats

PLoS ONE

Volumn 7, Issue 5, 2012, Pages

  Clark, Jeremy J ^a   Nasrallah, Nicholas A ^b   Hart, Andrew S ^a,b   Collins, Anne L ^a   Bernstein, Ilene L ^b   Phillips, Paul E M ^a,b  

^a UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENCE; ADOLESCENT; ALCOHOL CONSUMPTION; ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; CONTROLLED STUDY; DECISION MAKING; INSTRUMENTAL CONDITIONING; LEARNING DISORDER; MALE; NONHUMAN; RAT; REINFORCEMENT; REWARD; RISK BASED DECISION MAKING; SIMULATION; ANIMAL; COMPUTER SIMULATION; DRINKING BEHAVIOR; LEARNING; PSYCHOLOGICAL MODEL; RISK; SPRAGUE DAWLEY RAT;

ANIMALIA; RATTUS;

ALCOHOL DRINKING; ANIMALS; CHOICE BEHAVIOR; COMPUTER SIMULATION; CONDITIONING, OPERANT; DECISION MAKING; LEARNING; MALE; MODELS, PSYCHOLOGICAL; RATS; RATS, SPRAGUE-DAWLEY; REINFORCEMENT (PSYCHOLOGY); RISK;

EID: 84861219309     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0037357     Document Type: Article

References (40)

1. Witt ED, (2010) Research on alcohol and adolescent brain development: opportunities and future directions. Alcohol 44: 119-124.
2. Nutt DJ, King LA, Phillips LD, (2010) Drug harms in the UK: a multicriteria decision analysis. Lancet 376: 1558-1565.
3. Spear LP, (2000) The adolescent brain and age-related behavioral manifestations. Neurosci Biobeh Rev 24: 417-463.
4. National Institute on Alcohol Abuse and Alcoholism (2009) NIH Pub No. 06-4314.
5. Goudriaan AE, Grekin ER, Sher KJ, (2007) Decision making and binge drinking: a longitudinal study. Alcoholism: Clin & Exp Res 31: 928-938.
6. Johnson CA, Xiao L, Palmer P, Sun P, Wang Q, et al. (2008) Affective decision-making deficits, linked to a dysfunctional ventromedial prefrontal cortex, revealed in 10th grade Chinese adolescent binge drinkers. Neuropsychologia 46: 714-726.
7. Nasrallah NA, Yang TWH, Bernstein IL, (2009) Long-term risk preference and suboptimal decision making following adolescent alcohol use. Proc Natl Acad Sci U S A 106: 17600-17604.
8. Glimcher PW, Rustichini A, (2004) Neuroeconomics: the consilience of brain and decision. Science 306: 447-452.
9. March JG, (1996) Learning to be risk averse. Psychol Rev 103: 309-319.
10. Mihatsch O, Neuneier R, (2002) Risk-sensitive reinforcement learning. Mach Learn 49: 267-290.
11. Chiu PH, Lohrenz TM, Montague PR, (2008) Smokers' brains compute, but ignore, a fictive error signal in a sequential investment task. Nat Neurosci 11: 514-520.
12. Rangel A, Camerer C, Montague PR, (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9: 545-556.
13. Behrens TE, Woolrich MW, Walton ME, Rushworth MF, (2007) Learning the value of information in an uncertain world. Nat Neurosci 10: 1214-1221.
14. Redish AD, (2004) Addiction as a computational process gone awry. Science 306: 1944-1947.
15. Redish AD, Jensen S, Johnson A, (2008) A unified framework for addiction: vulnerabilities in the decision process. Behav Brain Sci 31: 415-437.
16. Hodos W, (1961) Progressive ratio as a measure of reward strength. Science 134: 943-944.
17. Reilly S, (1999) Reinforcement value of gustatory stimuli determined by progressive ratio performance. Pharmacol Biochem Behav 63: 301-311.
18. Sclafani A, Ackroff K, (2003) Reinforcement value of sucrose measured by progressive ratio operant licking in the rat. Physiol Behav 79: 663-670.
19. Wanat MJ, Kuhnen CM, Phillips PE, (2010) Delays conferred by escalating costs modulate dopamine release to rewards but not their predictors. J Neurosci 30: 12020-12027.
20. Nasrallah NA, Clark JJ, Collins AL, Akers CA, Phillips PEM, et al. (2011) Risk preference following adolescent alcohol use is associated with corrupted encoding of costs but not rewards by mesolimbic dopamine. Proc Natl Acad Sci U S A 108: 5466-5471.
21. Frank MJ, Seeberger LC, O'Reilly RC, (2004) By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306: 1940-1943.
22. Frank MJ, Samanta J, Moustafa AA, Sherman SJ, (2007) Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism. Science 318: 1309-1312.
23. Rescorla RA, Wagner AR, (1972) in Classical Conditioning II, In: Black AH, Prokasy WF, editors. (Appleton-Century-Crofts) pp. 64-99.
24. Kakade S, Dayan P, (2002) Acquisition and extinction in autoshaping. Psychol Rev 109: 533-544.
25. Redish AD, Jensen S, Johnson A, Kurth-Nelson Z, (2010) Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. Psychol Rev 114: 784-805.
26. Yechiam E, Busemeyer JR, (2005) Comparison of basic assumptions embedded in learning models for experience-based decision making. Psychon Bull Rev 12: 387-402.
27. Corrado GS, Sugrue LP, Brown JR, Newsome WT, (2008) in Neuroeconomics: Decision Making and the Brain, In: Glimcher PW, Camerer CF, Fehr E, Poldrack RA, editors. (Academic Press) pp. 463-480.
28. Crews F, He J, Hodge C, (2007) Adolescent cortical development: a critical period of vulnerability for addiction. Pharm Biochem Behav 86: 189-199.
29. Chambers RA, Taylor JR, Potenza MN, (2003) Developmental neurocircuitry of motivation in adolescence: a critical period of addiction vulnerability. Ame J Psychiatry 160: 1041-1052.
30. Philpot RM, Wecker L, Kirstein CL, (2009) Repeated ethanol exposure during adolescence alters the developmental trajectory of dopaminergic output from the nucleus accumbens septi. Int J Dev Neurosci 8: 805-815.
31. Bechara A, Damasio H, (2002) Decision-making and addiction (part I): impaired activation of somatic states in substance dependent individuals when pondering decisions with negative future consequences. Neuropsychologia 40: 1675-1689.
32. Stout JC, Rock SL, Campbell MC, Busemeyer JR, Finn PR, (2005) Psychological processes underlying risky decisions in drug abusers. Psychol Addictive Behav 19: 148-157.
33. Tobler PN, Fiorillo CD, Schultz W, (2005) Adaptive coding of reward value by dopamine neurons. Science 307: 1642-5.
34. Schultz W, (2008) in Neuroeconomics: Decision Making and the Brain, In: Glimcher PW, Camerer CF, Fehr E, Poldrack RA, editors. (Academic Press) pp. 323-329.
35. Niv Y, Montague PR, (2008) in Neuroeconomics: Decision Making and the Brain, In: Glimcher PW, Camerer CF, Fehr E, Poldrack RA, editors. (Academic Press) pp. 331-351.
36. Piray P, Keramati MM, Dezfouli A, Lucas C, Mokri A, (2010) Individual differences in nucleus accumbens dopamine receptors predict development of addiction-like behavior: a computational approach. Neural Comput 22: 2334-2368.
37. Niv Y, Edlund JA, Dayan P, O'Doherty JP, (2012) Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain. J Neurosci 32: 551-562.
38. McKinzie DL, McBride WJ, Murphy JM, Lumeng L, Li TK, (1999) in Alcohol and Alcoholism: Effects on Brain and Development, In: Hannigan JH, Spear LP, Spear NE, Goodlett CR, editors. (Lawrence Erlbaum Associates) pp. 135-160.
39. Rowland NE, Nasrallah N, Robertson KL, (2005) Accurate caloric compensation in rats for electively consumed ethanol-beer or ethanol-polycose mixtures. Pharmacol Biochem Behav 80: 109-114.
40. Peris J, Zharikova A, Li Z, Lingis M, MacNeill M, et al. (2006) Brain ethanol levels in rats after voluntary ethanol consumption using a sweetened gelatin vehicle. Pharmacol Biochem Behav 85: 562-568.