Dopamine modulates reward expectancy during performance of a slot machine task in rats: Evidence for a near-miss effect

Neuropsychopharmacology

Volumn 36, Issue 5, 2011, Pages 913-925

  Winstanley, Catharine A ^a   Cocker, Paul J ^a   Rogers, Robert D ^b  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

amphetamine; D 2 receptor; extinction; gambling; quinpirole; reinstatement

Indexed keywords

6 CHLORO 2,3,4,5 TETRAHYDRO 7,8 DIHYDROXY 1 PHENYL 1H 3 BENZAZEPINE; 8 CHLORO 2,3,4,5 TETRAHYDRO 3 METHYL 5 PHENYL 1H 3 BENZAZEPIN 7 OL HYDROGEN MALEATE; AMPHETAMINE; DOPAMINE 2 RECEPTOR; ETICLOPRIDE; QUINPIROLE;

ANIMAL EXPERIMENT; ANIMAL MODEL; ARTICLE; BINDING AFFINITY; BRAIN FUNCTION; COGNITION; CONTROLLED STUDY; DRUG PROTEIN BINDING; HABITUATION; LATENT PERIOD; MALE; NEUROCHEMISTRY; NONHUMAN; PATHOLOGICAL GAMBLING; PRIORITY JOURNAL; RAT; REWARD; SIGNAL TRANSDUCTION; TASK PERFORMANCE; TRAINING;

ANALYSIS OF VARIANCE; ANIMALS; BEHAVIOR, ANIMAL; CHOICE BEHAVIOR; CONDITIONING, OPERANT; DOPAMINE; DOPAMINE AGENTS; DOSE-RESPONSE RELATIONSHIP, DRUG; DRUG ADMINISTRATION SCHEDULE; EXTINCTION, PSYCHOLOGICAL; GAMES, EXPERIMENTAL; MALE; RATS; RATS, LONG-EVANS; REWARD; TASK PERFORMANCE AND ANALYSIS;

EID: 79952750847     PISSN: 0893133X     EISSN: None     Source Type: Journal    
DOI: 10.1038/npp.2010.230     Document Type: Article

References (65)

1. Balleine BW, Dickinson A (1998). Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37: 407-419. (Pubitemid 28306930)
2. Beninger RJ, Hanson DR, Phillips AG (1981). The acquisition of responding with conditioned reinforcement: effects of cocaine, (+)-amphetamine and pipradrol. Br J Pharmacol 74: 149-154. (Pubitemid 12196870)
3. Beninger RJ, Ranaldi R (1992). The effects of amphetamine, apomorphine, SKF 38393, quinpirole and bromocriptine on responding for conditioned reward in rats. Behav Pharmacol 3: 155-163.
4. Berridge KC, Robinson TE (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev 28: 309-369. (Pubitemid 29012677)
5. Breen RB, Zimmerman M (2002). Rapid onset of pathological gambling in machine gamblers. J Gambl Stud 18: 31-43.
6. Campbell-Meiklejohn DK, Wakeley J, Herbert V, Cook J, Scollo P, Kar Ray M et al (2011). Serotonin and dopamine play complementary roles in gambling to recover losses. Neuropsy-chopharmacology 36: 402-410.
7. Cardinal RN, Aitken M (2006). ANOVA for the behavioural sciences researcher. Lawrence Erlbaum Associates: London.
8. Chase HW, Clark L (2010). Gambling severity predicts midbrain response to near-miss outcomes. J Neurosci 30: 6180-6187.
9. Choliz M (2010). Experimental analysis of the game in pathological gamblers: effect of the immediacy of the reward in slot machines. J Gambl Stud 26: 249-256.
10. Clark L (2010). Decision-making during gambling: an integration of cognitive and psychobiological approaches. Philos Trans R Soc Lond B Biol Sci 365: 319-330.
11. Clark L, Lawrence AJ, Astley-Jones F, Gray N (2009). Gambling near-misses enhance motivation to gamble and recruit win-related brain circuitry. Neuron 61: 481-490.
12. Cole BJ, Robbins TW (1987). Amphetamine impairs the discriminative performance of rats with dorsal noradrenergic bundle lesions on a 5-choice serial reaction time task: new evidence for central dopaminergic-noradrenergic interactions. Psychophar-macology 91: 458-466. (Pubitemid 17038209)
13. Cote D, Caron A, Aubert J, Desrochers V, Ladouceur R (2003). Near wins prolong gambling on a video lottery terminal. J Gambl Stud 19: 433-438. (Pubitemid 39024150)
14. Dackis CA, O'Brien CP (2001). Cocaine dependence: a disease of the brain's reward centers. J Subst Abuse Treat 21: 111-117. (Pubitemid 33109059)
15. Dixon MR, Nastally BL, Jackson JE, Habib R (2009). Altering the near-miss effect in slot machine gamblers. J Appl Behav Anal 42: 913-918.
16. Dunn MJ, Futter D, Bonardi C, Killcross S (2005). Attenuation of d-amphetamine-induced disruption of conditional discrimination performance by alpha-flupenthixol. Psychopharmacology (Berl) 177: 296-306. (Pubitemid 40137290)
17. Dunn MJ, Killcross S (2006). Differential attenuation of d-amphetamine-induced disruption of conditional discrimination performance by dopamine and serotonin antagonists. Psychopharmacology (Berl) 188: 183-192. (Pubitemid 44371156)
18. Fiorillo CD, Tobler PN, Schultz W (2003). Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898-1902. (Pubitemid 36356659)
19. Floresco SB, Block AE, Tse MT (2008). Inactivation of the medial prefrontal cortex of the rat impairs strategy set-shifting, but not reversal learning, using a novel, automated procedure. Behav Brain Res 190: 85-96.
20. Floresco SB, West AR, Ash B, Moore H, Grace AA (2003). Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat Neurosci 6: 968-973. (Pubitemid 37064759)
21. Frank MJ, Claus ED (2006). Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol Rev 113: 300-326. (Pubitemid 43815199)
22. Frank MJ, Seeberger LC, O'Reilly RC (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306: 1940-1943. (Pubitemid 39627859)
23. Gan JO, Walton ME, Phillips PE (2010). Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat Neurosci 13: 25-27.
24. Grant JE, Kim SW (2006). Medication management of pathological gambling. Minnesota Medicine 89: 44-48.
25. Griffiths M (1991). Psychobiology of the near-miss in fruit machine gambling. J Psychol 125: 347-357.
26. Habib R, Dixon MR (2010). Neurobehavioral evidence for the 'near-miss' effect in pathological gamblers. J Exp Anal Behav 93: 313-328.
27. Hampson CL, Body S, den Boon FS, Cheung TH, Bezzina G, Langley RW et al (2010). Comparison of the effects of 2,5-dimethoxy-4-iodoamphetamine and D-amphetamine on the ability of rats to discriminate the durations and intensities of light stimuli. Behav Pharmacol 21: 11-20.
28. Harrigan KA (2008). Slot machine structural characteristics: creating near misses using high award symbol ratios. Int J Mental Health Addict 6: 353-368.
29. Harrigan KA, Dixon M (2010). Government sanctioned 'tight' and 'loose' slot machines: how having multiple versions of the same slot machine game may impact problem gambling. J Gambl Stud 26: 159-174.
30. Harrison AA, Everitt BJ, Robbins TW (1997). Central 5-HT depletion enhances impulsive responding without affecting the accuracy of attentional performance: interactions with dopami-nergic mechanisms. Psychopharmacology 133: 329-342. (Pubitemid 27462805)
31. Jentsch JD, Taylor JR (1999). Impulsivity resulting from frontos-triatal dysfunction in drug abuse: implications for the control of behavior by reward-related stimuli. Psychopharmacology 146: 373-390. (Pubitemid 29513278)
32. Kassinove JI, Schare ML (2001). Effects of the 'near miss' and the 'big win' on persistence at slot machine gambling. Psychol Addict Behav 15: 155-158. (Pubitemid 32803135)
33. Ladouceur R, Gaboury A, Dumont M, Rochette P (1988). Gambling: Relationship between the frequency of wins and irrational thinking. J Psychol: Interdisciplinary Applied 122: 409-414.
34. MacLin OH, Dixon MR, Daugherty D, Small SL (2007). Using a computer simulation of three slot machines to investigate a gambler's preference among varying densities of near-miss alternatives. Behav Res Methods 39: 237-241.
35. Mazurski EJ, Beninger RJ (1986). The effects of (+)-amphetamine and apomorphine on responding for a conditioned reinforcer. Psychopharmacology (Berl) 90: 239-243. (Pubitemid 16011362)
36. Nomoto K, Schultz W, Watanabe T, Sakagami M (2010). Temporally extended dopamine responses to perceptually demanding reward-predictive stimuli. J Neurosci 30: 10692-10702.
37. Peters H, Hunt M, Harper D (2010). An Animal Model of Slot Machine Gambling: The Effect of Structural Characteristics on Response Latency and Persistence. J Gambl Stud 26: 521-531.
38. Petry NM, Stinson FS, Grant BF (2005). Comorbidity of DSM-IV pathological gambling and other psychiatric disorders: results from the National Epidemiologic Survey on Alcohol and Related Conditions. J Clin Psychiatry 66: 564-574. (Pubitemid 40733697)
39. Potenza MN (2008). Review. The neurobiology of pathological gambling and drug addiction: an overview and new findings. Philos Trans R Soc Lond B Biol Sci 363: 3181-3189.
40. Potenza MN (2009). The importance of animal models of decision making, gambling, and related behaviors: implications for translational research in addiction. Neuropsychopharmacology 34: 2623-2624.
41. Reid RL (1986). The psychology of the near miss. J Gambl Behav 2: 32-39.
42. Reuter J, Raedler T, Rose M, Hand I, Glascher J, Buchel C (2005). Pathological gambling is linked to reduced activation of the mesolimbic reward system. Nat Neurosci 8: 147-148. (Pubitemid 40194043)
43. Robbins TW (1976). Relationship between reward-enhancing and stereotypical effects of psychomotor stimulant drugs. Nature 264: 57-59.
44. Robbins TW (1978). The acquisition of responding with conditioned reinforcement: effects of pipradrol, methylphenidate, d-amphetamine, and nomifensine. Psychopharmacology (Berl) 58: 79-87. (Pubitemid 8356986)
45. Robbins TW, Everitt BJ (1999). Drug addiction: bad habits add up. Nature 398: 567-570. (Pubitemid 29183674)
46. Robbins TW, Watson BA, Gaskin M, Ennis C (1983). Contrasting interactions of pipradol, d-amphetamine, cocaine, cocaine analogues, apomorphine and other drugs with conditioned reinforcement. Psychopharmacology 80: 113-119. (Pubitemid 13095624)
47. Robinson TE, Berridge KC (1993). The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain Res Brain Res Rev 18: 247-291. (Pubitemid 23219500)
48. Sanger DJ (1978). Effects of d-amphetamine on temporal and spatial discrimination in rats. Psychopharmacology (Berl) 58: 185-188. (Pubitemid 8363693)
49. Schultz W (1998). Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1-27. (Pubitemid 28326237)
50. Schultz W, Dayan P, Montague PR (1997). A neural substrate of prediction and reward. Science 275: 1593-1599. (Pubitemid 27120526)
51. Seamans JK, Yang CR (2004). The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog Neurobiol 74: 1-58.
52. Segal EF (1962). Effects of dl-amphetamine under concurrent VI DRL reinforcement. J Exp Anal Behav 5: 105-112.
53. Shaffer HJ, Hall MN, Vander Bilt J (1999). Estimating the prevalence of disordered gambling behavior in the United States and Canada: a research synthesis. Am J Public Health 89: 1369-1376. (Pubitemid 29404561)
54. Shaffer HJ, Korn DA (2002). Gambling and related mental disorders: a public health analysis. Annu Rev Public Health 23: 171-212. (Pubitemid 34508072)
55. Toneatto T, Blitz-Miller T, Calderwood K, Dragonetti R, Tsanos A (1997). Cognitive distortions in heavy gambling. J Gambl Stud 13: 253-266. (Pubitemid 127525522)
56. Tremblay AM, Desmond RC, Poulos CX, Zack M (2010). Haloperidol modifies instrumental aspects of slot machine gambling in pathological gamblers and healthy controls. Addiction Biology (10 March e-pubahead of print).
57. Voon V, Fernagut PO, Wickens J, Baunez C, Rodriguez M, Pavon N et al (2009). Chronic dopaminergic stimulation in Parkinson's disease: from dyskinesias to impulse control disorders. Lancet Neurology 8: 1140-1149.
58. Weatherly JN, Sauter JM, King BM (2004). The 'big win' and resistance to extinction when gambling. J Psychol 138: 495-504. (Pubitemid 40019688)
59. Winstanley CA, Zeeb FD, Bedard A, Fu K, Lai B, Steele C et al (2010). Dopaminergic modulation of the orbitofrontal cortex effects attention, motivation and impulsive responding in rats performing the five-choice serial reaction time task. Behav Brain Res 210: 263-272.
60. Wyvell CL, Berridge KC (2000). Intra-accumbens amphetamine increases the conditioned incentive salience of sucrose reward: enhancement of reward 'wanting' without enhanced 'liking' or response reinforcement. J Neurosci 20: 8122-8130.
61. Wyvell CL, Berridge KC (2001). Incentive sensitization by previous amphetamine exposure: increased cue-triggered 'wanting' for sucrose reward. J Neurosci 21: 7831-7840. (Pubitemid 32904983)
62. Zack M, Poulos CX (2004). Amphetamine primes motivation to gamble and gambling-related semantic networks in problem gamblers. Neuropsychopharmacology 29: 195-207. (Pubitemid 38068030)
63. Zack M, Poulos CX (2007). A D2 antagonist enhances the rewarding and priming effects of a gambling episode in pathological gamblers. Neuropsychopharmacology 32: 1678-1686. (Pubitemid 47076378)
64. Zeeb FD, Robbins TW, Winstanley CA (2009). Serotonergic and dopaminergic modulation of gambling behavior as assessed using a novel rat gambling task. Neuropsychopharmacology 34: 2329-2343.
65. Zlomke KR, Dixon MR (2006). Modification of slot-machine preferences through the use of a conditional discrimination paradigm. J Appl Beh Anal 39: 351-361. (Pubitemid 44433998)