A new approach to assess gambling-like behavior in laboratory rats: Using intracranial self-stimulation as a positive reinforcer

Frontiers in Behavioral Neuroscience

Volumn 8, Issue JUNE, 2014, Pages

  Tedford, Stephanie E ^a   Holtz, Nathan A ^a   Persons, Amanda L ^a   Celeste Napier, T ^a  

^a RUSH UNIVERSITY MEDICAL CENTER   (United States)

Author keywords

Cost benefit decision making; Discounting; Effort based decision making; Gambling; Intracranial self stimulation

Indexed keywords

ANIMAL BEHAVIOR; ARTICLE; BRAIN DEPTH STIMULATION; COST BENEFIT ANALYSIS; DECISION MAKING; EXPERIMENTAL RAT; GAMBLING; IMPULSIVENESS; MENTAL TASK; NONHUMAN; RAT; REINFORCEMENT; TASK PERFORMANCE;

EID: 84902248466     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2014.00215     Document Type: Article

References (62)

1. Alessi, S. M., and Petry, N. M. (2003). Pathological gambling severity is associated with impulsivity in a delay discounting procedure. Behav. Processes 64, 345-354. doi: 10.1016/S0376-6357(03)00150-5
2. Bickel, W. K., Jarmolowicz, D. P., Mueller, E. T., Koffarnus, M. N., and Gatchalian, K. M. (2012). Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: emerging evidence. Pharmacol Ther. 134, 287-297. doi: 10.1016/j.pharmthera.2012.02.004
3. Bizo, L. A., Bogdanov, S. V., and Killeen, P. R. (1998). Satiation causes within-session decreases in instrumental responding. J. Exp. Psychol. Anim. Behav. Process. 24, 439-452. doi: 10.1037/0097-7403.24.4.439
4. Buckholtz, J. W., Treadway, M. T., Cowan, R. L., Woodward, N. D., Li, R., Ansari, M. S., et al. (2010). Dopaminergic network differences in human impulsivity. Science 329, 532. doi: 10.1126/science.1185778
5. Buelow, M. T., and Suhr, J. A. (2009). Construct validity of the iowa gambling task. Neuropsychol. Rev. 19, 102-114. doi: 10.1007/s11065-009-9083-4
6. Corbett, D., and Wise, R. A. (1980). Intracranial self-stimulation in relation to the ascending dopaminergic systems of the midbrain: a moveable electrode mapping study. Brain Res. 185, 1-15. doi: 10.1016/0006-8993(80)90666-6
7. Crean, J. P., de, W. H., and Richards, J. B. (2000). Reward discounting as a measure of impulsive behavior in a psychiatric outpatient population. Exp. Clin. Psychopharmacol. 8, 155-162. doi: 10.1037/1064-1297.8.2.155
8. Dai, Z., Harrow, S. E., Song, X., Rucklidge, J., and Grace, R. (2013). Gambling, delay, and probability discounting in adults with and without ADHD. J. Atten. Disord. doi: 10.1177/1087054713496461. [Epub ahead of print].
9. Dixon, M. R., Marley, J., and Jacobs, E. A. (2003). Delay discounting by pathological gamblers. J. Appl. Behav. Anal. 36, 449-458. doi: 10.1901/jaba.2003.36-449
10. Douglas, V. I., and Parry, P. A. (1994). Effects of reward and nonreward on frustration and attention in attention deficit disorder. J. Abnorm. Child Psychol. 22, 281-302. doi: 10.1007/BF02168075
11. Eubig, P. A., Noe, T. E., Floresco, S. B., Sable, J. J., and Schantz, S. L. (2014). Sex differences in response to amphetamine in adult long-evans rats performing a delay-discounting task. Pharmacol. Biochem. Behav. 118, 1-9. doi: 10.1016/j.pbb.2013.12.021
12. Feja, M., and Koch, M. (2014). Ventral medial prefrontal cortex inactivation impairs impulse control but does not affect delay-discounting in rats. Behav. Brain Res. 264, 230-239. doi: 10.1016/j.bbr.2014.02.013
13. Graves, S. M., Rafeyan, R., Watts, J., and Napier, T. C. (2012). Mirtazapine, and mirtazapine-like compounds as possible pharmacotherapy for substance abuse disorders: evidence from the bench and the bedside. Pharmacol. Ther. 136, 343-353. doi: 10.1016/j.pharmthera.2012.08.013
14. Holt, D. D., Green, L., and Myerson, J. (2003). Is discounting impulsive? Evidence from temporal and probability discounting in gambling and non-gambling college students. Behav. Processes 64, 355-367. doi: 10.1016/S0376-6357(03)00141-4
15. Hosking, J. G., Cocker, P. J., and Winstanley, C. A. (2014). Dissociable contributions of anterior cingulate cortex and basolateral amygdala on a rodent cost/benefit decision-making task of cognitive effort. Neuropsychopharmacology 39, 1558-1567. doi: 10.1038/npp.2014.27
16. Housden, C. R., O'Sullivan, S. S., Joyce, E. M., Lees, A. J., and Roiser, J. P. (2010). Intact reward learning but elevated delay discounting in Parkinson's disease patients with impulsive-compulsive spectrum behaviors. Neuropsychopharmacology 35, 2155-2164. doi: 10.1038/npp.2010.84
17. Jimura, K., Myerson, J., Hilgard, J., Braver, T. S., and Green, L. (2009). Are people really more patient than other animals? evidence from human discounting of real liquid rewards. Psychon. Bull. Rev. 16, 1071-1075. doi: 10.3758/PBR.16.6.1071
18. Johnson, P. S., Madden, G. J., Brewer, A. T., Pinkston, J. W., and Fowler, S. C. (2011). Effects of acute pramipexole on preference for gambling-like schedules of reinforcement in rats. Psychopharmacology (Berl) 231, 11-18. doi: 10.1007/s00213-010-2006-5
19. Keesey, R. E. (1962). The relation between pulse frequency, intensity, and duration and the rate of responding for intracranial stimulation. J. Comp. Physiol. Psychol. 55, 671-678. doi: 10.1037/h0049222
20. Koffarnus, M. N., Newman, A. H., Grundt, P., Rice, K. C., and Woods, J. H. (2011). Effects of selective dopaminergic compounds on a delay-discounting task. Behav. Pharmacol. 22, 300-311. doi: 10.1097/FBP.0b013e3283473bcb
21. Kraplin, A., Dshemuchadse, M., Behrendt, S., Scherbaum, S., Goschke, T., and Buhringer, G. (2014). Dysfunctional decision-making in pathological gambling: pattern specificity and the role of impulsivity. Psychiatry Res. 215, 675-682. doi: 10.1016/j.psychres.2013.12.041
22. Ledgerwood, D. M., Alessi, S. M., Phoenix, N., and Petry, N. M. (2009). Behavioral assessment of impulsivity in pathological gamblers with and without substance use disorder histories versus healthy controls. Drug Alcohol Depend. 105, 89-96. doi: 10.1016/j.drugalcdep.2009.06.011
23. Leroi, I., Barraclough, M., McKie, S., Hinvest, N., Evans, J., Elliott, R., and McDonald, K. (2013). Dopaminergic influences on executive function and impulsive behaviour in impulse control disorders in Parkinson's disease. J. Neuropsychol. 7, 306-325. doi: 10.1111/jnp.12026
24. Madden, G. J., Johnson, P. S., Brewer, A. T., Pinkston, J. W., and Fowler, S. C. (2010). Effects of pramipexole on impulsive choice in male wistar rats. Exp. Clin. Psychopharmacol. 18, 267-276. doi: 10.1037/a0019244
25. Madden, G. J., Petry, N. M., and Johnson, P. S. (2009). Pathological gamblers discount probabilistic rewards less steeply than matched controls. Exp. Clin. Psychopharmacol. 17, 283-290. doi: 10.1037/a0016806
26. McCown, T. J., Napier, T. C., and Breese, G. R. (1986). Effects of chronic electrode implantation on dopaminergic neurons in vivo. Pharmacol. Biochem. Behav 25, 63-69. doi: 10.1016/0091-3057(86)90231-5
27. Mejia-Toiber, J., Boutros, N., Markou, A., and Semenova, S. (2014). Impulsive choice and anxiety-like behavior in adult rats exposed to chronic intermittent ethanol during adolescence and adulthood. Behav. Brain Res. 266, 19-28. doi: 10.1016/j.bbr.2014.02.019
28. Michalczuk, R., Bowden-Jones, H., Verdejo-Garcia, A., and Clark, L. (2011). Impulsivity and cognitive distortions in pathological gamblers attending the UK National Problem Gambling Clinic: a preliminary report. Psychol. Med. 41, 2625-2635. doi: 10.1017/S003329171100095X
29. Miedl, S. F., Peters, J., and Buchel, C. (2012). Altered neural reward representations in pathological gamblers revealed by delay and probability discounting. Arch. Gen. Psychiatry 69, 177-186. doi: 10.1001/archgenpsychiatry.2011.1552
30. Milenkova, M., Mohammadi, B., Kollewe, K., Schrader, C., Fellbrich, A., Wittfoth, M., et al. (2011). Intertemporal choice in Parkinson's disease. Mov. Disord. 26, 2004-2010. doi: 10.1002/mds.23756
31. Minamimoto, T., La Camera, G., and Richmond, B. J. (2009). Measuring and modeling the interaction among reward size, delay to reward, and satiation level on motivation in monkeys. J. Neurophysiol. 101, 437-447. doi: 10.1152/jn.90959.2008
32. Olds, J., and Milner, P. (1954). Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J. Comp. Physiol. Psychol. 47, 419-427. doi: 10.1037/h0058775
33. Papini, M. R., and Dudley, R. T. (1997). Consequences of surprising reward omissions. Rev. Gen. Psychol. 1, 175-197. doi: 10.1037/1089-2680.1.2.175
34. Persons, A. L., Tedford, S. E., and Napier, T. C. (2013). "Preclinical evaluations of mixed-function serotonergic compounds for the treatment of gambling disorders. program no. 635.12, " in Neuroscience Meeting Planner (San Diego, CA: Society for Neuroscience).
35. Petry, N. M. (2011). Discounting of probabilistic rewards is associated with gambling abstinence in treatment-seeking pathological gamblers. J. Abnorm. Psychol. 121, 151-159. doi: 10.1037/a0024782
36. Pirch, J. H., Napier, T. C., and Corbus, M. J. (1981). Brain stimulation as a cue for event-related potentials in rat cortex: amphetamine effects. Int. J. Neurosci. 15, 217-222.
37. Pizzagalli, D. A., Evins, A. E., Schetter, E. C., Frank, M. J., Pajtas, P. E., Santesso, D. L., et al. (2008). Single dose of a dopamine agonist impairs reinforcement learning in humans: behavioral evidence from a laboratory-based measure of reward responsiveness. Psychopharmacology (Berl) 196, 221-232. doi: 10.1007/s00213-007-0957-y
38. Rachlin, H., Raineri, A., and Cross, D. (1991). Subjective probability and delay. J. Exp. Anal. Behav. 55, 233-244. doi: 10.1901/jeab.1991.55-233
39. Rasmussen, E. B., Lawyer, S. R., and Reilly, W. (2010). Percent body fat is related to delay and probability discounting for food in humans. Behav. Processes 83, 23-30. doi: 10.1016/j.beproc.2009.09.001
40. Reynolds, B., Richards, J. B., Horn, K., and Karraker, K. (2004). Delay discounting and probability discounting as related to cigarette smoking status in adults. Behav. Processes 65, 35-42. doi: 10.1016/S0376-6357(03)00109-8
41. Riba, J., Kramer, U. M., Heldmann, M., Richter, S., and Munte, T. F. (2008). Dopamine agonist increases risk taking but blunts reward-related brain activity. PLoS. ONE 3:e2479. doi: 10.1371/journal.pone.0002479
42. Rokosik, S. L., and Napier, T. C. (2011). Intracranial self-stimulation as a positive reinforcer to study impulsivity in a probability discounting paradigm. J. Neurosci. Methods 198, 260-269. doi: 10.1016/j.jneumeth.2011.04.025
43. Rokosik, S. L., and Napier, T. C. (2012). Pramipexole-induced increased probabilistic discounting: comparison between a rodent model of Parkinson's disease and controls. Neuropsychopharmacology 37, 1397-1408. doi: 10.1038/npp.2011.325
44. Roll, J. M., McSweeney, F. K., Johnson, K. S., and Weatherly, J. N. (1995). Satiety contributes little to within-session decreases in responding. Learn. Motiv. 26, 323-341. doi: 10.1016/0023-9690(95)90018-7
45. Schuck-Paim, C., Pompilio, L., and Kacelnik, A. (2004). State-dependent decisions cause apparent violations of rationality in animal choice. PLoS. Biol. 2:e402. doi: 10.1371/journal.pbio.0020402
46. Spengos, K., Grips, E., Karachalios, G., Tsivgoulis, G., and Papadimitriou, G. (2006). Reversible pathological gambling under treatment with pramipexole. Nervenarzt 77, 958-960. doi: 10.1007/s00115-006-2128-5
47. St Onge, J. R., and Floresco, S. B. (2009). Dopaminergic modulation of risk-based decision making. Neuropsychopharmacology 34, 681-697. doi: 10.1038/npp.2008.121
48. Stopper, C. M., and Floresco, S. B. (2011). Contributions of the nucleus accumbens and its subregions to different aspects of risk-based decision making. Cogn. Affect. Behav. Neurosci. 11, 97-112. doi: 10.3758/s13415-010-0015-9
49. Szamosi, A., Nagy, H., and Keri, S. (2013). Delay discounting of reward and caudate nucleus volume in individuals with alpha-synuclein gene duplication before and after the development of Parkinson's disease. Neurodegener. Dis. 11, 72-78. doi: 10.1159/000341997
50. Tedford, S. E., Persons, A. L., Chen, L., Rokosik, S. L., and Napier, T. C. (2012). "Intracranial self-stimulation as the positive reinforcer to study impulsivity in a delayed discounting paradigm in rats. program No. 926.03, " inNeuroscience Meeting Planner (New Orleans, LA: Society for Neuroscience).
51. Tehovnik, E. J., and Sommer, M. A. (1997). Effective spread and timecourse of neural inactivation caused by lidocaine injection in monkey cerebral cortex. J. Neurosci. Methods 74, 17-26. doi: 10.1016/S0165-0270(97)02229-2
52. Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E., and Zald, D. H. (2009). Worth the 'EEfRT'? The effort expenditure for rewards task as an objective measure of motivation and anhedonia. PLoS. ONE 4:e6598. doi: 10.1371/journal.pone.0006598
53. Trowill, J. A., Panksepp, J., and Gandelman, R. (1969). An incentive model of rewarding brain stimulation. Psychol. Rev. 76, 264-281. doi: 10.1037/h0027295
54. Voon, V., Sohr, M., Lang, A. E., Potenza, M. N., Siderowf, A. D., Whetteckey, J., et al. (2011). Impulse control disorders in Parkinson disease: a multicenter case-control study. Ann. Neurol. 69, 986-996. doi: 10.1002/ana.22356
55. Wardle, M. C., Treadway, M. T., Mayo, L. M., Zald, D. H., and de, W. H. (2011). Amping up effort: effects of d-amphetamine on human effort-based decision-making. J. Neurosci. 31, 16597-16602. doi: 10.1523/JNEUROSCI.4387-11.2011
56. Weintraub, D., Koester, J., Potenza, M. N., Siderowf, A. D., Stacy, M., Voon, V., et al. (2010). Impulse control disorders in Parkinson disease: a cross-sectional study of 3090 patients. Arch. Neurol. 67, 589-595. doi: 10.1001/archneurol.2010.65
57. Wise, R. A. (1996). Addictive drugs and brain stimulation reward. Annu. Rev. Neurosci. 19, 319-340. doi: 10.1146/annurev.neuro.19.1.319
58. Wise, R. A. (2005). Forebrain substrates of reward and motivation. J. Comp. Neurol. 493, 115-121. doi: 10.1002/cne.20689
59. Wise, R. A., Bauco, P., Carlezon, W. A. Jr., and Trojniar, W. (1992). Self-stimulation and drug reward mechanisms. Ann. N.Y. Acad. Sci. 654, 192-198. doi: 10.1111/j.1749-6632.1992.tb25967.x
60. Wise, R. A., and Bozarth, M. A. (1981). Brain substrates for reinforcement and drug self-administration. Prog. Neuropsychopharmacol. 5, 467-474. doi: 10.1016/0364-7722(81)90028-X
61. Wise, R. A., and Rompre, P. P. (1989). Brain dopamine and reward. Annu. Rev. Psychol. 40, 191-225. doi: 10.1146/annurev.psych.40.1.191
62. Zeeb, F. D., Robbins, T. W., and Winstanley, C. A. (2009). Serotonergic and dopaminergic modulation of gambling behavior as assessed using a novel rat gambling task. Neuropsychopharmacology 34, 2329-2343. doi: 10.1038/npp.2009.62