Investigations of the Neurobiological Bases of Inter-Temporal Choice Behaviour

European Journal of Behavior Analysis

Volumn 14, Issue 2, 2013, Pages 215-239

  Valencia Torres, L ^a   Olarte Sanchez C M ^a   Body, S ^a   Bradshaw, C M ^a   Szabadi, E ^a  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

delay discounting; inter temporal choice; multiplicative hyperbolic model (MHM); nucleus accumbens; orbital prefrontal cortex; reinforcer value; subthalamic nucleus

Indexed keywords

EID: 84902194124     PISSN: None     EISSN: 2377729X     Source Type: Journal    
DOI: 10.1080/15021149.2013.11434457     Document Type: Article

References (102)

1. Acheson, A., Farrar, A. M., Patak, M., Hausknecht, K. A., Kieres, A. K., Choi, S., de Wit, H., & Richards, J. B. (2006) Nucleus accumbens lesions decrease sensitivity to rapid changes in the delay to reinforcement. Behavioural Brain Research, 173, 217–228. doi: 10.1016/j.bbr.2006.06.024
2. Ainslie, G. W. (1974). Impulse control in pigeons. Journal of the Experimental Analysis of Behavior, 21, 485–489. doi: 10.1901/jeab.1974.21-485
3. Ainslie, G. W. (1975). Specious reward: a behavioral theory of impulsiveness and impulse control. Psychological Bulletin, 82, 463–496. doi: 10.1037/h0076860
4. Ainslie, G. W. (2001). Breakdown of the will. Cambridge, MA: Cambridge University Press.
5. Albin, R. L., Young, A. B., & Penney, J. B. (1989). The functional anatomy of basal ganglia disorders. Trends in Neurosciences, 12, 366–375. doi: 10.1016/j.bbr.2011.03.031.
6. Alexander, G. E., DeLong, M. R., & Strick, P. L. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annual Review of Neuroscience, 9, 357–381. doi: 10.1146/annurev.ne.09.030186.002041
7. Balleine, B. W. & Dickinson, A. (1998). Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology, 37, 407–419. doi: 10.1016/S0028-3908(98)00033-1
8. Balleine, B. W. & O’Doherty, J. P. (2010). Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology, 35, 48–69. doi: 10.1038/npp.2009.131
9. Balleine, B. W., Doya, K., O’Doherty, J., & Sakagami, M. (Eds.) (2007). Reward and decision making in corticobasal ganglia networks. Annals of the New York Academy of Sciences, vol 1104. New York: Wiley-Blackwell.
10. Baunez, C., Amalric, M., Robbins, T. W. (2002). Enhanced food-related motivation after bilateral lesions of the subthalamic nucleus. Journal of Neuroscience, 22, 562–568. doi: 10.1111/j.1460-9568.1997.tb01376.x
11. Bezzina, G., Cheung, T. H. C., Asgari, K., Hampson, C. L., Body, S., Bradshaw, C. M., Szabadi, E., Anderson, I. M., & Deakin, J. F. W. (2007). Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-temporal choice: a quantitative analysis. Psychopharmacology, 195, 71–84. doi: 10.1007/s00213-007-0882-0
12. Bezzina, G., Body, S., Cheung, T. H. C., Hampson, C. L., Bradshaw, C. M., Szabadi, E., Anderson, I. M., & Deakin, J. F. W. (2008a). Effect of disconnecting the orbital prefrontal cortex from the nucleus accumbens core on inter-temporal choice behaviour: a quantitative analysis. Behavioural Brain Research,191, 272–279. doi: 10.1016/j.bbr.2008.03.041
13. Bezzina, G., Body, S., Cheung, T. H. C., Hampson, C. L., Deakin, J. F. W., Anderson, I. M., Szabadi, E., & Bradshaw, C. M. (2008b). Effect of quinolinic acid-induced lesions of the nucleus accumbens core on performance on a progressive ratio schedule of reinforcement: implications for inter-temporal choice. Psychopharmacology, 197, 339–350. doi: 10.1007/s00213-007-1036-0
14. Bezzina, G., den Boon, F. S., Hampson, C. L., Cheung, T. H. C., Body, S., Bradshaw, C. M., Szabadi, E., Anderson, I. M., & Deakin, J. F. W. (2008c). Effect of quinolinic acid-induced lesions of the subthalamic nucleus on performance on a progressive ratio schedule of reinforcement: a quantitative analysis. Behavioural Brain Research, 195, 223–230. doi: 10.1016/j.bbr.2008.09.005
15. Bezzina, G., Cheung, T. H. C., Body, S., Deakin, J. F. W., Anderson, I. M., Bradshaw, C. M., & Szabadi, E. (2009). Quantitative analysis of the effect of lesions of the subthalamic nucleus on inter-temporal choice: further evidence for enhancement of the incentive value of food reinforcers. Behavioural Pharmacology, 20, 437–446. doi: 10.1097/FBP.0b013e3283305e4d
16. Bradshaw, C. M. & Killeen, P. R. (2012). A theory of behaviour on progressive ratio schedules, with applications in behavioural pharmacology. Psychopharmacology, 222, 549–564. doi: 10.1007/s00213-012-2771-4
17. Bradshaw, C. M. & Szabadi, E. (1992). Choice between delayed reinforcers in a discrete-trials schedule: the effect of deprivation level. Quarterly Journal of Experimental Psychology, 44B, 1–16. doi: 10.1080/02724999208250599
18. Bradshaw, C. M., Body, S., & Szabadi, E. (2009). Delayed reinforcement: neuroscience. In L. R. Squire (Ed.) Encyclopedia of Neuroscience. (pp. 393–401). Oxford, England: Academic Press.
19. Broos, N., Schmaal, L., Wiskerke, J., Kostelijk, L., Lam, T., Stoop, N., Weierink, L., Ham, J., de Geus, E. J. C., Schoffelmeer1, A. N. M., van den Brink, W., Veltman, D. J., de Vries, T. J., Pattij, T., & Goudriaan, A. (2012). The relationship between impulsive choice and impulsive action: a cross-species tanslational study. PLOS ONE 7(5): e36781. doi: 10.1371/journal.pone.0036781
20. Cardinal, R. N., Robbins, T. W., & Everitt, B. J. (2000). The effects of d-amphetamine, chlordiazepozide, alpha-flupenthixol and behavioural manipulation on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology, 152, 362–375. doi: 10.1007/s002130000536
21. Cardinal, R. N., Pennicott, D. R., Sugathapala, C. L., Robbins, T. W., & Everitt, B. J. (2001). Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science, 292, 249–2501. doi: 10.1126/science.1060818
22. Cardinal, R. N., Parkinson, J. A., Hall, J., & Everitt, B. J. (2002). Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neuroscience and Biobehavioural. Reviews, 26, 321–352. doi: 10.1016/S0149-7634(02)00007-6
23. Cardinal, R. N., Robbins, T. W., & Everitt, B. J. (2003). Choosing delayed rewards: perspectives from learning theory, neurochemistry, and neuroanatomy. In N. Heather. & R. E. Vuchinich (Eds), Choice, behavioral economics and addiction (pp. 183–213, 217–218). Oxford, England: Elsevier.
24. Christokou, A., Robbins, T. W., & Everitt, B. J. (2001). Functional disconnection of a prefrontal cortical-dorsal striatal system disrupts choice reaction time performance: implications for attentional function. Behavioral Neuroscience, 115, 812–825. doi: 10.1037//0735-7044.115.4.812
25. Christakou, A., Robbins, T. W., & Everitt, B. J. (2004). Prefrontal cortical-ventral striatal interactions involved in affective modulation of attentional performance: implications for corticostriatal circuit function. Journal of Neuroscience, 24, 773–780. doi: 10.1523/JNEUROSCI.0949-03.2004
26. da Costa Araújo, S., Body, S., Hampson, C. L., Langley, R. W., Deakin, J. F. W., Anderson, I. M., Bradshaw, C. M., & Szabadi, E. (2009). Effect of lesions of the nucleus accumbens core on inter-temporal choice: further obnservations with an adjusting-delay schedule. Behavioural Brain Research, 202, 272–277. doi: 10.1016/j.bbr.2009.04.003
27. da Costa Araújo, S., Body, S., Valencia-Torres, L., Olarte-Sánchez, C. M., Bak, V. K., Deakin, J. F. W., Anderson, I. M., Bradshaw, C. M., & Szabadi, E. (2010). Choice between reinforcer delays versus choice between reinforcer magnitudes: differential Fos expression in the orbital prefrontal cortex and nucleus accumbens core. Behavioural Brain Research, 213, 269–277. doi: 10.1016/j.bbr.2010.05.014
28. Dalley, J. W., Everitt, B. J., & Robbins, T. W. (2011). Impulsivity, compulsivity, and top-dwn cognitive cntrol. Neuron, 69, 680–694. doi: 10.1016/j.neuron.2011.01.020
29. De Olmos, J. S. (2004). Amygdala. In G. Paxinos & J. K. Mai (Eds.). The human nervous system (pp. 739–868). Amsterdam, The Netherlands: Elsevier.
30. Dixon, M. R., Jacobs, E. A., & Sanders, S. (2006). Contextual control of delayed discounting by pathological gamblers. Journal of Applied Behavior Analysis, 39, 413–422. doi: 10.1901/jaba.2006.173-05
31. Eisenberger, R. & Masterson, F. A. (1987). Effects of prior learning and current motivation on self-control. In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. C. Rachlin (Eds.), Quantitative analyses of behavior, vol. V: The effect of delay and of intervening events on reinforcement value (pp. 267–282). Hillsdale NJ: Erlbaum.
32. Evenden, J. L. (1999). Varieties of impulsivity. Psychopharmacology, 146, 348–361. doi: 10.1007/PL00005481
33. Evenden J. L. & Ryan, C. N. (1996). The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology 128, 161–170. doi: 10.1007/s002130050121
34. Gaffan, D. & Eacott, M. J. (1995). Visual learning for an auditory secondary reinforcer by macaques is intact after uncinate fascicle section: indirect evidence for the involvement of the corpus striatum. European Journal of Neuroscience, 7(9), 1866–1871. doi: 10.1111/j.1460-9568.1995.tb00707.x
35. Gallagher, M., McMahon, R. W., & Schoenbaum, G. (1999). Orbitofrontal cortex and representation of incentive value in associative learning. Journal of Neuroscience, 19, 6610–6614.
36. rd ed., pp. 458–509). San Diego, CA: Elsevier.
37. Geschwind, N. (1965). Disconnexion syndromes in animals and man. Part 1. Brain, 88, 237–294. doi: 10.1093/brain/88.2.237
38. Green, L. & Myerson, J. (2004). A discounting framework for choice with delayed and probabilistic rewards. Psychological Bulletin, 130, 769–792. doi: 10.1037/0033-2909.130.5.769
39. Green, L., Myerson, J., Shah, A. K., Estle, S. J., & Holt, D. D. (2007). Do adjusting-amount and adjusting delay procedures produce equivalent estimates of subjective value in pigeons? Journal of the Experimental Analysis of Behavior, 87, 337–347. doi: 10.1901/jeab.2007.37-06
40. rd ed., pp. 408–508). San Diego, CA: Elsevier.
41. Haber, S. N. (2003). The primate basal ganglia: parallel and integrative networks. Journal of Chemical Neuroanatomy, 26, 317–330. doi: 10.1016/j.jchemneu.2003.10.003
42. Harty, S. C., Whaley, J. E., Halperin, J. M., & Ranaldi, R. (2011). Impulsive choice, as measured in a delay discounting paradigm, remains stable after chronic heroin administration. Pharmacology, Biochemistry and Behavior, 98, 337–340. doi: 10.1016/j.pbb.2011.02.004
43. Harvey-Lewis, C., Perdrizet, J., & Franklin, K. B. J. (2012). The effect of morphine dependence on impulsive choice in rats. Psychopharmaology, 223, 447–487. doi: 10.1007/s00213-012-2738-5
44. Herdegen, T. & Leah, J. D. (1998). Inducible and constitutive transcription factors in the mammalian nervous system: control of gene expression by Jun, Fos and Krox, and CREB/ATF proteins. Brain Research Reviews, 28, 370–490. doi: 10.1016/S0165-0173(98)00018-6
45. Herrnstein, R. J. (1981). Self-control as response strength. In C. M. Bradshaw C. M., Szabadi, E., & Lowe, C. F. (Eds.) Quantification of steady-state operant behaviour (pp. 3–20). Amsterdam, The Netherlands: Elsevier North Holland.
46. Ho, M.-Y., Wogar, M. A., Bradshaw, C. M., & Szabadi, E. (1997). Choice between delayed reinforcers: interaction between delay and deprivation level. Quarterly Journal of Experimental Psychology, 50B. 193–202. doi: 10.1080/713932652
47. Ho, M.-Y., Al-Zahrani, S. S. A., Al-Ruwaitea, A. S. A., Bradshaw, C. M., & Szabadi, E. (1998). 5-Hydroxytryptamine and impulse control: prospects for a behavioural analysis. Journal of Psychopharmacology, 12, 68–78. doi: 10.1177/026988119801200109
48. Ho, M.-Y., Mobini, S., Chiang, T.-J., Bradshaw, C. M., & Szabadi, E. (1999). Theory and method in the quantitative analysis of “impulsive choice” behaviour: implications for psychopharmacology. Psychopharmacology, 146, 362–372. doi: 10.1007/PL00005482
49. Hoffman, G. E., Smith, M. S., & Verbalis, J. G. (1993). C-Fos and related immediate early gene products as markers of activity in neuroendocrine systems. Frontiers in Neuroendocrinology, 14, 173–213. doi: 10.1006/frne.1993.1006
50. Kheramin, S., Body, S., Mobini S, Ho, M.-Y., Velazquez-Martinez, D. N., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., & Anderson, I. M. (2002). Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: a quantitative analysis. Psychopharmacology, 165, 9–17. doi: 10.1007/s00213-002-1228-6
51. Kheramin, S., Body, S., Mobini, S., Ho, M.-Y., Velazquez-Martinez, D. N., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., & Anderson, I. M. (2003). Role of the orbital prefrontal cortex on choice between delayed and uncertain reinforcers: a quantitative analysis. Behavioural Processes, 64, 239–250. doi: 10.1016/S0376-6357(03)00142-6
52. Kheramin, S., Body, S., Ho, M.-Y., Velazquez-Martinez, D. N., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., & Anderson, I. M. (2004). Effects of orbital prefrontal cortex dopamine depletion on inter-temporal choice: a quantitative analysis. Psychopharmacology, 175, 206–214. doi: 10.1007/s00213-004-1813-y
53. Kheramin, S., Body, S., Miranda Herrera, F., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., & Anderson, I. M. (2005). The effect of orbital prefrontal cortex lesions on performance on a progressive ratio schedule: implications for models of inter-temporal choice. Behavioural Brain Research, 156, 145-152. doi: 10.1016/j.bbr.2004.05.017
54. Killeen, P. R. (1994). Mathematical principles of reinforcement. Behavioural and Brain Sciences, 17, 105–172. doi: 10.1017/S0140525X00033744
55. Kirk, J.M. & Logue, A.W. (1997). Effects of deprivation level on humans’ self-control for food reinforcers. Appetite, 28, 215–226. doi: 10.1006/appe.1996.0071
56. MacCorquodale, K. & Meehl, P. E. (1948). On a distinction between hypothetical constructs and intervening variables. Psychological Review, 55, 95–107. doi: 10.1037/h0056029
57. Madden, G. J. & Bickel, W. K. (Eds.) (2010). Impulsivity: the behavioral and neurological science of discounting. Washington, DC: American Psychological Association.
58. Madden, G. J. & Johnson, P. S. (2010). A delay-discounting primer. In G. J. Madden & W. K. Bickel (Eds.) Impulsivity: the behavioral and neurological science of discounting (pp. 11–37). Washington, DC: American Psychological Association.
59. Mar, A. C., Walker, A. L. J., Theobald, D. E., Eagle, D. M., & Robbins, T. W. (2011). Dissociable effects of lesions to orbitofrontal cortex subregions on impulsive choice in the rat. Journal of Neuroscience, 31, 6398–6404. doi: 10.1523/JNEUROSCI.6620-10.2011
60. Mazur, J. E. (1984). Tests of an equivalence rule for fixed and variable reinforcer delays. Journal of Experimental Psychology: Animal Behavior Processes, 10, 426–436. doi: 10.1037/0097-7403.10.4.426
61. Mazur, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Commons, J. E. Mazur, J. A. Nevin, H. C. Rachlin (Eds.), Quantitative analyses of behavior, vol. 5: The effects of delay and intervening events on reinforcement value (pp. 55–73) Mahwah NJ: Erlbaum.
62. Mazur, J. E. (1991). Choice with probabilistic reinforcement: effects of delay and conditioned reinforcers. Journal of the Experimental Analysis of Behavior, 55, 63–77. doi: 10.1901/jeab.1998.70-253
63. Mazur, J. E. (1994). Effects of intertrial reinforcers on self-control choice. Journal of the Experimental Analysis of Behavior, 61, 83–96. doi: 10.1901/jeab.1994.61-83
64. Mazur, J. E. (1995). Conditioned reinforcement and choice with delayed and uncertain primary reinforcers. Journal of the Experimental Analysis of Behavior, 63, 139–150. doi: 10.1901/jeab.1995.63-139
65. Mazur, J. E. (1997). Choice, delay, probability, and conditioned reinforcement. Animal Learning and Behavior, 25, 131–147. doi: 10.3758/BF03199051
66. Mazur, J. E. (1998). Choice with delayed and probabilistic reinforcers: effects of prereinforcer and postreinforcer stimuli. Journal of the Experimental Analysis of Behavior, 70, 253–265. doi: 10.1901/jeab.1998.70-253
67. Mazur, J. E. (2003). Effects of free-food deliveries and delays on choice under concurrent-chains schedules. Behavioural Processes, 64, 251–260. doi: 10.1016/S0376-6357(03)00140-2
68. Mazur, J. E. (2006). Mathematical models and the experimental analysis of behavior. Journal of the Experimental Analysis of Behavior, 85, 275–291. doi: 10.1901/jeab.2006.65-05
69. Mobini, S., Body, S., Ho, M.-Y., Bradshaw, C. M., Szabadi, E., Deakin, J. F. W., & Anderson, I. M. (2002). Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcerment. Psychopharmacology, 160, 290–298. doi: 10.1007/s00213-001-0983-0
70. Nambu, A., Tokuno, H., & Takada, M. (2002). Functional significance of the cortico-subthalamo-pallidal ‘hyperdirect’ pathway. Neuroscience Reseach, 43, 111–117. doi: 10.1016/S0168-0102(02)00027-5
71. Nambu, A. (2004). A new dynamic model of the cortico-basal ganglia loop. Progress in Brain Research, 143, 461–466. doi: 10.1016/S0079-6123(03)43043-4
72. Nambu, A. (2008). Seven problems with the basal ganglia. Current Opinion in Neurobiology, 18, 595–604. doi: 10.1016/j.conb.2008.11.001
73. Odum, A. L. (2011). Delay discounting: I’m a K, you’re a K. Journal of the Experimental Analysis of Behavior, 96, 427–439. doi: 10.1901/jeab.2011.96-423
74. Pais-Vieira, M., Lima, D. & Galhardo, V. (2007). Orbitofrontal cortex lesions disrupt risk assessment in a novel serial decision-making task for rats. Neuroscience, 145, 225–231. doi: 10.1016/j.neuroscience.2006.11.058
75. Petry, N. M. & Madden, G. J. (2010). Discounting and pathological gambling. In G. J. Madden & W. K. Bickel (Eds.) Impulsivity: the behavioral and neurological science of discounting (pp. 273–294). Washington, DC: American Psychological Association.
76. Rachlin, H. & Green, L. (1972). Commitment, choice and self-control. Journal of the Experimental Analysis of Behavior, 17, 15–22. doi: 10.1901/jeab.1972.17-15
77. Rachlin, H., Raineri, A., & Cross, D. (1991). Subjective probability and delay. Journal of the Experimental Analysis of Behavior, 55, 233–244. doi: 10.1901/jeab.1991.55-233
78. Richards, J. B., Mitchell, S. H., de Wit, H., & Seiden, L. S. (1997). Determination of discount functions in rats with an adjusting amount procedure. Journal of the Experimental Analysis of Behavior, 67, 353–366. doi: 10.1901/jeab.1997.67-353
79. Robbins, T. W. & Everitt, B. J. (2002). Limbic-striatal memory systems and drug addiction. Neurobiology of Learning and Memory, 78, 625–636. doi: 10.1006/nlme.2002.4103
80. Robbins, T. W., Gillan, C. M., Smith, D. G., de Wit, S., & Ersche, K. D. (2012). Neurocognitive endophenotypes of impulsivity and compulsivity: towards dimensional psychiatry. Trends in Cognitive Sciences, 16, 82–91. doi: 10.1016/j.tics.2011.11.009
81. Robles, E., Huang, B. E., Simpson, P. M., & McMillan, D. E. (2011). Delay discounting, impulsiveness, and addiction severity in opioid-dependent patients. Journal of Substance Abuse Treatment, 41, 354–362. doi: 10.1016/j.jsat.2011.05.003
82. Roesch, M. R. & Olson, C. R. (2007). Neuronal activity related to anticipated reward in frontal cortex: does it represent value or reflect motivation? Annals of the New York Academy of Sciences, 1121, 431–446. doi: 10.1196/annals.1401.004
83. Rogers, R. D., Baunez, C., Everitt, B. J., & Robbins, T. W. (2001). Lesions of the medial and lateral striatum in the rat produce differential deficits in attentional performance. Behavioral Neuroscience, 115, 799–811. doi: 10.1037//0735-7044.115.4.799
84. Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., & Rushworth, M. F. (2006). Separate neural pathways process different decision costs. Nature Neuroscience, 9, 1161–1168. doi: 10.1038/nn1756
85. Sagvolden, T., Johansen, E., Aase, H., & Russell, V. (2005). A dynamic developmental theory of attention deficit hyperactivity disorder (ADHD) predominantly hyperactive/impulsive and combined subtypes. Behavioral and Brain Sciences, 28, 397–419. doi: 10.1017/S0140525X05000075
86. Sheng, M. & Greenberg, M. E. (1990). The regulation and function of c-fos and other immediate early genes in the nervous system. Neuron, 4, 477–485. doi: 10.1016/0896-6273(90)90060-S
87. Skinner, B. F. (1950). Are theories of learning necessary? Psychological Review, 57, 193–216. doi: 10.1037/h0054367
88. Takahashi, T. (2009). Theoretical frameworks for neuroeconomics of intertemporal choice. Journal of Neuroscience, Psychology, and Economics, 2, 75–90. doi: 10.1037/a0015463
89. Tekin, S. & Cummings, J. L. (2002). Frontal-subcortical neuronal circuits and clinical neuropsychiatry: an update. Journal of Psychosomatic Research, 53, 647–654. doi: 10.1016/S0022-3999(02)00428-2
90. Uslaner, J. M. & Robinson, T. E. (2006). Subthalamic nucleus lesions increase impulsive action and decrease impulsive choice–mediation by enhanced incentive motivation? European Journal of Neuroscience, 24, 2345–2354. doi: 10.1111/j.1460-9568.2006.05117.x
91. Uylings, H. B. M., Groenewegen, H. J., & Kolb, B. (2003). Do rats have a prefrontal cortex? Behavioural Brain Research, 146, 3–17. doi: 10.1016/j.bbr.2003.09.028
92. Valencia-Torres, L., da Costa Araújo, S., Olarte-Sánchez, C. M., Body, S., Bradshaw, C. M., & Szabadi, E. (2011). Transitional and steady-state choice behavior under an adjusting-delay schedule. Journal of the Experimental analysis of Behavior, 95, 57–74. doi: 10.1901/jeab.2011.95-57
93. Valencia-Torres, L., Olarte-Sánchez, C. M., da Costa Araújo, S., Body, S., Bradshaw, C. M., & Szabadi, E. (2012). Nucleus accumbens and delay discounting in rats: evidence from a new quantitative protocol for analysing inter-temporal choice. Psychopharmacology, 219, 271–283. doi: 10.1007/s00213-011-2459-1
94. Voorn, P., Vanderschuren, L. J. M. J., Groenewegen, H. J., Robbins, T. W., & Pennartz, C. M. A. (2004) Putting a spin on the dorsal–ventral divide of the striatum. Trends in Neuroscience, 27, 468-474. doi: 10.1016/j.tins.2004.06.006
95. Wallis, J. D. (2007). Orbitofrontal cortex and its contribution to decision-making. Annual Review of Neuroscience, 30, 31–56. doi: 10.1146/annurev.neuro.30.051606.094334
96. West, E. A., Forcelli, P. A., Murnen, A., Gale, K., & Malkova, L. (2011). A visual, position-independent instrumental reinforcer devaluation task for rats. Journal of Neuroscience Methods, 194, 297–304. doi: 10.1016/j.jneumeth.2010.11.004
97. Winstanley, C. A. (2010). The neural and neurochemical basis of delay discounting. In G. J. Madden & W. K. Bickel (Eds), Impulsivity: the behavioral and neurological science of discounting (pp. 95–121). Washington DC: American Psychological Association.
98. Winstanley, C. A., Theobald, D. E., Cardinal, R. N., & Robbins, T. W. (2004). Contrasting roles of basolateral amygdala and orbitofrontal cortex in impulsive choice. Journal of Neuroscience, 24, 4718–4722. doi: 10.1523/JNEUROSCI.5606-03.2004
99. Winstanley, C. A., Baunez, C., Theobald, D. E. H., & Robbins, T. W. (2005). Lesions of the subthalamic nucleus decrease impulsive choice but impair autoshaping in rats: the importance of the basal ganglia in Pavlovian conditioning and impulse control. European Journal of Neuroscience, 21, 3107–3116. doi: 10.1111/j.1460-9568.2005.04143.x
100. Wogar, M. A., Bradshaw, C. M., & Szabadi, E. (1992). Choice between delayed reinforcers in an adjusting-delay schedule: the effects of absolute reinforcer size and deprivation level. Quarterly Journal of Experimental Psychology, 45B, 1–13. doi: 10.1080/14640749208401021
101. Zeeb, F. D., Floresco, S.B., & Winstanley, C. A. (2010) Contributions of the orbitofrontal cortex to impulsive choice: interactions with basal levels of impulsivity, dopamine signalling, and reward-related cues. Psychopharmacology, 211, 87–98. doi: 10.1007/s00213-010-1871-2
102. Zeeb, F. D. & Winstanley, C. A. (2011). Lesions of the basolateral amygdala and orbitofrontal cortex differentially affect acquisition and performance of a rodent gambling task. Journal of Neuroscience, 31, 2197–204. doi: 10.1523/JNEUROSCI.5597-10.2011.