Theory and method in the quantitative analysis of 'impulsive choice' behaviour: Implications for psychopharmacology

Psychopharmacology

Volumn 146, Issue 4, 1999, Pages 362-372

  Ho, M Y ^a   Mobini, S ^a   Chiang, T J ^a   Bradshaw, C M ^a   Szabadi, E ^a  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Delay of reinforcement; Hyperbolic discounting functions; Impulsive choice; Indifference equations; Probability of reinforcement

Indexed keywords

2 DIPROPYLAMINO 8 HYDROXYTETRALIN; BENZODIAZEPINE DERIVATIVE; BUSPIRONE; FENCLONINE; PSYCHOTROPIC AGENT; SEROTONIN; SEROTONIN UPTAKE INHIBITOR;

ANIMAL BEHAVIOR; CALCULATION; IMPULSIVENESS; METHODOLOGY; NONHUMAN; PRIORITY JOURNAL; PSYCHOPHARMACOLOGY; REINFORCEMENT; REVIEW; SEROTONINERGIC SYSTEM; THEORY;

ANIMALS; CHOICE BEHAVIOR; HUMANS; IMPULSIVE BEHAVIOR; MODELS, PSYCHOLOGICAL; PSYCHOPHARMACOLOGY; REINFORCEMENT (PSYCHOLOGY);

EID: 0032693651     PISSN: 00333158     EISSN: None     Source Type: Journal    
DOI: 10.1007/PL00005482     Document Type: Review

References (95)

1. Ainslie G (1975) Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 82:463-496
2. Ainslie G, Haslam N (1992) Self-control. In: Loewenstein G, Elster J (eds) Choice over time. Russell Sage, New York
3. Ainslie G, Herrnstein RJ (1981) Preference reversal and delayed reinforcement. Anim Learn Behav 9:476-482
4. Al-Ruwaitea ASA, Al-Zahrani SSA, Ho M-Y, Bradshaw CM, Szabadi E (1997) Effect of central 5-hydroxytryptamine depletion on performance in the "time-left" procedure: further evidence for a role of the 5-hydroxytryptaminergic pathways in behavioural "switching". Psychopharmacology 134:179-186
5. Al-Ruwaitea ASA, Chiang T-J, Al-Zahrani SSA, Ho M-Y, Bradshaw CM, Szabadi E (1999a) Effect of central 5-hydroxytryptamine depletion on tolerance of delay of reinforcement: evidence from performance in a discrete-trials "time-left" procedure. Psychopharmacology 141:22-29
6. Al-Ruwaitea ASA, Chiang T-J, Ho M-Y, Bradshaw CM, Szabadi E (1999b) Effect of central 5-hydroxytryptamine depletion on changeover behaviour in concurrent schedules of reinforcement. Psychopharmacology 144:264-271
7. Al-Zahrani SSA, Ho M-Y, Velazquez Martinez DN, Lopez Cabrera M, Bradshaw CM, Szabadi E (1996) Effect of destruction of the 5-hydroxytryptaminergic pathways on behavioural timing and "switching" in a free-operant psychophysical procedure. Psychopharmacology 127:346-352
8. American Psychiatric Association (1994) Diagnostic and statistical manual of mental disorders, DSM-IV, 4th edn. American Psychiatric Association, Washington, D.C.
9. Autor SM (1960) The strength of conditioned reinforcers as a function of frequency and probability of reinforcement. Unpublished doctoral dissertation, Harvard University, 1960; reprinted. In: Hendry DP (ed) Conditioned reinforcement. Dorsey, Homewood, Ill.
10. Autor SM (1960) The strength of conditioned reinforcers as a function of frequency and probability of reinforcement. Unpublished doctoral dissertation, Harvard University, 1960; reprinted. In: Hendry DP (ed) Conditioned reinforcement. Dorsey, Homewood, Ill.
11. Barratt ES (1981) Time perception, cortical evoked potentials and impulsiveness among three groups of adolescents. In: Hays J, Roberts T, Soloway K (eds) Violence and violent individual. SP Medical Scientific, New York
12. Barratt ES (1983) The biological basis of impulsiveness: the significance of timing and rhythm disorders. Person Individ Diff 4:387-391
13. Barratt ES, Patton J (1983) Impulsivity: cognitive, behavioral, and psychophysiological correlates. In: Zuckerman M (ed) Biological bases of sensation seeking, impulsivity, and anxiety. Erlbaum, New York
14. Baum WM (1974) On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav 21:231-242
15. Becker GS, Murphy KM (1988) A theory of rational addiction. J Polit Econ 96:675-700
16. Berger DF, Sagvolden T (1998) Sex differences in operant discrimination behaviour in an animal model of attention-deficit hyperactivity disorder. Behav Brain Res 94:73-82
17. Bizo JC, Thiébot MH, Le Bihan C, Soubrié P, Simon P (1988) Effects of imipramine-like drugs and serotonin uptake blockers on delay of reward in rats. Possible implication in the behavioral mechanisms of action of antidepressants. J Pharmacol Exp Ther 246:1144-1151
18. Black JW, Leff P (1983) Operational models of pharmacological agonism. Proc R Soc Lond 220:141-162
19. Bradshaw CM, Szabadi E (1988) Quantitative analysis of human operant behaviour. In: Davey G, Cullen C (eds) Human operant conditioning and behaviour modification. Wiley, London
20. Bradshaw CM, Szabadi E (1989) Central neurotransmitter systems and the control of operant behaviour by "natural" positive reinforcers. In: Liebman J, Cooper S (eds) The neuropharmacological bases of reward. Oxford University Press, New York
21. Bradshaw CM, Szabadi (1992) Choice between delayed reinforcers in a discrete-trials schedule: the effect of deprivation level. Q J Exp Psychol 44B:1-16
22. Bradshaw CM, Ruddle HV, Szabadi E (1981) Relationship between response rate and reinforcement frequency in variable-interval schedules: II. Effect of the volume of sucrose reinforcement. J Exp Anal Behav 35:263-269
23. Bradshaw CM, Szabadi E, Ruddle HV, Pears E (1983) Herrnstein's equation: effect of deprivation level on performance in variable-interval schedules. Behav Anal Lett 3:267-273
24. Charrier D, Thiébot MH (1996) Effects of psychotropic drugs on rat responding in an operant paradigm involving choice between delayed reinforcers. Pharmacol Biochem Behav 54:149-157
25. Christensen-Szalanski JJJ (1984) Discount functions and the measurement of patients' values: women's decisions during child-birth. Med Decis Making 4:47-58
26. Deluty MZ (1981) Self-control and impulsiveness involving short-term and long-term punishing events. In: Bradshaw CM, Szabadi E, Lowe CF (eds) Quantification of steady-state operant behaviour. Elsevier, Amsterdam
27. de Villiers P (1977) Choice in concurrent schedules and a quantitative formulation of the law of effect. In: Honig WK, Staddon JER (eds) Handbook of operant behavior. Prentice Hall, Englewood Cliffs, N.J.
28. Evenden JL (1998) The pharmacology of impulsive behaviour in rats IV: the effects of selective serotonergic agents on a paced fixed consecutive number schedule. Psychopharmacology 140:319-330
29. Evenden JL (1999) The pharmacology of impulsive behaviour in rats V: the effects of drugs on responding under a discrimination task using unreliable visual stimuli. Psychopharmacology 143:111-122
30. Evenden JL, Ryan CN (1996) The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology 128: 161-170
31. Eysenck SBG, Eysenck HJ (1978) Impulsiveness and venture-someness: their position in a dimensional system of personality description. Psychol Rep 43:1247-1255
32. Eysenck SBG, Pearson PR, Easting G, Allsopp JF (1985) Age norms for impulsiveness, venturesomeness and empathy in adults. Person Indiv Diff 6:613-619
33. Fishburn PC, Rubinstein A (1982) Time preference. Int Econ Rev 23:677-694
34. Gibbon J, Church RM (1981) Time left: linear vs. logarithmic subjective time. J Exp Psych [Anim Behav Proc] 7:87-108
35. Gibbon J, Fairhurst S (1994) Ratio versus difference comparators in choice. J Exp Anal Behav 62:409-434
36. Gordon M (1979) The assessment of impulsivity and mediating behaviours in hyperactive and non-hyperactive boys. J Abnorm Child Psychol 7:317-326
37. Green L, Myerson J (1996) Exponential versus hyperbolic discounting of delayed outcomes: risk and waiting times. Am Zool 36:496-505
38. Green L, Fisher EB, Perlow S, Sherman L (1981) Preference reversal and self-control: choice as a function of reward amount and delay. Behav Anal Lett 1:43-51
39. Green L, Fry AF, Myerson J (1994) Discounting of delayed rewards: a life-span comparison. Psychol Sci 5:33-36
40. Green L, Myerson J, McFadden E (1997) Rate of temporal discounting decreases with amount of reward. Mem Cognit 25:715-723
41. Harrison AA, Everitt BJ, Robbins TW (1997) Doubly dissociable effects of median-and dorsal-raphe lesions on the performance of a five-choice serial reaction time test of attention in rats. Behav Brain Res 89:135-149
42. Herrnstein RJ (1964) Secondary reinforcement and the rate of primary reinforcement. J Exp Anal Behav 7:27-36
43. Herrnstein RJ (1970) On the law of effect. J Exp Anal Behav 13:243-266
44. Herrnstein RJ (1981) Self-control as response strength. In: Bradshaw CM, Szabadi E, Lowe CF (eds) Quantification of steady-state operant behaviour. Elsevier, North Holland
45. Herrnstein RJ, Prelec D (1992) A theory of addiction. In: Loewenstein G, Elster J (eds) Choice over time. Russell Sage, New York
46. Heyman GM, Monaghan MM (1987) The effect of changes in the response requirement and deprivation on the parameters of the matching law equation: new data and review. J Exp Psychol [Anim Behav Proc] 13:384-394
47. Ho M-Y, Bradsbaw CM, Szabadi E (1997) Choice between delayed reinforcers: interaction between delay and deprivation level. Q J Exp Psychol 50B:193-202
48. Ho M-Y, Al-Zahrani SSA, Al-Ruwaitea ASA, Bradshaw CM, Szabadi E (1998) 5-Hydroxytryptamine and impulse control: prospects for a behavioural analysis. J Psychopharmacol 12: 68-78
49. Hughes IE, MacKay D (1985) Quantification of the characteristics of antagonists exhibiting both competitive antagonism and functional interaction. Br J Pharmacol 85:271-275
50. Kacelnik A (1997) Normative and descriptive models of decision making: time discounting and risk sensitivity. In: Ciba Foundation Symposium, 208: Characterizing human psychological adaptations. Wiley, Chichester
51. Kagan J (1966) Reflection-impulsivity: the generality of dynamics of conceptual tempo. J Abnorm Psychol 1:17-24
52. Kenakin TP (1993) Pharmacologic analysis of drug-receptor interaction, 2nd edn. Raven Press, New York
53. King GR, Logue AW, Gleiser D (1992) Probability and delay in reinforcement: an examination of Mazur's equivalence rule. Behav Proc 27:125-138
54. Kirby KN (1997) Bidding on the future: evidence against normative discounting of delayed rewards. J Exp Psychol [Gen] 126:54-70
55. Kirby KN, Herrnstein RJ (1995) Preference reversal due to myopic discounting of delayed reward. Psychol Sci 6:83-89
56. Kirby KN Maraković (1996) Delay-discounting probabilistic rewards: rates decrease as amounts increase. Psychonom Bull Rev 3:100-104
57. Kollins SH, Newland MC, Critchfield TS (1997) Human sensitivity to reinforcement in operant choice: how much do consequences matter? Psychonom Bull Rev 4:208-220
58. Leon MI, Gallistel CR (1998) Self-stimulating rats combine subjective reward magnitude and subjective reward rate multiplicatively. J Exp Psychol [Anim Behav Proc] 24:265-277
59. Logue AW (1988) Research on self-control: an integrated framework. Behav Brain Sci 11:665-709
60. Logue AW, Tobin H, Chelonis JJ, Wang RY, Geary N, Schachter S (1992) Cocaine decrease self-control in rats: a preliminary report. Psychopharmacology 109:245-247
61. Loewenstein G, Prelec D (1992) Anomalies in intertemporal choice: evidence and an interpretation. In: Loewenstein G, Elster J (eds) Choice over time. Russell Sage, New York
62. Mackay D (1981) An analysis of functional antagonism and synergism. Br J Pharmacol 73:127-134
63. Mazur JE (1987) An adjusting procedure for studying delayed reinforcement. In: Commons ML, Mazur JE, Nevin JA, Rachlin H (eds) Quantitative analyses of behavior, vol V: the effect of delay and intervening events. Erlbaum, Hillsdale
64. Mazur JE (1988) Choice between small certain and large uncertain reinforcers. Anim Learn Behav 16:199-205
65. Mazur JE (1997) Choice, delay, probability, and conditioned reinforcement. Anim Learn Behav 25:131-147
66. Miller HL (1976) Matching-based hedonic scaling in the pigeon. J Exp Anal Behav 26:335-347
67. Mischel (1966) Theory and research on the antecedents on self-imposed delay of reward. In: Maher BA (ed) Progress in experimental personality research. Academic Press, New York
68. Myerson J, Green L (1995) Discounting of delayed rewards: models of individual choice. J Exp Anal Behav 64:263-276
69. Olson M, Bailey MJ (1981) Positive time preference. J Polit Econ 89:1-25
70. Ostaszewski P, Green L, Myerson J (1998) Effects of inflation on the subjective value of delayed and probabilistic rewards. Psychonom Bull Rev 5:324-333
71. Poulos CX, Parker JL, Le AD (1996) Dexfenfluramine and 8-OH-DPAT modulate impulsivity in a delay-of-reward paradigm: implications for a correspondence with alcohol consumption. Behav Pharmacol 7:395-399
72. Rachlin H (1974) Self-control. Behaviorism 2:94-107
73. Rachlin H, Raineri A (1992) Irrationality, impulsiveness and selfishness as discount reversal effects. In: Loewenstein G, Elster J (eds) Choice over time. Russell Sage, New York
74. Rachlin H, Siegel E (1994) Temporal patterning in probabilistic choice. Organiz Behav Hum Decis Proc 59:161-176
75. Rachlin H, Logue AW, Gibbon J, Frankel M (1986) Cognition and behavior in studies of choice. Psychol Rev 93:33-45
76. Rachlin H, Raineri A, Cross D (1991) Subjective probability and delay. J Exp Anal Behav 55:233-244
77. Richards JB, Mitchell SH, de Wit H, Seiden LS (1997) Determination of discount functions in rats with an adjusting-amount procedure. J Exp Anal Behav 67:353-366
78. Robbins TW, Evenden JL (1985) Rate-independent approaches to the analysis of drag action. In: Lowe CF, Richelle M, Blackman DE, Bradshaw CM (eds) Behaviour analysis and contemporary psychology. Erlbaum, London
79. Sagvolden T, Berger DF (1996) An animal model of attention-deficit disorder: the female shows more behavioural problems and is more impulsive than the male. Eur Psychol 1:113-122
80. Sagvolden T, Aase H, Zeiner P, Berger DF (1998) Altered reinforcement mechanisms in attention-deficit hyperactivity disorder: Hyperactivity may be required. Behav Brain Res 94:61-71
81. Samuelson PA (1937) A note on measurement of utility. Rev Econ Stud 23:155-161
82. Siegman AW (1961) The relationship between future time perspective, time estimation, and impulse control in a group of young offenders and a control group. J Consult Psychol 25: 470-475
83. Soubrie P (1986) Reconciling the role of central serotonin neurons in human and animal behavior. Behav Brain Sci 9:319-364
84. Thiebot MH (1986) Are serotonergic neurons involved in the control of anxiety and in the anxiolytic activity of benzodiazepines? Pharmacol Biochem Behav 24:1471-1477
85. Thiebot MH (1992) Anxiolytics and impulse control. J Psychopharmacol A46
86. Thiébot MH, Le Biahn C, Soubrie P, Simon P (1985) Benzodiazepines reduce tolerance to reward delay in rats. Psychopharmacology 86:147-152
87. Tomie A, Aguado AS, Pohorecky LA, Benjamin D (1998) Ethanol induces impulsive-like responding in a delay-of-reward operant choice procedure: impulsivity predicts autoshaping. Psychopharmacology 139:376-382
88. Van den Broek MD, Bradshaw CM, Szabadi E (1987a) Behaviour of "impulsive" and "non-impulsive" humans in a temporal differentiation schedule of reinforcement. Person Indiv Diff 8:233-239
89. van den Brock MD, Bradshaw CM, Szabadi E (1987b) Performance of normal adults on the Matching Familiar Figures Test. Br J Clin Psychol 26:71-72
90. van den Broek MD, Bradshaw CM, Szabadi E (1992) Performance of impulsive and non-impulsive subjects on two temporal differentiation tasks. Person Indiv Diff 13:169-174
91. Vaughan WM (1985) Choice: a local analysis. J Exp Anal Behav 43:383-405
92. Walker NW (1982) Comparison of cognitive tempo and time estimation by young boys. Percept Motor Skills 54:715-722
93. Wogar MA, Bradshaw CM, Szabadi E (1992) Choice between delayed reinforcers in an adjusting-delay schedule: the effects of absolute reinforcer size and deprivation level. Q J Exp Psychol 45B:1-13
94. Wogar MA, Bradshaw CM, Szabadi E (1993) Effects of lesions of the ascending 5-hydroxytryptaminergic pathways on choice between delayed reinforcers. Psychopharmacology 113:239-243
95. Zeiler MD (1977) Schedules of reinforcement. In: Honig WK, Staddon JER (ed) Handbook of operant behavior. Prentice-Hall, Englewood Cliffs, N.J.