Vulnerabilities underlying human drug dependence: Goal valuation versus habit learning

Clinical Applications of Learning Theory

Volumn , Issue , 2013, Pages 75-101

  Hogarth, Lee ^a   Chase, Henry W ^a  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84874501166     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (160)

1. Allen, S. S., Bade, T., Hatsukami, D., & Center, B. (2008). Craving, withdrawal, and smoking urges on days immediately prior to smoking relapse. Nicotine & Tobacco Research, 10, 35-45.
2. Anthony, J. C., Warner, L. A., & Kessler, R. C. (1994). Comparative epidemiology of dependence on tobacco, alcohol, controlled substances, and inhalants: Basic indings from the National Comorbidity Survey. Experimental and Clinical Psychopharmacology, 2, 244-268.
3. Balleine, B. W., & O'Doherty, J. P. (2010). Human and rodent homologies in action control: Corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology, 35, 48-69.
4. Balleine, B. W., & Ostlund, S. B. (2007). Still at the choice point. In B. W. Balleine, K. Doya, & J. O'Doherty (Eds.), Annals of the New York Academy of Sciences: Vol. 1104. Reward and decision making in corticobasal ganglia networks (pp. 147-171). New York, NY: New York Academy of Sciences.
5. Bardo, M. T., Donohew, R. L., & Harrington, N. G. (1996). Psychobiology of novelty seeking and drug seeking behavior. Behavioural Brain Research, 77, 23-43.
6. Barrett, S. P., Boileau, I., Okker, J., Pihl, R. O., & Dagher, A. (2004). The hedonic response to cigarette smoking is proportional to dopamine release in the human striatum as measured by positron emission tomography and [C-11]raclopride. Synapse, 54, 65-71.
7. Baum, W. M. (1974). 2 types of deviation from matching law: Bias and under-matching. Journal of the Experimental Analysis of Behavior, 22, 231-242.
8. Belin, D., Mar, A. C., Dalley, J. W., Robbins, T. W., & Everitt, B. J. (2008). High impulsivity predicts the switch to compulsive cocaine-taking. Science, 320, 1352-1355.
9. Bickel, W. K., Marsch, L. A., & Carroll, M. E. (2000). Deconstructing relative reinforcing eficacy and situating the measures of pharmacological reinforcement with behavioral economics: A theoretical proposal. Psychopharmacology, 153, 44-56.
10. Biederman, J., Wilens, T., Mick, E., Faraone, S. V., Weber, W., Curtis, S., et al. (1997). Is ADHD a risk factor for psychoactive substance use disorders? Findings from a four-year prospective follow-up study. Journal ofthe American Academy ofChild and Adolescent Psychiatry, 36, 21-29.
11. Bisaga, A., Padilla, M., Garawi, F., Sullivan, M. A., & Haney, M. (2007). Effects of alternative reinforcer and craving on the choice to smoke cigarettes in the laboratory. Human Psychopharmacology: Clinical and Experimental, 22, 41-47.
12. Bray, S., Rangel, A., Shimojo, S., Balleine, B., & O'Doherty, J. P. (2008). The neural mechanisms underlying the inluence of Pavlovian cues on human decision making. Journal ofNeuroscience, 28, 5861-5866.
13. Bühler, M., Vollstädt-Klein, S., Kobiella, A., Budde, H., Reed, L. J., Braus, D. F., et al. (2010). Nicotine dependence is characterized by disordered reward processing in a network driving motivation. Biological Psychiatry, 67, 745-752.
14. Campbell, J. M., & Oei, T. P. (2010). A cognitive model for the intergenerational transference of alcohol use behavior. Addictive Behaviors, 35, 73-83.
15. Cappelleri, J. C., Bushmakin, A. G., Baker, C. L., Merikle, E., Olufade, A. O., & Gilbert, D. G. (2007). Multivariate framework of the brief questionnaire of smoking urges. Drug and Alcohol Dependence, 90, 234-242.
16. Carter, B. L., & Tiffany, S. T. (1999). Meta-analysis of cue-reactivity in addiction research. Addiction, 94, 327-340.
17. Carter, B. L., & Tiffany, S. T. (2001). The cue-availability paradigm: The effects of cigarette availability on cue reactivity in smokers. Experimental and Clinical Psychopharmacology, 9, 183-190.
18. Colwill, R. M., & Motzkin, D. K. (1994). Encoding of the unconditioned stimulus in Pavlovian conditioning. Animal Learning & Behavior, 22, 384-394.
19. Colwill, R. M., & Rescorla, R. A. (1988). Associations between the discriminative stimulus and the reinforcer in instrumental learning. Journal of Experimental Psychology: Animal Behavior Processes, 14, 155-164.
20. Colwill, R. M., & Rescorla, R. A. (1990a). Effects of reinforcer devaluation on discriminative control of instrumental behavior. Journal of Experimental Psychology: Animal Behavior Processes, 16, 40-47.
21. Colwill, R. M., & Rescorla, R. A. (1990b). Evidence for the hierarchical structure of instrumental learning. Animal Learning & Behavior, 18, 71-82.
22. Consortium TTaG (2010). Genome-wide meta-analyses identify multiple loci associated with smoking behavior. Nature Genetics, 42, 441-447.
23. Corbit, L. H., Janak, P. H., & Balleine, B. W. (2007). General and outcome-speciic forms of Pavlovian-instrumental transfer: The effect of shifts in motivational state and inactivation of the ventral tegmental area. European Journal of Neuroscience, 26, 3141-3149.
24. Cox, L. S., Tiffany, S. T., & Christen, A. G. (2001). Evaluation of the brief questionnaire of smoking urges (QSU-brief) in the laboratory and clinical settings. Nicotine and Tobacco Research, 3, 7-16.
25. Dayan, P., & Daw, N. D. (2008). Decision theory, reinforcement learning, and the brain. Cognitive Affective & Behavioral Neuroscience, 8, 429-453.
26. de Wit, H., Uhlenhuth, E. H., & Johanson, C. E. (1986). Individual differences in the reinforcing and subjective effects of amphetamine and diazepam. Drug and Alcohol Dependence, 16, 341-360.
27. de Wit, S., Corlett, P. R., Aitken, M. R., Dickinson, A., & Fletcher, P. C. (2009). Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. Journal of Neuroscience, 29, 11330-11338.
28. de Wit, S., & Dickinson, A. (2009). Associative theories of goal-directed behaviour: A case for animal-human translational models. Psychological Research, 73, 463-476.
29. de Wit, S., Niry, D., Wariyar, R., Aitken, M. R. F., & Dickinson, A. (2007). Stimulus-outcome interactions during instrumental discrimination learning by rats and humans. Journal of Experimental Psychology: Animal Behavior Processes, 33, 1-11.
30. Deroche-Gamonet, V., Belin, D., & Piazza, P. V. (2004). Evidence for addiction-like behavior in the rat. Science, 305, 1014-1017.
31. Di Chiara, G., Tanda, G., Bassareo, V., Pontieri, F., Acquas, E., Fenu, S., et al. (1998). Drug addiction as a disorder of associative learning: Role of nucleus accumbens shell/extended amygdala dopamine. In J. F. McGinty (Ed.), Annals of the New York Academy of Sciences: Vol. 877. Advancing from the ventral striatum to the extended amygdala: Implications for neuropsychiatry and drug abuse (pp. 461-485). New York, NY: New York Academy of Sciences.
32. Dickinson, A. (1989). Expectancy theory in animal conditioning. In S. B. Klein & R. R. Mowrer (Eds.), Pavlovian conditioning and the status of traditional learning theory (pp. 279-308). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
33. Dickinson, A., & Balleine, B. W. (2002). The role of learning in the operation of motivational systems. In C. R. Gallistel (Ed.), Stevens' handbook of experimental psychology: Vol. 3. Learning, motivation and emotion (3rd ed., pp. 497-533). New York, NY: Wiley.
34. Dickinson, A., & Dawson, G. R. (1987). Pavlovian processes in the motivational control of instrumental performance. Quarterly Journal of Experimental Psychology Section B: Comparative and Physiological Psychology, 39, 201-213.
35. Dickinson, A., Wood, N., & Smith, J. W. (2002). Alcohol seeking by rats: Action or habit? Quarterly Journal of Experimental Psychology Section B: Comparative and Physiological Psychology, 55, 331-348.
36. Diergaarde, L., Pattij, T., Poortvliet, I., Hogenboom, F., de Vries, W., Schoffelmeer, A. N. M., et al. (2008). Impulsive choice and impulsive action predict vulnerability to distinct stages of nicotine seeking in rats. Biological Psychiatry, 63, 301-308.
37. Donny, E. C., & Dierker, L. C. (2007). The absence of DSM-IV nicotine dependence in moderate-to-heavy daily smokers. Drug and Alcohol Dependence, 89, 93-96.
38. Doran, N., Spring, B., McChargue, D., Pergadia, M., & Richmond, M. (2004). Impulsivity and smoking relapse. Nicotine & Tobacco Research, 6, 641-647.
39. Drevets, W. C., Gautier, C., Price, J. C., Kupfer, D. J., Kinahan, P. E., Grace, A. A., et al. (2001). Amphetamine-induced dopamine release in human ventral striatum correlates with euphoria. Biological Psychiatry, 49, 81-96.
40. Drobes, D. J., & Tiffany, S. T. (1997). Induction of smoking urge through imaginal and in vivo procedures: Physiological and self-report manifestations. Journal of Abnormal Psychology, 106, 15-25.
41. Droungas, A., Ehrman, R., Childress, A., & O'Brien, C. (1995). Effects of smoking cues and cigarette availability on craving and smoking behavior. Addictive Behaviors, 20, 657-673.
42. Drummond, D. C. (2000). What does cue-reactivity have to offer clinical research? Addiction, 95, S129-S144.
43. Economidou, D., Pelloux, Y., Robbins, T. W., Dalley, J. W., & Everitt, B. J. (2009). High impulsivity predicts relapse to cocaine-seeking after punishment-induced abstinence. Biological Psychiatry, 65, 851-856.
44. Etter, J. F., Le Houezec, J., & Perneger, T. V. (2003). A self-administered questionnaire to measure dependence on cigarettes: The Cigarette Dependence Scale. Neuropsychopharmacology, 28, 359-370.
45. Everitt, B. J., Belin, D., Economidou, D., Pelloux, Y., Dalley, J. W., & Robbins, T. W. (2008). Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction. Philosophical Transactions of the Royal Society B, 363, 3125-3135.
46. Fagerstrom, K., & Schneider, N. G. (1989). Measuring nicotine dependence: A review of the Fagerstrom Tolerance Questionnaire. Journal of Behavioral Medicine, 12, 159-182.
47. Ferguson, S. G., & Shiffman, S. (2009). Cue-induced cravings for cigarettes. Current Cardiovascular Risk Reports, 3(6), 385-390.
48. Fergusson, D. M., Horwood, L. J., Lynskey, M. T., & Madden, P. A. F. (2003). Early reactions to cannabis predict later dependence. Archives of General Psychiatry, 60, 1033-1039.
49. Flory, J. D., & Manuck, S. B. (2009). Impulsiveness and cigarette smoking. Psychosomatic Medicine, 71, 431-437.
50. Franques, P., Auriacombe, M., & Tignol, J. (2000). Addiction and personality. Encephale-Revue de Psychiatrie Clinique Biologique et Therapeutique, 26, 68-78.
51. Gámez, M., & Rosas, J. M. (2007). Associations in human instrumental conditioning. Learning and Motivation, 38, 242-261.
52. Gill, J. S. (2002). Reported levels of alcohol consumption and binge drinking within the UK undergraduate student population over the last 25 years. Alcohol and Alcoholism, 37, 109-120.
53. Glasner, S. V., Overmier, J. B., & Balleine, B. W. (2005). The role of Pavlovian cues in alcohol seeking in dependent and nondependent rats. Journal of Studies on Alcohol, 66, 53-61.
54. Goldstein, R. Z., Craig, A. D., Bechara, A., Garavan, H., Childress, A. R., Paulus, M. P., et al. (2009). The neurocircuitry of impaired insight in drug addiction. Trends in Cognitive Sciences, 13, 372-380.
55. Grant, B. F., Dawson, D. A., Stinson, F. S., Chou, S. P., Dufour, M. C., & Pickering, R. P. (2004). The 12-month prevalence and trends in DSM-IV alcohol abuse and dependence: United States, 1991-1992 and 2001-2002. Drug and Alcohol Dependence, 74, 223-234.
56. Grant, B. F., Dawson, D. A., Stinson, F. S., Chou, P. S., Kay, W., & Pickering, R. (2003). The Alcohol Use Disorder and Associated Disabilities Interview Schedule-IV (AUDADIS-IV): Reliability of alcohol consumption, tobacco use, family history of depression and psychiatric diagnostic modules in a general population sample. Drug and Alcohol Dependence, 71, 7-16.
57. Greenwald, M. K. (2008). Behavioral economic analysis of drug preference using multiple choice procedure data. Drug and Alcohol Dependence, 93, 103-110.
58. Hawkins, J. D., Catalano, R. F., & Miller, J. Y. (1992). Risk and protective factors for alcohol and other drug problems in adolescence and early adulthood: Implications for substance-abuse prevention. Psychological Bulletin, 112, 64-105.
59. Herd, N., Borland, R., & Hyland, A. (2009). Predictors of smoking relapse by duration of abstinence: Findings from the International Tobacco Control (ITC) Four Country Survey. Addiction, 104, 2088-2099.
60. Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4, 267-272.
61. Heyman, G. M. (1996). Resolving the contradictions of addiction. Behavioral and Brain Sciences, 19, 561-574.
62. Heyman, G. M. (2000). An economic approach to animal models of alcoholism. Alcohol Research & Health, 24, 132-139.
63. Heyman, G. M. (2009). Addiction: A disorder ofchoice. Cambridge, MA: Harvard University Press.
64. Hides, L., Kavanagh, D. J., Dawe, S., & Young, R. M. (2009). The influence of cannabis use expectancies on cannabis use and psychotic symptoms in psychosis. Drug and Alcohol Review, 28, 250-256.
65. Hiroi, N., & Scott, D. (2009). Constitutional mechanisms of vulnerability and resilience to nicotine dependence. Molecular Psychiatry, 14, 653-667.
66. Hogarth, L. (2011). The role of impulsivity in the aetiology of drug dependence: Reward sensitivity versus automaticity. Psychopharmacology, 215, 567-580.
67. Hogarth, L., & Chase, H. W. (2011). Parallel goal-directed and habitual control of human drug-seeking: Implications for dependence vulnerability. Journal of Experimental Psychology: Animal Behavior Processes, 37, 261-276.
68. Hogarth, L., Chase, H. W., & Baess, K. (in press). Impaired goal-directed control in human impulsivity. Quarterly Journal ofExperimental Psychology.
69. Hogarth, L., Dickinson, A., & Duka, T. (2009). Detection versus sustained attention to drug cues have dissociable roles in mediating drug seeking behaviour. Experimental and Clinical Psychopharmacology, 17, 21-30.
70. Hogarth, L., Dickinson, A., & Duka, T. (2010). The associative basis of cue elicited drug taking in humans. Psychopharmacology, 208, 337-351.
71. Hogarth, L., Dickinson, A., Hutton, S. B., Elbers, N., & Duka, T. (2006). Drug expectancy is necessary for stimulus control of human attention, instrumental drug-seeking behaviour and subjective pleasure. Psychopharmacology, 185, 495-504.
72. Hogarth, L., Dickinson, A., Janowski, M., Nikitina, A., & Duka, T. (2008). The role of attentional bias in mediating human drug seeking behaviour. Psycho-pharmacology, 201, 29-41.
73. Hogarth, L., Dickinson, A., Wright, A., Kouvaraki, M., & Duka, T. (2007). The role of drug expectancy in the control of human drug seeking. Journal of Experimental Psychology: Animal Behavior Processes, 33, 484-496.
74. Hogarth, L., & Duka, T. (2006). Human nicotine conditioning requires explicit contingency knowledge: Is addictive behaviour cognitively mediated? Psycho-pharmacology, 184, 553-566.
75. Holland, P. C. (2004). Relations between Pavlovian-instrumental transfer and reinforcer devaluation. Journal of Experimental Psychology: Animal Behavior Processes, 30, 258-258.
76. Hughes, J. R., Helzer, J. E., & Lindberg, S. A. (2006). Prevalence of DSM/ICD-defined nicotine dependence. Drug and Alcohol Dependence, 85, 91-102.
77. Hull, C. L. (1943). Principles ofbehavior. New York, NY: Appleton-Century-Crofts.
78. Hursh, S. R., & Silberberg, A. (2008). Economic demand and essential value. Psychological Review, 115, 186-198.
79. Hutcheson, D. M., Everitt, B. J., Robbins, T. W., & Dickinson, A. (2001). The role of withdrawal in heroin addiction: Enhances reward or promotes avoidance? Nature Neuroscience, 4, 943-947.
80. Hyland, A., Rezaishiraz, H., Bauer, J., Giovino, G. A., & Cummings, K. M. (2005). Characteristics of low-level smokers. Nicotine & Tobacco Research, 7, 461-468.
81. Jacobs, E. A., & Bickel, W. K. (1999). Modeling drug consumption in the clinic using simulation procedures: Demand for heroin and cigarettes in opioid-dependent outpatients. Experimental and Clinical Psychopharmacology, 7, 412-426.
82. Jarvik, M. E., Madsen, D. C., Olmstead, R. E., Iwamoto-Schaap, P. N., Elins, J. L., & Benowitz, N. L. (2000). Nicotine blood levels and subjective craving for cigarettes. Pharmacology Biochemistry & Behavior, 66, 553-558.
83. Jedynak, J. P., Uslaner, J. M., Esteban, J. A., & Robinson, T. E. (2007). Methamphetamine-induced structural plasticity in the dorsal striatum. European Journal ofNeuroscience, 25, 847-853.
84. Jentsch, J. D., & Taylor, J. R. (1999). Impulsivity resulting from frontostriatal dysfunction in drug abuse: Implications for the control of behavior by reward-related stimuli. Psychopharmacology, 146, 373-390.
85. Jones, B. T., Corbin, W., & Fromme, K. (2001). A review of expectancy theory and alcohol consumption. Addiction, 96, 57-72.
86. Juliano, L. M., & Brandon, T. H. (1998). Reactivity to instructed smoking availability and environmental cues: Evidence with urge and reaction time. Experimental and Clinical Psychopharmacology, 6, 45-53.
87. Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47, 263-291.
88. Kenward, B., Folke, S., Holmberg, J., Johansson, A., & Gredeback, G. (2009). Goal directedness and decision making in infants. Developmental Psychology, 45, 809-819.
89. Killen, J. D., & Fortmann, S. P. (1997). Craving is associated with smoking relapse: Findings from three prospective studies. Experimental and Clinical Psychophar-macology, 5, 137-142.
90. Kirisci, L., Vanyukov, M., & Tarter, R. (2005). Detection of youth at high risk for substance use disorders: A longitudinal study. Psychology of Addictive Behaviors, 19, 243-252.
91. Kirkeby, B. S., & Robinson, M. D. (2005). Impulsive behavior and stimulus-response variability in choice reaction time. Journal of Research in Personality, 39, 263-277.
92. Klossek, U. M. H., Russell, J., & Dickinson, A. (2008). The control of instrumental action following outcome devaluation in young children aged between 1 and 4 years. Journal ofExperimental Psychology: General, 137, 39-51.
93. Le Foll, B., Chefer, S. I., Kimes, A. S., Shumway, D., Stein, E. A., Mukhin, A. G., et al. (2009). Baseline expression of alpha 4 beta 2 nicotinic acetylcholine receptors predicts motivation to self-administer nicotine. Biological Psychiatry, 65, 714-716.
94. Leventhal, A. M., & Schmitz, J. M. (2006). The role of drug use outcome expectancies in substance abuse risk: An interactional-transformational model. Addictive Behaviors, 31, 2038-2062.
95. Lovibond, P. F., & Shanks, D. R. (2002). The role of awareness in Pavlovian conditioning: Empirical evidence and theoretical implications. Journal of Experimental Psychology: Animal Behavior Processes, 28, 3-26.
96. Ludwig, A. M., Wikler, A., & Stark, L. H. (1974). First drink: Psychobiological aspects of craving. Archives ofGeneral Psychiatry, 30, 539-547.
97. MacKillop, J., Miranda, Jr, R., Monti, P. M., Ray, L. A., Murphy, J. G., Rohsenow, D. J., et al. (2010). Alcohol demand, delayed reward discounting, and craving in relation to drinking and alcohol use disorders. Journal of Abnormal Psychology, 119, 106-114.
98. MacKillop, J., & Murphy, J. G. (2007). A behavioral economic measure of demand for alcohol predicts brief intervention outcomes. Drug and Alcohol Dependence, 89, 227-233.
99. MacKillop, J., Murphy, J. G., Ray, L. A., Eisenberg, D. T. A., Lisman, S. A., Lum, J. K., et al. (2008). Further validation of a cigarette purchase task for assessing the relative reinforcing eficacy of nicotine in college smokers. Experimental and Clinical Psychopharmacology, 16, 57-65.
100. Maude-Griffin, P. M., & Tiffany, S. T. (1996). Production of smoking urges through imagery: The impact of affect and smoking abstinence. Experimental and Clinical Psychopharmacology, 4, 198-208.
101. Miles, F. J., Everitt, B. J., & Dickinson, A. (2003). Oral cocaine seeking by rats: Action or habit? Behavioral Neuroscience, 117, 927-938.
102. Miller, H. L. (1976). Matching-based hedonic scaling in the pigeon. Journal of the Experimental Analysis of Behavior, 26, 335-347.
103. Miller, W. R., Westerberg, V. S., Harris, R. J., & Tonigan, J. S. (1996). What predicts relapse? Prospective testing of antecedent models. Addiction, 91, S155-S172.
104. Mitchell, C. J., De Houwer, J., & Lovibond, P. F. (2009). The propositional nature of human associative learning. Behavioral and Brain Sciences, 32, 183-198.
105. Moeller, F. G., Dougherty, D. M., Barratt, E. S., Schmitz, J. M., Swann, A. C., & Grabowski, J. (2001). The impact of impulsivity on cocaine use and retention in treatment. Journal ofSubstance Abuse Treatment, 21, 193-198.
106. Moeller, S. J., Maloney, T., Parvaz, M. A., Dunning, J. P., Alia-Klein, N., Woicik, P. A., et al. (2009). Enhanced choice for viewing cocaine pictures in cocaine addiction. Biological Psychiatry, 66, 169-176.
107. Morawska, A., & Oei, T. P. S. (2005). Binge drinking in university students: A test of the cognitive model. Addictive Behaviors, 30, 203-218.
108. Mucha, R. F., Pauli, P., & Angrilli, A. (1998). Conditioned responses elicited by experimentally produced cues for smoking. Canadian Journal of Physiology and Pharmacology, 76, 259-268.
109. Murphy, J. G., Barnett, N. P., Colby, S. M., Correia, C. J., Mackillop, J., & Vuchinich, R. E. (2006). Relative reinforcing value of alcohol predicts response to a brief intervention. Alcoholism: Clinical and Experimental Research, 30, 250A-250A.
110. Murphy, J. G., Correia, C. J., Colby, S. M., & Vuchinich, R. E. (2005). Using behavioral theories of choice to predict drinking outcomes following a brief intervention. Experimental and Clinical Psychopharmacology, 13, 93-101.
111. Murphy, J. G., & MacKillop, J. (2006). Relative reinforcing eficacy of alcohol among college student drinkers. Experimental and Clinical Psychopharmacology, 14, 219-227.
112. Naqvi, N. H., & Bechara, A. (2009). The hidden island of addiction: The insula. Trends in Neurosciences, 32, 56-67.
113. Nelson, A., & Killcross, S. (2006). Amphetamine exposure enhances habit formation. Journal ofNeuroscience, 26, 3805-3812.
114. Nemeth-Coslett, R., & Griffiths, R. R. (1984a). Determinants of puff duration in cigarette smokers: I. Pharmacology Biochemistry and Behavior, 20, 965-971.
115. Nemeth-Coslett, R., & Griffiths, R. R. (1984b). Determinants of puff duration in cigarette smokers: II. Pharmacology Biochemistry and Behavior, 21, 903-912.
116. Nordquist, R. E., Voorn, P., Malsen, J., Joosten, R., Pennartz, C. M. A., & Vanderschuren, L. (2007). Augmented reinforcer value and accelerated habit formation after repeated amphetamine treatment. European Neuropsychopharma-cology, 17, 532-540.
117. Olmstead, M. C., Lafond, M. V., Everitt, B. J., & Dickinson, A. (2001). Cocaine seeking by rats is a goal-directed action. Behavioral Neuroscience, 115, 394-402.
118. Ostlund, S. B., & Balleine, B. W. (2008). The disunity of Pavlovian and instrumental values. Behavioral and Brain Sciences, 31, 456.
119. Padoa-Schioppa, C. (2007). Orbitofrontal cortex and the computation of economic value. In G. Schoenbaum, J. A. Gottfried, E. A. Murray, & S. J. Ramus (Eds.), Annals of the New York Academy of Sciences: Vol. 1121. Linking affect to action: Critical contributions of the orbitofrontal cortex (pp. 232-253). Oxford, UK: Blackwell.
120. Palfai, T. P. (2002). Positive outcome expectancies and smoking behaviour: The role of expectancy accessibility. Cognitive Therapy and Research, 26, 317-333.
121. Paredes-Olay, C., Abad, M. J. F., Gámez, M., & Rosas, J. M. (2002). Transfer of control between causal predictive judgments and instrumental responding. Animal Learning & Behavior, 30, 239-248.
122. Patton, J. H., Stanford, M. S., & Barratt, E. S. (1995). Factor structure of the Barratt Impulsiveness Scale. Journal of Clinical Psychology, 51, 768-774.
123. Pelloux, Y., Everitt, B. J., & Dickinson, A. (2007). Compulsive drug seeking by rats under punishment: Effects of drug taking history. Psychopharmacology, 194, 127-137.
124. Perkins, K. A. (2009). Does smoking cue-induced craving tell us anything important about nicotine dependence? Addiction, 104, 1610-1616.
125. Perkins, K. A., Broge, M., Gerlach, D., Sanders, M., Grobe, J. E., Cherry, C., et al. (2002). Acute nicotine reinforcement, but not chronic tolerance, predicts withdrawal and relapse after quitting smoking. Health Psychology, 21, 332-339.
126. Perkins, K. A., Epstein, L. H., Grobe, J., & Fonte, C. (1994). Tobacco abstinence, smoking cues, and the reinforcing value of smoking. Pharmacology Biochemistry and Behavior, 47, 107-112.
127. Rangel, A., Camerer, C., & Montague, P. R. (2008). A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience, 9, 545-556.
128. Rescorla, R. A. (1991). Associative relations in instrumental learning: The 18 Bartlett memorial lecture. Quarterly Journal of Experimental Psychology Section B: Comparative and Physiological Psychology, 43, 1-23.
129. Rescorla, R. A. (1994). Transfer of instrumental control mediated by a devalued outcome. Animal Learning & Behavior, 22, 27-33.
130. Robbins, S. J., & Ehrman, R. N. (1992). Designing studies of drug conditioning in humans. Psychopharmacology, 106, 143-153.
131. Rohsenow, D. J., Childress, A. R., Monti, P. M., Niaura, R. S., & Abrams, D. B. (1991). Cue reactivity in addictive behaviors: Theoretical and treatment implications. International Journal ofthe Addictions, 25, 957-993.
132. Rose, J. E. (2006). Nicotine and nonnicotine factors in cigarette addiction. Psychopharmacology, 184, 274-285.
133. Scherrer, J. F., Grant, J. D., Duncan, A. E., Sartor, C. E., Haber, J. R., Jacob, T., et al. (2009). Subjective effects to cannabis are associated with use, abuse and dependence after adjusting for genetic and environmental influences. Drug and Alcohol Dependence, 105, 76-82.
134. Schoenbaum, G., & Setlow, B. (2005). Cocaine makes actions insensitive to outcomes but not extinction: Implications for altered orbitofrontal-amygdalar function. Cerebral Cortex, 15, 1162-1169.
135. Schwabe, L., & Wolf, O. T. (2009). Stress prompts habit behavior in humans. The Journal ofNeuroscience, 29, 7191-7198.
136. Schwabe, L., & Wolf, O. T. (2010). Socially evaluated cold pressor stress after instrumental learning favors habits over goal-directed action. Psychoneuroendocrinology, 35, 977-986.
137. Shiffman, S. (2009). Responses to smoking cues are relevant to smoking and relapse. Addiction, 104, 1617-1618.
138. Skinner, M. D., & Aubin, H.-J. (2010). Craving's place in addiction theory: Contributions of the major models. Neuroscience & Biobehavioral Reviews, 34, 606-623.
139. Stalnaker, T. A., Takahashi, Y., Roesch, M. R., & Schoenbaum, G. (2009). Neural substrates of cognitive inlexibility after chronic cocaine exposure. Neuropharma-cology, 56, 63-72.
140. Stanford, M. S., Mathias, C. W., Dougherty, D. M., Lake, S. L., Anderson, N. E., & Patton, J. H. (2009). Fifty years of the Barratt Impulsiveness Scale: An update and review. Personality and Individual Differences, 47, 385-395.
141. Stoops, W. W., Lile, J. A., Robbins, C. G., Martin, C. A., Rush, C. R., & Kelly, T. H. (2007). The reinforcing, subject-rated, performance, and cardiovascular effects of d-amphetamine: Inluence of sensation-seeking status. Addictive Behaviors, 32, 1177-1188.
142. Talmi, D., Dayan, P., Kiebel, S. J., Frith, C. D., & Dolan, R. J. (2009). How humans integrate the prospects of pain and reward during choice. The Journal of Neuroscience, 29, 14617-14626.
143. Talmi, D., Seymour, B., Dayan, P., & Dolan, R. J. (2008). Human Pavlovian-instrumental transfer. The Journal ofNeuroscience, 28, 360-368.
144. Tiffany, S. T., Cox, L. S., & Elash, C. A. (2000). Effects of transdermal nicotine patches on abstinence-induced and cue-elicited craving in cigarette smokers. Journal of Consulting and Clinical Psychology, 68, 233-240.
145. Tiffany, S. T., & Drobes, D. J. (1991). The development and initial validation of a questionnaire on smoking urges. British Journal of Addiction, 86, 1467-1476.
146. Tiffany, S. T., Warthen, M. W., & Goedeker, K. C. (2007). The functional signiicance of craving in nicotine dependence. In A. R. Caggiuls & R. A. Bevins (Eds.), The motivational impact ofnicotine and its role in tobacco use (Nebraska Symposium on Motivation) (pp. 1-27). New York, NY: Springer.
147. Tiffany, S. T., & Wray, J. (2009). The continuing conundrum of craving. Addiction, 104, 1618-1619.
148. Tricomi, E., Balleine, B. W., & O'Doherty, J. P. (2009). A speciic role for posterior dorsolateral striatum in human habit learning. European Journal of Neuroscience, 29, 2225-2232.
149. Urban, R. (2010). Smoking outcome expectancies mediate the association between sensation seeking, peer smoking, and smoking among young adolescents. Nicotine & Tobacco Research, 12, 59-68.
150. Ursu, S., Clark, K. A., Stenger, V. A., & Carter, C. S. (2008). Distinguishing expected negative outcomes from preparatory control in the human orbitofrontal cortex. Brain Research, 1227, 110-119.
151. Valentin, V., Dickinson, A., & O'Doherty, J. P. (2007). Determining the neural substrates of goal-directed learning in the human brain. The Journal of Neuroscience, 27, 4019-4026.
152. Vanderschuren, L. J. M. J., & Everitt, B. J. (2004). Drug seeking becomes compulsive after prolonged cocaine self-administration. Science, 305, 1017-1019.
153. Vlaev, I., Seymour, B., Dolan, R. J., & Chater, N. (2009). The price of pain and the value of suffering. Psychological Science, 20, 309-317.
154. Volkow, N. D., Fowler, J. S., Wang, G. J., Baler, R., & Telang, F. (2009). Imaging dopamine's role in drug abuse and addiction. Neuropharmacology, 56, 3-8.
155. Volkow, N. D., Fowler, J. S., Wang, G. J., Telang, F., Logan, J., Jayne, M., et al. (2010). Cognitive control of drug craving inhibits brain reward regions in cocaine abusers. Neurolmage, 49, 2536-2543.
156. Wagner, F. A., & Anthony, J. C. (2002). From irst drug use to drug dependence: Developmental periods of risk for dependence upon marijuana, cocaine, and alcohol. Neuropsychopharmacology, 26, 479-488.
157. Waters, A. J., Shiffman, S., Sayette, M. A., Paty, J. A., Gwaltney, C. J., & Balabanis, M. H. (2004). Cue-provoked craving and nicotine replacement therapy in smoking cessation. Journal of Consulting and Clinical Psychology, 72, 1136-1143.
158. Willner, P., Hardman, S., & Eaton, G. (1995). Subjective and behavioral-evaluation of cigarette cravings. Psychopharmacology, 118, 171-177.
159. Wise, R. A., & Rompre, P. P. (1989). Brain dopamine and reward. Annual Review of Psychology, 40, 191-225.
160. Yacubian, J., & Buchel, C. (2009). The genetic basis of individual differences in reward processing and the link to addictive behavior and social cognition. Neuroscience, 164, 55-71.