Habit formation: Implications for alcoholism research

Alcohol

Volumn 48, Issue 4, 2014, Pages 327-335

  O'Tousa, David ^a   Grahame, Nicholas ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

Alcohol; Animal model; Goal directed behavior; Habit learning; Reinforcer devaluation; Self administration

Indexed keywords

DOPAMINE; ALCOHOL;

ALCOHOL USE DISORDER; ALCOHOLISM; COMPULSION; CORPUS STRIATUM; DISEASE SEVERITY; DOPAMINE RELEASE; DOPAMINERGIC SYSTEM; DRINKING BEHAVIOR; HUMAN; INSTRUMENTAL CONDITIONING; MOTIVATION; PREFRONTAL CORTEX; REINFORCEMENT; REVIEW; SENSITIVITY ANALYSIS; STIMULUS RESPONSE; SUBSTANCE USE; WITHDRAWAL SYNDROME; ADDICTION; ANIMAL; ANIMAL MODEL; FEMALE; HABIT; MALE; METHODOLOGY; PATHOPHYSIOLOGY; PHYSIOLOGY; SECRETION (PROCESS); SEX DIFFERENCE;

ALCOHOL-RELATED DISORDERS; ALCOHOLISM; ANIMALS; BEHAVIOR, ADDICTIVE; CONDITIONING, OPERANT; CORPUS STRIATUM; DOPAMINE; ETHANOL; FEMALE; HABITS; HUMANS; MALE; MODELS, ANIMAL; RESEARCH DESIGN; SEX FACTORS;

EID: 84900464396     PISSN: 07418329     EISSN: 18736823     Source Type: Journal    
DOI: 10.1016/j.alcohol.2014.02.004     Document Type: Review

References (91)

1. Adams C.D. Post conditioning devaluation of an instrumental reinforcer has no effect on extinction performance. Quarterly Journal of Experimental Psychology 1980, 32:447-458.
2. Adams C.D. Variations in the sensitivity of instrumental responding to reinforcer devaluation. Quarterly Journal of Experimental Psychology. Section B: Comparative and Physiological Psychology 1982, 34:77-98.
3. Alexander G.E., Crutcher M.D. Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends in Neurosciences 1990, 13:266-271.
4. Diagnostic and Statistical Manual of Mental Disorders 2013, American Psychiatric Association, American Psychiatric Association, Washington, DC. 5th ed.
5. Aosaki T., Tsubokawa H., Ishida A., Watanabe K., Graybiel A.M., Kimura M. Responses of tonically active neurons in the primate's striatum undergo systematic changes during behavioral sensorimotor conditioning. The Journal of Neuroscience 1994, 14:3969-3984.
6. Baker T.B., Cannon D.S. Taste aversion with alcoholics: techniques and evidence of a conditioned response. Behaviour Research and Therapy 1979, 17:229-242.
7. Balleine B.W., Dickinson A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 1998, 37:407-419.
8. Balleine B.W., O'Doherty J.P. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology 2010, 35:48-69.
9. Barker J.M., Torregrossa M.M., Arnold A.P., Taylor J.R. Dissociation of genetic and hormonal influences on sex differences in alcoholism-related behaviors. The Journal of Neuroscience 2010, 30:9140-9144.
10. Belin D., Everitt B.J. Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron 2008, 57:432-441.
11. Belin D., Jonkman S., Dickinson A., Robbins T.W., Everitt B.J. Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction. Behavioural Brain Research 2009, 199:89-102.
12. Boland F.J., Mellor C.S., Revusky S. Chemical aversion treatment of alcoholism: lithium as the aversive agent. Behaviour Research and Therapy 1978, 16:401-409.
13. Bouton M.E., Winterbauer N.E., Todd T.P. Relapse processes after the extinction of instrumental learning: renewal, resurgence, and reacquisition. Behavioural Processes 2012, 90:130-141.
14. Brog J.S., Salyapongse A., Deutch A.Y., Zahm D.S. The patterns of afferent innervation of the core and shell in the "accumbens" part of the rat ventral striatum: immunohistochemical detection of retrogradely transported fluoro-gold. The Journal of Comparative Neurology 1993, 338:255-278.
15. Cannon D.S., Baker T.B., Wehl C.K. Emetic and electric shock alcohol aversion therapy: six- and twelve-month follow-up. Journal of Consulting and Clinical Psychology 1981, 49:360-368.
16. Chen J.S., Amsel A. Recall (versus recognition) of taste and immunization against aversive taste anticipations based on illness. Science 1980, 209:831-833.
17. Cooney N.L., Litt M.D., Morse P.A., Bauer L.O., Gaupp L. Alcohol cue reactivity, negative-mood reactivity, and relapse in treated alcoholic men. Journal of Abnormal Psychology 1997, 106:243-250.
18. Corbit L.H., Nie H., Janak P.H. Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum. Biological Psychiatry 2012, 72:389-395.
19. Coskunpinar A., Dir A.L., Cyder M.A. Multidimensionality in impulsivity and alcohol use: a meta-analysis using the UPPS model of impulsivity. Alcoholism: Clinical and Experimental Research 2013, 37:1441-1450.
20. Coutureau E., Killcross S. Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats. Behavioural Brain Research 2003, 146:167-174.
21. Crombag H.S., Galarce E.M., Holland P.C. Pavlovian influences on goal-directed behavior in mice: the role of cue-reinforcer relations. Learning & Memory 2008, 15:299-303.
22. Cuzon Carlson V.C., Seabold G.K., Helms C.M., Garg N., Odagiri M., Rau A.R., et al. Synaptic and morphological neuroadaptations in the putamen associated with long-term, relapsing alcohol drinking in primates. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology 2011, 36:2513-2528.
23. DePoy L., Daut R., Brigman J.L., MacPherson K., Crowley N., Gunduz-Cinar O., et al. Chronic alcohol produces neuroadaptations to prime dorsal striatal learning. Proceedings of the National Academy of Sciences of the United States of America 2013, 110:14783-14788.
24. Dickinson A. Actions and habits: the development of behavioural autonomy. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 1985, 308:67-78.
25. Dickinson A., Nicholas D.J., Adams C.D. The effect of the instrumental training contingency on susceptibility to reinforcer devaluation. The Quarterly Journal of Experimental Psychology. Section B: Comparative and Physiological Psychology 1983, 35:35-51.
26. Dickinson A., Squire S., Varga Z., Smith J.W. Omission learning after instrumental pretraining. The Quarterly Journal of Experimental Psychology. Section B: Comparative and Physiological Psychology 1998, 51:271-286.
27. Dickinson A., Wood N., Smith J.W. Alcohol seeking by rats: action or habit?. The Quarterly Journal of Experimental Psychology. Section B: Comparative and Physiological Psychology 2002, 55:331-348.
28. Elkins R.L. An appraisal of chemical aversion (emetic therapy) approaches to alcoholism treatment. Behaviour Research and Therapy 1991, 29:387-413.
29. Elmer G.I., George F.R. Operant rate depressant effects of ethanol in mice selectively bred for differential neurosensitivity to ethanol. Journal of Addictive Diseases 1994, 13:9-19.
30. Everitt B.J., Robbins T.W. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nature Neuroscience 2005, 8:1481-1489.
31. Faure A., Haberland U., Condé F., El Massioui N. Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. The Journal of Neuroscience 2005, 25:2771-2780.
32. Ferré S., Goldberg S.R., Lluis C., Franco R. Looking for the role of cannabinoid receptor heteromers in striatal function. Neuropharmacology 2009, 56(Suppl. 1):226-234.
33. George F.R., Ritz M.C., Meisch R.A. Rate-depressant effects of ethanol on fixed-ratio responding in ALKO AA and ANA rats. Advances in Alcohol & Substance Abuse 1990, 9:31-42.
34. Giros B., Jaber M., Jones S.R., Wightman R.M., Caron M.G. Hyperlocomotion and indifference to cocaine and amphetamine in mice lacking the dopamine transporter. Nature 1996, 379:606-612.
35. Grahame N.J., Li T.K., Lumeng L. Selective breeding for high and low alcohol preference in mice. Behavior Genetics 1999, 29:47-57.
36. Graybeal C., Feyder M., Schulman E., Saksida L.M., Bussey T.J., Brigman J.L., et al. Paradoxical reversal learning enhancement by stress or prefrontal cortical damage: rescue with BDNF. Nature Neuroscience 2011, 14:1507-1509.
37. Green A.S., Grahame N.J. Ethanol drinking in rodents: is free-choice drinking related to the reinforcing effects of ethanol?. Alcohol (Fayetteville, N.Y.) 2008, 42:1-11.
38. Gremel C.M., Costa R.M. Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions. Nature Communications 2013, 4:2264.
39. Gremel C.M., Costa R.M. Premotor cortex is critical for goal-directed actions. Frontiers in Computational Neuroscience 2013, 7:110.
40. Grüsser S.M., Wrase J., Klein S., Hermann D., Smolka M.N., Ruf M., et al. Cue-induced activation of the striatum and medial prefrontal cortex is associated with subsequent relapse in abstinent alcoholics. Psychopharmacology 2004, 175:296-302.
41. Hay R.A., Jennings J.H., Zitzman D.L., Hodge C.W., Robinson D.L. Specific and nonspecific effects of naltrexone on goal-directed and habitual models of alcohol seeking and drinking. Alcoholism: Clinical and Experimental Research 2013, 37:1100-1110.
42. Hilário M.R., Clouse E., Yin H.H., Costa R.M. Endocannabinoid signaling is critical for habit formation. Frontiers in Integrative Neuroscience 2007, 1:6.
43. Histed M.H., Pasupathy A., Miller E.K. Learning substrates in the primate prefrontal cortex and striatum: sustained activity related to successful actions. Neuron 2009, 63:244-253.
44. Hogarth L., Chase H.W. Parallel goal-directed and habitual control of human drug-seeking: implications for dependence vulnerability. Journal of Experimental Psychology. Animal Behavior Processes 2011, 37:261-276.
45. Holland P.C. Relations between Pavlovian-instrumental transfer and reinforcer devaluation. Journal of Experimental Psychology. Animal Behavior Processes 2004, 30:104-117.
46. Holland P.C., Rescorla R.A. The effect of two ways of devaluing the unconditioned stimulus after first- and second-order appetitive conditioning. Journal of Experimental Psychology. Animal Behavior Processes 1975, 1:355-363.
47. Holland P.C., Straub J.J. Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning. Journal of Experimental Psychology. Animal Behavior Processes 1979, 5:65-78.
48. Holmes N.M., Marchand A.R., Coutureau E. Pavlovian to instrumental transfer: a neurobehavioural perspective. Neuroscience and Biobehavioral Reviews 2010, 34:1277-1295.
49. Howard M.O. Pharmacological aversion treatment of alcohol dependence. I. Production and prediction of conditioned alcohol aversion. The American Journal of Drug and Alcohol Abuse 2001, 27:561-585.
50. Ikemoto S., McBride W.J., Murphy J.M., Lumeng L., Li T.K. 6-OHDA-lesions of the nucleus accumbens disrupt the acquisition but not the maintenance of ethanol consumption in the alcohol-preferring P line of rats. Alcoholism: Clinical and Experimental Research 1997, 21:1042-1046.
51. Ito R., Dalley J.W., Robbins T.W., Everitt B.J. Dopamine release in the dorsal striatum during cocaine-seeking behavior under the control of a drug-associated cue. The Journal of Neuroscience 2002, 22:6247-6253.
52. Kelley A.E., Berridge K.C. The neuroscience of natural rewards: relevance to addictive drugs. The Journal of Neuroscience 2002, 22:3306-3311.
53. Kirshenbaum A.P., Olsen D.M., Bickel W.K. A quantitative review of the ubiquitous relapse curve. Journal of Substance Abuse Treatment 2009, 36:8-17.
54. Knowlton B.J., Mangels J.A., Squire L.R. A neostriatal habit learning system in humans. Science 1996, 273:1399-1402.
55. Köhnke M.D. Approach to the genetics of alcoholism: a review based on pathophysiology. Biochemical Pharmacology 2008, 75:160-177.
56. Kreitzer A.C. Physiology and pharmacology of striatal neurons. Annual Review of Neuroscience 2009, 32:127-147.
57. Krystal J.H., Cramer J.A., Krol W.F., Kirk G.F., Rosenheck R.A. Naltrexone in the treatment of alcohol dependence. The New England Journal of Medicine 2001, 345:1734-1739. Veterans Affairs Naltrexone Cooperative Study 425 Group.
58. Lesscher H.M., van Kerkhof L.W., Vanderschuren L.J. Inflexible and indifferent alcohol drinking in male mice. Alcoholism: Clinical and Experimental Research 2010, 34:1219-1225.
59. Mangieri R.A., Cofresí R.U., Gonzales R.A. Ethanol seeking by Long Evans rats is not always a goal-directed behavior. PLoS One 2012, 7:e42886.
60. Matson L.M., Grahame N.J. Pharmacologically relevant intake during chronic, free-choice drinking rhythms in selectively bred high alcohol-preferring mice. Addiction Biology 2011, 18:921-929.
61. McBride W.J., Li T.K. Animal models of alcoholism: neurobiology of high alcohol-drinking behavior in rodents. Critical Reviews in Neurobiology 1998, 12:339-369.
62. Milad M.R., Rauch S.L., Pitman R.K., Quirk G.J. Fear extinction in rats: implications for human brain imaging and anxiety disorders. Biological Psychology 2006, 73:61-71.
63. Miles F.J., Everitt B.J., Dickinson A. Oral cocaine seeking by rats: action or habit?. Behavioral Neuroscience 2003, 117:927-938.
64. Miller M.A., Fillmore M.T. Persistence of attentional bias toward alcohol-related stimuli in intoxicated social drinkers. Drug and Alcohol Dependence 2011, 117:184-189.
65. Müller U.J., Sturm V., Voges J., Heinze H.J., Galazky I., Heldmann M., et al. Successful treatment of chronic resistant alcoholism by deep brain stimulation of nucleus accumbens: first experience with three cases. Pharmacopsychiatry 2009, 42:288-291.
66. Nauta W.J.H. Reciprocal links of the corpus striatum with the cerebral cortex and limbic system: a common substrate for movement and thought?. Neurology and Psychiatry: A Meeting of the Minds 1989, 43-63. Karger, Basel. Mueller (Ed.).
67. Nelson A., Killcross S. Amphetamine exposure enhances habit formation. The Journal of Neuroscience 2006, 26:3805-3812.
68. Nicola S.M., Surmeier J., Malenka R.C. Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annual Review of Neuroscience 2000, 23:185-215.
69. Ostlund S.B., Balleine B.W. Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. The Journal of Neuroscience 2005, 25:7763-7770.
70. Pastor A., Jones D.M., Currie J. High-dose baclofen for treatment-resistant alcohol dependence. Journal of Clinical Psychopharmacology 2012, 32:266-268.
71. Quinn J.J., Hitchcott P.K., Umeda E.A., Arnold A.P., Taylor J.R. Sex chromosome complement regulates habit formation. Nature Neuroscience 2007, 10:1398-1400.
72. Reilly S., Schachtman T.R. Conditioned taste aversion: neural and behavioral processes 2009, Oxford University Press, Oxford.
73. Rescorla R.A. Transfer of instrumental control mediated by a devalued outcome. Animal Learning & Behavior 1994, 22:27-33.
74. Robinson T.E., Berridge K.C. Addiction. Annual Review of Psychology 2003, 54:25-53.
75. Rodd Z.A., Bell R.L., Kuc K.A., Murphy J.M., Lumeng L., Li T.K., et al. Effects of repeated alcohol deprivations on operant ethanol self-administration by alcohol-preferring (P) rats. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology 2003, 28:1614-1621.
76. Samson H.H. Initiation of ethanol reinforcement using a sucrose-substitution procedure in food- and water-sated rats. Alcoholism: Clinical and Experimental Research 1986, 10:436-442.
77. Samson H.H., Cunningham C.L., Czachowski C.L., Chappell A., Legg B., Shannon E. Devaluation of ethanol reinforcement. Alcohol (Fayetteville, N.Y.) 2004, 32:203-212.
78. Schulte T., Oberlin B.G., Kareken D.A., Marinkovic K., Müller-Oehring E.M., Meyerhoff D.J., et al. How acute and chronic alcohol consumption affects brain networks: insights from multimodal neuroimaging. Alcoholism: Clinical and Experimental Research 2012, 36:2017-2027.
79. Simms J.A., Bito-Onon J.J., Chatterjee S., Bartlett S.E. Long-Evans rats acquire operant self-administration of 20% ethanol without sucrose fading. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology 2010, 35:1453-1463.
80. Smith Y., Bennett B.D., Bolam J.P., Parent A., Sadikot A.F. Synaptic relationships between dopaminergic afferents and cortical or thalamic input in the sensorimotor territory of the striatum in monkey. The Journal of Comparative Neurology 1994, 344:1-19.
81. Takahashi Y., Roesch M.R., Stalnaker T.A., Schoenbaum G. Cocaine exposure shifts the balance of associative encoding from ventral to dorsolateral striatum. Frontiers in Integrative Neuroscience 2007, 1:11.
82. Tiffany S.T., Carter B.L. Is craving the source of compulsive drug use?. Journal of Psychopharmacology 1998, 12:23-30.
83. Thorndike E.L. Animal Intelligence: Experimental Studies 1911, Macmillan, New York.
84. Vanderschuren L., Di Ciano P., Everitt B.J. Involvement of the dorsal striatum in cue-controlled cocaine seeking. The Journal of Neuroscience 2005, 25:8665-8670.
85. Volkow N.D., Wang G.J., Telang F., Fowler J.S., Logan J., Childress A.R., et al. Cocaine cues and dopamine in dorsal striatum: mechanism of craving in cocaine addiction. The Journal of Neuroscience 2006, 26:6583-6588.
86. Weafer J., Fillmore M.T. Alcohol-related stimuli reduce inhibitory control of behavior in drinkers. Psychopharmacology 2012, 222:489-498.
87. Wendler E., Gaspar J.C., Ferreira T.L., Barbiero J.K., Andreatini R., Vital M.A., et al. The roles of the nucleus accumbens core, dorsomedial striatum, and dorsolateral striatum in learning: performance and extinction of Pavlovian fear-conditioned responses and instrumental avoidance responses. Neurobiology of Learning and Memory 2013, 109:27-36.
88. Yin H.H., Knowlton B.J., Balleine B.W. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. The European Journal of Neuroscience 2004, 19:181-189.
89. Yin H.H., Ostlund S.B., Knowlton B.J., Balleine B.W. The role of the dorsomedial striatum in instrumental conditioning. The European Journal of Neuroscience 2005, 22:513-523.
90. Yu C., Gupta J., Chen J.F., Yin H.H. Genetic deletion of A2A adenosine receptors in the striatum selectively impairs habit formation. The Journal of Neuroscience 2009, 29:15100-15103.
91. Zapata A., Minney V.L., Shippenberg T.S. Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats. The Journal of Neuroscience 2010, 30:15457-15463.