Using optogenetics to study habits

Brain Research

Volumn 1511, Issue , 2013, Pages 102-114

  Smith, Kyle S ^a   Graybiel, Ann M ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Basal ganglia; Executive; Learning; Plasticity; Prefrontal cortex; Reward; Time

Indexed keywords

HALORHODOPSIN;

ADDICTION; APPETITE; ARTICLE; BASAL GANGLION; CONCEPTUAL FRAMEWORK; CORPUS STRIATUM; HABIT; HUMAN; ILLUMINATION; MACACA; NERVE CELL PLASTICITY; NEUROBIOLOGY; NONHUMAN; OPTOGENETICS; PREFRONTAL CORTEX; PRIORITY JOURNAL; TASTE AVERSION;

ANIMALS; HABITS; HALORHODOPSINS; HUMANS; LUMINESCENT PROTEINS; NEURAL PATHWAYS; OPTOGENETICS; PREFRONTAL CORTEX;

EID: 84879842041     PISSN: 00068993     EISSN: 18726240     Source Type: Journal    
DOI: 10.1016/j.brainres.2013.01.008     Document Type: Article

References (106)

1. C.D. Adams Variations in the sensitivity of instrumental responding to reinforcer devaluation Quart. J. Exp. Psychol. B 34 1982 77 98
2. R.L. Albin, and J.W. Mink Recent advances in Tourette syndrome research Trends Neurosci. 29 2006 175 182
3. J.W. Aldridge, K.C. Berridge, and A.R. Rosen Basal ganglia neural mechanisms of natural movement sequences Can. J. Physiol. Pharmacol. 82 2004 732 739
4. P. Anikeeva, A.S. Andalman, I. Witten, M. Warden, I. Goshen, L. Grosenick, L.A. Gunaydin, L.M. Frank, and K. Deisseroth Optetrode: a multichannel readout for optogenetic control in freely moving mice Nat. Neurosci. 15 2011 163 170
5. H.E. Atallah, M.W. Howe, and A.M. Graybiel Dynamic modulation of ensemble activity in the ventromedial sriatum during T-maze learning and re-learning Soc. Neurosci. Abstr. 708 2010 2
6. B.W. Balleine, and A. Dickinson Goal-directed instrumental action: contingency and incentive learning and their cortical substrates Neuropharmacology 37 1998 407 419
7. B.W. Balleine, M. Liljeholm, and S.B. Ostlund The integrative function of the basal ganglia in instrumental conditioning Behav. Brain Res. 199 2009 43 52
8. B.W. Balleine, and J.P. O'Doherty Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action Neuropsychopharmacology 35 2010 48 69
9. T.D. Barnes, Y. Kubota, D. Hu, D.Z. Jin, and A.M. Graybiel Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories Nature 437 2005 1158 1161
10. T.D. Barnes, D. Hu, J.B. Mao, Y. Kubota, M.W. Howe, X. Jin, and A.M. Graybiel Comparison of training-induced activity in the dorsolateral striatum during training on three versions of a T-maze task Soc. Neurosci. Abstr. 567 2009 11
11. D. Belin, S. Jonkman, A. Dickinson, T.W. Robbins, and B.J. Everitt Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction Behav. Brain Res. 199 2009 89 102
12. J.G. Bernstein, and E.S. Boyden Optogenetic tools for analyzing the neural circuits of behavior Trends Cognition Sci. 15 2011 592 600
13. A.M. Bornstein, and N.D. Daw Multiplicity of control in the basal ganglia: computational roles of striatal subregions Curr. Opin. Neurobiol. 21 2011 374 380
14. J.M. Bossert, A.L. Stern, F.R. Theberge, C. Cifani, E. Koya, B.T. Hope, and Y. Shaham Ventral medial prefrontal cortex neuronal ensembles mediate context-induced relapse to heroin Nat. Neurosci. 14 2011 420 422
15. M.S. Brainard, and A.J. Doupe What songbirds teach us about learning Nature 417 2002 351 358
16. Brown, M.T.; Tan, K.R.; O'Connor, E.C.; Nikonenko, I.; Muller, D.; Luscher, C.; 2012. Ventral tegmental area GABA projections pause accumbal cholinergic interneurons to enhance associative learning. Nature.
17. R.M. Carelli, M. Wolske, and M.O. West Loss of lever press-related firing of rat striatal forelimb neurons after repeated sessions in a lever pressing task J. Neurosci. 17 1997 1804 1814
18. Y. Chudasama, F. Passetti, S.E. Rhodes, D. Lopian, A. Desai, and T.W. Robbins Dissociable aspects of performance on the 5-choice serial reaction time task following lesions of the dorsal anterior cingulate, infralimbic and orbitofrontal cortex in the rat: differential effects on selectivity, impulsivity and compulsivity Behav. Brain Res. 146 2003 105 119
19. J.Y. Cohen, S. Haesler, L. Vong, B.B. Lowell, and N. Uchida Neuron-type-specific signals for reward and punishment in the ventral tegmental area Nature 482 2012 85 88
20. R.M. Colwill, and R.A. Rescorla Postconditioning devaluation of a reinforcer affects instrumental responding J. Exp. Psychol.: Anim. Behav. Process. 11 1985 120 132
21. R.M. Colwill, and S.M. Triola Instrumental responding remains under the control of the consequent outcome after extended training Behav. Process. 57 2002 51 64
22. E. Coutureau, and S. Killcross Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats Behav. Brain Res. 146 2003 167 174
23. N.D. Daw, Y. Niv, and P. Dayan Actions, policies, values, and the Basal Ganglia E. Bezard, Recent Breakthroughs in Basal Ganglia Research, vol. 2005 Nova Science Publishers Hauppauge, NY 91 106
24. N.D. Daw, Y. Niv, and P. Dayan Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control Nat. Neurosci. 8 2005 1704 1711
25. A. Dickinson Actions and habits: the development of behavioral autonomy Philos. Trans. R. Soc. Lond. B Biol. Sci. 308 1985 67 78
26. A. Dickinson, and B.W. Balleine Hedonics: the cognitive-motivational interface M.L. Kringelbach, K.C. Berridge, Pleasures of the Brain. 2009 Oxford University Press Oxford, UK
27. A. Faure, U. Haberland, F. Conde, and N. El Massioui Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation J. Neurosci. 25 2005 2771 2780
28. M.S. Fee, and J.H. Goldberg A hypothesis for basal ganglia-dependent reinforcement learning in the songbird Neuroscience 198 2011 152 170
29. L. Fenno, O. Yizhar, and K. Deisseroth The development and application of optogenetics Annu. Rev. Neurosci. 34 2011 389 412
30. E. Ferenczi, and K. Deisseroth When the electricity (and the lights) go out: transient changes in excitability Nat. Neurosci. 15 2012 1058 1060
31. S.M. Ferguson, D. Eskenazi, M. Ishikawa, M.J. Wanat, P.E. Phillips, Y. Dong, B.L. Roth, and J.F. Neumaier Transient neuronal inhibition reveals opposing roles of indirect and direct pathways in sensitization Nat. Neurosci. 14 2011 22 24
32. N. Fujii, and A.M. Graybiel Representation of action sequence boundaries by macaque prefrontal cortical neurons Science 301 2003 1246 1249
33. H. Fujimoto, T. Hasegawa, and D. Watanabe Neural coding of syntactic structure in learned vocalizations in the songbird J. Neurosci. 31 2011 10023 10033
34. J. Garcia, and F.R. Ervin Appetites, aversions, and addictions: a model for visceral memory Recent Adv. Biol. Psychiatry 10 1968 284 293
35. A. Ghazizadeh, F. Ambroggi, N. Odean, and H.L. Fields Prefrontal cortex mediates extinction of responding by two distinct neural mechanisms in accumbens shell J. Neurosci. 32 2012 726 737
36. I. Goshen, M. Brodsky, R. Prakash, J. Wallace, V. Gradinaru, C. Ramakrishnan, and K. Deisseroth Dynamics of retrieval strategies for remote memories Cell 147 2011 678 689
37. V. Gradinaru, F. Zhang, C. Ramakrishnan, J. Mattis, R. Prakash, I. Diester, I. Goshen, K.R. Thompson, and K. Deisseroth Molecular and cellular approaches for diversifying and extending optogenetics Cell 141 2010 154 165
38. A.M. Graybiel The basal ganglia and chunking of action repertoires Neurobiol. Learn Mem. 70 1998 119 136
39. A.M. Graybiel, and S.L. Rauch Toward a neurobiology of obsessive-compulsive disorder Neuron 28 2000 343 347
40. A.M. Graybiel Habits, rituals, and the evaluative brain Annu. Rev. Neurosci. 31 2008 359 387
41. X. Han, X. Qian, J.G. Bernstein, H.H. Zhou, G.T. Franzesi, P. Stern, R.T. Bronson, A.M. Graybiel, R. Desimone, and E.S. Boyden Millisecond-timescale optical control of neural dynamics in the nonhuman primate brain Neuron 62 2009 191 198
42. O. Hikosaka, K. Nakamura, K. Sakai, and H. Nakahara Central mechanisms of motor skill learning Curr. Opin. Neurobiol. 12 2002 217 222
43. O. Hikosaka, and M. Isoda Switching from automatic to controlled behavior: cortico-basal ganglia mechanisms Trends Cognition Sci. 14 2010 154 161
44. P.K. Hitchcott, J.J. Quinn, and J.R. Taylor Bidirectional modulation of goal-directed actions by prefrontal cortical dopamine Cereb. Cortex 17 2007 2820 2827
45. Hogarth, L.; Balleine, B.W.; Corbit, L.H.; Killcross, S.; 2012. Associative learning mechanisms underpinning the transition from recreational drug use to addiction. Ann. N. Y. Acad. Sci.
46. P.C. Holland, and J.J. Straub Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning J. Exp. Psychol. Anim. Behav. Process. 5 1979 65 78
47. P.E. Holtzheimer, and H.S. Mayberg Deep brain stimulation for psychiatric disorders Annu. Rev. Neurosci. 34 2011 289 307
48. M.W. Howe, H.E. Atallah, A. McCool, D.J. Gibson, and A.M. Graybiel Habit learning is associated with major shifts in frequencies of oscillatory activity and synchronized spike firing in striatum Proc. Natl. Acad. Sci. USA 108 2011 16801 16806
49. Hull, C.L.; 1943. Principles of Behavior. Appleton-Century Crofts, NewYork.
50. S.E. Hyman, R.C. Malenka, and E.J. Nestler Neural mechanisms of addiction: the role of reward-related learning and memory Annu Rev Neurosci. 29 2006 565 598
51. James, W.; 1899. Talksto Teacherson Psychology. Henry Holtand Company, NewYork.
52. J.P. Jedynak, J.M. Uslaner, J.A. Esteban, and T.E. Robinson Methamphetamine-induced structural plasticity in the dorsal striatum Eur. J. Neurosci. 25 2007 847 853
53. X. Jin, and R.M. Costa Start/stop signals emerge in nigrostriatal circuits during sequence learning Nature 466 2010 457 462
54. M.S. Jog, Y. Kubota, C.I. Connolly, V. Hillegaart, and A.M. Graybiel Building neural representations of habits Science 286 1999 1745 1749
55. M. Jueptner, C.D. Frith, D.J. Brooks, R.S. Frackowiak, and R.E. Passingham Anatomy of motor learning. II. Subcortical structures and learning by trial and error J. Neurophysiol. 77 1997 1325 1337
56. M. Jueptner, K.M. Stephan, C.D. Frith, D.J. Brooks, R.S. Frackowiak, and R.E. Passingham Anatomy of motor learning. I. Frontal cortex and attention to action J. Neurophysiol. 77 1997 1313 1324
57. P.W. Kalivas, and N.D. Volkow The neural basis of addiction: a pathology of motivation and choice Am. J. Psychiatry. 162 2005 1403 1413
58. S. Killcross, and E. Coutureau Coordination of actions and habits in the medial prefrontal cortex of rats Cereb. Cortex 13 2003 400 408
59. A.V. Kravitz, B.S. Freeze, P.R. Parker, K. Kay, M.T. Thwin, K. Deisseroth, and A.C. Kreitzer Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry Nature 466 2010 622 626
60. Kravitz A.V.;Owen, S.F.; Kreitzer, A.C.; Optogenetic identification of striatal projection neuron subtypes during in vivo recordings. BrainRes, this issue.
61. A.V. Kravitz, L.D. Tye, and A.C. Kreitzer Distinct roles for direct and indirect pathway striatal neurons in reinforcement Nat. Neurosci. 15 2012 816 818
62. A.C. Kreitzer, and J.D. Berke Investigating striatal function through cell-type-specific manipulations Neuroscience 198 2011 19 26
63. Y. Kubota, J. Liu, D. Hu, W.E. DeCoteau, U.T. Eden, A.C. Smith, and A.M. Graybiel Stable encoding of task structure coexists with flexible coding of task events in sensorimotor striatum J. Neurophysiol. 102 2009 2142 2160
64. J.F. Leckman, and M.A. Riddle Tourette's syndrome: when habit-forming systems form habits of their own? Neuron 28 2000 349 354
65. N.W. Lingawi, and B.W. Balleine Amygdala central nucleus interacts with dorsolateral striatum to regulate the acquisition of habits J. Neurosci. 32 2012 1073 1081
66. M.K. Lobo, H.E. Covington 3rd, D. Chaudhury, A.K. Friedman, H. Sun, D. Damez-Werno, D.M. Dietz, S. Zaman, J.W. Koo, P.J. Kennedy, E. Mouzon, M. Mogri, R.L. Neve, K. Deisseroth, M.H. Han, and E.J. Nestler Cell type-specific loss of BDNF signaling mimics optogenetic control of cocaine reward Science 330 2010 385 390
67. M.K. Lobo, E.J. Nestler, and H.E. Covington 3rd Potential utility of optogenetics in the study of depression Biol. Psychiatry. 71 2012 1068 1074
68. R.J. McDonald, and N.M. White A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum Behav. Neurosci. 107 1993 3 22
69. A. Nelson, and S. Killcross Amphetamine exposure enhances habit formation J. Neurosci. 26 2006 3805 3812
70. M.G. Packard, and J.L. McGaugh Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning Neurobiol. Learn Mem. 65 1996 65 72
71. M.G. Packard Exhumed from thought: basal ganglia and response learning in the plus-maze Behav. Brain Res. 199 2009 24 31
72. V. Pascoli, M. Turiault, and C. Luscher Reversal of cocaine-evoked synaptic potentiation resets drug-induced adaptive behaviour Nature 481 2012 71 75
73. Pavlov,I.; 1927. Conditioned Reflexes. Dover Publications, Mineola, NY.
74. J. Peters, P.W. Kalivas, and G.J. Quirk Extinction circuits for fear and addiction overlap in prefrontal cortex Learn. Mem. 16 2009 279 288
75. R.A. Poldrack, F.W. Sabb, K. Foerde, S.M. Tom, R.F. Asarnow, S.Y. Bookheimer, and B.J. Knowlton The neural correlates of motor skill automaticity J. Neurosci. 25 2005 5356 5364
76. L.J. Porrino, and D. Lyons Orbital and medial prefrontal cortex and psychostimulant abuse: studies in animal models Cereb. Cortex. 10 2000 326 333
77. M.E. Ragozzino The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility Ann. N.Y. Acad. Sci. 1121 2007 355 375
78. J.V. Raimondo, L. Kay, T.J. Ellender, and C.J. Akerman Optogenetic silencing strategies differ in their effects on inhibitory synaptic transmission Nat. Neurosci. 15 2012 1102 1104
79. A.D. Redish, S. Jensen, and A. Johnson A unified framework for addiction: vulnerabilities in the decision process Behav. Brain Sci. 31 2008 415 437 (discussion 437-87)
80. R.A. Rescorla Response-outcome associations remain functional through interference treatments Anim. Learn. Behav. 24 1996 450 458
81. S.E. Rhodes, and S. Killcross Lesions of rat infralimbic cortex enhance recovery and reinstatement of an appetitive Pavlovian response Learn. Mem 11 2004 611 616
82. E.L. Rich, and M. Shapiro Rat prefrontal cortical neurons selectively code strategy switches J. Neurosci. 29 2009 7208 7219
83. T.E. Robinson, and K.C. Berridge The incentive sensitization theory of addiction: some current issues. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363 2008 3137 3146
84. G. Schoenbaum, and B. Setlow Cocaine makes actions insensitive to outcomes but not extinction: implications for altered orbitofrontal-amygdalar function Cereb. Cortex 15 2005 1162 1169
85. C.A. Seger, and B.J. Spiering A critical review of habit learning and the Basal Ganglia Front. Syst. Neurosci. 5 2011 66
86. K.S. Smith, A. Virkud, K. Deisseroth, and A.M. Graybiel Reversible online control of habitual behavior by optogenetic perturbation of medial prefrontal cortex Proc. Natl.Acad. Sci. USA 109 2012 18932 18937
87. Smith K.S, Graybiel A.M. A dual-operator view of habitual behavior reflecting cortical and striatal activity dynamics, submitted for publication.
88. M.T. Stefanik, K. Moussawi, Y.M. Kupchik, K.C. Smith, R.L. Miller, M.L. Huff, K. Deisseroth, P.W. Kalivas, and R.T. Lalumiere Optogenetic inhibition of cocaine seeking in rats Addict. Biol. 2012
89. G.D. Stuber, D.R. Sparta, A.M. Stamatakis, W.A. van Leeuwen, J.E. Hardjoprajitno, S. Cho, K.M. Tye, K.A. Kempadoo, F. Zhang, K. Deisseroth, and A. Bonci Excitatory transmission from the amygdala to nucleus accumbens facilitates reward seeking Nature 475 2011 377 380
90. G.D. Stuber, J.P. Britt, and A. Bonci Optogenetic modulation of neural circuits that underlie reward seeking Biol. Psychiatry 71 2012 1061 1067
91. C.A. Thorn, H.E. Atallah, M.W. Howe, and A.M. Graybiel Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning Neuron 66 2010 781 795
92. E.L. Thorndike Animal Intelligence: An Experimental Study of the Associative Processes in Animals 1898 Macmillan New York
93. E.C. Tolman, B.F. Ritchie, and D. Kalish Studies in spatial learning: V. Response learning versus place learning by the non-correction method J. Exp. Psychol. 37 1947 285 292
94. J. Tonnesen, A.T. Sorensen, K. Deisseroth, C. Lundberg, and M. Kokaia Optogenetic control of epileptiform activity Proc. Natl. Acad. Sci. USA 106 2009 12162 12167
95. K.M. Tye, R. Prakash, S.Y. Kim, L.E. Fenno, L. Grosenick, H. Zarabi, K.R. Thompson, V. Gradinaru, C. Ramakrishnan, and K. Deisseroth Amygdala circuitry mediating reversible and bidirectional control of anxiety Nature 471 2011 358 362
96. K.M. Tye, and K. Deisseroth Optogenetic investigation of neural circuits underlying brain disease in animal models Nat. Rev. Neurosci. 13 2012 251 266
97. L.P. Wang, F. Li, D. Wang, K. Xie, X. Shen, and J.Z. Tsien NMDA receptors in dopaminergic neurons are crucial for habit learning Neuron 72 2011 1055 1066
98. Warden, M.R.; Selimbeyoglu, A.; Mirzabekov, J.J.; Lo, M.; Thompson, K.R.; Kim, S.Y.; Adhikari, A.; Tye, K.M.; Frank, L.M.; Deisseroth, K.; 2012. A prefrontal cortex-brainstem neuronal projection that controls response to behavioural challenge. Nature 492, 428-432.
99. I.B. Witten, S.C. Lin, M. Brodsky, R. Prakash, I. Diester, P. Anikeeva, V. Gradinaru, C. Ramakrishnan, and K. Deisseroth Cholinergic interneurons control local circuit activity and cocaine conditioning Science 330 2010 1677 1681
100. Willuhn, I.; Burgeno, L.M.; Everitt, B.J.; Phillips, P.E.; 2012. Hierarchical recruitment of phasic dopamine signaling in the striatum during the progression of cocaine use. Proc. Natl. Acad. Sci. USA 109, 20703-20708
101. W. Wood, and D.T. Neal A new look at habits and the habit-goal interface Psychol. Rev. 114 2007 843 863
102. K. Wunderlich, P. Dayan, and R.J. Dolan Mapping value based planning and extensively trained choice in the human brain Nat. Neurosci. 15 2012 786 791
103. H.H. Yin, B.J. Knowlton, and B.W. Balleine Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning Eur. J. Neurosci. 19 2004 181 189
104. H.H. Yin, and B.J. Knowlton The role of the basal ganglia in habit formation Nat. Rev. Neurosci. 7 2006 464 476
105. H.H. Yin, S.P. Mulcare, M.R. Hilario, E. Clouse, T. Holloway, M.I. Davis, A.C. Hansson, D.M. Lovinger, and R.M. Costa Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill Nat. Neurosci. 12 2009 333 341
106. C. Yu, J. Gupta, J.F. Chen, and H.H. Yin Genetic deletion of A2A adenosine receptors in the striatum selectively impairs habit formation J. Neurosci. 29 2009 15100 15103