Cortico-Basal Ganglia Networks and the Neural Substrates of Actions

Neurobiology of Alcohol Dependence

Volumn , Issue , 2014, Pages 29-47

  Yin, Henry H ^a  

^a DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Alcohol addiction; Basal ganglia; Dopamine; Homeostasis; Motivation; Negative feedback

Indexed keywords

EID: 84902402140     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-405941-2.00002-X     Document Type: Chapter

References (122)

1. Ashby W.R. Design for a brain 1960, Chapman & Hall. 2nd ed.
2. Badrinarayan A., Wescott S.A., Vander Weele C.M., Saunders B.T., Couturier B.E., Maren S., et al. Aversive stimuli differentially modulate real-time dopamine transmission dynamics within the nucleus accumbens core and shell. Journal of Neuroscience 2012, 32(45):15779-15790.
3. Balleine B., Dickinson A. The role of incentive learning in instrumental outcome revaluation by specific satiety. Animal Learning and Behavior 1998, 26:46-59.
4. Balleine B.W. Incentive processes in instrumental conditioning. Handbook of contemporary learning theories 2001, 307-366. Lawrence Erlbaum Associates Inc, Mahwah, NJ, US. R.R. Mowrer, S.B. Klein (Eds.).
5. Balleine B.W. Neural bases of food-seeking: Affect, arousal and reward in corticostriatolimbic circuits. Physiology & Behavior 2005, 86(5):717-730.
6. Balleine B.W., Dickinson A. Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology 1998, 37(4-5):407-419.
7. Balleine B.W., Killcross A.S., Dickinson A. The effect of lesions of the basolateral amygdala on instrumental conditioning. Journal of Neuroscience 2003, 23(2):666-675.
8. Barrionuevo G., Brown T.H. Associative long-term potentiation in hippocampal slices. Proceedings of the National Academy of Sciences 1983, 80(23):7347-7351.
9. Baum W.M. The correlation-based law of effect. Journal of the Experimental Analysis of Behavior 1973, 20(1):137-153.
10. Bayliss L.E. Living control systems 1966, English Universities Press, London.
11. Bechara A., Tranel D., Damasio H. Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions. Brain 2000, 123(Pt 11):2189-2202.
12. Bernstein N. The coordination and regulation of movements 1967, Pergamon Press, Oxford.
13. Berridge K.C., Whishaw I.Q. Cortex, striatum and cerebellum: Control of serial order in a grooming sequence. Experimental Brain Research 1992, 90(2):275-290.
14. Bolles R.C. Theory of motivation 1975, Harper Collins, New York.
15. Breland K., Breland M. The misbehavior of organisms. American Psychologist 1961, 16(11):681.
16. Brown P.L., Jenkins H.M. Auto-shaping the pigeon's key peck. Journal of the Experimental Analysis of Behavior 1968, 11:1-8.
17. Camhi J.M. Neuroethology 1984, Sinauer, New York.
18. Cannon W. The wisdom of the body 1932, W. W. Norton, New York.
19. Colwill R.M., Rescorla R.A. Postconditioning devaluation of a reinforcer affects instrumental responding. Journal of Experimental Psychology: Animal Behavior Processes 1985, 11(1):120-132.
20. Cools A. Brain and behavior: Hierarchy of feedback systems and control of input. Perspectives in ethology 1985, 109-168. Springer, New York.
21. Corbit L.H., Balleine B.W. The role of prelimbic cortex in instrumental conditioning. Behavioural Brain Research 2003, 146(1-2):145-157.
22. Corbit L.H., Balleine B.W. Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. Journal of Neuroscience 2005, 25(4):962-970.
23. Corbit L.H., Balleine B.W. The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. Journal of Neuroscience 2011, 31(33):11786-11794.
24. Corbit L.H., Muir J.L., Balleine B.W. The role of the nucleus accumbens in instrumental conditioning: Evidence of a functional dissociation between accumbens core and shell. Journal of Neuroscience 2001, 21(9):3251-3260.
25. Cromwell H.C., Berridge K.C. Implementation of action sequences by a neostriatal site: A lesion mapping study of grooming syntax. Journal of Neuroscience 1996, 16(10):3444-3458.
26. Daw N.D., Niv Y., Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience 2005, 8(12):1704-1711.
27. Derusso A.L., Fan D., Gupta J., Shelest O., Costa R.M., Yin H.H. Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement. Front Integrative Neuroscience 2010, 4.
28. Dickinson A. Actions and habits: The development of behavioural autonomy. Philosophical Transactions of the Royal Society 1985, B308:67-78.
29. Dickinson A. Instrumental conditioning. Animal learning and cognition 1994, 45-79. Academic Press, Orlando. N.J. Mackintosh (Ed.).
30. Dickinson A., Campos J., Varga Z.I., Balleine B. Bidirectional instrumental conditioning. Quarterly Journal of Experimental Psychology: Comparative & Physiological Psychology 1996, 49(4):289-306.
31. Dickinson A., Charnock D.J. Contingency effects with maintained instrumental reinforcement. Quarterly Journal of Experimental Psychology: Comparative & Physiological Psychology 1985, 37(4):397-416.
32. Dickinson A., Squire S., Varga Z., Smith J.W. Omission learning after instrumental pretraining. Quarterly Journal of Experimental Psychology 1998, 51(3):271-286.
33. Domjan M. Pavlovian conditioning: A functional perspective. Annual Review of Psychology 2005, 56:179-206.
34. Dworkin B. Learning and physiological regulation 1993, University of Chicago Press, Chicago.
35. Ellison G.D., Konorski J. Separation of the salivary and motor responses in instrumental conditioning. Science 1964, 146:1071-1072.
36. Everitt B.J., Robbins T.W. Neural systems of reinforcement for drug addiction: From actions to habits to compulsion. Nature Neuroscience 2005, 8(11):1481-1489.
37. Fan D., Rossi M.A., Yin H.H. Mechanisms of action selection and timing in substantia nigra neurons. Journal of Neuroscience 2012, 32(16):5534-5548.
38. Fanselow M.S. Conditional and unconditional components of post-shock freezing. The Pavlovian Journal of Biological Science: Official Journal of the Pavlovian 1980, 15(4):177-182.
39. Ferster C., Skinner B.F. Schedules of reinforcement 1957, Appleton Century, New York.
40. Freud S. Instincts and their vicissitudes. Collected papers 1915, Vol. 4. Basic Books, New York.
41. Gerfen C.R. The neostriatal mosaic: Multiple levels of compartmental organization in the basal ganglia. Annual Review of Neuroscience 1992, 15:285-320.
42. Glimcher P.W. Quantification of Behavior Sackler Colloquium: Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesis. Proceedings of the National Academy of Sciences of the United States of America. 2011.
43. Grant B.F., Stinson F.S., Dawson D.A., Chou S.P., Dufour M.C., Compton W., et al. Prevalence and co-occurrence of substance use disorders and independent mood and anxiety disorders: Results from the National Epidemiologic Survey on alcohol and related conditions. Archives of General Psychiatry 2004, 61(8):807.
44. Graziano M. The organization of behavioral repertoire in motor cortex. Annual Review of Neuroscience 2006, 29:105-134.
45. Gutierrez R., Carmena J.M., Nicolelis M.A., Simon S.A. Orbitofrontal ensemble activity monitors licking and distinguishes among natural rewards. Journal of Neurophysiology 2006, 95(1):119-133.
46. Haber S.N. The primate basal ganglia: Parallel and integrative networks. Journal of Chemical Neuroanatomy 2003, 26(4):317-330.
47. Haber S.N., Fudge J.L., McFarland N.R. Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. Journal of Neuroscience 2000, 20(6):2369-2382.
48. Hammond L.J. The effect of contingency upon the appetitive conditioning of free-operant behavior. Journal of the Experimental Analysis of Behavior 1980, 34(3):297-304.
49. Hershberger W.A. An approach through the looking glass. Animal Learning & Behavior 1986, 14:443-451.
50. Hikosaka O. GABAergic output of the basal ganglia. Progress in Brain Research 2007, 160:209-226.
51. Hilario M., Holloway T., Jin X., Costa R.M. Different dorsal striatum circuits mediate action discrimination and action generalization. European Journal of Neuroscience 2012, 35(7):1105-1114.
52. Hull C. Principles of behavior 1943, Appleton-Century-Crofts, New York.
53. Hull C. A behavior system 1952, Yale University Press, New Haven.
54. James W. The principles of psychology 1890, Vol. 1. Henry Holt, New York.
55. Joel D., Weiner I. The organization of the basal ganglia-thalamocortical circuits: Open interconnected rather than closed segregated. Neuroscience 1994, 63(2):363-379.
56. Kandel E.R. Cellular basis of behavior 1976, W. H. Freeman, New York.
57. Kermadi I., Joseph J.P. Activity in the caudate nucleus of monkey during spatial sequencing. Journal of Neurophysiology 1995, 74(3):911-933.
58. Kimble G.A. Hilgard and Marquis' conditioning and learning 1961, Appleton-Century-Crofts, New York. 2nd ed.
59. Konorski J. Integrative activity of the brain 1967, University of Chicago Press, Chicago.
60. Koob G.F., Le Moal M. Addiction and the brain antireward system. Annual Review of Psychology 2008, 59:29-53.
61. Kording K.P., Wolpert D.M. Bayesian integration in sensorimotor learning. Nature 2004, 427(6971):244-247.
62. Lashley K.S. The problem of serial order in behavior. Cerebral mechanisms in behavior: The Hixon symposium 1951, 112-146. Wiley, New York. L.A. Jeffress (Ed.).
63. Liljeholm M., Tricomi E., O'Doherty J.P., Balleine B.W. Neural correlates of instrumental contingency learning: Differential effects of action-reward conjunction and disjunction. Journal of Neuroscience 2011, 31(7):2474-2480.
64. Lisberger S.G., Morris E., Tychsen L. Visual motion processing and sensory-motor integration for smooth pursuit eye movements. Annual Review of Neuroscience 1987, 10(1):97-129.
65. Luria A. Higher cortical functions in man 1966, Basic Books, New York.
66. Matsumoto J., Urakawa S., Hori E., de Araujo M.F., Sakuma Y., Ono T., et al. Neuronal responses in the nucleus accumbens shell during sexual behavior in male rats. Journal of Neuroscience 2012, 32(5):1672-1686.
67. Matyas F., Sreenivasan V., Marbach F., Wacongne C., Barsy B., Mateo C., et al. Motor control by sensory cortex. Science 2010, 330(6008):1240-1243.
68. McGeorge A.J., Faull R.L. The organization and collateralization of corticostriate neurones in the motor and sensory cortex of the rat brain. Brain Research 1987, 423(1-2):318-324.
69. McGeorge A.J., Faull R.L. The organization of the projection from the cerebral cortex to the striatum in the rat. Neuroscience 1989, 29(3):503-537.
70. Merton, P. (1953). Speculations on the servo-control of movement. Paper presented at the Ciba Foundation Symposium-The Spinal Cord.
71. Miller N.E., Dollard J. Social learning and imitation 1941, Yale University Press, New Haven.
72. Mountcastle V. An organizing principle for cerebral function: The unit model and the distributed system. The mindful brain 1978, 7-50. MIT Press, Cambridge. G.M. Edelman, V.V. Mountcastle (Eds.).
73. Mowrer O. Learning theory and behavior 1960, John Wiley & Sons, New York.
74. Mowrer O., Jones H. Habit strength as a function of the pattern of reinforcement. Journal of Experimental Psychology 1945, 35(4):293.
75. Mrosovsky N. Rheostasis: The physiology of change 1990, Oxford University Press, Oxford.
76. Newsome W.T., Britten K.H., Movshon J.A. Neuronal correlates of a perceptual decision. Nature 1989, 341(6237):52-54.
77. Ostlund S.B., Balleine B.W. Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. Journal of Neuroscience 2005, 25(34):7763-7770.
78. Ostlund S.B., Winterbauer N.E., Balleine B.W. Evidence of action sequence chunking in goal-directed instrumental conditioning and its dependence on the dorsomedial prefrontal cortex. Journal of Neuroscience 2009, 29(25):8280-8287.
79. Pavlov I. Conditioned reflexes 1927, Oxford University Press, Oxford.
80. Pecina S., Smith K.S., Berridge K.C. Hedonic hot spots in the brain. Neuroscientist 2006, 12(6):500-511.
81. Powers W.T. Feedback: Beyond behaviorism. Science 1973, 179(71):351-356.
82. Powers W.T. Quantitative analysis of purpose systems. Psychological Review 1978, 85(5):417-435.
83. Prinssen E.P., Balestra W., Bemelmans F.F., Cools A.R. Evidence for a role of the shell of the nucleus accumbens in oral behavior of freely moving rats. Journal of Neuroscience 1994, 14(3 Pt 2):1555-1562.
84. Rescorla R.A. Pavlovian conditioning and its proper control procedures. Psychological Review 1967, 74(1):71-80.
85. Rescorla R.A., Holland P.C. Behavioral studies of associative learning in animals. Annual Review of Psychology 1982, 33:265-308.
86. Rescorla R.A., Solomon R.L. Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning. Psychological Review 1967, 74(3):151-182.
87. Rossi M.A., Fan D., Barter J.W., Yin H.H. Bidirectional modulation of Substantia Nigra activity by motivational state. PLoS One 2013, 8(8):e71598.
88. Rossi M.A., Hayrapetyan V.Y., Maimon B., Mak K., Je H.S., Yin H.H. Prefrontal cortical mechanisms underlying delayed alternation in mice. Journal of Neurophysiology 2012, 108(4):1211-1222.
89. Rossi M.A., Sukharnikova T., Hayrapetyan V.Y., Yang L., Yin H.H. Operant self-stimulation of dopamine neurons in the Substantia Nigra. PLoS One 2013, 8(6):e65799.
90. Salamone J.D., Correa M., Farrar A.M., Nunes E.J., Pardo M. Dopamine, behavioral economics, and effort. Front Behavioral Neuroscience 2009, 3:13.
91. Schwartz B., Gamzu E. Pavlovian control of operant behavior. Handbook of operant behavior 1977, 53-97. Prentice Hall, New Jersey. W. Honig, J.E.R. Staddon (Eds.).
92. Seligman M.E., Railton P., Baumeister R.F., Sripada C. Navigating into the future or driven by the past. Perspectives on Psychological Science 2013, 8(2):119-141.
93. Sherrington C.S. The integrative action of the nervous system 1906, Yale University Press, New Haven.
94. Shettleworth S.J. Reinforcement and the organization of behavior in golden hamsters: Hunger, environment, and food reinforcement. Journal of the Experimental Psychology: Animal Behavior Processes 1975, 1:56-87.
95. Skinner B.F. The behavior of organisms 1938, Appleton-Century-Crofts, New York.
96. Solomon R.L. The opponent-process theory of acquired motivation: The costs of pleasure and the benefits of pain. The American Psychologist 1980, 35(8):691-712.
97. Sommerhoff G. Logic of the living brain 1974, John Wiley & Sons.
98. Spence K. The role of secondary reinforcement in delayed reward learning. Psychological Review 1947, 54:1-8.
99. Spence K. Behavior theory and learning 1960, Prentice-Hall, Englewood Cliffs, NJ.
100. Staddon J.E.R. Adaptive behavior and learning 1983, Cambridge University Press, Cambridge.
101. Stuber G.D., Hnasko T.S., Britt J.P., Edwards R.H., Bonci A. Dopaminergic terminals in the nucleus accumbens but not the dorsal striatum corelease glutamate. Journal of Neuroscience 2010, 30(24):8229-8233.
102. Swanson L.W. Cerebral hemisphere regulation of motivated behavior. Brain Research 2000, 886(1-2):113-164.
103. Taha S.A., Fields H.L. Encoding of palatability and appetitive behaviors by distinct neuronal populations in the nucleus accumbens. Journal of Neuroscience 2005, 25(5):1193-1202.
104. Tanji J., Shima K. Role for supplementary motor area cells in planning several movements ahead. Nature 1994, 371(6496):413-416.
105. Tanji J., Shima K. Supplementary motor cortex in organization of movement. European Neurology 1996, 36(Suppl. 1):13-19.
106. Thorndike E.L. Animal intelligence: Experimental studies 1911, Macmillan, New York.
107. Tolman E.C. Purposive behavior in animals and man 1932, Macmillan, New York.
108. Tricomi E.M., Delgado M.R., Fiez J.A. Modulation of caudate activity by action contingency. Neuron 2004, 41(2):281-292.
109. Von Neumann J. The computer and the brain 2012, Yale University Press.
110. Wiltgen B.J., Law M., Ostlund S., Mayford M., Balleine B.W. The influence of Pavlovian cues on instrumental performance is mediated by CaMKII activity in the striatum. European Journal of Neuroscience 2007, 25(8):2491-2497.
111. Wymbs N.F., Bassett D.S., Mucha P.J., Porter M.A., Grafton S.T. Differential recruitment of the sensorimotor putamen and frontoparietal cortex during motor chunking in humans. Neuron 2012, 74(5):936-946.
112. Yin H.H. The role of the murine motor cortex in action duration and order. Front Integrative Neuroscience 2009, 3:23.
113. Yin H.H. The sensorimotor striatum is necessary for serial order learning. Journal of Neuroscience 2010, 30(44):14719-14723.
114. Yin H.H., Knowlton B.J. Addiction and learning. Handbook of implicit cognition and addiction 2005, 167-183. Sage, Thousand Oaks. R.W. Wiers, A.W. Stacy (Eds.).
115. Yin H.H., Knowlton B.J. The role of the basal ganglia in habit formation. Nature Reviews and Neuroscience 2006, 7(6):464-476.
116. Yin H.H., Knowlton B.J., Balleine B.W. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. European Journal of Neuroscience 2004, 19(1):181-189.
117. Yin H.H., Knowlton B.J., Balleine B.W. Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. European Journal of Neuroscience 2005, 22:505-512.
118. Yin H.H., Knowlton B.J., Balleine B.W. Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behavioural Brain Research 2006, 166(2):189-196.
119. Yin H.H., Ostlund S.B., Balleine B.W. Reward-guided learning beyond dopamine in the nucleus accumbens: The integrative functions of cortico-basal ganglia networks. European Journal of Neuroscience 2008, 28(8):1437-1448.
120. Yin H.H., Ostlund S.B., Knowlton B.J., Balleine B.W. The role of the dorsomedial striatum in instrumental conditioning. European Journal of Neuroscience 2005, 22:513-523.
121. Yu C., Fan D., Lopez A., Yin H.H. Dynamic changes in single unit activity and gamma oscillations in a thalamocortical circuit during rapid instrumental learning. PLoS One 2012, 7(11):e50578.
122. Yu C., Gupta J., Yin H.H. The role of mediodorsal thalamus in temporal differentiation of reward-guided actions. Front Integrative Neuroscience 2010, 4.