The basal ganglia, the ideal machinery for the cost-benefit analysis of action plans

Frontiers in Neural Circuits

Volumn , Issue JUL, 2013, Pages

  Hwang, Eun Jung ^a  

^a California Institute of Technology   (United States)

Author keywords

Action selection; Cortico basal; Decision making; Effort; Ganglia loop; Optimal control; Reward

Indexed keywords

ACTION PLAN; ARTICLE; BASAL GANGLION; BRAIN DYSFUNCTION; COST BENEFIT ANALYSIS; FEEDBACK SYSTEM; HUMAN; MOTOR ACTIVITY; MOTOR DYSFUNCTION; MOVEMENT (PHYSIOLOGY); NONHUMAN; PREDICTION; RESEARCH; SENSORIMOTOR FUNCTION; SIGNAL TRANSDUCTION; THINKING;

EID: 84879721432     PISSN: 16625110     EISSN: None     Source Type: Journal    
DOI: 10.3389/fncir.2013.00121     Document Type: Article

References (50)

1. Albin RL, Young AB, Penney JB (1989) The functional anatomy of basal ganglia disorders. Trends Neurosci 12:366-375.
2. Alexander GE, Crutcher MD (1990) Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends Neurosci 13:266-271.
3. Alexander GE, DeLong MR, Strick PL (1986) Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9:357-381.
4. Amemori KI, Graybiel AM (2012) Localized microstimulation of primate pregenual cingulate cortex induces negative decision-making. Nat Neurosci.
5. Bateup HS, Santini E, Shen W, Birnbaum S, Valjent E, Surmeier DJ, Fisone G, Nestler EJ, Greengard P (2010) Distinct subclasses of medium spiny neurons differentially regulate striatal motor behaviors. Proc Natl Acad Sci 107:14845-14850.
6. Bautista LM, Tinbergen J, Kacelnik A (2001) To walk or to fly? How birds choose among foraging modes. Proc Natl Acad Sci U 98:1089-1094.
7. Bayer HM, Glimcher PW (2005) Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal. Neuron 47:129-141.
8. Burke CJ, Huetteroth W, Owald D, Perisse E, Krashes MJ, Das G, Gohl D, Silies M, Certel S, Waddell S (2012) Layered reward signalling through octopamine and dopamine in Drosophila. Nature 492:433-437.
9. Cepeda C, Buchwald NA, Levine MS (1993) Neuromodulatory actions of dopamine in the neostriatum are dependent upon the excitatory amino acid receptor subtypes activated. Proc Natl Acad Sci U 90:9576-9580.
10. Croxson PL, Walton ME, O'Reilly JX, Behrens TEJ, Rushworth MFS (2009) Effort-based costbenefit valuation and the human brain. J Neurosci 29:4531-4541.
11. Cui G, Jun SB, Jin X, Pham MD, Vogel SS, Lovinger DM, Costa RM (2013) Concurrent activation of striatal direct and indirect pathways during action initiation. Nature 494:238-242.
12. Diedrichsen J, Shadmehr R, Ivry RB (2010) The coordination of movement: optimal feedback control and beyond. Trends Cogn Sci 14:31-39.
13. Durieux PF, Bearzatto B, Guiducci S, Buch T, Waisman A, Zoli M, Schiffmann SN, de Kerchove d'Exaerde A (2009) D2R striatopallidal neurons inhibit both locomotor and drug reward processes. Nat Neurosci 12:393-395.
14. Floresco SB, St Onge JR, Ghods-Sharifi S, Winstanley CA (2008) Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cognitive, affective & behavioral neuroscience 8:375-389.
15. Frank MJ (2011) Computational models of motivated action selection in corticostriatal circuits. Curr Opin Neurobiol 21:381-386.
16. Gan JO, Walton ME, Phillips PEM (2010) Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat Neurosci 13:25-27.
17. Gerfen CR, Engber TM, Mahan LC, Susel Z, Chase TN, Monsma FJ, Jr., Sibley DR (1990) D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons. Science 250:1429-1432.
18. Gillies A, Arbuthnott G (2000) Computational models of the basal ganglia. Mov Disord 15:762-770.
19. Gurney K, Prescott TJ, Wickens JR, Redgrave P (2004) Computational models of the basal ganglia: from robots to membranes. Trends in Neurosciences 27:453-459.
20. Haber SN, Knutson B (2010) The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 35:4-26.
21. Harris CM, Wolpert DM (1998) Signal-dependent noise determines motor planning. Nature 394:780-784.
22. Hikida T, Kimura K, Wada N, Funabiki K, Nakanishi S (2010) Distinct Roles of Synaptic Transmission in Direct and Indirect Striatal Pathways to Reward and Aversive Behavior. Neuron 66:896-907.
23. Hikosaka O, Takikawa Y, Kawagoe R (2000) Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol Rev 80:953-978.
24. Kravitz AV, Tye LD, Kreitzer AC (2012) Distinct roles for direct and indirect pathway striatal neurons in reinforcement. Nat Neurosci 15:816-818.
25. Kravitz AV, Freeze BS, Parker PRL, Kay K, Thwin MT, Deisseroth K, Kreitzer AC (2010) Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry. Nature 466:622-626.
26. Lammel S, Lim BK, Ran C, Huang KW, Betley MJ, Tye KM, Deisseroth K, Malenka RC (2012) Input-specific control of reward and aversion in the ventral tegmental area. Nature 491:212-217.
27. Lei W, Jiao Y, Del Mar N, Reiner A (2004) Evidence for differential cortical input to direct pathway versus indirect pathway striatal projection neurons in rats. J Neurosci 24:8289-8299.
28. Mallet N, Ballion B, Le Moine C, Gonon F (2006) Cortical inputs and GABA interneurons imbalance projection neurons in the striatum of parkinsonian rats. J Neurosci 26:3875-3884.
29. Matsumoto M, Hikosaka O (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459:837-841.
30. Mazzoni P, Hristova A, Krakauer JW (2007) Why Don't We Move Faster? Parkinson's Disease, Movement Vigor, and Implicit Motivation. J Neurosci 27:7105-7116.
31. Mink JW (1996) THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS. Prog Neurobiol 50:381-425.
32. Nambu A (2011) Somatotopic organization of the primate Basal Ganglia. Front Neuroanat 5:26.
33. Niv Y (2007) Cost, benefit, tonic, phasic: what do response rates tell us about dopamine and motivation? Annals of the New York Academy of Sciences 1104:357-376.
34. Platt ML, Huettel SA (2008) Risky business: the neuroeconomics of decision making under uncertainty. Nat Neurosci 11:398-403.
35. Redgrave P, Prescott TJ, Gurney K (1999) The basal ganglia: a vertebrate solution to the selection problem? Neuroscience 89:1009-1023.
36. Reiner A, Albin RL, Anderson KD, D'Amato CJ, Penney JB, Young AB (1988) Differential loss of striatal projection neurons in Huntington disease. PNAS 85:5733-5737.
37. Richfield EK, Maguire-Zeiss KA, Cox C, Gilmore J, Voorn P (1995) Reduced expression of preproenkephalin in striatal neurons from Huntington's disease patients. Annals of neurology 37:335-343.
38. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MF (2006) Separate neural pathways process different decision costs. Nat Neurosci 9:1161-1168.
39. Salamone JD, Correa M, Farrar A, Mingote SM (2007) Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191:461-482.
40. Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-1599.
41. Shadmehr R, Krakauer JW (2008) A computational neuroanatomy for motor control. Exp Brain Res 185:359-381.
42. Shen W, Flajolet M, Greengard P, Surmeier DJ (2008) Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321:848-851.
43. Smith MA, Brandt J, Shadmehr R (2000) Motor disorder in Huntington's disease begins as a dysfunction in error feedback control. Nature 403:544-549.
44. Steiner H, Tseng KY (2010) Handbook of Basal Ganglia Structure and Function: A Decade of Progress: Elsevier Science.
45. Stevens JR, Rosati AG, Ross KR, Hauser MD (2005) Will Travel for Food: Spatial Discounting in Two New World Monkeys. Curr Biol 15:1855-1860.
46. Tai LH, Lee AM, Benavidez N, Bonci A, Wilbrecht L (2012) Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value. Nat Neurosci 15:1281-1289.
47. Todorov E (2000) Direct cortical control of muscle activation in voluntary arm movements: a model. Nat Neurosci 3:391-398.
48. Treadway MT, Buckholtz JW, Cowan RL, Woodward ND, Li R, Ansari MS, Baldwin RM, Schwartzman AN, Kessler RM, Zald DH (2012) Dopaminergic mechanisms of individual differences in human effort-based decision-making. J Neurosci 32:6170-6176.
49. Turner RS, DeLong MR (2000) Corticostriatal Activity in Primary Motor Cortex of the Macaque. J Neurosci 20:7096-7108.
50. van Gaalen MM, van Koten R, Schoffelmeer ANM, Vanderschuren LJMJ (2006) Critical Involvement of Dopaminergic Neurotransmission in Impulsive Decision Making. Biological Psychiatry 60:66-73.