Goal-based action selection and utility-based action bias

Neural Networks

Volumn 19, Issue 8, 2006, Pages 1315-1320

  Matsumoto, Kenji ^a   Matsumoto, Madoka ^a,b   Abe, Hiroshi ^a,c  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^b KYOTO UNIVERSITY   (Japan)

^c TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Adaptation; Goal; Goal setting; Prefrontal cortex; Striatum; Utility

Indexed keywords

GOAL SETTING; GOAL SETTING PROCESS; PREFRONTAL CORTEX; STRIATUM;

ADAPTIVE CONTROL SYSTEMS; DATA ACQUISITION; DECISION MAKING; NEURAL NETWORKS;

ARTIFICIAL INTELLIGENCE;

ACTION RESEARCH; ADAPTATION; ARTICLE; ARTIFICIAL INTELLIGENCE; BEHAVIOR; BRAIN FUNCTION; CORPUS STRIATUM; DECISION MAKING; GOAL ATTAINMENT; MOTIVATION; NONHUMAN; OUTCOME VARIABLE; PREFRONTAL CORTEX; PRIORITY JOURNAL;

ANIMALS; BIAS (EPIDEMIOLOGY); CORPUS STRIATUM; DECISION MAKING; GOALS; HUMANS; LEARNING; NEURONS; PREFRONTAL CORTEX; REWARD;

EID: 33749058047     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2006.05.036     Document Type: Article

References (24)

1. Daw N.D., Niv Y., and Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience 8 (2005) 1704-1711
2. Dickinson A., and Balleine B. Motivational control of goal-directed action. Animal Learning and Behavior 22 (1994) 1-18
3. Doya K. Metalearning and neuromodulation. Neural Networks 15 (2002) 495-506
4. Duncan J. Disorganisation of behaviour after frontal lobe damage. Cognitive Psychology 3 (1986) 271-290
5. Duncan J. Goal weighting and the choice of behaviour in a complex world. Ergonomics 33 (1990) 1265-1279
6. Fuster J.M. The prefrontal cortex: Anatomy, physiology, and neuropsychology of the frontal lobe. 3rd ed. (1997), Lippincott-Raven, Philadelphia
7. Hadland K.A., Rushworth M.F., Gaffan D., and Passingham R.E. The anterior cingulate and reward-guided selection of actions. Journal of Neurophysiology 89 (2003) 1161-1164
8. Heath C., Larrick R.P., and Wu G. Goals as reference points. Cognitive Psychology 38 (1999) 79-109
9. Kahneman D., and Tversky A. Prospect theory: An analysis of decision under risk. Econometrica 47 (1979) 263-291
10. Kimura M., Matsumoto N., Okahashi K., Ueda Y., Satoh T., Minamimoto T., et al. Goal-directed, serial and synchronous activation of neurons in the primate striatum. Neuroreport 14 (2003) 799-802
11. Lauwereyns J., Watanabe K., Coe B., and Hikosaka O. A neural correlate of response bias in monkey caudate nucleus. Nature 418 (2002) 413-417
12. Locke E.A., and Latham G.P. A theory of goal setting & task performance (1990), Prentice Hall, Englewood Cliffs, NJ
13. Matsumoto K., Suzuki W., and Tanaka K. Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science 301 (2003) 229-232
14. Montague P.R., Hyman S.E., and Cohen J.D. Computational roles for dopamine in behavioural control. Nature 431 (2004) 760-767
15. Mushiake H., Saito N., Furusawa Y., Izumiyama M., Sakamoto K., Shamoto H., et al. Orderly activations of human cortical areas during path-planning task. Neuroreport 13 (2002) 423-426
16. Ostlund S.B., and Balleine B.W. Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. Journal of Neuroscience 25 (2005) 7763-7770
17. Russell S.J., and Norvig P. Artificial intelligence: A modern approach. 2nd ed. (2003), Prentice Hall, Pearson Education, Upper Saddle River, NJ
18. Saito N., Mushiake H., Sakamoto K., Itoyama Y., and Tanji J. Representation of immediate and final behavioral goals in the monkey prefrontal cortex during an instructed delay period. Cerebral Cortex 15 (2005) 1535-1546
19. Samejima K., Ueda Y., Doya K., and Kimura M. Representation of action-specific reward values in the striatum. Science 310 (2005) 1337-1340
20. Schultz W. Behavioral theories and the neurophysiology of reward. Annual Review of Psychology 57 (2006) 87-115
21. Shimo Y., and Hikosaka O. Role of tonically active neurons in primate caudate in reward-oriented saccadic eye movement. Journal of Neuroscience 21 (2001) 7804-7814
22. Tremblay L., Hollerman J.R., and Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate striatum. Journal of Neurophysiology 80 (1998) 964-977
23. Vogt B.A., Vogt L.J., Nimchinsky E.A., and Hof P.R. Primate cingulate cortex chemoarchitecture and its disruption in Alzheimer's disease. In: Bloom F.E., Bjèorklund A., and Hèokfelt T. (Eds). Handbook of chemical neuroanatomy, vol. 13: The primate nervous system, part I (1997), Elsevier, Amsterdam, New York 455-528
24. Wise S.P., Murray E.A., and Gerfen C.R. The frontal cortex-basal ganglia system in primates. Critical Reviews in Neurobiology 10 (1996) 317-356