메뉴 건너뛰기




Volumn 28, Issue 1, 2016, Pages 140-157

Prefrontal goal codes emerge as latent states in probabilistic value learning

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ANIMAL MODEL; ARTICLE; COGNITION; COMPUTER MODEL; CONTROLLED STUDY; GOAL ATTAINMENT; HAPLORHINI; LATENT PERIOD; LEARNING; NERVE CELL; NONHUMAN; PREFRONTAL CORTEX; PRIORITY JOURNAL; PROBABILISTIC VALUE LEARNING; REWARD; ANIMAL; BIOLOGICAL MODEL; COMPUTER SIMULATION; MALE; MOTIVATION; PERCEPTIVE DISCRIMINATION; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOMETRY; VISION;

EID: 84948770548     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn_a_00886     Document Type: Article
Times cited : (35)

References (59)
  • 1
    • 0000705894 scopus 로고
    • The adaptive nature of human categorization
    • Anderson, J. R. (1991). The adaptive nature of human categorization. Psychological Review, 98, 409–429.
    • (1991) Psychological Review , vol.98 , pp. 409-429
    • Anderson, J.R.1
  • 2
    • 70350566799 scopus 로고    scopus 로고
    • Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective
    • Botvinick, M. M., Niv, Y., & Barto, A. C. (2009). Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective. Cognition, 113, 262–280.
    • (2009) Cognition , vol.113 , pp. 262-280
    • Botvinick, M.M.1    Niv, Y.2    Barto, A.C.3
  • 3
    • 84872566721 scopus 로고    scopus 로고
    • Whatever next? Predictive brains, situated agents, and the future of cognitive science
    • Clark, A. (2013). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behavioral and Brain Sciences, 36, 181–204.
    • (2013) Behavioral and Brain Sciences , vol.36 , pp. 181-204
    • Clark, A.1
  • 4
    • 84881089217 scopus 로고    scopus 로고
    • Cognitive control over learning: Creating, clustering, and generalizing task-set structure
    • Collins, A. G. E., & Frank, M. J. (2013). Cognitive control over learning: Creating, clustering, and generalizing task-set structure. Psychological Review, 120, 190–229.
    • (2013) Psychological Review , vol.120 , pp. 190-229
    • Collins, A.G.E.1    Frank, M.J.2
  • 5
    • 84858980829 scopus 로고    scopus 로고
    • Reasoning, learning, and creativity: Frontal lobe function and human decision-making
    • Collins, A. G. E., & Koechlin, E. (2012). Reasoning, learning, and creativity: Frontal lobe function and human decision-making. PLoS Biology, 10, e1001293.
    • (2012) Plos Biology , vol.10
    • Collins, A.G.E.1    Koechlin, E.2
  • 6
    • 67349170462 scopus 로고    scopus 로고
    • Goal-directed control and its antipodes
    • Dayan, P. (2009). Goal-directed control and its antipodes. Neural Networks, 22, 213–219.
    • (2009) Neural Networks , vol.22 , pp. 213-219
    • Dayan, P.1
  • 7
    • 0037384717 scopus 로고    scopus 로고
    • The neural basis of the Weber-Fechner law: A logarithmic mental number line
    • Dehaene, S. (2003). The neural basis of the Weber-Fechner law: A logarithmic mental number line. Trends in Cognitive Sciences, 7, 145–147.
    • (2003) Trends in Cognitive Sciences , vol.7 , pp. 145-147
    • Dehaene, S.1
  • 8
    • 84885802926 scopus 로고    scopus 로고
    • Goals and habits in the brain
    • Dolan, R. J., & Dayan, P. (2013). Goals and habits in the brain. Neuron, 80, 312–325.
    • (2013) Neuron , vol.80 , pp. 312-325
    • Dolan, R.J.1    Dayan, P.2
  • 9
    • 84903295903 scopus 로고    scopus 로고
    • Foundations of human reasoning in the prefrontal cortex
    • Donoso, M., Collins, A. G. E., & Koechlin, E. (2014). Foundations of human reasoning in the prefrontal cortex. Science, 344, 1481–1486.
    • (2014) Science , vol.344 , pp. 1481-1486
    • Donoso, M.1    Collins, A.G.E.2    Koechlin, E.3
  • 10
    • 0033213819 scopus 로고    scopus 로고
    • What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?
    • Doya, K. (1999). What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? Neural Networks, 12, 961–974.
    • (1999) Neural Networks , vol.12 , pp. 961-974
    • Doya, K.1
  • 12
    • 0035511995 scopus 로고    scopus 로고
    • An adaptive coding model of neural function in prefrontal cortex
    • Duncan, J. (2001). An adaptive coding model of neural function in prefrontal cortex. Nature Reviews Neuroscience, 2, 820–829.
    • (2001) Nature Reviews Neuroscience , vol.2 , pp. 820-829
    • Duncan, J.1
  • 13
    • 79960438530 scopus 로고    scopus 로고
    • Predicting sights from sounds: 6-montholds’ intermodal numerical abilities
    • Feigenson, L. (2011). Predicting sights from sounds: 6-montholds’ intermodal numerical abilities. Journal of Experimental Child Psychology, 110, 347–361.
    • (2011) Journal of Experimental Child Psychology , vol.110 , pp. 347-361
    • Feigenson, L.1
  • 14
    • 84857211334 scopus 로고    scopus 로고
    • Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: Computational analysis
    • Frank, M. J., & Badre, D. (2012). Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: Computational analysis. Cerebral Cortex, 22, 509–526.
    • (2012) Cerebral Cortex , vol.22 , pp. 509-526
    • Frank, M.J.1    Badre, D.2
  • 15
    • 0035846981 scopus 로고    scopus 로고
    • Categorical representation of visual stimuli in the primate prefrontal cortex
    • Freedman, D. J., Riesenhuber, M., Poggio, T., & Miller, E. K. (2001). Categorical representation of visual stimuli in the primate prefrontal cortex. Science, 291, 312–316.
    • (2001) Science , vol.291 , pp. 312-316
    • Freedman, D.J.1    Riesenhuber, M.2    Poggio, T.3    Miller, E.K.4
  • 16
    • 57149113922 scopus 로고    scopus 로고
    • Hierarchical models in the brain
    • Friston, K. (2008). Hierarchical models in the brain. PLoS Computational Biology, 4, e1000211.
    • (2008) Plos Computational Biology , vol.4
    • Friston, K.1
  • 17
    • 75549090229 scopus 로고    scopus 로고
    • The free-energy principle: A unified brain theory?
    • Friston, K. (2010). The free-energy principle: A unified brain theory? Nature Reviews Neuroscience, 11, 127–138.
    • (2010) Nature Reviews Neuroscience , vol.11 , pp. 127-138
    • Friston, K.1
  • 20
    • 33746196550 scopus 로고    scopus 로고
    • Representation of future and previous spatial goals by separate neural populations in prefrontal cortex
    • Genovesio, A., Brasted, P. J., & Wise, S. P. (2006). Representation of future and previous spatial goals by separate neural populations in prefrontal cortex. Journal of Neuroscience, 26, 7305–7316.
    • (2006) Journal of Neuroscience , vol.26 , pp. 7305-7316
    • Genovesio, A.1    Brasted, P.J.2    Wise, S.P.3
  • 21
    • 84893046611 scopus 로고    scopus 로고
    • Autonomous encoding of irrelevant goals and outcomes by prefrontal cortex neurons
    • Genovesio, A., Tsujimoto, S., Navarra, G., Falcone, R., & Wise, S. P. (2014). Autonomous encoding of irrelevant goals and outcomes by prefrontal cortex neurons. Journal of Neuroscience, 34, 1970–1978.
    • (2014) Journal of Neuroscience , vol.34 , pp. 1970-1978
    • Genovesio, A.1    Tsujimoto, S.2    Navarra, G.3    Falcone, R.4    Wise, S.P.5
  • 22
    • 84861444112 scopus 로고    scopus 로고
    • Encoding goals but not abstract magnitude in the primate prefrontal cortex
    • Genovesio, A., Tsujimoto, S., & Wise, S. P. (2012). Encoding goals but not abstract magnitude in the primate prefrontal cortex. Neuron, 74, 656–662.
    • (2012) Neuron , vol.74 , pp. 656-662
    • Genovesio, A.1    Tsujimoto, S.2    Wise, S.P.3
  • 24
    • 84874126433 scopus 로고    scopus 로고
    • Bayesian non-parametrics and the probabilistic approach to modelling. Philosophical Transactions of the Royal Society of London, Series A, Mathematical
    • Ghahramani, Z. (2013). Bayesian non-parametrics and the probabilistic approach to modelling. Philosophical Transactions of the Royal Society of London, Series A, Mathematical, Physical and Engineering Sciences, 371, 20110553.
    • (2013) Physical and Engineering Sciences , vol.371 , pp. 20110553
    • Ghahramani, Z.1
  • 25
    • 0344787262 scopus 로고
    • Scalar expectancy theory and Weber’s law in animal timing
    • Gibbon, J. (1977). Scalar expectancy theory and Weber’s law in animal timing. Psychological Review, 84, 279–325.
    • (1977) Psychological Review , vol.84 , pp. 279-325
    • Gibbon, J.1
  • 26
    • 84865761157 scopus 로고    scopus 로고
    • A novel test to determine the significance of neural selectivity to single and multiple potentially correlated stimulus features
    • Ince, R. A. A., Mazzoni, A., Bartels, A., Logothetis, N. K., & Panzeri, S. (2012). A novel test to determine the significance of neural selectivity to single and multiple potentially correlated stimulus features. Journal of Neuroscience Methods, 210, 49–65.
    • (2012) Journal of Neuroscience Methods , vol.210 , pp. 49-65
    • Ince, R.A.A.1    Mazzoni, A.2    Bartels, A.3    Logothetis, N.K.4    Panzeri, S.5
  • 27
    • 35548944543 scopus 로고    scopus 로고
    • Anterior prefrontal function and the limits of human decision-making
    • Koechlin, E., & Hyafil, A. (2007). Anterior prefrontal function and the limits of human decision-making. Science, 318, 594–598.
    • (2007) Science , vol.318 , pp. 594-598
    • Koechlin, E.1    Hyafil, A.2
  • 28
    • 0242497620 scopus 로고    scopus 로고
    • The architecture of cognitive control in the human prefrontal cortex
    • Koechlin, E., Ody, C., & Kouneiher, F. (2003). The architecture of cognitive control in the human prefrontal cortex. Science, 302, 1181–1185.
    • (2003) Science , vol.302 , pp. 1181-1185
    • Koechlin, E.1    Ody, C.2    Kouneiher, F.3
  • 29
    • 34249278114 scopus 로고    scopus 로고
    • An information theoretical approach to prefrontal executive function
    • Koechlin, E., & Summerfield, C. (2007). An information theoretical approach to prefrontal executive function. Trends in Cognitive Sciences, 11, 229–235.
    • (2007) Trends in Cognitive Sciences , vol.11 , pp. 229-235
    • Koechlin, E.1    Summerfield, C.2
  • 30
    • 84908345348 scopus 로고    scopus 로고
    • Ensembles of spiking neurons with noise support optimal probabilistic inference in a dynamically changing environment
    • Legenstein, R., & Maass, W. (2014). Ensembles of spiking neurons with noise support optimal probabilistic inference in a dynamically changing environment. PLoS Computational Biology, 10, e1003859.
    • (2014) Plos Computational Biology , vol.10
    • Legenstein, R.1    Maass, W.2
  • 31
    • 84928980578 scopus 로고    scopus 로고
    • Embodied choice: How action influences perceptual decision making
    • Lepora, N., & Pezzulo, G. (2015). Embodied choice: How action influences perceptual decision making. PLoS Computational Biology, 11, e1004110.
    • (2015) Plos Computational Biology , vol.11
    • Lepora, N.1    Pezzulo, G.2
  • 32
    • 0034928713 scopus 로고    scopus 로고
    • An integrative theory of prefrontal cortex function
    • Miller, E. K., & Cohen, J. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167–202.
    • (2001) Annual Review of Neuroscience , vol.24 , pp. 167-202
    • Miller, E.K.1    Cohen, J.2
  • 35
    • 33644927837 scopus 로고    scopus 로고
    • Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia
    • O’Reilly, R. C., & Frank, M. J. (2006). Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia. Neural Computation, 18, 283–328.
    • (2006) Neural Computation , vol.18 , pp. 283-328
    • O’Reilly, R.C.1    Frank, M.J.2
  • 36
    • 34548790687 scopus 로고    scopus 로고
    • Correcting for the sampling bias problem in spike train information measures
    • Panzeri, S., Senatore, R., Montemurro, M. A., & Petersen, R. S. (2007). Correcting for the sampling bias problem in spike train information measures. Journal of Neurophysiology, 98, 1064–1072.
    • (2007) Journal of Neurophysiology , vol.98 , pp. 1064-1072
    • Panzeri, S.1    Senatore, R.2    Montemurro, M.A.3    Petersen, R.S.4
  • 38
    • 84870867705 scopus 로고    scopus 로고
    • An active inference view of cognitive control
    • Pezzulo, G. (2012). An active inference view of cognitive control. Frontiers in Psychology, 3, 478.
    • (2012) Frontiers in Psychology , vol.3 , pp. 478
    • Pezzulo, G.1
  • 39
    • 67449113542 scopus 로고    scopus 로고
    • Thinking as the control of imagination: A conceptual framework for goal-directed systems
    • Pezzulo, G., & Castelfranchi, C. (2009). Thinking as the control of imagination: A conceptual framework for goal-directed systems. Psychological Research, 73, 559–577.
    • (2009) Psychological Research , vol.73 , pp. 559-577
    • Pezzulo, G.1    Castelfranchi, C.2
  • 40
    • 84878783112 scopus 로고    scopus 로고
    • Themixed instrumental controller: Using value of information to combine habitual choice and mental simulation
    • Pezzulo, G., Rigoli, F., & Chersi, F. (2013). Themixed instrumental controller: Using value of information to combine habitual choice and mental simulation. Frontiers in Psychology, 4, 92.
    • (2013) Frontiers in Psychology , vol.4 , pp. 92
    • Pezzulo, G.1    Rigoli, F.2    Chersi, F.3
  • 41
    • 84946080033 scopus 로고    scopus 로고
    • Active inference, homeostatic regulation and adaptive behavioural control. Progress in Neurobiology
    • Pezzulo, G., Rigoli, F., & Friston, K. (2015). Active inference, homeostatic regulation and adaptive behavioural control. Progress in Neurobiology. doi:10.1016/j.pneurobio.2015.09.001.
    • (2015)
    • Pezzulo, G.1    Rigoli, F.2    Friston, K.3
  • 43
    • 84907494705 scopus 로고    scopus 로고
    • The principles of goal-directed decision-making: From neural mechanisms to computation and robotics. Philosophical Transactions of the Royal Society of London, Series B
    • Pezzulo, G., Verschure, P. F. M. J., Balkenius, C., & Pennartz, C. M. (2014). The principles of goal-directed decision-making: From neural mechanisms to computation and robotics. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 369, 20130470.
    • (2014) Biological Sciences , vol.369 , pp. 20130470
    • Pezzulo, G.1    Verschure, P.F.M.J.2    Balkenius, C.3    Pennartz, C.M.4
  • 44
    • 5644298608 scopus 로고    scopus 로고
    • Exact and approximate arithmetic in an Amazonian indigene group
    • Pica, P., Lemer, C., Izard, V., & Dehaene, S. (2004). Exact and approximate arithmetic in an Amazonian indigene group. Science, 306, 499–503.
    • (2004) Science , vol.306 , pp. 499-503
    • Pica, P.1    Lemer, C.2    Izard, V.3    Dehaene, S.4
  • 46
    • 84861562734 scopus 로고    scopus 로고
    • Compositionality of rule representations in human prefrontal cortex
    • Reverberi, C., Görgen, K., & Haynes, J.-D. (2012). Compositionality of rule representations in human prefrontal cortex. Cerebral Cortex, 22, 1237–1246.
    • (2012) Cerebral Cortex , vol.22 , pp. 1237-1246
    • Reverberi, C.1    Görgen, K.2    Haynes, J.-D.3
  • 47
    • 84878390558 scopus 로고    scopus 로고
    • The importance of mixed selectivity in complex cognitive tasks
    • Rigotti, M., Barak, O., Warden, M. R., Wang, X.-J., Daw, N. D., Miller, E. K., et al. (2013). The importance of mixed selectivity in complex cognitive tasks. Nature, 497, 585–590.
    • (2013) Nature , vol.497 , pp. 585-590
    • Rigotti, M.1    Barak, O.2    Warden, M.R.3    Wang, X.-J.4    Daw, N.D.5    Miller, E.K.6
  • 48
    • 78249247078 scopus 로고    scopus 로고
    • Rational approximations to rational models: Alternative algorithms for category learning
    • Sanborn, A. N., Griffiths, T. L., & Navarro, D. (2010). Rational approximations to rational models: Alternative algorithms for category learning. Psychological Review, 117, 1144–1167.
    • (2010) Psychological Review , vol.117 , pp. 1144-1167
    • Sanborn, A.N.1    Griffiths, T.L.2    Navarro, D.3
  • 50
    • 33846273788 scopus 로고    scopus 로고
    • Categorization of behavioural sequences in the prefrontal cortex
    • Shima, K., Isoda, M., Mushiake, H., &Tanji, J. (2007). Categorization of behavioural sequences in the prefrontal cortex. Nature, 445, 315–318.
    • (2007) Nature , vol.445 , pp. 315-318
    • Shima, K.1    Isoda, M.2    Mushiake, H.3    Tanji, J.4
  • 51
    • 84859737036 scopus 로고    scopus 로고
    • Goal-directed decision making as probabilistic inference: A computational framework and potential neural correlates
    • Solway, A., & Botvinick, M. M. (2012). Goal-directed decision making as probabilistic inference: A computational framework and potential neural correlates. Psychological Review, 119, 120–154.
    • (2012) Psychological Review , vol.119 , pp. 120-154
    • Solway, A.1    Botvinick, M.M.2
  • 52
    • 84856250502 scopus 로고    scopus 로고
    • Emergence of a “visual number sense” in hierarchical generative models
    • Stoianov, I., & Zorzi, M. (2012). Emergence of a “visual number sense” in hierarchical generative models. Nature Neuroscience, 15, 194–196.
    • (2012) Nature Neuroscience , vol.15 , pp. 194-196
    • Stoianov, I.1    Zorzi, M.2
  • 53
  • 55
    • 35448993329 scopus 로고    scopus 로고
    • Neuronal population coding of continuous and discrete quantity in the primate posterior parietal cortex
    • Tudusciuc, O., & Nieder, A. (2007). Neuronal population coding of continuous and discrete quantity in the primate posterior parietal cortex. Proceedings of the National Academy of Sciences, U.S.A., 104, 14513–14518.
    • (2007) Proceedings of the National Academy of Sciences, U.S.A. , vol.104 , pp. 14513-14518
    • Tudusciuc, O.1    Nieder, A.2
  • 56
    • 84907494746 scopus 로고    scopus 로고
    • The why, what, where, when and how of goal-directed choice: Neuronal and computational principles. Philosophical Transactions of the Royal Society of London, Series B
    • Verschure, P., Pennartz, C. M. A., & Pezzulo, G. (2014). The why, what, where, when and how of goal-directed choice: Neuronal and computational principles. Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences, 369, 20130483.
    • (2014) Biological Sciences , vol.369 , pp. 20130483
    • Verschure, P.1    Pennartz, C.M.A.2    Pezzulo, G.3
  • 57
    • 0242618983 scopus 로고    scopus 로고
    • Nonverbal counting in humans: The psychophysics of number representation
    • Whalen, J., Gallistel, C. R., & Gelman, R. (1999). Nonverbal counting in humans: The psychophysics of number representation. Psychological Science, 10, 130–137.
    • (1999) Psychological Science , vol.10 , pp. 130-137
    • Whalen, J.1    Gallistel, C.R.2    Gelman, R.3
  • 58
    • 84892714870 scopus 로고    scopus 로고
    • Orbitofrontal cortex as a cognitive map of task space
    • Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014). Orbitofrontal cortex as a cognitive map of task space. Neuron, 81, 267–279.
    • (2014) Neuron , vol.81 , pp. 267-279
    • Wilson, R.C.1    Takahashi, Y.K.2    Schoenbaum, G.3    Niv, Y.4
  • 59
    • 84866262547 scopus 로고    scopus 로고
    • Distinct information representation and processing for goal-directed behavior in the dorsolateral and ventrolateral prefrontal cortex and the dorsal premotor cortex
    • Yamagata, T., Nakayama, Y., Tanji, J., & Hoshi, E. (2012). Distinct information representation and processing for goal-directed behavior in the dorsolateral and ventrolateral prefrontal cortex and the dorsal premotor cortex. Journal of Neuroscience, 32, 12934–12949.
    • (2012) Journal of Neuroscience , vol.32 , pp. 12934-12949
    • Yamagata, T.1    Nakayama, Y.2    Tanji, J.3    Hoshi, E.4


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.