Learning to learn about uncertain feedback

Learning and Memory

Volumn 23, Issue 2, 2016, Pages 90-98

  Faraut, Maïlys C M ^a   Procyk, Emmanuel ^b   Wilson, Charles R E ^a  

^a STEM CELL AND BRAIN RESEARCH INSTITUTE   (France)

^b UNIVERSITÉ DE LYON   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTATION; ANIMAL EXPERIMENT; ARTICLE; ASSOCIATION; CONTROLLED STUDY; FEEDBACK SYSTEM; FEMALE; LEARNING; LEARNING TO LEARN; MALE; NONHUMAN; PRIORITY JOURNAL; RHESUS MONKEY; STIMULUS RESPONSE; UNEXPECTED FEEDBACK; ANIMAL; DECISION MAKING; PROBLEM SOLVING; PSYCHOLOGICAL FEEDBACK; UNCERTAINTY;

ANIMALS; CHOICE BEHAVIOR; FEEDBACK, PSYCHOLOGICAL; FEMALE; MACACA MULATTA; MALE; PROBLEM SOLVING; SERIAL LEARNING; UNCERTAINTY;

EID: 84958825057     PISSN: 10720502     EISSN: 15495485     Source Type: Journal    
DOI: 10.1101/lm.039768.115     Document Type: Article

References (35)

1. Bavelier D, Green CS, Pouget A, Schrater P. 2012. Brain plasticity through the life span: Learning to learn and action video games. Annu Rev Neurosci 35: 391-416.
2. Behrens TEJ, Woolrich MW, Walton ME, Rushworth MFS. 2007. Learning the value of information in an uncertain world. Nat Neurosci 10: 1214-1221.
3. Biernaskie JM, Walker SC, Gegear RJ. 2009. Bumblebees learn to forage like Bayesians. Am Nat 174: 413-423.
4. Browning PGF, Gaffan D. 2008. Prefrontal cortex function in the representation of temporally complex events. J Neurosci 28: 3934-3940.
5. Browning PGF, Easton A, Gaffan D. 2007. Frontal-temporal disconnection abolishes object discrimination learning set in macaque monkeys. Cereb Cortex 17: 859-864.
6. Collins AGE, Frank MJ. 2013. Cognitive control over learning: Creating, clustering, and generalizing task-set structure. Psychol Rev 120: 190-229.
7. Collins AGE, Koechlin E. 2012. Reasoning, learning, and creativity: Frontal lobe function and human decision-making. PLoS Biol 10: e1001293.
8. Costa VD, Tran VL, Turchi J, Averbeck BB. 2014. Dopamine modulates novelty seeking behavior during decision making. Behav Neurosci 128: 556-566.
9. Courville AC, Daw ND, Touretzky DS. 2006. Probabilistic models of cognition: Conceptual foundations. Trends Cogn Sci 10: 294-300.
10. Donoso M, Collins AGE, Koechlin E. 2014. Human cognition. Foundations of human reasoning in the prefrontal cortex. Science 344: 1481-1486.
11. Fuster JM. 2008. The prefrontal cortex. Academic, London.
12. Gallistel CR, Mark TA, King AP, Latham PE. 2001. The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect. J Exp Psychol Anim Behav Process 27: 354-372.
13. Gershman SJ, Blei DM, Niv Y. 2010. Context, learning, and extinction. Psychol Rev 117: 197-209.
14. Harlow HF. 1949. The formation of learning sets. Psychol Rev 56: 51-65.
15. Hertwig R, Barron G, Weber EU, Erev I. 2004. Decisions from experience and the effect of rare events in risky choice. Psychol Sci 15: 534-539.
16. Izquierdo A, Suda RK, Murray EA. 2004. Bilateral orbital prefrontal cortex lesions in rhesus monkeys disrupt choices guided by both reward value and reward contingency. J Neurosci 24: 7540-7548.
17. Kennerley SW, Walton ME, Behrens TE, Buckley MJ, Rushworth MF. 2006. Optimal decision making and the anterior cingulate cortex. Nat Neurosci 9: 940-947.
18. Kornell N, Son LK, Terrace HS. 2007. Transfer of metacognitive skills and hint seeking in monkeys. Psychol Sci 18: 64-71.
19. McGuire JT, Nassar MR, Gold JI, Kable JW. 2014. Functionally dissociable influences on learning rate in a dynamic environment. Neuron 84: 870-881.
20. McNamara JM, Houston AI. 1985. Optimal foraging and learning. J Theor Biol 117: 231-249.
21. Miller BL, Cummings JL. 2007. The human frontal lobes: functions and disorders, 2nd ed. Guilford Press, New York.
22. Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G, et al. 2015. Human-level control through deep reinforcement learning. Nature 518: 529-533.
23. Murray EA, Gaffan D. 2006. Prospective memory in the formation of learning sets by rhesus monkeys (Macaca mulatta). J Exp Psychol Anim Behav Process 32: 87-90.
24. Ollason JG. 1980. Learning to forage-optimally? Theor Popul Biol 18: 44-56.
25. Payzan-LeNestour E, Bossaerts P. 2011. Risk, unexpected uncertainty, and estimation uncertainty: Bayesian learning in unstable settings. PLoS Comput Biol 7: e1001048.
26. Pleskac TJ. 2008. Decision making and learning while taking sequential risks. J Exp Psychol Learn Mem Cogn 34: 167-185.
27. Quilodran R, Rothe M, Procyk E. 2008. Behavioral shifts and action valuation in the anterior cingulate cortex. Neuron 57: 314-325.
28. Rudebeck PH, Behrens TE, Kennerley SW, Baxter MG, Buckley MJ, Walton ME, Rushworth MFS. 2008. Frontal cortex subregions play distinct roles in choices between actions and stimuli. J Neurosci 28: 13775-13785.
29. Schrier AM. 1966. Transfer by macaque monkeys between learning-set and repeated-reversal tasks. Percept Mot Skills 23: 787-792.
30. Stuss DT, Alexander MP. 2007. Is there a dysexecutive syndrome? Philos Trans R Soc Lond B Biol Sci 362: 901-915.
31. Tebbich S, Teschke I. 2014. Coping with uncertainty: woodpecker finches (Cactospiza pallida) from an unpredictable habitat are more flexible than birds from a stable habitat ed. G. Sorci. PLoS One 9: e91718.
32. Walton ME, Behrens TEJ, Buckley MJ, Rudebeck PH, Rushworth MFS. 2010. Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65: 927-939.
33. Wilson CRE, Gaffan D. 2008. Prefrontal-inferotemporal interaction is not always necessary for reversal learning. J Neurosci 28: 5529-5538.
34. Wilson CRE, Gaffan D, Browning PG, Baxter MG. 2010. Functional localization within the prefrontal cortex: missing the forest for the trees? Trends Neurosci 33: 533-540.
35. Zuur A, Ieno EN, Walker N, Saveliev AA, Smith GM. 2009. Mixed effects models and extensions in ecology with R. Springer, New York.