Neural Computations Mediating One-Shot Learning in the Human Brain

PLoS Biology

Volumn 13, Issue 4, 2015, Pages

  Lee, Sang Wan ^a   O’Doherty, John P ^a   Shimojo, Shinsuke ^a,b  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b California Institute of Technology   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BAYES THEOREM; BAYESIAN LEARNING; CALCULATION; CONTROLLED STUDY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HIPPOCAMPUS; HUMAN; HUMAN EXPERIMENT; INHIBITION (PSYCHOLOGY); LATENT PERIOD; LEARNING; LEARNING ALGORITHM; MALE; MATHEMATICAL COMPUTING; MENTAL TASK; NEUROMODULATION; PHASE TRANSITION; PREDICTION; PROBABILITY; SIMULATION; TASK PERFORMANCE; VALIDATION PROCESS; VENTROLATERAL PREFRONTAL CORTEX; BRAIN; PHYSIOLOGY; YOUNG ADULT;

ADULT; BRAIN; FEMALE; HUMANS; LEARNING; MALE; YOUNG ADULT;

EID: 84929492304     PISSN: 15449173     EISSN: 15457885     Source Type: Journal    
DOI: 10.1371/journal.pbio.1002137     Document Type: Article

References (79)

1. Li F-F, Rob F, Perona P, (2006) One-shot learning of object categories. IEEE Trans Pattern Anal Mach Intell 28: 594–611. 16566508
2. Garety P, Freeman D, Jolley S, Ross K, Waller H, et al. (2011) Jumping to conclusions: the psychology of delusional reasoning. Adv Psychiatr Treat 17: 332–339.
3. Moore SC, Sellen JL, (2006) Jumping to conclusions: a network model predicts schizophrenic patients’ performance on a probabilistic reasoning task. Cogn Affect Behav Neurosci 6: 261–269. 17458441
4. Moutoussis M, Bentall RP, El-Deredy W, Dayan P, (2011) Bayesian modelling of Jumping-to- Conclusions bias in delusional patients. Cogn Neuropsychiatry 16: 422–447. doi: 10.1080/13546805.2010.548678 21480015
5. Schippers MC, Lange PAM Van, (2006) The Psychological Benefits of Superstitious Rituals in Top Sport: A Study Among Top Sportspersons. J Appl Soc Psychol 36: 2532–2553.
6. Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. Class Cond II: 64–99.
7. Jenkins HM, Ward WC, (1965) Judgement of contingency between responses and outcomes. Psychol Monogr Gen Appl 79: 1–17.
8. Pearce JM, Hall G, (1980) A model for Pavlovian learning: Variation in the effectiveness of conditioned but not unconditioned stimuli. Psychol Rev 87: 532–552. 7443916
9. McLaren IPL, Mackintosh NJ, (2000) An elemental model of associative learning: I. Latent inhibition and perceptual learning. Anim Learn Behav 28: 211–246.
10. Griffiths TL, Tenenbaum JB, (2009) Theory-based causal induction. Psychol Rev 116: 661–716. doi: 10.1037/a0017201 19839681
11. Holyoak KJ, Lee HS, Lu H, (2010) Analogical and category-based inference: a theoretical integration with Bayesian causal models. J Exp Psychol Gen 139: 702–727. doi: 10.1037/a0020488 21038985
12. Carroll CD, Cheng PW, Lu H (2011) Uncertainty and dependency in causal inference. Proceedings of the 33 rd Annual Conference of the Cognitive Science Society. Boston, MA: Cognitive Science Society. pp. 1418–1423.
13. Behrens TEJ, Woolrich MW, Walton ME, Rushworth MFS, (2007) Learning the value of information in an uncertain world. Nat Neurosci 10: 1214–1221. 17676057
14. Payzan-LeNestour E, Bossaerts P, (2011) Risk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings. PLoS Comput Biol 7: e1001048. doi: 10.1371/journal.pcbi.1001048 21283774
15. Lengyel M, Dayan P (2007) Hippocampal Contributions to Control: The Third Way. Neural Information Processing Systems (NIPS). http://papers.nips.cc/paper/3311-hippocampal-contributions-to-control-the-third-way.pdf. Accessed 24 March 2015.
16. Polyn SM, Norman KA, Kahana MJ, (2009) A context maintenance and retrieval model of organizational processes in free recall. Psychol Rev 116: 129–156. doi: 10.1037/a0014420 19159151
17. Eichenbaum H, Yonelinas AP, Ranganath C, (2007) The medial temporal lobe and recognition memory. Annu Rev Neurosci 30: 123–152. 17417939
18. Gaffan D, (1994) Scene-specific memory for objects: a model of episodic memory impairment in monkeys with fornix transection. J Cogn Neurosci 6: 305–320. doi: 10.1162/jocn.1994.6.4.305 23961727
19. Buckley MJ, Charles DP, Browning PGF, Gaffan D, (2004) Learning and retrieval of concurrently presented spatial discrimination tasks: role of the fornix. Behav Neurosci 118: 138–149. 14979790
20. Squire LR, Stark CEL, Clark RE, (2004) The medial temporal lobe. Annu Rev Neurosci 27: 279–306. 15217334
21. Kapur S, Craik FIM, Tulving E, Houle S, (1997) Role of the prefrontal cortex in human episodic memory: Lessons from PET studies. Biol Psychiatry 42: 75S–76S.
22. Lepage M, Ghaffar O, Nyberg L, Tulving E, (2000) Prefrontal cortex and episodic memory retrieval mode. Proc Natl Acad Sci 97: 506–511. 10618448
23. Eichenbaum H, (2000) A cortical-hippocampal system for declarative memory. Nat Rev Neurosci 1: 41–50. 11252767
24. Tulving E, Markowitsch HJ, (1998) Episodic and declarative memory: role of the hippocampus. Hippocampus 8: 198–204. 9662134
25. Fahy FL, Riches IP, Brown MW, (1993) Neuronal activity related to visual recognition memory: long-term memory and the encoding of recency and familiarity information in the primate anterior and medial inferior temporal and rhinal cortex. Exp brain Res 96: 457–472. 8299747
26. Kumaran D, Summerfield JJ, Hassabis D, ME A., (2009) Tracking the emergence of conceptual knowledge during human decision making. Neuron 63: 889–901. doi: 10.1016/j.neuron.2009.07.030 19778516
27. Li L, Miller EK, Desimone R, (1993) The representation of stimulus familiarity in anterior inferior temporal cortex. J Neurophysiol 69: 1918–1929. 8350131
28. Packard M, McGaugh J, (1992) Double dissociation of fornix and caudate nucleus lesions on acquisition of two water maze tasks: further evidence for multiple memory systems. Behav Neurosci 106: 439–446. 1616610
29. Anderson JR, Byrne D, Fincham JM, Gunn P, (2008) Role of prefrontal and parietal cortices in associative learning. Cereb Cortex 18: 904–914. 17675369
30. McClelland JL, McNaughton BL, O’Reilly RC, (1995) Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychol Rev 102: 419–457. 7624455
31. Poldrack RA, Clark J, Pare-Blagoev EJ, Shohamy D, Creso Moyano J, et al. (2001) Interactive memory systems in the human brain. Nature 414: 546–550. 11734855
32. Atallah HE, Frank MJ, O’Reilly RC, (2004) Hippocampus, cortex and basal ganglia: Insights from computational models of complementary learning systems. Neurobiol Learn Mem 82: 253–267. 15464408
33. Nyberg L, Persson J, Habib R, Tulving E, McIntosh AR, et al. (2000) Large scale neurocognitive networks underlying episodic memory. J Cogn Neurosci 12: 163–173. 10769313
34. Badre D, Wagner AD, (2002) Semantic retrieval, mnemonic control, and prefrontal cortex. Behav Cogn Neurosci Rev 1: 206–218. 17715593
35. Badre D, Poldrack RA, Paré-Blagoev EJ, Insler RZ, Wagner AD, (2005) Dissociable controlled retrieval and generalized selection mechanisms in ventrolateral prefrontal cortex. Neuron 47: 907–918. 16157284
36. Bunge SA, Burrows B, Wagner AD, (2004) Prefrontal and hippocampal contributions to visual associative recognition: interactions between cognitive control and episodic retrieval. Brain Cogn 56: 141–152. 15518931
37. Cho S, Metcalfe AWS, Young CB, Ryali S, Geary DC, et al. (2012) Hippocampal-prefrontal engagement and dynamic causal interactions in the maturation of children’s fact retrieval. J Cogn Neurosci 24: 1849–1866. doi: 10.1162/jocn_a_00246 22621262
38. Levy BJ, Wagner AD, (2011) Cognitive control and right ventrolateral prefrontal cortex: reflexive reorienting, motor inhibition, and action updating. Ann N Y Acad Sci 1224: 40–62. doi: 10.1111/j.1749-6632.2011.05958.x 21486295
39. Wagner AD, Desmond JE, Demb JB, Glover GH, Gabrieli JD, (1997) Semantic repetition priming for verbal and pictorial knowledge: a functional MRI study of left inferior prefrontal cortex. J Cogn Neurosci 9: 714–726. doi: 10.1162/jocn.1997.9.6.714 23964594
40. Simons JS, Spiers HJ, (2003) Prefrontal and Medial Temporal Lobe Interactions in Long-term Memory. Nat Rev Neurosci 4: 637–648. 12894239
41. Menon V, Rabinovich MI, Friston KJ, Varona P, (2012) Functional connectivity, neurocognitive networks and brain dynamics. In: Principles of Brain Dynamics: Global State Interactions. MIT Press.
42. Chun MM, Golomb JD, Turk-Browne NB, (2011) A taxonomy of external and internal attention. Annu Rev Psychol 62: 73–101. doi: 10.1146/annurev.psych.093008.100427 19575619
43. Kuhl BABA, Dudukovic NMNM, Kahn I, Wagner ADAD, (2007) Decreased demands on cognitive control reveal the neural processing benefits of forgetting. Nat Neurosci 10: 908–914. 17558403
44. Nee DE, Jonides J, (2009) Common and distinct neural correlates of perceptual and memorial selection. Neuroimage 45: 963–975. 19280708
45. Turner DC, Aitken MRF, Shanks DR, Sahakian BJ, Robbins TW, et al. (2004) The role of the lateral frontal cortex in causal associative learning: exploring preventative and super-learning. Cereb Cortex 14: 872–880. 15054060
46. Luce RD, (1959) Individual choice behavior: a theoretical analysis. New York: Wiley.
47. Koller D, Friedman N, (2009) Probabilistic Graphical Models—Principles and Techniques. MIT press.
48. Ellis B, Wong WH, (2008) Learning Causal Bayesian Network Structures From Experimental Data. J Am Stat Assoc 103: 778–789.
49. Wagner AD, Schacter DL, Rotte M, Koutstaal W, Maril A, et al. (1998) Building Memories: Remembering and Forgetting of Verbal Experiences as Predicted by Brain Activity. Science (80-) 281: 1188–1191. 9712582
50. Henson RN, Rugg MD, Shallice T, Josephs O, Dolan RJ, (1999) Recollection and familiarity in recognition memory: an event-related functional magnetic resonance imaging study. J Neurosci 19: 3962–3972. 10234026
51. Habib R, McIntosh AR, Wheeler M a, Tulving E, (2003) Memory encoding and hippocampally-based novelty/familiarity discrimination networks. Neuropsychologia 41: 271–279. 12457753
52. O’Kane G, Insler RZ, Wagner AD, (2005) Conceptual and perceptual novelty effects in human medial temporal cortex. Hippocampus 15: 326–332. 15490462
53. Biederman I, Vessel EA, (2006) Perceptual Pleasure and the Brain. Am Sci 94: 247–253.
54. Amunts K, Kedo O, Kindler M, Pieperhoff P, Mohlberg H, et al. (2005) Cytoarchitectonic mapping of the human amygdala, hippocampal region and entorhinal cortex: intersubject variability and probability maps. Anat Embryol (Berl) 210: 343–352. 16208455
55. O’Doherty JP, Dayan P, Schultz J, Deichmann R, Friston K, et al. (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science (80-) 304: 452–454. 15087550
56. Li J, Schiller D, Schoenbaum G, Phelps EA, Daw ND, (2011) Differential roles of human striatum and amygdala in associative learning. Nat Neurosci 14: 1250–1252. doi: 10.1038/nn.2904 21909088
57. Deese Kaufman, (1957) Serial effects in recall of unorganized and sequentially organized verbal material. J Exp Psychol 54: 180–187. 13475644
58. Murdock BB, (1962) The Serial Position Effect of Free Recall. J Exp Psychol 65: 482–488.
59. Clark RE, (1998) Classical Conditioning and Brain Systems: The Role of Awareness. Science (80-) 280: 77–81.
60. Lee SW, Shimojo S, O’Doherty JP, (2014) Neural Computations Underlying Arbitration between Model-Based and Model-free Learning. Neuron 81: 687–699. doi: 10.1016/j.neuron.2013.11.028 24507199
61. Dobbins IG, Han S, (2006) Cue- versus probe-dependent prefrontal cortex activity during contextual remembering. J Cogn Neurosci 18: 1439–1452. 16989546
62. Dobbins IG, Foley H, Schacter DL, Wagner AD, (2002) Executive Control during Episodic Retrieval: Multiple Prefrontal Processes Subserve Source Memory. Neuron 35: 989–996. 12372291
63. Fletcher PC, Henson RN, (2001) Frontal lobes and human memory: insights from functional neuroimaging. Brain 124: 849–881. 11335690
64. Hannula DE, Ranganath C, (2009) The Eyes Have It: Hippocampal Activity Predicts Expression of Memory in Eye Movements. Neuron 63: 592–599. doi: 10.1016/j.neuron.2009.08.025 19755103
65. Purves D, Bonardi C, Hall G, (1995) Enhancement of latent inhibition in rats with electrolytic lesions of the hippocampus. Behav Neurosci 109: 366–370. 7619326
66. Reilly S, Harley C, Revusky S, (1993) Ibotenate lesions of the hippocampus enhance latent inhibition in conditioned taste aversion and increase resistance to extinction in conditioned taste preference. Behav Neurosci 107: 996–1004. 8136075
67. Stone ME, Grimes BS, Katz DB, (2005) Hippocampal inactivation enhances taste learning. Learn Mem 12: 579–586. 16322360
68. Moulding R, Kyrios M, (2006) Anxiety disorders and control related beliefs: The exemplar of Obsessive-Compulsive Disorder (OCD). Clin Psychol Rev 26: 573–583. 16647173
69. Deichmann R, Gottfried JA, Hutton C, Turner R, (2003) Optimized EPI for fMRI studies of the orbitofrontal cortex. Neuroimage 19: 430–441. 12814592
70. Friston KJ, Buechel C, Fink GR, Morris J, Rolls ET, et al. (1997) Psychophysiological and modulatory interactions in neuroimaging. Neuroimage 6: 218–229. 9344826
71. Widrow B, Hoff M (1960) Adaptive Switching Circuits. IRE WESCON Convention Record. pp. 96–104.
72. Miller RR, Barnet RC, Grahame NJ, (1995) Assessment of the Rescorla–Wagner Model. Psychol Bull 117: 363–386. 7777644
73. Cheng PW, (1997) From Covariation to Causation: A Causal Power Theory. Psychol Rev 104: 367–405.
74. Murphy KP (2001) Active Learning of Causal Bayes Net Structure. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.20.8206. Accessed 12 February 2014.
75. Riesenhuber M, Poggio T, (1999) Hierarchical models of object recognition in cortex. Nat Neurosci 2: 1019–1025. 10526343
76. Lagarias JC, Reeds JA, Wright MH, Wright PE, (1998) Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions. SiAM J Optim 9: 112–147.
77. Schapire RE, Freund Y, (2012) Boosting. MIT press.
78. Granger CWJ, (1969) Investigating Causal Relations by Econometric Models and Cross-Spectral Methods. Econometrica 37: 424–438.
79. Dempster AP, Laird NM, Rubin DB, (1977) Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc Series B 39: 1–38.