Temporal structure in associative retrieval

eLife

Volumn 2015, Issue 4, 2015, Pages

  Kurth Nelson, Zeb ^a   Barnes, Gareth ^a   Sejdinovic, Dino ^b   Dolan, Ray ^a   Dayan, Peter ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ASSOCIATIVE MEMORY; DECISION MAKING; EVOKED VISUAL RESPONSE; FEMALE; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; IMAGE PROCESSING; MAGNETOENCEPHALOGRAPHY; OBJECT RELATION; OUTCOME ASSESSMENT; PREDICTION; RESPONSE TIME; SENSORY PRECONDITIONING; SPATIOTEMPORAL ANALYSIS; SUPPORT VECTOR MACHINE; TASK PERFORMANCE; VISUAL ANALOG SCALE; VISUAL DISCRIMINATION; VISUAL STIMULATION; YOUNG ADULT; ADOLESCENT; BEHAVIOR; EVOKED RESPONSE; LEARNING; MALE; MEMORY; MULTIVARIATE ANALYSIS; PHOTOSTIMULATION; PHYSIOLOGY; TIME;

ADOLESCENT; ADULT; ASSOCIATION LEARNING; BEHAVIOR; EVOKED POTENTIALS; FEMALE; HUMANS; MAGNETOENCEPHALOGRAPHY; MALE; MEMORY; MULTIVARIATE ANALYSIS; PHOTIC STIMULATION; TASK PERFORMANCE AND ANALYSIS; TIME FACTORS; YOUNG ADULT;

EID: 84964695586     PISSN: None     EISSN: 2050084X     Source Type: Journal    
DOI: 10.7554/eLife.04919     Document Type: Article

References (97)

1. Bar M. 2003. A cortical mechanism for triggering top-down Facilitation in visual object recognition. Journal of Cognitive Neuroscience 15:600–609. doi: 10.1162/089892903321662976.
2. Bar M. 2004. Visual objects in context. Nature Reviews Neuroscience 5:617–629. doi: 10.1038/nrn1476.
3. Bledowski C, Kadosh KC, Wibral M, Rahm B, Bittner RA, Hoechstetter K, Scherg M, Maurer K, Goebel R, Linden DEJ. 2006. Mental chronometry of working memory retrieval: a combined functional magnetic resonance imaging and event-related potentials approach. The Journal of Neuroscience 26:821–829. doi: 10.1523/JNEUROSCI.3542-05.2006.
4. Bobak P, Bodis-Wollner I, Guillory S. 1987. The effect of blur and contrast of VEP latency: comparison between check and sinusoidal grating patterns. Electroencephalography and Clinical Neurophysiology 68:247–255. doi: 10.1016/0168-5597(87)90045-1.
5. Bosch SE, Jehee JFM, Fernández G, Doeller CF. 2014. Reinstatement of associative memories in early visual cortex is signaled by the hippocampus. The Journal of Neuroscience 34:7493–7500. doi: 10.1523/JNEUROSCI.0805-14.2014.
6. Brogden WJ. 1939. Sensory pre-conditioning. Journal of Experimental Psychology 25:323–332. doi: 10.1037/h0058944.
7. Carlson T, Tovar DA, Alink A, Kriegeskorte N. 2013. Representational dynamics of object vision: the first 1000 ms. Journal of Vision 13:1. doi: 10.1167/13.10.1.
8. Cichy RM, Pantazis D, Oliva A. 2014. Resolving human object recognition in space and time. Nature Neuroscience 17:455–462. doi: 10.1038/nn.3635.
9. Conci M, Gramann K, Müller HJ, Elliott MA. 2006. Electrophysiological correlates of similarity-based interference during detection of visual forms. Journal of Cognitive Neuroscience 18:880–888. doi: 10.1162/jocn.2006.18.6.880.
10. Danker JF, Anderson JR. 2010. The ghosts of brain states past: remembering reactivates the brain regions engaged during encoding. Psychological Bulletin 136:87–102. doi: 10.1037/a0017937.
11. Dayan P. 1993. Improving generalization for temporal difference learning: the successor representation. Neural Computation 5:613. doi: 10.1162/neco.1993.5.4.613.
12. Deuker L, Olligs J, Fell J, Kranz TA, Mormann F, Montag C, Reuter M, Elger CE, Axmacher N. 2013. Memory consolidation by replay of stimulus-specific neural activity. The Journal of Neuroscience 33:19373–19383. doi: 10.1523/JNEUROSCI.0414-13.2013.
13. Doll BB, Shohamy D, Daw ND. 2014. Multiple memory systems as substrates for multiple decision systems. Neurobiology of learning and memory 117:4–13. doi: 10.1016/j.nlm.2014.04.014.
14. Dragoi G, Tonegawa S. 2013. Distinct preplay of multiple novel spatial experiences in the rat. Proceedings of the National Academy of Sciences of USA 110:9100–9105. doi: 10.1073/pnas.1306031110.
15. Dragoi G, Tonegawa S. 2011. Preplay of future place cell sequences by hippocampal cellular assemblies. Nature 469:397–401. doi: 10.1038/nature09633.
16. Engel AK, Fries P, Singer W. 2001. Dynamic predictions: oscillations and synchrony in top–down processing. Nature Reviews Neuroscience 2:704–716. doi: 10.1038/35094565.
17. Ezzyat Y, Davachi L. 2014. Similarity breeds proximity: pattern similarity within and across contexts is related to later mnemonic judgments of temporal proximity. Neuron 81:1179–1189. doi: 10.1016/j.neuron.2014.01.042.
18. Florian RV. 2007. Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural Computation 19:1468–1502. doi: 10.1162/neco.2007.19.6.1468.
19. Foster DJ, Wilson MA. 2006. Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 440:680–683. doi: 10.1038/nature04587.
20. Friston K, Kiebel S. 2009. Predictive coding under the free-energy principle. Philosophical Transactions of the Royal Society of London Series B Biological Sciences 364:1211–1221. doi: 10.1098/rstb.2008.0300.
21. Fuster JM. 2001. The prefrontal Cortex—an update: time is of the essence. Neuron 30:319–333. doi: 10.1016/S0896-6273(01)00285-9.
22. Garrido MI, Kilner JM, Kiebel SJ, Friston KJ. 2007. Evoked brain responses are generated by feedback loops. Proceedings of the National Academy of Sciences of USA 104:20961–20966. doi: 10.1073/pnas.0706274105.
23. Gelbard-Sagiv H, Mukamel R, Harel M, Malach R, Fried I. 2008. Internally generated reactivation of single neurons in human Hippocampus during free recall. Science 322:96–101. doi: 10.1126/science.1164685.
24. Gewirtz JC, Davis M. 2000. Using pavlovian higher-order conditioning paradigms to investigate the neural substrates of Emotional learning and memory. Learning and Memory 7:257–266. doi: 10.1101/lm.35200.
25. Gollwitzer PM. 1999. Implementation intentions: Strong effects of simple plans. The American Psychologist 54:493–503. doi: 10.1037/0003-066X.54.7.493.
26. Gupta AS, van der Meer MA, Touretzky DS, Redish AD. 2010. Hippocampal replay is not a simple function of experience. Neuron 65:695–705. doi: 10.1016/j.neuron.2010.01.034.
27. Hasselmo ME. 2008. Temporally structured replay of neural activity in a model of entorhinal cortex, hippocampus and postsubiculum. The European Journal of Neuroscience 28:1301–1315. doi: 10.1111/j.1460-9568.2008.06437.x.
28. Hempel CM, Hartman KH, Wang X-J, Turrigiano GG, Nelson SB. 2000. Multiple forms of short-term plasticity at Excitatory Synapses in rat medial prefrontal cortex. Journal of Neurophysiology 83:3031–3041.
29. Hoffman KL, McNaughton BL. 2002. Coordinated reactivation of distributed memory traces in primate neocortex. Science 297:2070–2073. doi: 10.1126/science.1073538.
30. Hopf JM, Luck SJ, Girelli M, Hagner T, Mangun GR, Scheich H, Heinze HJ. 2000. Neural sources of Focused attention in visual search. Cerebral Cortex 10:1233–1241. doi: 10.1093/cercor/10.12.1233.
31. Hopfield JJ. 2010. Neurodynamics of mental exploration. Proceedings of the National Academy of Sciences of USA 107:1648–1653. doi: 10.1073/pnas.0913991107.
32. Hsieh LT, Gruber MJ, Jenkins LJ, Ranganath C. 2014. Hippocampal activity patterns carry information about objects in temporal context. Neuron 81:1165–1178. doi: 10.1016/j.neuron.2014.01.015.
33. Hsieh LT, Ekstrom AD, Ranganath C. 2011. Neural Oscillations associated with item and temporal order maintenance in working memory. The Journal of Neuroscience 31:10803–10810. doi: 10.1523/JNEUROSCI.0828-11.2011.
34. Jadhav SP, Kemere C, German PW, Frank LM. 2012. Awake hippocampal sharp-wave ripples support spatial memory. Science 336:1454–1458. doi: 10.1126/science.1217230.
35. Jafarpour A, Horner AJ, Fuentemilla L, Penny WD, Duzel E. 2013. Decoding oscillatory representations and mechanisms in memory. Neuropsychologia 51:772–780. doi: 10.1016/j.neuropsychologia.2012.04.002.
36. Jafarpour A, Fuentemilla L, Horner AJ, Penny W, Duzel E. 2014. Replay of very early encoding representations during recollection. The Journal of Neuroscience 34:242–248. doi: 10.1523/JNEUROSCI.1865-13.2014.
37. Johnson A, Redish AD. 2007. Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. The Journal of Neuroscience 27:12176–12189. doi: 10.1523/JNEUROSCI.3761-07.2007.
38. Johnson JD, Rugg MD. 2007. Recollection and the reinstatement of encoding-related cortical activity. Cerebral Cortex 17:2507–2515. doi: 10.1093/cercor/bhl156.
39. Johnson JD, Minton BR, Rugg MD. 2008. Content dependence of the electrophysiological correlates of recollection. Neuroimage 39:406–416. doi: 10.1016/j.neuroimage.2007.08.050.
40. Káli S, Dayan P. 2004. Off-line replay maintains declarative memories in a model of hippocampal-neocortical interactions. Nature Neuroscience 7:286–294. doi: 10.1038/nn1202.
41. Kok A. 2001. On the utility of P3 amplitude as a measure of processing capacity. Psychophysiology 38:557–577. doi: 10.1017/S0048577201990559.
42. Kourtzi Z, Connor CE. 2011. Neural representations for object perception: structure, category, and adaptive coding. Annual Review of Neuroscience 34:45–67. doi: 10.1146/annurev-neuro-060909-153218.
43. Kriegeskorte N, Mur M, Bandettini P. 2008. Representational similarity analysis—connecting the branches of systems neuroscience. Frontiers in Systems Neuroscience 2:4. doi: 10.3389/neuro.06.004.2008.
44. Kuhl BA, Chun MM. 2014. Successful remembering elicits event-specific activity patterns in lateral parietal cortex. The Journal of Neuroscience 34:8051–8060. doi: 10.1523/JNEUROSCI.4328-13.2014.
45. Kuhl BA, Bainbridge WA, Chun MM. 2012. Neural reactivation reveals mechanisms for updating memory. The Journal of Neuroscience 32:3453–3461. doi: 10.1523/JNEUROSCI.5846-11.2012.
46. Kurth-Nelson Z, Bickel W, Redish AD. 2012. A theoretical account of cognitive effects in delay discounting. The European Journal of Neuroscience 35:1052–1064. doi: 10.1111/j.1460-9568.2012.08058.x.
47. Lamme VAF, Roelfsema PR. 2000. The distinct modes of vision offered by feedforward and recurrent processing. Trends in Neurosciences 23:571–579. doi: 10.1016/S0166-2236(00)01657-X.
48. Lisman J, Redish AD. 2009. Prediction, sequences and the hippocampus. Philosophical transactions of the Royal Society of London Series B, Biological sciences 364:1193–1201. doi: 10.1098/rstb.2008.0316.
49. Liu J, Harris A, Kanwisher N. 2002. Stages of processing in face perception: an MEG study. Nature Neuroscience 5:910–916. doi: 10.1038/nn909.
50. MacKay DG, Bowman RW Jr. 1969. On producing the meaning in Sentences. The American Journal of Psychology 82:23–39. doi: 10.2307/1420605.
51. Makeig S, Jung TP, Bell AJ, Ghahremani D, Sejnowski TJ. 1997. Blind separation of auditory event-related brain responses into independent components. Proceedings of the National Academy of Sciences of USA 94: 10979–10984. doi: 10.1073/pnas.94.20.10979.
52. Manning JR, Polyn SM, Baltuch GH, Litt B, Kahana MJ. 2011. Oscillatory patterns in temporal lobe reveal context reinstatement during memory search. Proceedings of the National Academy of Sciences of USA 108: 12893–12897. doi: 10.1073/pnas.1015174108.
53. Manning JR, Sperling MR, Sharan A, Rosenberg EA, Kahana MJ. 2012. Spontaneously reactivated patterns in frontal and temporal lobe predict semantic clustering during memory search. The Journal of Neuroscience 32:8871–8878. doi: 10.1523/JNEUROSCI.5321-11.2012.
54. Marr D. 1971. Simple memory: a theory for archicortex. Philosophical transactions of the Royal Society of London Series B, Biological sciences 262:23–81. doi: 10.1098/rstb.1971.0078.
55. Miller JF, Neufang M, Solway A, Brandt A, Trippel M, Mader I, Hefft S, Merkow M, Polyn SM, Jacobs J, Kahana MJ, Schulze-Bonhage A. 2013. Neural activity in human hippocampal formation reveals the spatial context of retrieved memories. Science 342:1111–1114. doi: 10.1126/science.1244056.
56. Mongillo G, Barak O, Tsodyks M. 2008. Synaptic Theory of working memory. Science 319:1543–1546. doi: 10.1126/science.1150769.
57. Moore AW, Atkeson CG. 1993. Prioritized sweeping: reinforcement learning with less data and less time. Machine Learning 13:103–130. doi: 10.1007/BF00993104.
58. Morton NW, Kahana MJ, Rosenberg EA, Baltuch GH, Litt B, Sharan AD, Sperling MR, Polyn SM. 2013. Categoryspecific neural Oscillations predict recall organization during memory search. Cerebral Cortex 23:2407–2422. doi: 10.1093/cercor/bhs229.
59. Näätänen R, Winkler I. 1999. The concept of auditory stimulus representation in cognitive neuroscience. Psychological Bulletin 125:826–859. doi: 10.1037/0033-2909.125.6.826.
60. Nádasdy Z, Hirase H, Czurkó A, Csicsvari J, Buzsáki G. 1999. Replay and time compression of recurring spike sequences in the hippocampus. The Journal of Neuroscience 19:9497–9507.
61. Norman KA, Polyn SM, Detre GJ, Haxby JV. 2006. Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends in cognitive sciences 10:424–430. doi: 10.1016/j.tics.2006.07.005.
62. Nyberg L, Habib R, McIntosh AR, Tulving E. 2000. Reactivation of encoding-related brain activity during memory retrieval. Proceedings of the National Academy of Sciences of USA 97:11120–11124. doi: 10.1073/pnas.97.20.11120.
63. Oostenveld R, Praamstra P, Stegeman DF, van Oosterom A. 2001. Overlap of attention and movement-related activity in lateralized event-related brain potentials. Clinical Neurophysiology 112:477–484. doi: 10.1016/S1388-2457(01)00460-6.
64. Pfeiffer BE, Foster DJ. 2013. Hippocampal place-cell sequences depict future paths to remembered goals. Nature 497:74–79. doi: 10.1038/nature12112.
65. Polyn SM, Natu VS, Cohen JD, Norman KA. 2005. Category-specific cortical activity Precedes retrieval during memory search. Science 310:1963–1966. doi: 10.1126/science.1117645.
66. Rainer G, Rao SC, Miller EK. 1999. Prospective coding for objects in primate prefrontal cortex. The Journal of Neuroscience 19:5493–5505.
67. Rao RP, Ballard DH. 1999. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience 2:79–87. doi: 10.1038/4580.
68. Riesenhuber M, Poggio T. 2000. Models of object recognition. Nature Neuroscience 3:1199–1204. doi: 10.1038/81479.
69. Rissman J, Wagner AD. 2012. Distributed representations in memory: insights from functional brain imaging. Annual Review of Psychology 63:101–128. doi: 10.1146/annurev-psych-120710-100344.
70. Rossion B, Jacques C. 2008. Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170. Neuroimage 39:1959–1979. doi: 10.1016/j.neuroimage.2007.10.011.
71. Sakai K, Miyashita Y. 1991. Neural organization for the long-term memory of paired associates. Nature 354: 152–155. doi: 10.1038/354152a0.
72. Sandberg K, Barnes GR, Rees G, Overgaard M. 2013. Magnetoencephalographic activity related to conscious perception is Stable within individuals across Years but not between individuals. Journal of Cognitive Neuroscience 26:840–853. doi: 10.1162/jocn_a_00525.
73. Sanguinetti JL, Allen JJB, Peterson MA. 2014. The ground side of an object: perceived as shapeless yet processed for semantics. Psychological Science 25:256–264. doi: 10.1177/0956797613502814.
74. Schacter DL, Addis DR, Hassabis D, Martin VC, Spreng RN, Szpunar KK. 2012. The future of memory: remembering, imagining, and the brain. Neuron 76:677–694. doi: 10.1016/j.neuron.2012.11.001.
75. Schiff S, Mapelli D, Vallesi A, Orsato R, Gatta A, Umiltà C, Amodio P. 2006. Top-down and bottom-up processes in the extrastriate cortex of cirrhotic patients: an ERP study. Clinical Neurophysiology 117:1728–1736.doi: 10.1016/j.clinph.2006.04.020.
76. Schmolesky MT, Wang Y, Hanes DP, Thompson KG, Leutgeb S, Schall JD, Leventhal AG. 1998. Signal timing across the macaque visual system. Journal of Neurophysiology 79:3272–3278.
77. Schneider TR, Debener S, Oostenveld R, Engel AK. 2008. Enhanced EEG gamma-band activity reflects multisensory semantic matching in visual-to-auditory object priming. Neuroimage 42:1244–1254. doi: 10.1016/j.neuroimage.2008.05.033.
78. Schwindel CD, McNaughton BL. 2011. Hippocampal-cortical interactions and the dynamics of memory trace reactivation. Progress in Brain Research 193:163–177. doi: 10.1016/B978-0-444-53839-0.00011-9.
79. Seidel RJ. 1959. A review of sensory preconditioning. Psychological Bulletin 56:58–73. doi: 10.1037/h0040776.
80. Seung HS. 2003. Learning in spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron 40:1063–1073. doi: 10.1016/S0896-6273(03)00761-X.
81. Singer AC, Carr MF, Karlsson MP, Frank LM. 2013. Hippocampal SWR activity predicts correct decisions during the initial learning of an alternation task. Neuron 77:1163–1173. doi: 10.1016/j.neuron.2013.01.027.
82. Sirota A, Csicsvari J, Buhl D, Buzsáki G. 2003. Communication between neocortex and hippocampus during sleep in rodents. Proceedings of the National Academy of Sciences of USA 100:2065–2069. doi: 10.1073/pnas.0437938100.
83. Steiner AP, Redish AD. 2014. Behavioral and neurophysiological correlates of regret in rat decision-making on a neuroeconomic task. Nature Neuroscience 17:995–1002. doi: 10.1038/nn.3740.
84. Sutton RS. 1991. Dyna, an Integrated Architecture for learning, planning, and reacting. ACM SIGART Bulletin 2:160–163. doi: 10.1145/122344.122377.
85. Sutton RS. 1995. TD models: Modeling the world at a Mixture of time scales. In. Proceedings of the Twelfth International Conference on Machine Learning, Morgan Kaufmann. p. 531–539.
86. Tanaka JW, Curran T. 2001. A neural basis for expert object recognition. Psychological Science 12:43–47. doi: 10.1111/1467-9280.00308.
87. Todd PM, Hills TT, Robbins TW. 2012. Cognitive search: evolution, algorithms, and the brain. MIT press.
88. Tsivilis D, Otten LJ, Rugg MD. 2001. Context effects on the neural correlates of recognition memory: An electrophysiological study. Neuron 31:497–505. doi: 10.1016/S0896-6273(01)00376-2.
89. Tulving E, Thomson DM. 1973. Encoding specificity and retrieval processes in episodic memory. Psychological Review 80:352–373. doi: 10.1037/h0020071.
90. Ullman S. 2000. High-Level Vision: Object Recognition and Visual Cognition. MIT press.
91. Van der Meer MA, Johnson A, Schmitzer-Torbert NC, Redish AD. 2010. Triple dissociation of information processing in dorsal striatum, ventral striatum, and hippocampus on a learned spatial decision task. Neuron 67:25–32. doi: 10.1016/j.neuron.2010.06.023.
92. Van de Nieuwenhuijzen ME, Backus AR, Bahramisharif A, Doeller CF, Jensen O, van Gerven MA. 2013. MEGbased decoding of the spatiotemporal dynamics of visual category perception. Neuroimage 83:1063–1073. doi: 10.1016/j.neuroimage.2013.07.075.
93. VanRullen R, Thorpe SJ. 2001. The time course of visual processing: from early perception to decision-making. Journal of Cognitive Neuroscience 13:454–461. doi: 10.1162/08989290152001880.
94. Wang Y, Markram H, Goodman PH, Berger TK, Ma J, Goldman-Rakic PS. 2006. Heterogeneity in the pyramidal network of the medial prefrontal cortex. Nature Neuroscience 9:534–542. doi: 10.1038/nn1670.
95. Wimber M, Maaß A, Staudigl T, Richardson-Klavehn A, Hanslmayr S. 2012. Rapid memory reactivation revealed by oscillatory Entrainment. Current Biology 22:1482–1486. doi: 10.1016/j.cub.2012.05.054.
96. Wimmer GE, Shohamy D. 2012. Preference by association: how memory mechanisms in the hippocampus bias decisions. Science 338:270–273. doi: 10.1126/science.1223252.
97. Yick YY, Wilding EL. 2008. Material-specific neural correlates of memory retrieval. NeuroReport 19:1463–1467. doi: 10.1097/WNR.0b013e32830ef76f.