Which way do i go? neural activation in response to feedback and spatial processing in a virtual t-maze

Cerebral Cortex

Volumn 19, Issue 8, 2009, Pages 1708-1722

  Baker, Travis E ^a   Holroyd, Clay B ^a  

^a UNIVERSITY OF VICTORIA   (Canada)

Author keywords

Event related brain potentials; Feedback error related negativity; Medial temporal lobe; Midbrain dopamine system; N170; Reinforcement learning; Virtual T maze

Indexed keywords

COGNITION; DOPAMINERGIC SYSTEM; EVENT RELATED POTENTIAL; FEEDBACK SYSTEM; HUMAN; INFORMATION PROCESSING; LEARNING; MAZE TEST; MESENCEPHALON; NONHUMAN; PREDICTIVE VALIDITY; PRIORITY JOURNAL; REINFORCEMENT; REVIEW; REWARD; TEMPORAL LOBE;

ADOLESCENT; ADULT; BRAIN MAPPING; CEREBRAL CORTEX; CUES; DOPAMINE; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; MALE; MAZE LEARNING; MESENCEPHALON; NERVE NET; REWARD; SPATIAL BEHAVIOR; TEMPORAL LOBE; USER-COMPUTER INTERFACE;

EID: 67651120119     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhn223     Document Type: Review

References (123)

1. Aguirre GK, Detre JA, Alsop DC, D'Esposito M. 1996. The parahippocampus subserves topographical learning in man. Cereb Cortex. 6:823-829.
2. Allison T. 1982. Scalp and cortical recordings of initial somatosensory cortex activity to median nerve stimulation in man. Ann N Y Acad Sci. 388:671-678.
3. Atallah HE, Frank MJ, O'Reilly RC. 2004. Hippocampus, cortex, and basal ganglia: insights from computational models of complementary learning systems. Neurobiol Learn Mem. 82:253-267.
4. Bentin S, Deouell LY. 2000. Structural encoding and identification in face processing: ERP evidence for separate mechanisms. Cognitive Neuropsychology. 17:35-54.
5. Braun C, Lutzenberger W, Miltner W, Elbert T. 1990. Can subcortical structures generate potentials large in amplitude? In: Brunia CHM, Galliard AWK, Kok A, editors. Psychophysiological brain research. Tilburg (the Netherlands): Tilburg University Press. p. 31-35.
6. Brun VH, Otnass MK, Molden S, Steffenach HA, Witter MP. 2002. Place cells and place recognition maintained by direct entorhinalhippocampal circuitry. Science. 296:2243-2246.
7. Burgess N, Maguire EA, O'Keefe J. 2002. The human hippocampus and spatial and episodic memory. Neuron. 35:625-641.
8. Burgess N, O'Keefe J. 2003. Neural representations in human spatial memory. Trends Cogn Sci. 7:517-519.
9. Burwell RD, Amaral DG. 1998. Perirhinal and postrhinal cortices of the rat: interconnectivity and connections with the entorhinal cortex. J. Comp Neurol. 391:293-321.
10. Caplan JB, Madsen JR, Raghavachari S, Kahana MJ. 2001. Distinct patterns of brain oscillations underlie two basic parameters of human maze learning. J Neurophysiol. 86:368-380.
11. Catania A. 1999. Thorndike's legacy: learning, selection, and the law of effect. J Exp Anal Behav. 72:425-428.
12. Cohen JD, Braver TS, Brown JW. 2002. Computational perspectives on dopamine function in prefrontal cortex. Curr Opin Neurobiol. 12:223-229.
13. Corbit LH, Janak PH. 2007. Inactivation of the lateral but not medial dorsal striatum eliminates the excitatory impact of Pavlovian stimuli on instrumental responding. J. Neurosci. 27:13977-13981.
14. Cornwell BR, Johnson LL, Holroyd T, Carver FW, Grillon C. 2008. Human hippocampal and parahippocampal theta during goaldirected spatial navigation predicts performance on a virtual Morris water maze. J Neurosci. 28:5983-5990.
15. Crane J, Milner B. 2005. What went where? Impaired object-location learning in patients with right hippocampal lesions. Hippocampus. 15:216-231.
16. Deffke I, Sander T, Heidenreich J, Sommer W, Curio G. 2007. MEG/EEG sources of the 170-ms response to faces are co-localized in the fusiform gyrus. Neuroimage. 35:1495-1501.
17. Diana RA, Yonelinas AP, Ranganath C. 2007. Imaging recollection and familiarity in the medial temporal lobe: a three-component model. Trends Cogn Sci. 11:379-386.
18. Dunning JP, Hajcak G. 2007. Error-related negativities elicited by monetary loss and cues that predict loss. Neuroreport. 18:1875-1878.
19. Duzel E, Habib R, Rotte M, Guderian S, Tulving E, Heinze HJ. 2003. Human hippocampal and parahippocampal activity during visual associative recognition memory for spatial and nonspatial stimulus configurations. J Neurosci. 23:9439-9444.
20. Eichenbaum H, Otto T, Cohen NJ. 1994. Two functional components of the hippocampal memory system. Behav Brain Sci. 17:449-517.
21. Eichenbaum H, Yonelinas AP, Ranganath C. 2007. The medial temporal lobe and recognition memory. Annu Rev Neurosci. 30:123-152.
22. Ekstrom AD, Bookheimer SY. 2007. Spatial and temporal episodic memory retrieval recruit dissociable functional networks in the human brain. Learn Mem. 14:645-654.
23. Ekstrom AD, Kahana MJ, Caplan JB, Fields TA, Isham EA. 2003. Cellular networks underlying human spatial navigation. Nature. 425:184-188.
24. Epstein R, Harris A, Stanley D, Kanwisher N. 1999. The parahippocampal place area: recognition, navigation, or encoding? Neuron. 23: 115-125.
25. Foster DJ, Morris RG, Dayan P. 2000. A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus. 10:1-16.
26. Frank MJ, Claus ED. 2006. Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol Rev. 113:300-326.
27. Frank MJ, Rudy JW, O'Reilly RC. 2003. Transitivity, flexibility, conjunctive representations, and the hippocampus. II. A computational analysis. Hippocampus. 13:341-354.
28. Fujii T, Okuda J, Kawashima R, Yamadori A, Fukatsu R, Suzuki K, Ito M, Goto R, Fukuda H. 1997. Different roles of the left and right parahippocampal regions in verbal recognition: a PET study. Neuroreport. 8:1113-1117.
29. Gratton G, Coles MG, Donchin E. 1983. A new method for off-line removal of ocular artifact. Electroencephalogr Clin Neurophysiol. 55:468-484.
30. Habib M, Sirigu A. 1987. Pure topographical disorientation: a definition and anatomical basis. Cortex. 23:73-85.
31. Hadland KA, Rushworth MF, Gaffan D, Passingham RE. 2003. The anterior cingulate and reward-guided selection of actions. J. Neurophysiol. 89:1161-1164.
32. Hafting T, Fyhn M, Bonnevie T, Moser MB, Moser EI. 2008. Hippocampusindependent phase precession in entorhinal grid cells. Nature. 453:1248-1252.
33. Hafting T, Fyhn M, Bonnevie T, Moser MB, Moser EI. 2008. Hippocampus-independent phase precession in entorhinal grid cells. Nature. 453:1248-1252.
34. Hafting T, Fyhn M, Bonnevie T, Moser MB, Moser EI. 2008. Hippocampus-independent phase precession in entorhinal grid cells. Nature. 453:1248-1252.
35. Hajcak G, Holroyd CB, Moser JS, Simons RF. 2005. Brain potentials associated with expected and unexpected good and bad outcomes. Psychophysiology. 42:161-170.
36. Hajcak G, Moser JS, Holroyd CB, Simons RF. 2006. The feedback-related negativity reflects the binbary evaluation of good versus bad outcomes. Biological Psychology. 7:148-154.
37. Handy TC, Kingstone A, Mangun GR. 1996. Spatial distribution of visual attention: perceptual sensitivity and response latency. Percept Psychophys. 58:613-627.
38. Holroyd CB, Coles MG. 2002. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol Rev. 109:679-709.
39. Holroyd CB, Coles MG. 2008. Dorsal anterior cingulate cortex integrates reinforcement history to guide voluntary behavior. Cortex. 44:548-559.
40. Holroyd CB, Krigolson OE. 2007. Reward prediction error signals associated with a modified time estimation task. Psychophysiology. 44:913-917.
41. Holroyd CB, Larsen JT, Cohen JD. 2004. Context dependence of the event-related brain potential associated with reward and punishment. Psychophysiology. 41:245-253.
42. Holroyd CB, Nieuwenhuis S, Yeung N, Cohen JD. 2003. Errors in reward prediction are reflected in the event-related brain potential. Neuroreport. 14:2481-2484.
43. Holroyd CB, Pakzad-Vaezi KL, Krigolson OE. 2008. The feedback correct-related positivity: Sensitivity of the event-related brain potential to unexpected positive feedback. Psychophysiology. 45:245-253.
44. Iidaka T, Matsumoto A, Haneda K, Okada T, Sadato N. 2006. Hemodynamic and electrophysiological relationship involved in human face processing: evidence from a combined fMRI-ERP study. Brain Cogn. 60:176-186.
45. Itier RJ, Taylor MJ. 2004. Source analysis of the N170 to faces and objects. Neuroreport. 15:1261-1265.
46. Janzen G, van TM. 2004. Selective neural representation of objects relevant for navigation. Nat Neurosci. 7:673-677.
47. Jasper HH. 1958. The ten twenty electrode system of the international federation. Electroencephalogr Clin Neurophysiol. 10:371-375.
48. Kahana MJ, Seelig D, Madsen JR. 2001. Theta returns. Curr Opin Neurobiol. 11:739-744.
49. Kahn I, Andrews-Hanna JR, Vincent JL, Snyder AZ, Buckner RL. 2008.
50. Distinct cortical anatomy linked to subregions of the medial temporal lobe revealed by intrinsic functional connectivity. J Neurophysiol. 100:129-139.
51. Kotecha SA, Oak JN, Jackson MF, Perez Y, Orser BA, Van Tol HHM, McDonald JF. 2002. A D2 class dopamine receptor transactivates a receptor tyrosine kinase to inhibit NMDA receptor transmission. Neuron. 35:1111-1122.
52. Krigolson OE, Holroyd CB. 2007. Predictive information and error processing: the role of medial-frontal cortex during motor control. Psychophysiology. 44:586-595.
53. Kumaran D, Hassabis D, Spiers HJ, Vann SD, Vargha-Khadem F, Maguire EA. 2007. Impaired spatial and non-spatial configural learning in patients with hippocampal pathology. Neuropsychologia. 45:2699-2771.
54. Landis T, Cummings JL, Benson DF, Palmer EP. 1986. Loss of topographic familiarity. An environmental agnosia. Arch Neurol. 43:132-136.
55. Lavenex P, Amaral DG. 2000. Hippocampal-neocortical interaction: a hierarchy of associativity. Hippocampus. 10:420-430.
56. Lutzenberger W, Elbert T, Rockstroh B. 1987. A brief tutorial on the implications of volume conduction for the interpretation of the EEG. J Psychophysiol. 1:81-89.
57. Maguire EA. 1997. Hippocampal involvement in human topographical memory: evidence from functional imaging. Philos Trans R Soc Lond B Biol Sci. 352:1475-1480.
58. Maguire EA, Frackowiak RS, Frith CD. 1996. Learning to find your way: a role for the human hippocampal formation. Proc Biol Sci. 263:1745-1750.
59. Maguire EA. 2001. Neuroimaging, memory and the human hippocampus. Rev Neurol. 157:791-794.
60. Maguire EA, Burgess N, O'Keefe J. 1999. Human spatial navigation: cognitive maps, sexual dimorphism, and neural substrates. Curr Opin Neurobiol. 9:171-177.
61. Maguire EA, Frith CD, Burgess N, Donnett JG, O'Keefe J. 1998. Knowing where things are: parahippocampal involvement in encoding object locations in virtual large-scale space. J Cogn Neurosci. 10:61-76.
62. Maguire EA, Frith CD, Cipolotti L. 2001. Distinct neural systems for the encoding and recognition of topography and faces. Neuroimage. 13:743-750.
63. Maguire EA, Nannery R, Spiers HJ. 2006a. Navigation around London by a taxi driver with bilateral hippocampal lesions. Brain. 129:2894-2907.
64. Maguire EA, Woollett K, Spiers HJ. 2006b. London taxi drivers and bus drivers: a structural MRI and neuropsychological analysis. Hippocampus. 16:1091-1100.
65. Makeig S, Westerfield M, Jung TP, Enghoff S, Townsend J. 2002. Dynamic brain sources of visual evoked responses. Science. 295:690-694.
66. Manns JR, Eichenbaum H. 2006. Evolution of declarative memory. Hippocampus. 16:795-808.
67. Matsumoto K, Wataru S, Tanaka K. 2003. Neural correlates of goal-based motor selection in the prefrontal cortex. Science. 301:229-232.
68. McClelland JL, McNaughton BL, O'Reilly RC. 1995. Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychol Rev. 102:419-457.
69. McDonald B, Highley JR, Walker MA, Herron BM, Cooper SJ, Esiri MM, Crow TJ. 2000. Anomalous asymmetry of fusiform and parahippocampal gyrus gray matter in schizophrenia: a postmortem study. Am J Psychiatry. 157:40-47.
70. Miller EK, Cohen JD. 2001. An integrative theory of prefrontal cortex function. Annu Rev Neurosci. 24:167-202.
71. Milner B, Johnsrude I, Crane J. 1997. Right medial temporal-lobe contribution to object-location memory. Philos Trans R Soc Lond B Biol Sci. 352:1469-1474.
72. Miltner WHR, Braun CH, Coles MGH. 1997. Event-related brain potentials following incorrect feedback in a time-estimation task: evidence for a generic neural system for error detection. J Cogn Neurosci. 9:788-798.
73. Minnebusch DA, Suchan B, Ramon M, Daum I. 2007. Event-related potentials reflect heterogeneity of developmental prosopagnosia. Eur J Neurosci. 25:2234-2247.
74. Montague PR, Hyman SE, Cohen JD. 2004. Computational roles for dopamine in behavioural control. Nature. 431:760-767.
75. Murray EA, Richmond BJ. 2001. Role of perirhinal cortex in object perception, memory, and associations. Curr Opin Neurobiol. 11:188-193.
76. Nieuwenhuis S, Holroyd CB, Mol N, Coles MG. 2004. Reinforcementrelated brain potentials from medial frontal cortex: origins and functional significance. Neurosci Biobehav Rev. 28:441-448.
77. Nieuwenhuis S, Slagter HA, von Geusau NJ, Heslenfeld DJ, Holroyd CB. 2005. Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes. Eur J Neurosci. 21:3161-3168.
78. Norman KA, O'Reilly RC. 2003. Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learningsystems approach. Psychol Rev. 110:611-646.
79. O'Keefe J. 1976. Place units in the hippocampus of the freely moving rat. Exp Neurol. 51:78-109.
80. O'Keefe J, Burgess N, Donnett JG, Jeffery KJ, Maguire EA. 1998. Place cells, navigational accuracy, and the human hippocampus. Philos Trans R Soc Lond B Biol Sci. 353:1333-1340.
81. O'Keefe J, Dostrovsky J. 1971. The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res. 34:171-175.
82. O'Keefe J, Nadel L. 1978. The Hippocampus as a cognitive map. Oxford: Oxford University Press.
83. O'Keefe J, Recce ML. 1993. Phase relationship between hippocampal place units and the EEG theta rhythm. Hippocampus. 3:317-330.
84. O'Reilly RC, Norman KA. 2002. Hippocampal and neocortical contributions to memory: advances in the complementary learning systems framework. Trends Cogn Sci. 6:505-510.
85. O'Reilly RC, Rudy JW. 2000. Computational principles of learning in the neocortex and hippocampus. Hippocampus. 10:389-397.
86. O'Reilly RC, Rudy JW. 2001. Conjunctive representations in learning and memory: principles of cortical and hippocampal function. Psychol Rev. 108:311-345.
87. Packard MG, Knowlton BJ. 2002. Learning and memory functions of the basal ganglia. Annu Rev Neurosci. 25:563-593.
88. Packard MG, McGaugh JL. 1996. Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol Learn Mem. 65:65-72.
89. Poldrack RA, Packard MG. 2003. Competition among multiple memory systems: converging evidence from animal and human brain studies. Neuropsychologia. 41:245-251.
90. Robbins TW, Cador M, Taylor JR, Everitt BJ. 1989. Limbic-striatal interactions in reward-related processes. Neurosci Biobehav Rev. 13:155-162.
91. Rossion B, Joyce CA, Cottrell GW, Tarr MJ. 2003. Early lateralization and orientation tuning for face, word, and object processing in the visual cortex. Neuroimage. 20:1609-1624.
92. Rugg M, Coles M. 1995. Electrophysiology of mind: event-related brain potentials and cognition. Oxford: Oxford University Press. Rushworth MFS. 2008. Intention, choice, and the medial frontal cortex. Ann N Y Acad Sci. 1124:181-207.
93. Rushworth MFS, Buckley MJ, Behrens TEJ, Walton ME, Bannerman DM. 2007. Functional organization of the medial frontal cortex. Curr. Opin. Neurobiol. 17:220-227.
94. Rushworth MFS, Walton ME, Kennerley SW, Bannerman DM. 2004. Action sets and decisions in the medial frontal cortex. Trend in Cog. Sci. 8:410-417.
95. Samejima K, Ueda Y, Doya K, Kimura M. 2005. Representation of actionspecific reward values in the striatum. Science. 25:1337-1340.
96. Schultz W. 1997. Dopamine neurons and their role in reward mechanisms. Curr Opin Neurobiol. 7:191-197.
97. Schultz W. 1998a. The phasic reward signal of primate dopamine neurons. Adv Pharmacol. 42:686-690.
98. Schultz W. 1998b. Predictive reward signal of dopamine neurons. J Neurophysiol. 80:1-27.
99. Schultz W. 1999. The reward signal of midbrain dopamine neurons. News Physiol Sci. 14:249-255.
100. Schultz W. 2006. Behavioral theories and the neurophysiology of reward. Annu Rev Psychol. 57:87-115.
101. Schultz W, Dayan P, Montague PR. 1997. A neural substrate of prediction and reward. Science. 275:1593-1599.
102. SchultzW, Tremblay L, Hollerman JR. 1998. Reward prediction in primate basal ganglia and frontal cortex. Neuropharmacology. 37:421-429.
103. Schultz W, Tremblay L, Hollerman JR. 2000. Reward processing in primate orbitofrontal cortex and basal ganglia. Cereb Cortex. 10:272-284.
104. Spiers HJ, Burgess N, Maguire EA, Baxendale SA, Hartley T, et al. 2001. Unilateral temporal lobectomy patients show lateralized topographical and episodic memory deficits in a virtual town. Brain. 124:2476-2489.
105. Spiers HJ, Maguire EA. 2004. A 'landmark' study on the neural basis of navigation. Nat Neurosci. 7:572-574.
106. Squire LR, Stark CE, Clark RE. 2004. The medial temporal lobe. Annu Rev Neurosci. 27:279-306.
107. Squire LR, Zola-Morgan S. 1991. The medial temporal lobe memory system. Science. 253:1380-1386.
108. Suri RE. 2001. Anticipatory responses of dopamine neurons and cortical neurons reproduced by internal model. Exp Brain Res. 140: 234-240.
109. Suri RE, Schultz W. 2001. Temporal difference model reproduces anticipatory neural activity. Neural Comput. 13:841-862.
110. Suzuki WA, Amaral DG. 1994. Perirhinal and parahippocampal cortices of the macaque monkey: cortical afferents. J Comp Neurol. 350:497-533.
111. Tanaka SC, Samejima K, Okada G, Ueda K, Okamoto Y, Yamawaki S, Doya K, et al. 2006. Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics. Neural Netw. 19:1233-1241.
112. Terrace HS. 2005. The simultaneous chain: a new approach to serial learning. Trends Cogn Sci. 9:202-210.
113. Thorndike EL. 1933. A proof of the law of effect. Science. 77:173-175.
114. Tobler PN, Fiorillo CD, Schultz W. 2005. Adaptive coding of reward value by dopamine neurons. Science. 307:1642-1645.
115. Tolman EC. 1948. Cognitive maps in rats and men. Psychol Rev. 56:144-155.
116. Tulving E, Markowitsch HJ. 1997. Memory beyond the hippocampus. Curr Opin Neurobiol. 7:209-216.
117. Tulving E, Markowitsch HJ. 1998. Episodic and declarative memory: role of the hippocampus. Hippocampus. 8:198-204.
118. White NM, McDonald RJ. 2002. Multiple parallel memory systems in the brain of the rat. Neurobiol Learn Mem. 77:125-184.
119. Witter MP, Wouterlood FG, Naber PA, van HT. 2000. Anatomical organization of the parahippocampal-hippocampal network. Ann N Y Acad Sci. 911:1-24.
120. Yamaguchi Y, Sato N, Wagatsuma H, Wu Z, Molter C, Aota Y. 2007. A unified view of theta-phase coding in the entorhinal-hippocampal system. Curr Opin Neurobiol. 17:197-204.
121. Yeung N, Bogacz R, Holroyd CB, Cohen JD. 2004. Detection of synchronized oscillations in the electroencephalogram: an evaluation of methods. Psychophysiology. 41:822-832.
122. Yeung N, Bogacz R, Holroyd CB, Nieuwenhuis S, Cohen JD. 2007. Theta phase resetting and the error-related negativity. Psychophysiology. 44:39-49.
123. Yin HH, Knowlton BJ. 2006. The role of the basal ganglia in habit formation. Nat Rev Neurosci. 7:464-476.