Spatiotemporal characteristics of perceptual decision making in the human brain

Handbook of Reward and Decision Making

Volumn , Issue , 2009, Pages 185-212

  Philiastides, Marios G ^a   Heekeren, Hauke R ^a  

^a MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 78049336370     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-374620-7.00008-X     Document Type: Chapter

References (144)

1. Gold J., Shadlen M. The neural basis of decision making. Annu. Rev. Neurosci. 2007, 30:535-574.
2. Tversky A., Kahneman D. The framing of decisions and the psychology of choice. Science 1981, 211:453-458.
3. Opris I., Bruce C. Neural circuitry of judgment and decision mechanisms. Brain Res. Rev. 2005, 48:509-526.
4. Heekeren H., Marrett S., Ungerleider L. The neural systems that mediate human perceptual decision making. Nat. Rev. Neurosci. 2008, 9:467-479.
5. Heekeren H., et al. A general mechanism for perceptual decision-making in the human brain. Nature 2004, 431:859-862.
6. Heekeren H., et al. Involvement of human left dorsolateral prefrontal cortex in perceptual decision making is independent of response modality. Proc. Natl. Acad. Sci. USA 2006, 103:10023-10028.
7. Pleger B., et al. Neural coding of tactile decisions in the human prefrontal cortex. J. Neurosci. 2006, 26:12596-12601.
8. Ploran E., et al. Evidence accumulation and the moment of recognition: dissociating perceptual recognition processes using fMRI. J. Neurosci. 2007, 27:11912-11924.
9. Philiastides M., Sajda P. Temporal characterization of the neural correlates of perceptual decision making in the human brain. Cereb. Cortex 2006, 16:509-518.
10. Philiastides M., Ratcliff R., Sajda P. Neural representation of task difficulty and decision-making during perceptual categorization: a timing diagram. J. Neurosci. 2006, 26:8965-8975.
11. Donner T., et al. Population activity in the human dorsal pathway predicts the accuracy of visual motion detection. J. Neurophysiol. 2007, 98:345-359.
12. Debener S., et al. Trial-by-trial coupling of concurrent electroencephalogram and functional magnetic resonance imaging identifies the dynamics of performance monitoring. J. Neurosci. 2005, 25:11730-11737.
13. Debener S., et al. Single-trial EEG-fMRI reveals the dynamics of cognitive function. Trends Cogn. Sci. 2006, 10:558-563.
14. Philiastides M., Sajda P. EEG-informed fMRI reveals spatiotemporal characteristics of perceptual decision making. J. Neurosci. 2007, 27:13082-13091.
15. Britten K., et al. The analysis of visual motion: a comparison of neuronal and psychophysical performance. J. Neurosci. 1992, 12:4745-4765.
16. Britten K., et al. Responses of neurons in macaque MT to stochastic motion signals. Vis. Neurosci. 1993, 10:4745-4765.
17. Shadlen M., Newsome W. Motion perception: seeing and deciding. Proc. Natl. Acad. Sci. USA 1996, 93:628-633.
18. Britten K., et al. A relationship between behavioral choice and visual responses of neurons in macaque MT. Vis. Neurosci. 1996, 14:87-100.
19. Salzman C., Britten K., Newsome W. Cortical microstimulation influences perceptual judgements of motion direction. Nature 1990, 346:174-177.
20. Salzman C., et al. Microstimulation in visual area mt: effects on direction discrimination performance. J. Neurosci. 1992, 12:2331-2355.
21. Ditterich J., Mazurek M., Shadlen M. Microstimulation of visual cortex affects the speed of perceptual decisions. Nat. Neurosci. 2003, 6:891-898.
22. Keysers C., et al. The speed of sight. J. Cogn. Neurosci. 2001, 13:90-101.
23. Afraz S., Kiani R., Esteky H. Microstimulation of inferotemporal cortex influences face categorization. Nature 2006, 442:692-695.
24. Salinas E., et al. Periodicity and firing rate as candidate neural codes for the frequency of vibrotactile stimuli. J. Neurosci. 2000, 20:5503-5515.
25. Romo R., et al. Somatosensory discrimination based on cortical microstimulation. Nature 1998, 392:387-390.
26. Romo R., et al. Sensing without touching: psychophysical perfrormance based on cortical microstimulation. Neuron 2000, 26:273-278.
27. Ratcliff R. A theory of memory retrieval. Psychol. Rev. 1978, 85:59-108.
28. Ratcliff R., Tuerlinckx F. Estimating parameters of the diffusion model: approaches to dealing with contaminant reaction times and parameters variability. Psychon. Bull. Rev. 2002, 9:438-481.
29. Mazurek M., et al. A role for neural integrators in perceptual decision making. Cereb. Cortex 2003, 13:1257-1269.
30. Bogacz R. Optimal decision making theories: linking neurobiology with behaviour. Trends Cogn. Sci. 2007, 11:118-125.
31. Grossberg S., Pilly P. Temporal dynamics of decision-making during motion perception in the visual cortex. Vision Res. 2008, 48:1345-1373.
32. Schall J. Neural basis of saccade target selection. Rev. Neurosci. 1995, 6:63-85.
33. Colby C., Duhamel J., Goldberg M. Visual, presaccadic, and cognitive activation of single neurons in monkey lateral intraparietal area. J. Neurophysiol. 1996, 76:2841-2852.
34. Shadlen M., Newsome W. Neural basis of perceptual decision making in the parietal cortex (area LIP) of the rhesus monkey. J. Neurophysiol. 2001, 86:1916-1936.
35. Roitman J., Shadlen M. Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J. Neurosci. 2002, 22:9475-9489.
36. Huk A., Shadlen M. Neural activity in the macaque parietal cortex reflects temporal integration of visual motion signals during perceptual decision making. J. Neurosci. 2005, 25:10420-10436.
37. Hanks T., Ditterich J., Shadlen M. Microstimulation of macaque area lip affects decision-making in a motion discrimination task. Nat. Neurosci. 2006, 9:682-689.
38. Gold J., Shadlen M. Neural computations that underlie decisions about sensory stimuli. Trends Cogn. Sci. 2001, 5:10-16.
39. Yang T., Shadlen M. Probabilistic reasoning by neurons. Nature 2007, 447:1075-1080.
40. Churchland A., Kiani R., Shadlen M. Decision-making with multiple alternatives. Nat. Neurosci. 2008, 11:693-702.
41. Kim J., Shadlen M. Neural correlates of decision making in the dorsolateral prefrontal cortex of the macaque. Nat. Neurosci. 1999, 2:176-185.
42. Romo R., et al. Neuronal correlates of parametric working memory in prefrontal cortex. Nature 1999, 399:470-473.
43. Romo R., et al. Neuronal correlates of decision-making in secondary somatosensory cortex. Nat. Neurosci. 2002, 5:1217-1224.
44. Romo R., Hernandez A., Zainos A. Neuronal correlates of decisionmaking in ventral premotor cortex. Neuron 2004, 41:165-173.
45. Hernandez A., Zainos A., Romo R. Temporal evolution of a decision-making process in medial premotor cortex. Neuron 2002, 33:959-972.
46. Brody C., et al. Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex. Cereb. Cortex 2003, 13:1196-1207.
47. Haxby J. The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations. J. Neurosci. 1994, 14:6336-6353.
48. Kanwisher N., McDermott J., Chun M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 1997, 17:4302-4311.
49. McCarthy G., et al. Face-specific processing in the human fusiform gyrus. J. Cogn. Neurosci. 1997, 9:605-611.
50. Epstein R., Kanwisher N. A cortical representation of the local visual environment. Nature 1998, 392:598-601.
51. Ishai A., et al. Distributed representation of objects in the human ventral visual pathway. Proc. Natl. Acad. Sci. USA 1999, 96:9379-9384.
52. Preuschhof C., et al. Neural correlates of vibrotactile working memory in the human brain. J. Neurosci. 2006, 26:13231-13239.
53. Tegenthoff M., et al. Improvement of tactile discrimination performance and enlargement of cortical somatosensory maps after 5Hz rTMS. PLoS Biol. 2005, 3:2031-2040.
54. Binder J., et al. Neural correlates of sensory and decision processes in auditory object identification. Nat. Neurosci. 2004, 7:295-301.
55. Thielscher A., Pessoa L. Neural correlates of perceptual choice and decision making during fear-disgust discrimination. J. Neurosci. 2007, 27:2908-2917.
56. Grinband J., Hirsch J., Ferrera V.P. A neural representation of categorization uncertainty in the human brain. Neuron 2006, 49:757-763.
57. H. Heekeren, S. Marrett, P. Bandettini, L. Ungerleider, Human fMRI evidence for representation of a perceptual decision in oculomotor areas, in: Society for Neuroscience, 35th Annual Meeting Abst. 228.8, 2005.
58. Sereno M., Pitzalis S., Martinez A. Mapping of controlateral space in retinotopic coordinates by a parietal cortical area in humans. Science 2001, 294:1350-1354.
59. Heinen S., et al. An oculomotor decision process revealed by functional magnetic resonance imaging. J. Neurosci. 2006, 26:13515-13522.
60. Rorie A., Newsome W. A general mechanism for perceptual decision-making in the human brain?. Trends Cogn. Sci. 2005, 9:41-43.
61. Ridderinkhof K., et al. The role of the medial frontal cortex in cognitive control. Science 2004, 306:443-447.
62. Rushworth M., Behrens T. Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci. 2008, 11:389-397.
63. Egner T., Hirsch J. Cognitive control mechanisms resolve conflict through cortical amplification of task-relevant information. Nat. Neurosci. 2005, 8:1784-1790.
64. Makeig S., et al. Dynamic brain sources of visual evoked responses. Science 2002, 295:690-694.
65. Jung T., et al. Imaging brain dynamics using independent component analysis. Proc. IEEE. 2001, 89:1107-1122.
66. Onton J., et al. Imaging human EEG dynamics using independent component analysis. Neurosci. Biobehav. Rev. 2006, 30:802-822.
67. Guger C., Ramoser H., Pfurtscheller G. Real-time EEG analysis with subject-specific spatial patterns for a brain computer interface BCI. IEEE. Trans. Rehabil. Eng. 2000, 8:441-446.
68. Ramoser H., Pfurtscheller J.M.-G.G. Optimal spatial filtering of single trial EEG during imagined hand movement. IEEE. Trans. Rehabil. Eng. 2000, 8:441-446.
69. Lal T., et al. Support vector channel selection in BCI. IEEE. Trans. Biomed. Eng. 2004, 51:1003-1010.
70. Thulasidas M., Guan C., Wu J. Robust classification of EEG signals for brain-computer interface. IEEE. Trans. Neural Syst. Rehabil. Eng. 2006, 14:24-29.
71. Parra L., et al. Linear spatial integration for single-trial detection in encephalography. Neuroimage 2002, 17:223-230.
72. Parra L., et al. Recipes for the linear analysis of EEG. Neuroimage 2005, 28:326-341.
73. Hyvarinen A., Karhunen J., Oja E. Independent Component Analysis 2001, John Wiley and Sons, New York.
74. Jeffreys D. Evoked studies of face and object processing. Vis. Cogn. 1996, 3:1-38.
75. Bentin S., et al. Electrophysiological studies of face perception in humans. J. Cogn. Neurosci. 1996, 8:551-565.
76. Halgren E., et al. Cognitive response profile of the human fusiform face area as determined by MEG. Cereb. Cortex 2000, 10:69-81.
77. Liu J., et al. The selectivity of the occipitotemporal M170 for faces. Neuroreport 2000, 11:337-341.
78. Rossion B., et al. Early laterization and orientation tuning for face, word, and object processing in the visual cortex. Neuroimage 2003, 20:1609-1624.
79. Nunez P., Srinivasan R. Electric Fields of the Brain: The Neurophysics of EEG 2005, Oxford University Press, New York.
80. Tallon-Baudry C., Bertrand O. Oscillatory gamma activity in humans and its role in object representation. Trends Cogn. Sci. 1999, 3:151-162.
81. Schiff S., et al. Fast wavelet transformation of eeg. Electroencephalogr. Clin. Neurophysiol. 1994, 91:442-455.
82. Thomson D. Spectrum estimation and harmonic analysis. Proc. IEEE. 1982, 70:1055-1096.
83. Mitra P., Pesaran B. Analysis of dynamic brain imaging data. Biophys. J. 1999, 76:691-708.
84. van Vugt M., Sederberg P., Kahana M. Comparison of spectral analysis methods for characterizing brain oscillations. J. Neurosci. Methods 2007, 162:49-63.
85. Siegel M., et al. High-frequency activity in human visual cortex is modulated by visual motion strength. Cereb. Cortex 2007, 17:732-741.
86. Van Veen B., et al. Localization of brain electrical activity via linearly constrained minimum variance spatial filtering. IEEE. Trans. Biomed. Eng. 1997, 44:867-880.
87. Gross J., et al. Dynamic imaging of coherent sources: studying neural interactions in the human brain. Proc. Natl. Acad. Sci. USA 2001, 98:694-699.
88. Logothetis N., et al. Neurophysiological investigation of the basis of the fMRI signal. Nature 2001, 412:150-157.
89. Logothetis N. What we can do and what we cannot do with fMRI. Nature 2008, 453:869-878.
90. Niessing J., et al. Hemodynamic signals correlate tightly with synchronized gamma oscillations. Science 2005, 309:948-951.
91. Viswanathan A., Freeman R. Neurometabolic coupling in cerebral cortex reflects synaptic more than spiking activity. neurometabolic coupling in cerebral cortex reflects synaptic more than spiking activity. Nat. Neurosci. 2007, 10:1308-1312.
92. Puce A., et al. Temporal cortex activation in humans viewing eye and mouth movements. J. Neurosci. 1998, 18:2188-2199.
93. Haxby J., Hoffman E., Gobbini M. The distributed human neural system for face perception. Trends Cogn. Sci. 2000, 4:223-233.
94. Hoffman E., Haxby J. Distinct representation of eye gaze and identity in the distributed human neural system for face perception. Nat. Neurosci. 2000, 3:80-84.
95. Allison T., et al. Electrophysiological studies of human face perception: potentials generated in occipitotemporal cortex by face and nonface stimuli. Cereb. Cortex 1999, 9:415-430.
96. Puce A., Allison T., McCarthy G. Electrophysiological studies of human face perception. III. effects of top-down processing on face-specific potentials. Cereb. Cortex 1999, 9:445-458.
97. Puce A., Allison T., McCarthy G. Electrophysiological studies of human face perception. II. response properties of face specific potentials generated in occipitotemporal cortex. Cereb. Cortex 1999, 9:431-444.
98. Cohen J., et al. Temporal dynamics of brain activation during working memory task. Nature 1997, 386:604-608.
99. Ganis G., Thompson W., Kosslyn S. Brain areas underlying visual mental imagery and visual perception: an fMRI study. Brain Res. Cogn. Brain Res. 2004, 20:226-241.
100. Vuilleumier P., et al. Neural fate of seen and unseen faces in visuospatial neglect: a combined event-related functional MRI and event-related potential study. Proc. Natl. Acad. Sci. USA 2001, 98:3495-3500.
101. Corbetta M., et al. A common network of functional areas for attention and eye movements. Neuron 1998, 21:761-773.
102. Schall J., Stuphorn V., Brown J. Monitoring and control of action by the frontal lobes. Neuron 2002, 36:309-322.
103. Kelley T., et al. Cortical mechanisms for shifting and holding visuospatial attention. Cereb. Cortex 2008, 18:114-125.
104. Moore T., Armstrong K., Fallah M. Visuomotor origins of covert spatial attention. Neuron 2003, 40:671-683.
105. Moore T., Armstrong K. Selective gating of visual signals by microstimulation of frontal cortex. Nature 2003, 421:370-373.
106. Carter C., et al. Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 1998, 280:747-749.
107. MacDonald A., et al. Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. Science 2000, 288:1835-1838.
108. Kerns J., et al. Anterior cingulate conflict monitoring and adjustments in control. Science 2004, 303:1023-1026.
109. Brown J., Braver T. Learned predictions of error likelihood in the anterior cingulate cortex. Science 2005, 307:1118-1121.
110. Milham M., et al. The relative involvement of anterior cingulate and prefrontal cortex in attentional control depends on nature conflict. Cogn. Brain Res. 2001, 12:467-473.
111. Bor D., et al. Encoding strategies dissociate prefrontal activity from working memory demand. Neuron 2003, 37:361-367.
112. Olesen P., Westerberg H., Klingberg T. Increased prefrontal and parietal activity after training of working memory. Nat. Neurosci. 2004, 7:75-79.
113. Pessoa L., et al. Neural correlates of visual working memory: fMRI amplitude predicts task performance. Neuron 2002, 35:975-987.
114. Sakai K., Rowe J., Passingham R. Active maintenance in prefrontal area 46 creates distractor-resistant memory. Nat. Neurosci. 2002, 5:479-484.
115. Mesulam M., Mufson E. Insula of the old world monkey. II: afferent cortical output and comments on function. J. Comp. Neurol. 1982, 212:23-37.
116. Mesulam M., Mufson E. Insula of the old world monkey. II: efferent cortical output and comments on function. J. Comp. Neurol. 1982, 212:38-52.
117. Selemon L., Goldman-Rakic P. Common cortical and subcortical targets of the dorsolateral prefrontal and posterior parietal cortices in the rhesus monkey: evidence for a distributed neural network subserving spatially guided behavior. J. Neurosci. 1988, 8:4049-4068.
118. James T., et al. The effects of visual object priming on brain activation before and after recognition. Curr. Biol. 2000, 10:1017-1024.
119. James T., et al. Differential effects of viewpoint on object-driven activation in dorsal and ventral streams. Neuron 2002, 35:793-801.
120. Grill-Spector K., et al. The dynamics of object-selective activation correlate with recognition performance in humans. Nat. Neurosci. 2000, 3:837-843.
121. Grill-Spector K., Kourtzi Z., Kanwisher N. The lateral occipital complex and its role in object recognition. Vision Res. 2001, 41:1409-1422.
122. Grill-Spector K., Knouf N., Kanwisher N. The fusiform face area subserves face perception, not generic within-category identification. Nat. Neurosci. 2004, 7:555-562.
123. Ferber S., Humphrey G., Vilis T. The lateral occipital complex subserves the perceptual persistence of motion-defined groupings. Cereb. Cortex 2002, 35:793-801.
124. Large M., Aldcroft A., Vilis T. Perceptual continuity and the emergence of perceptual persistence in the ventral visual pathway. J. Neurophysiol. 2005, 93:3453-3462.
125. Lollo V.D. Temporal characteristics of iconic memory. Nature 1977, 267:241-243.
126. Coltheart M. The persistences of vision. Philos. Trans. R. Soc. Lond. B Biol. Sci. 1980, 290:57-69.
127. VanRullen R., Koch C. Visual selective behavior can be triggered by a feed-forward process. J. Cogn. Neurosci. 2003, 15:209-217.
128. McClure S., et al. Separate neural systems value immediate and delayed monetary rewards. Science 2004, 306:503-507.
129. Petrides M. The mid-ventrolateral prefrontal cortex and active mnemonic retrieval. Neurobiol. Learn. Mem. 2002, 78:528-538.
130. Prince S., Daselaar S., Cabeza R. Neural correlates of relational memory: successful encoding and retrieval of semantic and perceptual associations. J. Neurosci. 2005, 25:1203-1210.
131. Hanakawa T., et al. Brain activity during visuomotor behavior triggered by arbitrary and spatial constrained cues: an fMRI study in humans. Exp. Brain Res. 2006, 172:275-282.
132. Winterer G., Weinberger D. Genes, dopamine and cortical signal-to-noise ratio in schizophrenia. Trend Neurosci. 2004, 27:683-690.
133. Winterer G., et al. COMT genotype predicts BOLD signal and noise characteristics in prefrontal circuits. Neuroimage 2006, 32:1722-1732.
134. Meyer-Lindenberg A., Weinberger D. Intermediate phenotypes and genetic mechanisms of psychiatric disorders. Nat. Rev. Neurosci. 2006, 7:818-827.
135. Lotta T., et al. Kinetics of human soluble and membrane-bound catechol omethyltransferase: a revised mechanism and description of the thermolabile variant of the enzyme. Biochemistry 1995, 34:4202-4210.
136. MacDonald S., Nyberg L., Backman L. Intra-individual variability in behavior: links to brain structure, neurotransmission and neuronal activity. Trend Neurosci. 2006, 29:474-480.
137. O'Doherty J. Reward representations and reward-related learning in the human brain: insights from human neuroimaging. Curr. Opin. Neurobiol. 2004, 14:769-776.
138. O'Doherty J., Hampton A., Kim H. Model-based fMRI and its application to reward learning and decision making. Ann. NY Acad. Sci. 2007, 1104:35-53.
139. Daw N., et al. Cortical substrates for exploratory decisions in humans. Nature 2006, 441:876-879.
140. Montague P., King-Casas B., Cohen J. Imaging valuation models in human choice. Annu. Rev. Neurosci. 2006, 29:417-448.
141. Pleger B., et al. Reward facilitates tactile judgments and modulates hemodynamic responses in human primary somatosensory cortex. J. Neurosci. 2008, 28:8161-8168.
142. Rangel A., Camerer C., Montague P. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 2008, 545-556.
143. Green D., Swets J. Signal Detection Theory and Psychophysics 1966, John Wiley & Sons, New York.
144. R. Ratcliff, M.G. Philiastides and P. Sajda, Quality of evidence for perceptual decision making is indexed by trial-to-trial variability of the EEG, Proceedings of National Academy of Science (PNAS), 2009, doi:10.1073/pnas.0812580106.