The timing of exploratory decision-making revealed by single-trial topographic EEGanalyses

NeuroImage

Volumn 60, Issue 4, 2012, Pages 1959-1969

  Tzovara, Athina ^a,b   Murray, Micah M ^a,b   Bourdaud, Nicolas ^c   Chavarriaga, Ricardo ^c   Millán, José del R ^c   De Lucia, Marzia ^a,b  

^a University of Lausanne   (Switzerland)

^b LAUSANNE UNIVERSITY HOSPITAL   (Switzerland)

^c EPFL   (Switzerland)

Author keywords

Decision making; EEG; Exploration exploitation; Single trial; Timing

Indexed keywords

ADULT; ARTICLE; BEHAVIOR CONTROL; BRAIN FUNCTION; CLASSIFICATION; DECISION MAKING; ELECTRIC POTENTIAL; ELECTROENCEPHALOGRAPHY; EXPLORATORY BEHAVIOR; FEMALE; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PREFRONTAL CORTEX; PRIORITY JOURNAL; REACTION TIME; REWARD; STATISTICAL ANALYSIS; SUPRAMARGINAL GYRUS; TIME;

ADULT; BRAIN; BRAIN MAPPING; DECISION MAKING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; HUMANS; MALE; REACTION TIME; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 84858132445     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2012.01.136     Document Type: Article

References (44)

1. Basten U., Biele G., Heekeren H.R., Fiebach C.J. How the brain integrates costs and benefits during decision making. Proc. Natl. Acad. Sci. U. S. A. 2010, 107(50):21767-21772.
2. Binder J.R., Liebenthal E., Possing E.T., Medler D.A., Ward B.D. Neural correlates of sensory and decision processes in auditory object identification. Nat. Neurosci. 2004, 7(3):295-301.
3. Boorman E.D., Behrens T.E., Woolrich M.W., Rushworth M.F. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 2009, 62(5):733-743.
4. Bourdaud N., Chavarriaga R., Galan F., Millan Jdel R. Characterizing the EEG correlates of exploratory behavior. IEEE Trans. Neural Syst. Rehabil. Eng. 2008, 16(6):549-556.
5. Cavanagh J.F., Frank M.J., Klein T.J., Allen J.J. Frontal theta links prediction errorsto behavioral adaptation in reinforcement learning. Neuroimage 2010, 49(4):3198-3209.
6. Christopoulos G.I., Tobler P.N., Bossaerts P., Dolan R.J., Schultz W. Neural correlates of value, risk, and risk aversion contributing to decision making under risk. J. Neurosci. 2009, 29(40):12574-12583.
7. Cohen M.X., Ranganath C. Reinforcement learning signals predict future decisions. J. Neurosci. 2007, 27(2):371-378. 10.
8. Cohen J.D., McClure S.M., Yu A.J. Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2007, 362(1481):933-942.
9. Daw N.D., O'Doherty J.P., Dayan P., Seymour B., Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature 2006, 441(7095):876-879.
10. De Lucia M., Michel C.M., Clarke S., Murray M.M. Single-trial topographic analysis of human EEG: a new 'image' of event-related potentials. Proceedings Information Technology Applications in Biomedicine 2007.
11. De Lucia, M., Tzovara, A., Bernasconi, F., Spierer, L., Murray, M.M., in press. Auditory perceptual decision-making based on semantic categorization of environmental sounds. Neuroimage. doi:. http://doi:8.10.1016/j.neuroimage.2012.01.131.
12. Einhäuser W., Koch C., Carter O.L. Pupil dilation betrays the timing of decisions. Front. Hum. Neurosci. 2010, 4:18. 26.
13. Ernst M., Bolla K., Mouratidis M., Contoreggi C., Matochik J.A., Kurian V., Cadet J.L., Kimes A.S., London E.D. Decision-making in a risk-taking task: a PET study. Neuropsychopharmacology 2002, 26(5):682-691.
14. Frank M.J., Woroch B.S., Curran T. Error-related negativity predicts reinforcement learning and conflict biases. Neuron 2005, 47(4):495-501.
15. Frank M.J., Doll B.B., Oas-Terpstra J., Moreno F. Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat. Neurosci. 2009, 12(8):1062-1068.
16. Gianotti L.R.R., Knoch D., Faber P.L., Lehmann D., Pascual-Marqui R.D., Diezi C., Schoch C., Eisenegger C., Fehr E. Tonic activity level in the right prefrontal cortex predicts individuals' risk taking. Psychol. Sci. 2009, 20:33-38.
17. Green D.M., Swets J.M. Signal Detection Theory and Psychophysics 1966, John Wiley and Sons Inc., New York.
18. Hampton A.N., O'doherty J.P. Decoding the neural substrates of reward-related decision making with functional MRI. Proc. Natl. Acad. Sci. U. S. A. 2007, 104(4):1377-1382.
19. Heekeren H.R., Marrett S., Bandettini P.A., Ungerleider L.G. A general mechanism for perceptual decision-making in the human brain. Nature 2004, 431(7010):859-862.
20. Holroyd C.B., Coles M.G. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 2002, 109(4):679-709.
21. Hsu M., Bhatt M., Adolphs R., Tranel D., Camerer C.F. Neural systems responding to degrees of uncertainty in human decision-making. Science 2005, 310(5754):1680-1683.
22. Jepma M., Nieuwenhuis S. Pupil diameter predicts changes in the exploration-exploitation trade-off: evidence for the adaptive gain theory. J. Cogn. Neurosci. 2011, 23(7):1587-1596.
23. Knoch D., Gianotti L.R., Pascual-Leone A., Treyer V., Regard M., Hohmann M., Brugger P. Disruption of right prefrontal cortex by low-frequency repetitive transcranial magnetic stimulation induces risk-taking behavior. J. Neurosci. 2006, 26(24):6469-6472.
24. Koenig T., Melie-García L. A method to determine the presence of averaged event-related fields using randomization tests. Brain Topogr. 2010, 23(3):233-242.
25. Lehmann D., Skrandies W. Reference-free identification of components of checkerboard-evoked multichannel potential fields. Electroencephalogr. Clin. Neurophysiol. 1980, 48:609-621.
26. McKeeff T.J., Tong F. The timing of perceptual decisions for ambiguous face stimuli in the human ventral visual cortex. Cereb. Cortex 2006, 17(3):669-678.
27. Michel C.M., Murray M.M., Lantz G., Gonzalez S., Spinelli L., Grave de Peralta R. EEG source imaging. Clin. Neurophysiol. 2004, 115(10):2195-2222.
28. Murray M.M., Brunet D., Michel C.M. Topographic ERP analyses: a step-by-step tutorial review. Brain Topogr. 2008, 20(4):249-264.
29. Murray M.M., De Lucia M., Brunet D., Michel C.M. Principles of topographic analysesof electrical neuroimaging. Event-Related Potentials II: Advances in ERP, EEG, & MEG Analysis 2009, MIT Press. T.C. Handy (Ed.).
30. Nieuwenhuis S., Holroyd C.B., Mol N., Coles M.G. Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance. Neurosci. Biobehav. Rev. 2004, 28(4):441-448.
31. Pascual-Marqui R.D., Michel C.M., Lehmann D. Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. Int. J. Psychophysiol. 1994, 18(1):49-65.
32. Perrin F., Pernier J., Bertrand O., Giard M.H., Echallier J.F. Mapping of scalp potentialsby surface spline interpolation. Electroencephalogr. Clin. Neurophysiol. 1987, 66:75-81.
33. Philiastides M.G., Biele G., Vavatzanidis N., Kazzer P., Heekeren H.R. Temporal dynamics of prediction error processing during reward-based decision making. Neuroimage 2010, 53(1):221-232.
34. Raftery A.E. Bayesian model selection in social research. Sociol. Methodol. 1995, 25:111-163.
35. Reverberi C., Cherubini P., Rapisarda A., Rigamonti E., Caltagirone C., Frackowiak R.S., Macaluso E., Paulesu E. Neural basis of generation of conclusions in elementary deduction. Neuroimage 2007, 38(4):752-762.
36. Rushworth M.F., Behrens T.E.J. Choice, uncertainty and value in prefrontal and cingulate cortex. Nature Neurosci. 2008, 11:389-397.
37. Seo H., Barraclough D.J., Lee D. Lateral intraparietal cortex and reinforcement learning during a mixed-strategy game. J. Neurosci. 2009, 29(22):7278-7289.
38. Soon C.S., Brass M., Heinze H.J., Haynes J.D. Unconscious determinants of free decisions in the human brain. Nat. Neurosci. 2008, 11(5):543-545.
39. Suton R., Barto A. Reinforcement Learning: An Introduction 1998, MIT Press, Cambridge, MA.
40. Talairach J., Tournoux P. Co-planar Stereotaxic Atlas of the Human Brain 1988, Thieme, New York.
41. Tzovara A., Murray M.M., Plomp G., Herzog M.H., Michel C.M., De Lucia M. Decoding stimulus-related information from single-trial EEG responses based on voltage topographies. Pattern Recognit. 2011, 10.1016/j.patcog.2011.04.007.
42. Wu Y., Zhou X. The P300 and reward valence, magnitude, and expectancy in outcome evaluation. Brain Res. 2009, 1286:114-122.
43. Yeung N., Holroyd C.B., Cohen J.D. ERP correlates of feedback and reward processing in the presence and absence of response choice. Cereb. Cortex 2005, 15(5):535-544.
44. Yoshida W., Ishii S. Resolution of uncertainty in prefrontal cortex. Neuron 2006, 50(5):781-789.