Linking brain electrical signals elicited by current outcomes with future risk decision-making

Frontiers in Behavioral Neuroscience

Volumn 8, Issue MAR, 2014, Pages

  Zhang, Dandan ^a   Gu, Ruolei ^b   Broster, Lucas S ^c   Jiang, Yang ^c   Luo, Wenbo ^d   Zhang, Jian ^a   Luo, Yue Jia ^a  

^a Shenzhen University School of Medicine   (China)

^b INSTITUTE OF PSYCHOLOGY   (China)

^c UNIVERSITY OF KENTUCKY   (United States)

^d LIAONING NORMAL UNIVERSITY   (China)

Author keywords

Decision making; Event related oscillation; Event related potential; Independent component analysis; Outcome evaluation; Time frequency analysis

Indexed keywords

ADULT; ARTICLE; BRAIN ELECTROPHYSIOLOGY; DECISION MAKING; ELECTROENCEPHALOGRAM; EVENT RELATED CROSS COHERENCE; EVENT RELATED POTENTIAL; EVOKED AUDITORY RESPONSE; FEMALE; FRONTAL CORTEX; HUMAN; INDEPENDENT COMPONENT ANALYSIS; LEFT HEMISPHERE; MALE; MU RHYTHM; NEUROPHYSIOLOGY; RIGHT HEMISPHERE; SENSORIMOTOR CORTEX; THETA RHYTHM; YOUNG ADULT;

EID: 84896992712     PISSN: 16625153     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnbeh.2014.00084     Document Type: Article

References (92)

1. Amodio, D. M., Bartholow, B. D., and Ito, T. A. (2013). Tracking the dynamics of the social brain: ERP approaches for social cognitive and affective neuroscience. Soc. Cogn. Affect. Neurosci. 9, 385-393. doi: 10.1093/scan/nst177
2. Bach, D. R., and Dolan, R. J. (2012). Knowing how much you don't know: a neural organization of uncertainty estimates. Nat. Rev. Neurosci. 13, 572-586. doi: 10.1038/nrn3289
3. Baillet, S., Mosher, J. C., and Leahy, R. M. (2001). Electromagnetic brain mapping. Signal Process. Mag. 18, 14-30. doi: 10.1109/79.962275
4. Bell, A. J., and Sejnowski, T. J. (1995). An information-maximization approach to blind separation and blind deconvolution. Neural Comput. 7, 1129-1159. doi: 10.1162/neco.1995.7.6.1129
5. Bellebaum, C., and Daum, I. (2008). Learning-related changes in reward expectancy are reflected in the feedback-related negativity. Eur. J. Neurosci. 27, 1823-1835. doi: 10.1111/j.1460-9568.2008.06138.x
6. Blankertz, B., Lemm, S., Treder, M., Haufe, S., and Muller, K. R. (2011). Single-trial analysis and classification of ERP components-a tutorial. Neuroimage 56, 814-825. doi: 10.1016/j.neuroimage.2010.06.048
7. Boorman, E. D., Behrens, T. E., Woolrich, M. W., and Rushworth, M. F. (2009). How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62, 733-743. doi: 10.1016/j.neuron.2009.05.014
8. Buzsaki, G., and Draguhn, A. (2004). Neuronal oscillations in cortical networks. Science 304, 1926-1929. doi: 10.1126/science.1099745
9. Cavanagh, J. F., Cohen, M. X., and Allen, J. J. (2009). Prelude to and resolution of an error: EEG phase synchrony reveals cognitive control dynamics during action monitoring. J. Neurosci. 29, 98-105. doi: 10.1523/JNEUROSCI.4137-08.2009
10. Cavanagh, J. F., Figueroa, C. M., Cohen, M. X., and Frank, M. J. (2012). Frontal theta reflects uncertainty and unexpectedness during exploration and exploitation. Cereb. Cortex 22, 2575-2586. doi: 10.1093/cercor/bhr332
11. Cavanagh, J. F., Frank, M. J., Klein, T. J., and Allen, J. J. (2010). Frontal theta links prediction errors to behavioral adaptation in reinforcement learning. Neuroimage 49, 3198-3209. doi: 10.1016/j.neuroimage.2009.11.080
12. Chase, H. W., Swainson, R., Durham, L., Benham, L., and Cools, R. (2011). Feedback-related negativity codes prediction error but not behavioral adjustment during probabilistic reversal learning. J. Cogn. Neurosci. 23, 936-946. doi: 10.1162/jocn.2010.21456
13. Cohen, J. (1973). Eta-squared and partial eta-squared in fixed factor ANOVA designs. Educ. Psychol. Meas. 33, 107-112. doi: 10.1177/001316447303300111
14. Cohen, M. X. (2011). It's about Time. Front. Hum. Neurosci. 5:2. doi: 10.3389/fnhum.2011.00002
15. Cohen, M. X., Axmacher, N., Lenartz, D., Elger, C. E., Sturm, V., and Schlaepfer, T. E. (2009a). Nuclei accumbens phase synchrony predicts decision-making reversals following negative feedback. J. Neurosci. 29, 7591-7598. doi: 10.1523/JNEUROSCI.5335-08.2009
16. Cohen, M. X., Bour, L., Mantione, M., Figee, M., Vink, M., Tijssen, M. A., et al. (2012). Top-down-directed synchrony from medial frontal cortex to nucleus accumbens during reward anticipation. Hum. Brain Mapp. 33, 246-252. doi: 10.1002/hbm.21195
17. Cohen, M. X., Elger, C. E., and Fell, J. (2009b). Oscillatory activity and phase-amplitude coupling in the human medial frontal cortex during decision making. J. Cogn. Neurosci. 21, 390-402. doi: 10.1162/jocn.2008.21020
18. Cohen, M. X., Elger, C. E., and Ranganath, C. (2007). Reward expectation modulates feedback-related negativity and EEG spectra. Neuroimage 35, 968-978. doi: 10.1016/j.neuroimage.2006.11.056
19. Cohen, M. X., and Ranganath, C. (2007). Reinforcement learning signals predict future decisions. J. Neurosci. 27, 371-378. doi: 10.1523/JNEUROSCI.4421-06.2007
20. Cohen, M. X., Wilmes, K., and van de Vijver, I. (2011). Cortical electrophysiological network dynamics of feedback learning. Trends Cogn. Sci. 15, 558-566. doi: 10.1016/j.tics.2011.10.004
21. Cook, I. A., O'Hara, R., Uijtdehaage, S. H., Mandelkern, M., and Leuchter, A. F. (1998). Assessing the accuracy of topographic EEG mapping for determining local brain function. Electroencephalogr. Clin. Neurophysiol. 107, 408-414. doi: 10.1016/S0013-4694(98)00092-3
22. Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., and Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature 441, 876-879. doi: 10.1038/nature04766
23. de Borst, A. W., Sack, A. T., Jansma, B. M., Esposito, F., de Martino, F., Valente, G., et al. (2012). Integration of "what" and "where" in frontal cortex during visual imagery of scenes. Neuroimage 60, 47-58. doi: 10.1016/j.neuroimage.2011.12.005
24. Delorme, A., and Makeig, S. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9-21. doi: 10.1016/j.jneumeth.2003.10.009
25. Delorme, A., Palmer, J., Onton, J., Oostenveld, R., and Makeig, S. (2012). Independent EEG sources are dipolar. PLoS ONE 7:e30135. doi: 10.1371/journal.pone.0030135
26. Ernst, B., and Steinhauser, M. (2012). Feedback-related brain activity predicts learning from feedback in multiple-choice testing. Cogn. Affect. Behav. Neurosci. 12, 323-336. doi: 10.3758/s13415-012-0087-9
27. Ernst, M., and Paulus, M. P. (2005). Neurobiology of decision making: a selective review from a neurocognitive and clinical perspective. Biol. Psychiatry 58, 597-604. doi: 10.1016/j.biopsych.2005.06.004
28. Esposito, F., Scarabino, T., Hyvarinen, A., Himberg, J., Formisano, E., Comani, S., et al. (2005). Independent component analysis of fMRI group studies by self-organizing clustering. Neuroimage 25, 193-205. doi: 10.1016/j.neuroimage.2004.10.042
29. Fellows, L. K. (2004). The cognitive neuroscience of human decision making: a review and conceptual framework. Behav. Cogn. Neurosci. Rev. 3, 159-172. doi: 10.1177/1534582304273251
30. Gehring, W. J., and Willoughby, A. R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science 295, 2279-2282. doi: 10.1126/science.1066893
31. Granger, C. W. J. (1988). Causality, cointegration, and control. J. Econ. Dyn. Control 12, 551-559. doi: 10.1016/0165-1889(88)90055-3
32. Gu, R., Ge, Y., Jiang, Y., and Luo, Y. J. (2010a). Anxiety and outcome evaluation: the good, the bad and the ambiguous. Biol. Psychol. 85, 200-206. doi: 10.1016/j.biopsycho.2010.07.001
33. Gu, R., Huang, Y. X., and Luo, Y. J. (2010b). Anxiety and feedback negativity. Psychophysiology 47, 961-967. doi: 10.1111/j.1469-8986.2010.00997.x
34. Gu, R., Lei, Z., Broster, L., Wu, T., Jiang, Y., and Luo, Y. J. (2011). Beyond valence and magnitude: a flexible evaluative coding system in the brain. Neuropsychologia 49, 3891-3897. doi: 10.1016/j.neuropsychologia.2011.10.006
35. Hake, H. W., and Hyman, R. (1953). Perception of the statistical structure of a random series of binary symbols. J. Exp. Psychol. 45, 64-74. doi: 10.1037/h0060873
36. Hertwig, R., and Erev, I. (2009). The description-experience gap in risky choice. Trends Cogn. Sci. 13, 517-523. doi: 10.1016/j.tics.2009.09.004
37. Holroyd, C. B., and Coles, M. G. H. (2002). The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109, 679-709. doi: 10.1037/0033-295X.109.4.679
38. Holroyd, C. B., Hajcak, G., and Larsen, J. T. (2006). The good, the bad and the neutral: electrophysiological responses to feedback stimuli. Brain Res. 1105, 93-101. doi: 10.1016/j.brainres.2005.12.015
39. Jung, K. Y., Kim, J. M., Kim, D. W., and Chung, C. S. (2005). Independent component analysis of generalized spike-and-wave discharges: primary versus secondary bilateral synchrony. Clin. Neurophysiol. 116, 913-919. doi: 10.1016/j.clinph.2004.11.023
40. Kahnt, T., Park, S. Q., Cohen, M. X., Beck, A., Heinz, A., and Wrase, J. (2009). Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions. J. Cogn. Neurosci. 21, 1332-1345. doi: 10.1162/jocn.2009.21092
41. Kamarajan, C., Rangaswamy, M., Chorlian, D. B., Manz, N., Tang, Y., Pandey, A. K., et al. (2008). Theta oscillations during the processing of monetary loss and gain: a perspective on gender and impulsivity. Brain Res. 1235, 45-62. doi: 10.1016/j.brainres.2008.06.051
42. Kamarajan, C., Rangaswamy, M., Manz, N., Chorlian, D. B., Pandey, A. K., Roopesh, B. N., et al. (2012). Topography, power, and current source density of theta oscillations during reward processing as markers for alcohol dependence. Hum. Brain Mapp. 33, 1019-1039. doi: 10.1002/hbm.21267
43. Klimesch, W., Sauseng, P., Hanslmayr, S., Gruber, W., and Freunberger, R. (2007). Event-related phase reorganization may explain evoked neural dynamics. Neurosci. Biobehav. Rev. 31, 1003-1016. doi: 10.1016/j.neubiorev.2007.03.005
44. Knutson, B., Rick, S., Wirnmer, G. E., Prelec, D., and Loewenstein, G. (2007). Neural predictors of purchases. Neuron 53, 147-156. doi: 10.1016/j.neuron.2006.11.010
45. Knyazev, G. G. (2007). Motivation, emotion, and their inhibitory control mirrored in brain oscillations. Neurosci. Biobehav. Rev. 31, 377-395. doi: 10.1016/j.neubiorev.2006.10.004
46. Lee, T. W., Girolami, M., and Sejnowski, T. J. (1999). Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources. Neural Comput. 11, 417-441. doi: 10.1162/089976699300016719
47. Lobier, M., Siebenhuhner, F., Palva, S., and Palva, J. M. (2014). Phase transfer entropy: a novel phase-based measure for directed connectivity in networks coupled by oscillatory interactions. Neuroimage 85(Pt 2), 853-872. doi: 10.1016/j.neuroimage.2013.08.056
48. Makeig, S. (1993). Auditory event-related dynamics of the EEG spectrum and effects of exposure to tones. Electroencephalogr. Clin. Neurophysiol. 86, 283-293. doi: 10.1016/0013-4694(93)90110-H
49. Makeig, S., Bell, A. J., Jung, T. P., and Sejnowski, T. J. (1996). "Independent component analysis of electroencephalographic data, " in Advances in Neural Informa-tion Processing Systems, eds D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo (Cambridge, MA: The MIT Press), 145-151.
50. Makeig, S., Delorme, A., Westerfield, M., Jung, T. P., Townsend, J., Courchesne, E., et al. (2004). Electroencephalographic brain dynamics following manually responded visual targets. PLoS Biol. 2:e176. doi: 10.1371/journal.pbio.0020176
51. Makeig, S., Westerfield, M., Jung, T. P., Enghoff, S., Townsend, J., Courchesne, E., et al. (2002). Dynamic brain sources of visual evoked responses. Science 295, 690-694. doi: 10.1126/science.1066168
52. Marco-Pallares, J., Cucurell, D., Cunillera, T., Garcia, R., Andres-Pueyo, A., Munte, T. F., et al. (2008). Human oscillatory activity associated to reward processing in a gambling task. Neuropsychologia 46, 241-248. doi: 10.1016/j.neuropsychologia.2007.07.016
53. Marshall, P. J., and Meltzoff, A. N. (2011). Neural mirroring systems: exploring the EEG mu rhythm in human infancy. Dev. Cogn. Neurosci. 1, 110-123. doi: 10.1016/j.dcn.2010.09.001
54. McFarland, D. J., Miner, L. A., Vaughan, T. M., and Wolpaw, J. R. (2000). Mu and beta rhythm topographies during motor imagery and actual movements. Brain Topogr. 12, 177-186. doi: 10.1023/A:1023437823106
55. Meltzer, J. A., Negishi, M., Mayes, L. C., and Constable, R. T. (2007). Individual differences in EEG theta and alpha dynamics during working memory correlate with fMRI responses across subjects. Clin. Neurophysiol. 118, 2419-2436. doi: 10.1016/j.clinph.2007.07.023
56. Milne, E., Scope, A., Pascalis, O., Buckley, D., and Makeig, S. (2009). Independent component analysis reveals atypical electroencephalographic activity during visual perception in individuals with autism. Biol. Psychiatry 65, 22-30. doi: 10.1016/j.biopsych.2008.07.017
57. Miyakoshi, M., Kanayama, N., Iidaka, T., and Ohira, H. (2010). EEG evidence of face-specific visual self-representation. Neuroimage, 50, 1666-1675. doi: 10.1016/j.neuroimage.2010.01.030
58. Nieuwenhuis, S., Aston-Jones, G., and Cohen, J. D. (2005). Decision making, the P3, and the locus coeruleus-norepinephrine system. Psychol. Bull. 131, 510-532. doi: 10.1037/0033-2909.131.4.510
59. Nigbur, R., Cohen, M. X., Ridderinkhof, K. R., and Sturmer, B. (2012). Theta dynamics reveal domain-specific control over stimulus and response conflict. J. Cogn. Neurosci. 24, 1264-1274. doi: 10.1162/jocn_a_00128
60. Onton, J., Delorme, A., and Makeig, S. (2005). Frontal midline EEG dynamics during working memory. Neuroimage 27, 341-356. doi: 10.1016/j.neuroimage.2005.04.014
61. Onton, J., and Makeig, S. (2006). "Information-based modeling of event-related brain dynamics, " in Event-Related Dynamics of Brain Oscillations, eds C. Neuper and W. Klimesch (Amsterdam: Elsevier), 99-120.
62. Onton, J., Westerfield, M., Townsend, J., and Makeig, S. (2006). Imaging human EEG dynamics using independent component analysis. Neurosci. Biobehav. Rev. 30, 808-822. doi: 10.1016/j.neubiorev.2006.06.007
63. Parra, L., Alvino, C., Tang, A., Pearlmutter, B., Yeung, N., Osman, A., et al. (2002). Linear spatial integration for single-trial detection in encephalography. Neuroimage 17, 223-230. doi: 10.1006/nimg.2002.1212
64. Paulus, M. P. (2005). Neurobiology of decision-making: Quo vadis? Cogn. Brain Res. 23, 2-10. doi: 10.1016/j.cogbrainres.2005.01.001
65. Perfetti, B., Moisello, C., Landsness, E. C., Kvint, S., Lanzafame, S., Onofrj, M., et al. (2011a). Modulation of gamma and theta spectral amplitude and phase synchronization is associated with the development of visuo-motor learning. J. Neurosci. 31, 14810-14819. doi: 10.1523/JNEUROSCI.1319-11.2011
66. Perfetti, B., Moisello, C., Landsness, E. C., Kvint, S., Pruski, A., Onofrj, M., et al. (2011b). Temporal evolution of oscillatory activity predicts performance in a choice-reaction time reaching task. J. Neurophysiol. 105, 18-27. doi: 10.1152/jn.00778.2010
67. Pessoa, L., and Padmala, S. (2007). Decoding near-threshold perception of fear from distributed single-trial brain activation. Cereb. Cortex 17, 691-701. doi: 10.1093/cercor/bhk020
68. Peterson, D. A., Lotz, D. T., Halgren, E., Sejnowski, T. J., and Poizner, H. (2011). Choice modulates the neural dynamics of prediction error processing during rewarded learning. Neuroimage 54, 1385-1394. doi: 10.1016/j.neuroimage.2010.09.051
69. Pfurtscheller, G., Brunner, C., Schlögl, A., and Lopes da Silva, F. H. (2006). Mu rhythm (de) synchronization and EEG single-trial classification of different motor imagery tasks. Neuroimage 31, 153-159. doi: 10.1016/j.neuroimage.2005.12.003
70. Philiastides, M. G., Biele, G., Vavatzanidis, N., Kazzer, P., and Heekeren, H. R. (2010). Temporal dynamics of prediction error processing during reward-based decision making. Neuroimage 53, 221-232. doi: 10.1016/j.neuroimage.2010.05.052
71. Philiastides, M. G., Ratcliff, R., and Sajda, P. (2006). Neural representation of task difficulty and decision making during perceptual categorization: a timing diagram. J. Neurosci. 26, 8965-8975. doi: 10.1523/JNEUROSCI.1655-06.2006
72. Platt, M. L. (2002). Neural correlates of decisions. Curr. Opin. Neurobiol. 12, 141-148. doi: 10.1016/S0959-4388(02)00302-1
73. Polich, J., and Criado, J. R. (2006). Neuropsychology and neuropharmacology of P3a and P3b. Int. J. Psychophysiol. 60, 172-185. doi: 10.1016/j.ijpsycho.2005.12.012
74. Rangel, A., Camerer, C., and Montague, P. R. (2008). A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9, 545-556. doi: 10.1038/nrn2357
75. Sabate, M., Llanos, C., Enriquez, E., and Rodriguez, M. (2012). Mu rhythm, visual processing and motor control. Clin. Neurophysiol. 123, 550-557. doi: 10.1016/j.clinph.2011.07.034
76. San Martín, R. (2012). Event-related potential studies of outcome processing and feedback-guided learning. Front. Hum. Neurosci. 6:304. doi: 10.3389/fnhum.2012.00304
77. San Martín, R., Appelbaum, L. G., Pearson, J. M., Huettel, S. A., and Woldorff, M. G. (2013). Rapid brain responses independently predict gain-maximization and loss-minimization during economic decision-making. J. Neurosci. 33, 7011-7019. doi: 10.1523/JNEUROSCI.4242-12.2013
78. Schultz, W. (2004). Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology. Curr. Opin. Neurobiol. 14, 139-147. doi: 10.1016/j.conb.2004.03.017
79. Schulz, E., Zherdin, A., Tiemann, L., Plant, C., and Ploner, M. (2012). Decoding an individual's sensitivity to pain from the multivariate analysis of EEG data. Cereb. Cortex 22, 1118-1123. doi: 10.1093/cercor/bhr186
80. Sengupta, K., and Abdel-Hamid, T. K. (1993). Alternative conceptions of feedback in dynamic decision environments: an experimental investigation. Manage. Sci. 39, 411-428. doi: 10.1287/mnsc.39.4.411
81. Steinhauser, M., and Yeung, N. (2010). Decision Processes in Human Performance Monitoring. J. Neurosci. 30, 15643-15653. doi: 10.1523/JNEUROSCI.1899-10.2010
82. Tallon-Baudry, C., Bertrand, O., Delpuech, C., and Pernier, J. (1996). Stimulus specificity of phase-locked and non-phase-locked 40 Hz visual responses in human. J. Neurosci. 16, 4240-4249.
83. Tversky, A., and Kahneman, D. (1971). Belief in the law of small numbers. Psychol. Bull. 76, 105-110. doi: 10.1037/h0031322
84. van de Vijver, I., Ridderinkhof, K. R., and Cohen, M. X. (2011). Frontal oscillatory dynamics predict feedback learning and action adjustment. J. Cogn. Neurosci. 23, 4106-4121. doi: 10.1162/jocn_a_00110
85. Walsh, M. M., and Anderson, J. R. (2011). Modulation of the feedback-related negativity by instruction and experience. Proc. Natl. Acad. Sci. U.S.A. 108, 19048-19053. doi: 10.1073/pnas.1117189108
86. Walsh, M. M., and Anderson, J. R. (2012). Learning from experience: event-related potential correlates of reward processing, neural adaptation, and behavioral choice. Neurosci. Biobehav. Rev. 36, 1870-1884. doi: 10.1016/j.neubiorev.2012.05.008
87. Wu, Y., and Zhou, X. L. (2009). The P300 and reward valence, magnitude, and expectancy in outcome evaluation. Brain Res. 1286, 114-122. doi: 10.1016/j.brainres.2009.06.032
88. Wunderlich, K., Symmonds, M., Bossaerts, P., and Dolan, R. J. (2011). Hedging your bets by learning reward correlations in the human brain. Neuron 71, 1141-1152. doi: 10.1016/j.neuron.2011.07.025
89. Wyart, V., de Gardelle, V., Scholl, J., and Summerfield, C. (2012). Rhythmic fluctuations in evidence accumulation during decision making in the human brain. Neuron 76, 847-858. doi: 10.1016/j.neuron.2012.09.015
90. Yeung, N., and Sanfey, A. G. (2004). Independent coding of reward magnitude and valence in the human brain. J. Neurosci. 24, 6258-6264. doi: 10.1523/JNEUROSCI.4537-03.2004
91. Zervakis, M., Michalopoulos, K., Iordanidou, V., and Sakkalis, V. (2011). Intertrial coherence and causal interaction among independent EEG components. J. Neurosci. Methods 197, 302-314. doi: 10.1016/j.jneumeth.2011.02.001
92. Zhang, D., Gu, R., Wu, T., Broster, L. S., Luo, Y., Jiang, Y., et al. (2013). An electrophysiological index of changes in risk decision-making strategies. Neuropsychologia 51, 1397-1407. doi: 10.1016/j.neuropsychologia.2013.04.014