Frontal midline theta and N200 amplitude reflect complementary information about expectancy and outcome evaluation

Psychophysiology

Volumn 50, Issue 6, 2013, Pages 550-562

  Hajihosseini, Azadeh ^a   Holroyd, Clay B ^a  

^a UNIVERSITY OF VICTORIA   (Canada)

Author keywords

Feedback ERN; Fontal midline theta; Reward prediction error

Indexed keywords

EID: 84877663114     PISSN: 00485772     EISSN: 14698986     Source Type: Journal    
DOI: 10.1111/psyp.12040     Document Type: Article

References (62)

1. Alexander, W. H., & Brown, J. W. (2011). Medial prefrontal cortex as an action-outcome predictor. Nature Neuroscience, 14, 1338-1344. doi: 10.1038/nn.2921
2. Baker, T. E., & Holroyd, C. B. (2011). Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200. Biological Psychology, 87, 25-34. doi: 10.1016/j.biopsycho.2011.01.010
3. Bernat, E. M., Nelson, L. D., Holroyd, C. B., Gehring, W. J., & Patrick, C. J. (2008). Separating cognitive processes with principal components analysis of EEG time-frequency distributions. In F. T. Luk (Ed.), Proceedings of the SPIE: Advanced Signal Processing Algorithms, Architectures, and Implementations XVIII (Vol. 7074, pp. 70740S-70740S). doi: 10.1117/12.801362
4. Burnham, K. P., & Anderson, D. R. (1998). Model selection and inference: An information-theoretic approach. New York, NY: Springer-Verlag.
5. Caplin, A., & Dean, M. (2008). Axiomatic methods, dopamine and reward prediction error. Current Opinion in Neurobiology, 18, 197-202. doi: 10.1016/j.conb.2008.07.007
6. Cavanagh, J. F., Bismark, A. J., Frank, M. J., & Allen, J. J. (2011). Larger error signals in major depression are associated with better avoidance learning. Frontiers in Psychology, 2, 331. doi: 10.3389/fpsyg.2011.00331
7. Cavanagh, J. F., Figueroa, C. M., Cohen, M. X., & Frank, M. J. (2011). Frontal theta reflects uncertainty and unexpectedness during exploration and exploitation. Cerebral Cortex, 22, 2575-2586. doi: 10.1093/cercor/bhr332
8. Cavanagh, J. F., Frank, M. J., & Allen, J. J. (2011). Social stress reactivity alters reward and punishment learning. Social Cognitive and Affective Neuroscience., 6, 311-320. doi: 10.1093/scan/nsq041
9. Cavanagh, J. F., Frank, M. J., Klein, T. J., & Allen, J. J. (2010). Frontal theta links prediction errors to behavioral adaptation in reinforcement learning. NeuroImage, 49, 3198-3209. doi: 10.1016/j.neuroimage.2009.11.080
10. Cavanagh, J. F., Wiecki, T. V., Cohen, M. X., Figueroa, C. M., Samanta, J., Sherman, S. J., & Frank, M. J. (2011). Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold. Nature Neuroscience, 14, 1462-1467. doi: 10.1038/nn.2925
11. Cavanagh, J. F., Zambrano-Vazquez, L., & Allen, J. J. (2012). Theta lingua franca: A common mid-frontal substrate for action monitoring processes. Psychophysiology, 49, 220-238. doi: 10.1111/j.1469-8986.2011.01293.x
12. Christie, G. J., & Tata, M. S. (2009). Right frontal cortex generates reward-related theta-band oscillatory activity. NeuroImage, 48, 415-422. doi: 10.1016/j.neuroimage.2009.06.076
13. Cohen, J. (1994). The earth is round (p<. 05). American Psychologist, 49, 997-1003. doi: 10.1037/0003-066X.49.12.997
14. Cohen, M. X. (2011). Error-related medial frontal theta activity predicts cingulate-related structural connectivity. NeuroImage, 55, 1373-1383. doi: 10.1016/j.neuroimage.2010.12.072
15. Cohen, M. X., & Cavanagh, J. F. (2011). Single-trial regression elucidates the role of prefrontal theta oscillations in response conflict. Frontiers in Psychology, 2, 30. doi: 10.3389/fpsyg.2011.00030
16. Cohen, M. X., Ridderinkhof, K. R., Haupt, S., Elger, C. E., & Fell, J. (2008). Medial frontal cortex and response conflict: Evidence from human intracranial EEG and medial frontal cortex lesion. Brain Research, 1238, 127-142. doi: 10.1016/j.brainres.2008.07.114
17. Cohen, M. X., Wilmes, K., & van de Vijver, I. (2011). Cortical electrophysiological network dynamics of feedback learning. Trends in Cognitive Sciences, 15, 558-566. doi: 10.1016/j.tics.2011.10.004
18. Donkers, F. C., Nieuwenhuis, S., & van Boxtel, G. J. (2005). Mediofrontal negativities in the absence of responding. Cognitive Brain Research, 25, 777-787. doi: 10.1016/j.cogbrainres.2005.09.007
19. Donkers, F. C., & van Boxtel, G. J. (2005). Mediofrontal negativities to averted gains and losses in the slot-machine task. Journal of Psychophysiology, 19, 256-262. doi: 10.1027/0269-8803.19.4.256
20. Eppinger, B., Kray, J., Mock, B., & Mecklinger, A. (2008). Better or worse than expected? Aging, learning, and the ERN. Neuropsychologia, 46, 521-539. doi: 10.1016/j.neuropsychologia.2007.09.001
21. Ferdinand, N. K., Mecklinger, A., Kray, J., & Gehring, W. J. (2012). The processing of unexpected positive response outcomes in the mediofrontal cortex. The Journal of Neuroscience, 32, 12087-12092. doi: 10.1523/JNEUROSCI.1410-12.2012
22. Foti, D., Weinberg, A., Dien, J., & Hajcak, G. (2011). Event-related potential activity in the basal ganglia differentiates rewards from nonrewards: Temporospatial principal components analysis and source localization of the feedback negativity. Human Brain Mapping, 32, 2207-2216. doi: 10.1002/hbm.21182
23. Glover, S., & Dixon, P. (2004). Likelihood ratios: A simple and flexible statistic for empirical psychologists. Psychonomic Bulletin & Review, 11, 791-806. doi: 10.3758/BF03196706
24. Gratton, G., Coles, M. G. H., & Donchin, E. (1983). A new method for off-line removal of ocular artifact. Electroencephalography and Clinical Neurophysiology, 55, 468-484. doi: 10.1016/0013-4694(83)90135-9
25. HajiHosseini, A., Rodriguez-Fornells, A., & Marco-Pallares, J. (2012). The role of beta-gamma oscillations in unexpected rewards processing. NeuroImage, 60, 1678-1685. doi: 10.1016/j.neuroimage.2012.01.125
26. Hewig, J., Kretschmer, N., Trippe, R. H., Hecht, H., Coles, M. G., Holroyd, C. B., & Miltner, W. H. (2010). Hypersensitivity to reward in problem gamblers. Biological Psychiatry, 67, 781-783. doi: 10.1016/j.biopsych.2009.11.009
27. Holroyd, C. B. (2004). A note on the oddball N200 and the feedback ERN. In M. Ullsperger & M. Falkenstein (Eds.), Errors, conflicts, and the brain: Current opinions on performance monitoring, (pp. 211-218). Leipzig, Germany: MPI of Cognitive Neuroscience.
28. Holroyd, C. B., & Coles, M. G. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679-709. doi: 10.1037/0033-295X.109.4.679
29. Holroyd, C. B., HajiHosseini, A., & Baker, T. E. (2012). ERPs and EEG oscillations, best friends forever: Comment on Cohen etal. Trends in Cognitive Sciences, 16, 192. doi: 10.1016/j.tics.2012.02.008
30. Holroyd, C. B., & Krigolson, O. E. (2007). Reward prediction error signals associated with a modified time estimation task. Psychophysiology, 44, 913-917. doi: 10.1111/j.1469-8986.2007.00561.x
31. Holroyd, C. B., Krigolson, O. E., & Lee, S. (2011). Reward positivity elicited by predictive cues. NeuroReport, 22, 249-252. doi: 10.1097/WNR.0b013e328345441d
32. Holroyd, C. B., Nieuwenhuis, S., Yeung, N., & Cohen, J. D. (2003). Errors in reward prediction are reflected in the event-related brain potential. NeuroReport, 14, 2481-2484. doi: 10.1097/01.wnr.0000099601.41403.a5
33. Holroyd, C. B., Pakzad-Vaezi, K. L., & Krigolson, O. E. (2008). The feedback correct-related positivity: Sensitivity of the event-related brain potential to unexpected positive feedback. Psychophysiology, 45, 688-697. doi: 10.1111/j.1469-8986.2008.00668.x
34. Holroyd, C. B., & Yeung, N. (2012). Motivation of extended behaviors by anterior cingulate cortex. Trends in Cognitive Sciences, 16, 122-128. doi: 10.1016/j.tics.2011.12.008
35. Jensen, O., & Tesche, C. D. (2002). Frontal theta activity in humans increases with memory load in a working memory task. European Journal of Neuroscience, 15, 1395-1399. doi: 10.1046/j.1460-9568.2002.01975.x
36. Kamarajan, C., Rangaswamy, M., Chorlian, D. B., Manz, N., Tang, Y., Pandey, A. K., ... Porjesz, B. (2008). Theta oscillations during the processing of monetary loss and gain: A perspective on gender and impulsivity. Brain Research, 1235, 45-62. doi: 10.1016/j.brainres.2008.06.051
37. Khamassi, M., Lallée, S., Enel, P., Procyk, E., & Dominey, P. F. (2011). Robot cognitive control with a neurophysiologically inspired reinforcement learning model. Frontiers in Neurorobotics, 5, 1. doi: 10.3389/fnbot.2011.00001
38. Kruschke, J. K. (2010). Bayesian data analysis. Wiley Interdisciplinary Reviews: Cognitive Science, 1, 658-676. doi: 10.1002/wcs.72
39. Luck, S. J. (2005). An introduction to the event-related potential technique. Cambridge, MA: MIT Press.
40. Luque, D., Lopez, F. J., Marco-Pallares, J., Camara, E., & Rodriguez-Fornells, A. (2012). Feedback-related brain potential activity complies with basic assumptions of associative learning theory. Journal of Cognitive Neuroscience, 24, 794-808. doi: 10.1162/jocn_a_00145
41. Luu, P., & Tucker, D. M. (2001). Regulating action: Alternating activation of midline frontal and motor cortical networks. Clinical Neurophysiology, 112, 1295-1306. doi: 10.1016/S1388-2457(01)00559-4
42. Luu, P., Tucker, D. M., & Makeig, S. (2004). Frontal midline theta and the error-related negativity: Neurophysiological mechanisms of action regulation. Clinical Neurophysiology, 115, 1821-1835. doi: 10.1016/j.clinph.2004.03.031
43. Makeig, S., Westerfield, M., Jung, T. P., Enghoff, S., Townsend, J., Courchesne, E., & Sejnowski, T. J. (2002). Dynamic brain sources of visual evoked responses. Science, 295, 690-694. doi: 10.1126/science.1066168
44. Marco-Pallares, J., Cucurell, D., Cunillera, T., García, R., Andrés-Pueyo, A., Munte, T., & Rodriguez-Fornells, A. (2008). Human oscillatory activity associated to reward processing in a gambling task. Neuropsychologia, 46, 241-248. doi: 10.1016/j.neuropsychologia.2007.07.016
45. Masson, M. E. (2011). A tutorial on a practical Bayesian alternative to null-hypothesis significance testing. Behavior Research Methods, 43, 679-690. doi: 10.3758/s13428-010-0049-5
46. Miltner, W. H., Braun, C. H., & Coles, M. G. (1997). Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a "generic" neural system for error detection. Journal of Cognitive Neuroscience, 9, 788-798. doi: 10.1162/jocn.1997.9.6.788
47. Oliveira, F. T., McDonald, J. J., & Goodman, D. (2007). Performance monitoring in the anterior cingulate is not all error related: Expectancy deviation and the representation of action-outcome associations. Journal of Cognitive Neuroscience, 19, 1994-2004. doi: 10.1162/jocn.2007.19.12.1994
48. Potts, G. F., Martin, L. E., Burton, P., & Montague, P. R. (2006). When things are better or worse than expected: The medial frontal cortex and the allocation of processing resources. Journal of Cognitive Neuroscience, 18, 1112-1119. doi: 10.1162/jocn.2006.18.7.1112
49. Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25, 111-164.
50. San Martin, R., Manes, F., Hurtado, E., Isla, P., & Ibanez, A. (2010). Size and probability of rewards modulate the feedback error-related negativity associated with wins but not losses in a monetarily rewarded gambling task. NeuroImage, 51, 1194-1204. doi: 10.1016/j.neuroimage.2010.03.031
51. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275, 1593-1599. doi: 10.1126/science.275.5306.1593
52. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
53. Tallon-Baudry, C., & Bertrand, O. (1999). Oscillatory gamma activity in humans and its role in object representation. Trends in Cognitive Sciences, 3, 151-162. doi: 10.1016/S1364-6613(99)01299-1
54. Talmi, D., Fuentemilla, L., Litvak, V., Duzel, E., & Dolan, R. J. (2012). An MEG signature corresponding to an axiomatic model of reward prediction error. NeuroImage, 59, 635-645. doi: 10.1016/j.neuroimage.2011.06.051
55. Trujillo, L. T., & Allen, J. J. (2007). Theta EEG dynamics of the error-related negativity. Clinical Neurophysiology, 118, 645-668. doi: 10.1016/j.clinph.2006.11.009
56. Tzur, G., & Berger, A. (2009). Fast and slow brain rhythms in rule/expectation violation tasks: Focusing on evaluation processes by excluding motor action. Behavioral Brain Research, 198, 420-428. doi: 10.1016/j.bbr.2008.11.041
57. van de Vijver, I., Ridderinkhof, K. R., & Cohen, M. X. (2011). Frontal oscillatory dynamics predict feedback learning and action adjustment. Journal of Cognitive Neuroscience, 23, 4106-4121. doi: 10.1162/jocn_a_00110
58. Wagenmakers, E. J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin and Review, 14, 779-804. doi: 10.3758/BF03194105
59. Walsh, M. M., & Anderson, J. R. (2012). Learning from experience: Event-related potential correlates of reward processing, neural adaptation, and behavioral choice. Neuroscience & Biobehavioral Reviews, 36, 1870-1884. doi: 10.1016/j.neubiorev.2012.05.008
60. Warren, C. M., & Holroyd, C. B. (2012). The impact of deliberative strategy dissociates ERP components related to conflict processing vs. reinforcement learning. Frontiers in Neuroscience, 6, 43. doi: 10.3389/fnins.2012.00043
61. Yeung, N., Bogacz, R., Holroyd, C. B., & Cohen, J. D. (2004). Detection of synchronized oscillations in the electroencephalogram: An evaluation of methods. Psychophysiology, 41, 822-832. doi: 10.1111/j.0048-5772.2004.00239.x
62. Zaghloul, K. A., Blanco, J. A., Weidemann, C. T., McGill, K., Jaggi, J. L., Baltuch, G. H., & Kahana, M. J. (2009). Human substantia nigra neurons encode unexpected financial rewards. Science, 323, 1496-1499. doi: 10.1126/science.1167342