Dissociation of response and feedback negativity in schizophrenia: Electrophysiological and computational evidence for a deficit in the representation of value

Frontiers in Human Neuroscience

Volumn , Issue OCTOBER, 2011, Pages

  Morris, Sarah E ^a,b   Holroyd, Clay B ^c   Mann Wrobel, Monica C ^a   Gold, James M ^b  

^a Education and Clinical Center   (United States)

^b UNIVERSITY OF MARYLAND SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF VICTORIA   (Canada)

Author keywords

Dopamine; Error related negativity; Feedback; Reward; Schizophrenia

Indexed keywords

ADULT; AMPLITUDE MODULATION; ARTICLE; BRAIN ELECTROPHYSIOLOGY; CLINICAL ARTICLE; CONTROLLED STUDY; DISEASE ASSOCIATION; EVOKED CORTICAL RESPONSE; FEMALE; HUMAN; INTERMETHOD COMPARISON; MALE; MATHEMATICAL MODEL; MENTAL PERFORMANCE; MOLECULAR PATHOLOGY; NEGATIVE FEEDBACK; NEUROFEEDBACK; NEUROIMAGING; OUTCOME ASSESSMENT; POSITIVE FEEDBACK; PREDICTION; REINFORCEMENT; REWARD; SCHIZOPHRENIA; SENSITIVITY ANALYSIS; SYSTEMATIC ERROR; TASK PERFORMANCE;

EID: 84933677549     PISSN: 16625161     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2011.00123     Document Type: Article

References (99)

1. Alain, C., McNeely, H. E., He, Y., Christensen, B. L., and West, R. (2002). Neurophysiological evidence of error-monitoring deficits in patients with schizophrenia. Cereb. Cortex 12, 840-846.
2. Allain, S., Hasbroucq, T., Burle, B., Grapperon, J., and Vidal, F. (2004). Response monitoring without sensory feedback. Clin. Neurophysiol. 115, 2014-2020.
3. Andreasen, N. (1982). The Scale for the Assessment ofNegative Symptoms (SANS). Iowa City: University of Iowa.
4. Angel, R. W. (1976). Efference copy in the control of movement. Neurology 26, 1164-1168.
5. Baker, T. E., and Holroyd, C. B. (2011). Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feed-back error-related negativity and N200. Biol. Psychol. 87, 25-34.
6. Bates, A. T., Kiehl, K. A., Laurens, K. R., and Liddle, P. F. (2002). Error-related negativity and correct response negativity in schiz-ophrenia. Clin. Neurophysiol. 113, 1454-1463.
7. Bates, A. T., Liddle, P. F., Kiehl, K. A., and Ngan, E. T. C. (2004). State dependent changes in error monitoring in schizophrenia. J. Psychiatr. Res. 38, 347-356.
8. Bilder, R. M., Volavka, J., Lachman, H. M., and Grace, A. A. (2004). The catechol-O-methyltransferase polymorphism: relations to the tonic-phasic dopamine hypothe-sis and neuropsychiatric pheno-types. Neuropsychopharmacology 29, 1943-1961.
9. Bryson, G., Whelahan, H., and Bell, M. (2001). Memory and executive function impairments in deficit syndrome schizophrenia. Psychiatry Res. 102, 29-37.
10. Cockburn, J., and Holroyd, C. B. (2010). Focus on the positive: computational simulations impli-cate asymmetrical reward pre-diction error signals in childhood attention-deficit/ hyperactivity disorder. Brain Res. 1365, 18-34.
11. Cohen, M. X. (2008). Neurocomputational mechanisms of reinforcement-guided learning in humans: a review. Cogn. Affect. Behav. Neurosci. 8, 113-125.
12. Cohen, M. X., Elger, C. E., and Ran-ganath, C. (2007). Reward expectation modulates feedback-related negativity and EEG spectra. Neu-roimage 35, 968-978.
13. Cohen, M. X., and Frank, M. J. (2009). Neurocomputational models of basal ganglia function in learning, memory and choice. Behav. BrainRes. 199, 141-156.
14. Corlett, P. R., Honey, G. D., Aitken, M. R. F., Dickinson, A., Shanks, D. R., Absalom, A. R., Lee, M., Pomarol-Clotet, E., Murray, G. K., McKenna, P. J., Robbins, T. W., Bullmore, E. T., and Fletcher, P. C. (2006). Frontal responses during learning predict vulnerability to the psychotogenic effects of ketamine: linking cognition, brain activity, and psychosis. Arch. Gen. Psychiatry 63, 611-621.
15. Corlett, P. R., Honey, G. D., and Fletcher, P. C. (2007). From prediction error to psychosis: ketamine as a pharmacological model of delusions. J. Psychopharmacol 21,238-252.
16. Davis, K. L. K., Rene, S., Ko, G., and Davidson, M. (1991). Dopamine in schizophrenia: a review and reconaceptualization. Am.J. Psychiatry 148, 1474-1486.
17. Dayan, P., and Daw, N. D. (2008). Decision theory, reinforcement learning, and the brain. Cogn. Affect. Behav. Neurosci. 8, 429-453.
18. de Bruijn, E., Sabbe, B., Hulstijn, W., Ruigt, G., and Verkes, R. (2006). Effects of antipsychotic and antidepressant drugs on action monitor-ing in healthy volunteers. Brain Res. 1105, 122-129.
19. Eppinger, B., Kray, J., Mock, B., and Mecklinger, A. (2008). Better or worse than expected? Aging, learning, and the ERN. Neuropsychologia 46, 521-539.
20. Eriksen, B.A., andEriksen, C.W. (1974). Effects ofnoise letters upon the identification of a target letter in a non-search task. Percept. Psychophys. 16, 143-149.
21. Falkenstein, M. (1990). "Effects oferrors in choice reaction tasks on the ERP under focused and divided atten-tion, " in Psychophysiological Brain Research, eds C. K. Brunia, A. Gaillard, and A. Kok (Tilburg: Tilburg University Press), 192-195.
22. Feinberg, I. (1978). Efference copy and corollary discharge: implications for thinking and its disorders. Schizophr. Bull. 4, 636-640.
23. First, M., Spitzer, R., Gibbon, M., and Williams, J. (1994). Structured Clinical InterviewforAxis IDSM-IV. New York: Biometrics Research Depart-ment, New State Psychiatric Insti-tute.
24. Fletcher, P. C., and Frith, C. D. (2009). Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia. Nat. Rev. Neurosci. 10, 48-58.
25. Frank, M. J. (2008). Schizophrenia: a computational reinforcement learning perspective. Schizophr. Bull. 34, 1008-1011.
26. Frank, M. J., Samanta, J., Moustafa, A. A., and Sherman, S. J. (2007). Hold your horses: impulsivity, deep brain stimulation, and medication in Parkinsonism. Science 318, 1309-1312.
27. Frith, C. D., Blakemore, S., and Wolpert, D. M. (2000). Explaining the symp-toms of schizophrenia: Abnormalities in the awareness of action. Brain Res. Rev. 31,357-363.
28. Frith, C. D., and Done, D. J. (1988). Towards a neuropsychology of schiz-ophrenia. Br. J. Psychiatry 153, 437-443.
29. Frith, C. D., and Done, D. J. (1989). Experiences of alien control in schiz-ophrenia reflect a disorder in the central monitoring of action. Psy-chol. Med. 19,359-363.
30. Gehring, W. J., Goss, B., Coles, M. G., Meyer, D.E., and Donchin, E. (1993). A neural system for error detection and compensation. Psychol. Sci. 4, 385-390.
31. Gehring, W. J., and Willoughby, A. R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science 295, 2279-2282.
32. Gold, J. M., Waltz, J. A., Matveeva, T. M., Kasanova, Z., Strauss, G. P., Herbener, E. S., Collins, A. G. E., and Frank, M. J. (in press). Neg-ative symptoms in schizophrenia result from a failure to represent the expected value of rewards: Behavioral and computational modeling evidence. Arch. Gen. Psychiatry.
33. Gold, J. M., Waltz, J. A., Prentice, K. J., Morris, S. E., and Heerey, E. A. (2008). Reward processing in schiz-ophrenia: a deficit in the represen-tation of value. Schizophr. Bull. 34, 835-847.
34. Gratton, G., Coles, M. G. H., and Donchin, E. (1983). A new method for offline removal of ocular arti-fact. Electroencephalogr. Clin. Neuro-physiol. 55, 468-484.
35. Heerey, E. A., Bell-Warren, K. R., and Gold, J. M. (2008). Decision-making impairments in the context of intact reward sensitivity in schizophrenia. Biol. Psychiatry 64, 62-69.
36. Heerey, E. A., and Gold, J. M. (2007). Patients with schizophrenia demonstrate dissociation between affective experience and motivated behavior. J. Abnorm. Psychol. 116, 268-278.
37. Heerey, E. A., Matveeva, T. M., and Gold, J. M. (2011). Imagining the future: degraded representations of future rewards and events in schizophrenia. J. Abnorm. Psychol. 120, 483-489.
38. Heerey, E. A., Robinson, B. M., McMahon, R. P., and Gold, J. M. (2007). Delay discounting in schiz-ophrenia. Cogn. Neuropsychiatry 12, 213-221.
39. Holroyd, C. B., and Coles, M. G. (2008). Dorsal anterior cingulate cortex integrates reinforcement history to guide voluntary behavior. Cortex 44, 548-559.
40. Holroyd, C. B., and Coles, M. G. H. (2002). The neural basis of human error processing: reinforcement learning, dopamine, and the error-relatednegativity. Psychol. Rev. 109, 679-709.
41. Holroyd, C. B., Hajcak, G., and Larsen, J. T. (2006). The good, the bad and the neutral: electrophysiological responses to feedback stimuli. Brain Res. 1105,93-101.
42. Holroyd, C. B., and Krigolson, O. E. (2007). Reward prediction error signals associated with a modified time estimation task. Psychophysiology 44, 913-917.
43. Holroyd, C. B., Krigolson, O. E., Baker, R., Lee, S., and Gibson, J. (2009). When is an error not a prediction error? An electrophysiological inves-tigation. Cogn. Affect. Behav. Neurosci. 9, 59-70.
44. Holroyd, C. B., Krigolson, O. E., and Lee, S. (2011). Reward positivity elicited by predictive cues. Neuroreport 22, 249-252.
45. Holroyd, C. B., Pakzad-Vaezi, K. L., and Krigolson, O. E. (2008). The feedback correctrelated posi-tivity: sensitivity of the event-related brain potential to unexpected pos-itive feedback. Psychophysiology 45, 688-697.
46. Holroyd, C. B., Yeung, N., Coles, M. G., and Cohen, J. D. (2005). A mecha-nism for error detection in speeded response time tasks. J. Exp. Psychol. Gen. 134,163-191.
47. Horan, W. P., Green, M. F., Knowlton, B. J., Wynn, J. K., Mintz, J., and Nuechterlein, K. H. (2008). Impaired implicit learning in schizophrenia. Neuropsychology 22, 606-617.
48. Juckel, G., Schlagenhauf, F., Koslowski, M., Filonov, D., Wustenberg, T., Villringer, A., Knutson, B., Kienast, T., Gallinat, J., Wrase, J., and Heinz, A. (2006). Dysfunction of ventral striatal reward prediction in schizophrenic patients treated with typical, not atypical, neuroleptics. Psychopharmacology (Berl.) 187, 222-228.
49. Kapur, S. (2003). Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacologyinschizophrenia. Am. J. Psychiatry 160,13-23.
50. Kirsch, P., Ronshausen, S., Mier, D., and Gallhofer, B. (2007). The influence of antipsychotic treatment on brain reward system reactivity in schizo-phrenia patients. Pharmacopsychiatry 40, 196-198.
51. Koch, K., Schachtzabel, C., Wagner, G., Schikora, J., Schultz, C., Reichen-bach, J. R., Sauer, H., and Schlosser, R. G. (2010). Altered activation in association with reward-related trial-and-error learning in patients with schizophrenia. Neuroimage 50, 223-232.
52. Kopp, B., and Rist, F. (1999). An event-related brain potential substrate of disturbed response monitoring in paranoid schizophrenic patients. J. Abnorm. Psychol. 108, 337-346.
53. Krawitz, A., Braver, T. S., Barch, D. M., and Brown, J. W. (2011). Impaired error-likelihood predic-tion in medial prefrontal cortex in schizophrenia. Neuroimage 54, 1506-1517.
54. Lau, B., and Glimcher, P. W. (2008). Value representations in the primate striatum during matching behavior. Neuron 58, 451-463.
55. Logothetis, N. K. (2003). The under-pinnings of the BOLD functional magnetic resonance imaging signal. J. Neurosci. 23, 3963-3971.
56. Luck, S. J. (2005). An Introduction to the Event-Related Potential Technique. Cambridge, MA: MIT Press.
57. Luck, S. J., Kappenman, E. S., Fuller, R. L., Robinson, B., Summerfelt, A., and Gold, J. M. (2009). Impaired response selection in schizophrenia: evidence from the P3 wave and the lateralized readiness potential. Psy-chophysiology 46, 776-786.
58. Malenka, R. C., Angel, R. W., Hampton, B., and Berger, P. A. (1982). Impaired central error-correcting behavior in schizophrenia. Arch. Gen. Psychiatry 39, 101-107.
59. Malenka, R. C., Angel, R. W., Thiemann, S., Weitz, C. J., and Berger, P. A. (1986). Central error-correcting behavior in schizophrenia and depression. Biol. Psychol. 21, 263-273.
60. Marco-Pallares, J., Cucurell, D., Münte, T. F., Strien, N., and Rodriguez-Fornells, A. (2011). On the number of trials needed for astable feedback-related negativity. Psychophysiology 47, 852-860.
61. Mathalon, D. H., Fedor, M., Faustman, W. O., Gray, M., Askari, N., and Ford, J. M. (2002). Response-monitoring dysfunction in schizophrenia: an event-related brain potential study. J. Abnorm. Psychol. 111,22-41.
62. Matthysse, S. (1973). Antipsychotic drug actions: a clue to the neu-ropathology of schizophrenia? Fed. Proc. 32, 200-205.
63. Miller, G. A., Gratton, G., and Yee, C. M. (1988). Generalized implemen-tation of an eye movement correc-tion procedure. Psychophysiology 25, 241-243.
64. Miltner, W., Braun, C. H., and Coles, M. G. H. (1997). Event-related brain potentials following incorrect feed-back in a time-estimation task: evidence for a generic neural system for error detection. J. Cogn. Neurosci. 9, 788-798.
65. Montague, P. R., and Sejnowski, T. J. (1994). The predictivebrain: tempo-ral coincidence and temporal order in synaptic learning mechanisms. Learn. Mem. 1, 1-33.
66. Morris, S. E., Heerey, E. A., Gold, J. M., andHolroyd, C. B. (2008). Learning-related changes in brain activity fol-lowing errors and performance feed-back in schizophrenia. Schizophr. Res. 99, 274-285.
67. Morris, S. E., Yee, C. M., and Nuechter-lein, K. H. (2006). Electrophysiolog-ical analysis of error monitoring in schizophrenia. J. Abnorm. Psychol. 115, 239-250.
68. Murray, G. K., Corlett, P. R., Clark, L., Pessiglione, M., Blackwell, A. D., Honey, G., Jones, P. B., Bullmore, E. T., Robbins, T. W., and Fletcher, P. A. (2008). Substantia nigra/ventral tegmental reward prediction error disruption in psychosis. Mol. Psychi-atry 13, 267-276.
69. Nieuwenhuis, S., Nielen, M. M., Mol, N., Hajcak, G., and Veltman, D. J. (2005). Performance monitoring in obsessive-compulsive disorder. Psy-chiatryRes. 134,111-122.
70. Nieuwenhuis, S., Ridderinkhof, K. R., Talsma, D., Coles, M. G. H., Hol-royd, C. B., Kok, A., and van der Molen, M. W. (2002). A computa-tional account of altered error pro-cessing in older age: dopamine and the error-related negativity. Cogn. Affect. Behav. Neurosci. 2, 19-36.
71. Nieuwenstein, M. R., Aleman, A., and de Haan, E. H. (2001). Relationship between symptom dimensions and neurocognitive functioning in schiz-ophrenia: a meta-analysis of WCST and CPT studies. J. Psychiatr. Res. 35, 119-125.
72. Niv, Y. (2009). Reinforcement learning in the brain. J. Math. Psychol. 53, 139-154.
73. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., and Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304, 452-454.
74. O'Reilly, R. C., and Farah, M. J. (1999). Simulation and explanation in neuropsychology and beyond. Cogn. Neuropsychol. 16, 49-72.
75. Overall, J. E., and Gorham, D. R. (1962). The brief psychiatric rating scale. Psychol. Rep. 10, 799-812.
76. Potts, G. F., Martin, L. E., Burton, P., and Montague, P. (2006). When things are better or worse than expected: the medial frontal cortex and the allocation of processing resources. J. Cogn. Neurosci. 18, 1112-1119.
77. Prentice, K. J., Gold, J. M., and Buchanan, R. W. (2008). The Wis-consin card sorting impairment in schizophrenia is evident in the first four trials. Schizophr. Res. 106, 81-87.
78. Rabbitt, P. M. (1966). Error correction time without external error signals. Nature 212, 438.
79. Ruchsow, M., Grothe, J., Spitzer, M., and Kiefer, M. (2002). Human anterior cingulate cortex is activated by neg-ative feedback: evidence from event-related potentials in a guessing task. Neurosci. Lett. 325, 203-206.
80. Samejima, K., Ueda, Y., Doya, K., and Kimura, M. (2005). Represen-tation of action-specific reward val-ues in the striatum. Science 310, 1337-1340.
81. Schlagenhauf, F., Juckel, G., Koslowski, M., Kahnt, T., Knutson, B., Dem-bler, T., Kienast, T., Gallinat, J., Wrase, J., and Heinz, A. (2008). Reward system activation in schiz-ophrenic patients switched from typical neuroleptics to olanzap-ine. Psychopharmacology (Berl.) 196, 673-684.
82. Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neu-rophysiol. 80, 1-27.
83. Schultz, W. (2002). Getting formal with dopamine and reward. Neuron 36, 241-263.
84. Schultz, W., Romo, R., Ljungberg, T., Mirenowicz, J., Hollerman, J. R., and Dickinson, A. (1995). "Reward-related signals carried by dopamine neurons, " in Models of Informa-tion Processing in the Basal Gan-glia, eds J. Houk, J. Davis, and D. Beiser (Cambridge, MA: MIT Press), 233-248.
85. Simon, J. J., Biller, A., Walther, S., Roesch-Ely, D., Stippich, C., Weis-brod, M., and Kaiser, S. (2010). Neural correlates of reward process-ing in schizophrenia-relationship to apathy and depression. Schizophr. Res. 118,154-161.
86. Smith, A., Li, M., Becker, S., and Kapur, S. (2006). Dopamine, predic-tion error and associative learning: a model-based account. Network 17, 61-84.
87. Snitz, B. E., MacDonald, A. III, Cohen, J. D., Cho, R. Y., Becker, T., and Carter, C. S. (2005). Lateral and medial hypofrontalityin first-episode schiz-ophrenia: functional activity in a medication-naive state and effects of short-term atypical antipsychotic treatment. Am. J. Psychiatry 162, 2322-2329.
88. Strauss, G. P., Robinson, B. M., Waltz, J. A., Frank, M. J., Kasanova, Z., Herbener, E. S., and Gold, J. M. (2011). Patients with schizophrenia demonstrateinconsistent preference judgments for affective and nonaf-fective stimuli. Schizophr. Bull. 37, 1295-1304.
89. Suri, R. E. (2002). TD models of reward predictive responses in dopamine neurons. NeuralNetw. 15, 523-533.
90. Suri, R. E., Bargas, J., and Arbib, M. A. (2001). Modeling functions of stri-atal dopamine modulation in learning and planning. Neuroscience 103, 65-85.
91. Sutton, R. S. (1988). Learning to pre-dict by the method of temporal differences. Mach. Learn. 3, 9-44.
92. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning: An Intro-duction. Cambridge, MA: MIT Press.
93. Ursu, S., Kring, A. M., Gard, M. G., Minzenberg, M. J., Yoon, J. H., Ragland, J. D., Solomon, M., and Carter, C. S. (2011). Pre-frontal cortical deficits andimpaired cognition-emotion interactions in schizophrenia. Am. J. Psychiatry 168, 276-285.
94. Waltz, J. A., Frank, M. J., Robinson, B. M., and Gold, J. M. (2007). Selec-tive reinforcement learning deficits in schizophrenia support predic-tions from computational models of striatal-cortical dysfunction. Biol. Psychiatry 62, 756-764.
95. Waltz, J. A., Schweitzer, J. B., Gold, J. M., Kurup, P. K., Ross, T. J., Salmeron, B. J., Rose, E. J., McClure, S. M., and Stein, E. A. (2009). Patients with schizophrenia have a reduced neural response to both unpredictable and predictable pri-mary reinforcers. Neuropsychophar-macology 34, 1567-1577.
96. Weickert, T. W., Terrazas, A., Bigelow, L. B., Malley, J. D., Hyde, T., Egan, M. F., Weinberger, D. R., and Gold-berg, T. E. (2002). Habit and skill learning in schizophrenia: evidence of normal striatal processing with abnormal input. Learn. Mem. 9, 430-442.
97. Weiler, J. A., Bellebaum, C., Brune, M., Juckel, G., and Daum, I. (2009). Impairment of probabilistic reward-based learning in schizophrenia. Neuropsychology 23, 571-580.
98. Ziauddeen, H., and Murray, G. K. (2010). The relevance of reward pathways for schizophrenia. Curr. Opin. Psychiatry 23, 91-96.
99. Zirnheld, P. J., Carroll, C. A., Kieffaber, P. D., O'Donnell, B. F., Shekhar, A., and Hetrick, W. P. (2004). Haloperidol impairs learning and error-related negativity in humans. J. Cogn. Neurosci. 16, 1098-1112.