Organization of neural systems for aversive information processing: Pain, error, and punishment

Frontiers in Neuroscience

Volumn , Issue SEP, 2012, Pages

  Kobayashi, Shunsuke ^a  

^a FUKUSHIMA MEDICAL UNIVERSITY   (Japan)

Author keywords

Amygdala; Anterior cingulate cortex; Error related negativity; Orbitofrontal cortex; Pain; Periaqueductal gray; Prefrontal cortex; Reward

Indexed keywords

AMYGDALOID NUCLEUS; AVERSIVE BEHAVIOR; COGNITION; DEFENSE MECHANISM; HUMAN; INFORMATION PROCESSING; INSULA; LEARNING; NEUROTRANSMISSION; NONHUMAN; ORBITAL CORTEX; PAIN; PERCEPTION; PERIAQUEDUCTAL GRAY MATTER; PREFRONTAL CORTEX; PUNISHMENT; REVIEW; STEREOTYPY; WORKING MEMORY;

EID: 84870886076     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2012.00136     Document Type: Review

References (88)

1. Amorapanth, P., Ledoux, J. E., and Nader, K. (2000). Different lateral amygdala outputs mediate reactions and actions elicited by a fear-arousing stimulus. Nat. Neurosci. 3, 74-79.
2. Ballantine, H. T. Jr., Cassidy, W. L., Flanagan, N. B., and Marino, R. Jr. (1967). Stereotaxic anterior cingu-lotomy for neuropsychiatric illness and intractable pain. J. Neurosurg. 26, 488-495.
3. Belova, M. A., Paton, J. J., Morrison, S. E., and Salzman, C. D. (2007). Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron 55, 970-984.
4. Bennett, G. J., and Mayer, D. J. (1979). Inhibition of spinal cord interneu-rons by narcotic microinjection and focal electrical stimulation in the periaqueductal central gray matter. Brain Res. 172, 243-257.
5. Blair, H. T., Sotres-Bayon, F., Moita, M. A., and Ledoux, J. E. (2005). The lateral amygdala processes the value of conditioned and unconditioned aversive stimuli. Neuroscience 133, 561-569.
6. Botvinick, M., Nystrom, L. E., Fis-sell, K., Carter, C. S., and Cohen, J. D. (1999). Conflict monitoring versus selection-for-action in anterior cingulate cortex. Nature 402, 179-181.
7. Botvinick,M. M. (2007). Conflict monitoring and decision making: reconciling two perspectives on anterior cingulate function. Cogn. Affect. Behav. Neurosci. 7, 356-366.
8. Bush, G., Vogt, B. A., Holmes, J., Dale, A. M., Greve, D., Jenike, M. A., and Rosen, B. R. (2002). Dorsal anterior cingulate cortex: a role in reward-based decision making. Proc. Natl. Acad. Sci. U.S.A. 99, 523-528.
9. Carmichael, S. T., and Price, J. L. (1995). Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J. Comp. Neurol. 363, 615-641.
10. Chase,H.W., Swainson, R., Durham, L., Benham, L., and Cools, R. (2011). Feedback-related negativity codes prediction error but not behavioral adjustment during probabilistic reversal learning. J. Cogn. Neu-rosci. 23, 936-946.
11. Coe, B., Tomihara, K., Matsuzawa, M., and Hikosaka, O. (2002). Visual and anticipatory bias in three cortical eye fields of the monkey during an adaptive decision-making task. J. Neurosci. 22, 5081-5090.
12. Coghill, R. C., Talbot, J. D., Evans, A. C., Meyer, E., Gjedde, A., Bushnell, M. C., and Duncan, G. H. (1994). Distributed processing of pain and vibration by the human brain. J. Neurosci. 14, 4095-4108.
13. Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., and Uchida, N. (2012). Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482, 85-88.
14. Cole, M. W., Yeung, N., Freiwald,W. A., and Botvinick, M. (2009). Cingulate cortex: diverging data from humans and monkeys. Trends Neurosci. 32, 566-574.
15. Davis, M., Walker, D. L., and Myers, K. M. (2003). Role of the amygdala in fear extinction measured with potentiated startle. Ann. N. Y. Acad. Sci. 985, 218-232.
16. Dehaene, S., Posner, M. I., and Tucker, D. M. (1994). Localization of a neural system for error detection and compensation. Psychol. Sci. 5, 303-305.
17. Devinsky, O., Morrell, M. J., and Vogt, B. A. (1995). Contributions of anterior cingulate cortex to behaviour. Brain 118(Pt 1), 279-306.
18. Di Pellegrino, G., Ciaramelli, E., and Ladavas, E. (2007). The regulation of cognitive control following rostral anterior cingulate cortex lesion in humans. J. Cogn. Neurosci. 19, 275-286.
19. Emeric, E. E., Brown, J. W., Leslie, M., Pouget, P., Stuphorn,V., and Schall, J. D. (2008). Performance monitoring local field potentials in the medial frontal cortex of primates: anterior cingulate cortex. J. Neurophysiol. 99, 759-772.
20. Emeric, E. E., Leslie, M., Pouget, P., and Schall, J. D. (2010). Performance monitoring local field potentials in the medial frontal cortex of primates: supplementary eye field. J. Neurophysiol. 104, 1523-1537.
21. Falkenstein, M., Hohnsbein, J., Hoor-mann, J., and Blanke, L. (1990). "Effects of errors in choice reaction tasks on the ERP under focused anddivided attention," in Psychophysio-logical Brain Research, eds C. H. M. Brunia,A.W.K. Gaillard,andA.Kok (Tilburg: Tilburg University Press), 192-195.
22. Foltz, E. L., and White, L. E. Jr. (1962). Pain "relief" by frontal cingulumo-tomy. J. Neurosurg. 19, 89-100.
23. Gehring, W. J., Himle, J., and Nisenson, L. G. (2000). Action-monitoring dysfunctioninobsessive-compulsive disorder. Psychol. Sci. 11, 1-6.
24. Godlove, D. C., Emeric, E. E., Sego-vis, C. M., Young, M. S., Schall, J. D., and Woodman, G. F. (2011). Event-related potentials elicited by errors during the stop-signal task. I. Macaque monkeys. J. Neurosci. 31, 15640-15649.
25. Gottfried,J.A., O'doherty, J., and Dolan, R. J. (2002). Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging.J. Neu-rosci. 22, 10829-10837.
26. Graeff, F. G., and Silveira Filho, N. G. (1978). Behavioral inhibition induced by electrical stimulation of the median raphe nucleus of the rat. Physiol. Behav. 21, 477-484.
27. Gratton, G., Coles,M. G., and Donchin, E. (1992). Optimizing the use of information: strategic control of activation of responses. J. Exp. Psy-chol. Gen. 121, 480-506.
28. Hayes, D. J., and Northoff, G. (2011). Identifying a network of brain regions involved in aversion-related processing: a cross-species translational investigation. Front. Integr. Neurosci. 5, 49. doi:10.3389/fnint.2011.00049
29. Holroyd,C. B., and Coles, M. G. (2002). The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109, 679-709.
30. Holroyd, C. B., Dien, J., and Coles, M. G. (1998). Error-related scalp potentials elicited by hand and foot movements: evidence for an output-independent error-processing system in humans. Neurosci. Lett. 242, 65-68.
31. Hopkins,D.A.,and Holstege,G.(1978). Amygdaloid projections to the mes-encephalon, pons and medulla oblongata in the cat. Exp. Brain Res. 32, 529-547.
32. Hsu, M. M., and Shyu, B. C. (1997). Electrophysiological study of the connection between medial thal-amus and anterior cingulate cortex in the rat. Neuroreport 8, 2701-2707.
33. Hutchison, W. D., Davis, K. D., Lozano, A. M., Tasker, R. R., and Dostrovsky, J. O. (1999). Pain-related neurons in the human cingulate cortex. Nat. Neurosci. 2, 403-405.
34. Ito, S., Stuphorn, V., Brown, J. W., and Schall, J. D. (2003). Performance monitoring by the anterior cingu-late cortex during saccade countermanding. Science 302, 120-122.
35. Iwata, K., Kamo, H., Ogawa, A., Tsuboi, Y., Noma, N., Mitsuhashi, Y., Taira, M., Koshikawa, N., and Kitagawa, J. (2005). Anterior cingulate cortical neuronal activity during perception of noxious thermal stimuli in monkeys. J. Neurophysiol. 94, 1980-1991.
36. Johansen, J. P., Tarpley, J. W., Ledoux, J. E., and Blair, H. T. (2010). Neural substrates for expectation-modulated fear learning in the amygdala and periaqueductal gray. Nat. Neurosci. 13, 979-986.
37. Jones, A. K., Brown, W. D., Friston, K. J., Qi, L. Y., and Frackowiak, R. S. (1991). Cortical and sub-cortical localization of response to pain in man using positron emission tomography. Proc. Biol. Sci. 244, 39-44.
38. Kerns, J. G., Cohen, J. D., MacDonald, A. W. III, Cho, R. Y., Stenger, V. A., and Carter, C. S. (2004). Anterior cingulate conflict monitoring and adjustments in control. Science 303, 1023-1026.
39. Kobayashi, S., Lauwereyns, J., Koizumi, M., Sakagami, M., and Hikosaka, O. (2002). Influence of reward expectation on visuospatial processing in macaque lateral prefrontal cortex. J. Neurophysiol. 87, 1488-1498.
40. Kobayashi, S., Nomoto, K., Watanabe, M., Hikosaka, O., Schultz, W., and Sakagami, M. (2006). Influences of rewarding and aversive outcomes on activity in macaque lateral prefrontal cortex. Neuron 51, 861-870.
41. Koyama, T., Kato, K., Tanaka, Y. Z., and Mikami, A. (2001). Anterior cingu-late activity during pain-avoidance and reward tasks in monkeys. Neu-rosci. Res. 39, 421-430.
42. Kuo, C. C., and Yen, C. T. (2005). Comparison of anterior cingulate and primary somatosensory neu-ronal responses to noxious laser-heat stimuli in conscious, behaving rats.J. Neurophysiol. 94, 1825-1836.
43. Le Bars, D., Dickenson, A. H., and Besson, J. M. (1979). Diffuse noxious inhibitory controls (DNIC). I. Effects on dorsal horn convergent neurones in the rat. Pain 6, 283-304.
44. Ledoux, J. E., Iwata, J., Cicchetti, P., and Reis, D. J. (1988). Different projections of the central amygdaloid nucleus mediate autonomic and behavioral correlates of conditioned fear. J. Neurosci. 8, 2517-2529.
45. Ljungberg, T., Apicella, P., and Schultz, W. (1992). Responses of monkey dopamine neurons during learning of behavioral reactions. J. Neuro-physiol. 67, 145-163.
46. Machado, C. J., and Bachevalier, J. (2006). The impact of selective amygdala, orbital frontal cortex, or hippocampal formation lesions on established social relationships in rhesus monkeys (Macaca mulatta). Behav. Neurosci. 120, 761-786.
47. Machado, C. J., Emery, N. J., Mason, W. A., and Amaral, D. G. (2010). Selective changes in foraging behavior following bilateral neurotoxic amygdala lesions inrhesus monkeys. Behav. Neurosci. 124, 761-772.
48. Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837-841.
49. Mayer,D. J.,and Liebeskind,J.C. (1974). Pain reduction by focal electrical stimulation of the brain:ananatom-ical and behavioral analysis. Brain Res. 68, 73-93.
50. Medalla, M., and Barbas, H. (2010). Anterior cingulate synapses in pre-frontal areas10 and46suggest differential influence in cognitive control. J. Neurosci. 30, 16068-16081.
51. Miltner, W. H., Lemke, U., Weiss, T., Holroyd, C., Scheffers, M. K., and Coles, M. G. (2003). Implementation of error-processing in the human anterior cingulate cortex: a source analysis of the magnetic equivalent of the error-related negativity. Biol. Psychol. 64, 157-166.
52. Mirenowicz, J., and Schultz, W. (1996). Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379, 449-451.
53. Montague,P.R.,and Berns,G.S.(2002). Neuraleconomics and the biological substrates of valuation. Neuron 36, 265-284.
54. Morrison, S. E., Saez, A., Lau, B., and Salzman, C. D. (2011). Different time courses forlearning-related changes in amygdala and orbitofrontal cortex. Neuron 71, 1127-1140.
55. Nakamura, K., Roesch, M. R., and Olson, C. R. (2005). Neuronal activity in macaque SEF and ACC during performance of tasks involving conflict. J. Neurophysiol. 93, 884-908.
56. Nguyen, J. P., Nizard, J., Keravel, Y., and Lefaucheur, J. P. (2011). Invasive brain stimulation for the treatment of neuropathic pain. Nat. Rev. Neurol. 7, 699-709.
57. Nieuwenhuis, S., Ridderinkhof, K. R., Blom, J., Band, G. P., and Kok, A. (2001). Error-related brain potentials are differentially related to awareness of response errors: evidence from an antisaccade task. Psy-chophysiology 38, 752-760.
58. Nieuwenhuis, S., Yeung, N., Holroyd, C B., Schurger, A., and Cohen, J. D. (2004). Sensitivity of electro-physiological activity from medial frontal cortex to utilitarian and per formance feedback. Cereb. Cortex 14, 741-747.
59. Niki, H., and Watanabe, M. (1979). Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain Res. 171, 213-224.
60. O'Doherty, J., Kringelbach, M. L., Rolls, E T., Hornak, J., and Andrews, C. (2001). Abstract reward and punish ment representations in the human orbitofrontal cortex. Nat. Neurosci. 4, 95-102.
61. Paton, J. J., Belova, M. A., Morrison, 5. E., and Salzman, C. D. (2006). Theprimate amygdalarepresentsthe positive and negative value of visual stimuli during learning. Nature 439, 865-870.
62. Pellegrino, L. (1968). Amygdaloid lesions and behavioral inhibition in the rat. J. Comp. Physiol. Psychol. 65, 483-491.
63. Platt, M. L., and Glimcher, P. W. (1999). Neural correlates of decision variables in parietal cortex. Nature 400, 233-238.
64. Quirk, G. J., Repa, C., and Ledoux, J. E. (1995). Fear conditioning enhances short-latency auditory responses of lateral amygdala neurons: parallel recordings in the freely behaving rat. Neuron 15, 1029-1039.
65. Rabbitt, P. M. (1966). Errors and error correction in choice-response tasks. J. Exp. Psychol. 71, 264-272.
66. Rothe, M., Quilodran, R., Sallet, J., and Procyk, E. (2011). Coordination of high gamma activity in anterior cin-gulate and lateral prefrontal cortical areas during adaptation. J. Neurosci. 31, 11110-11117.
67. Schall, J. D., Stuphorn, V., and Brown, J. W. (2002). Monitoring and control of actionby the frontal lobes. Neuron 36, 309-322.
68. Schnitzler, A., and Ploner, M. (2000). Neurophysiology and functional neuroanatomy of pain perception. J. Clin. Neurophysiol. 17, 592-603.
69. Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593-1599.
70. Shyu, B. C., Sikes, R. W., Vogt, L. J., and Vogt, B. A. (2010). Nociceptive processing by anterior cingulate pyramidal neurons. J. Neurophysiol. 103, 3287-3301.
71. Sikes, R. W., and Vogt, B. A. (1992). Nociceptive neurons in area 24 of rabbit cingulate cortex. J. Neurophys-iol. 68, 1720-1732.
72. Sikes, R. W., Vogt, L. J., and Vogt, B. A. (2008). Distribution and properties of visceral nociceptive neurons in rabbit cingulate cortex. Pain 135, 160-174.
73. Slotnick, B. M. (1973). Fear behavior and passive avoidance deficits in mice with amygdala lesions. Physiol. Behav. 11, 717-720.
74. Small, D. M., Zatorre, R. J., Dagher, A., Evans, A. C., and Jones-Gotman, M. (2001). Changes in brain activity related to eating chocolate: from pleasure to aversion. Brain 124, 1720-1733.
75. Stroop, J. R. (1935). Studies of interference in serial verbal reactions. J. Exp. Psychol. 18, 634-662.
76. Stuphorn, V., Taylor, T. L., and Schall, J. D. (2000). Performance monitoring by the supplementary eye field. Nature 408, 857-860.
77. Sturmer, B., Leuthold, H., Soetens, E., Schroter, H., and Sommer, W. (2002). Control over location-based response activation in the Simon task: behavioral and electrophys-iological evidence. J. Exp. Psy-chol. Hum. Percept. Perform. 28, 1345-1363.
78. Talbot, J. D., Marrett, S., Evans, A. C., Meyer, E., Bushnell,M. C., and Duncan, G. H. (1991). Multiple repre-sentationsof paininhuman cerebral cortex. Science 251, 1355-1358.
79. Vogt, B. A. (1993). "Structural organization of cingulate cortex: areas, neurons, and somatodendritic receptors," in Neurobiology of Cingu-late Cortex and Limbic Thalamus: A Comprehensive Handbook, eds B. A. Vogt and M. Gabriel (Boston: Birkhauser), 19-70.
80. Vogt, B. A., Rosene, D. L., and Peters, A. (1981). Synaptic termination of thalamic and callosal afferents in cingulate cortex of the rat. J. Comp. Neurol. 201, 265-283.
81. Vogt, B. A., and Sikes, R. W. (2000). The medial pain system, cingulate cortex, and parallel processing of noci-ceptive information. Prog. Brain Res. 122, 223-235.
82. Vogt, B. A., Sikes, R. W., and Vogt, L. J. (1993a). "Anterior cingulate cortex and the medial pain system," in Neurobiology of Cingulate Cortex and Limbic Thalamus:AComprehen-sive Handbook, eds L. J. Vogt and M. Gabriel (Boston: Birkhäuser), 313-344.
83. Vogt, B. A., Sikes, R. W., and Vogt, L. J. (1993b). "Anterior cingulate cortex and the medial pain system," in Neurobiology of Cingulate Cortex and Limbic Thalamus, eds B. A. Vogt and M. Gabriel (Boston: Birkhauser), 313-344.
84. Wilensky, A. E., Schafe, G. E., and Ledoux, J. E. (1999). Functional inactivation of the amygdala before but not after auditory fear conditioning prevents memory formation. J. Neurosci. 19, RC48.
85. Womelsdorf, T., Johnston, K., Vinck, M., and Everling, S. (2010). Theta-activity in anterior cingulate cortex predicts task rules and their adjustments following errors. Proc. Natl. Acad. Sci. U. S. A. 107, 5248-5253.
86. Wuhr, P., and Ansorge, U. (2005). Exploring trial-by-trial modulations of the Simon effect. Q. J. Exp. Psy-chol. A 58, 705-731.
87. Yaksh, T. L., Al-Rodhan, N. R., and Jensen, T. S. (1988). Sites of action of opiates in production of analgesia. Prog. Brain Res. 77, 371-394.
88. Zhang,Y., Wang, N., Wang, J. Y., Chang, J. Y., Woodward, D. J., and Luo, F. (2011). Ensemble encoding of noci-ceptive stimulus intensity in the rat medial and lateral pain systems. Mol. Pain 7, 64.