Brain and autonomic association accompanying stochastic decision-making

NeuroImage

Volumn 49, Issue 1, 2010, Pages 1024-1037

  Ohira, Hideki ^a   Ichikawa, Naho ^a   Nomura, Michio ^b   Isowa, Tokiko ^a,c   Kimura, Kenta ^a,d   Kanayama, Noriaki ^a   Fukuyama, Seisuke ^e,f   Shinoda, Jun ^e   Yamada, Jitsuhiro ^e  

^a NAGOYA UNIVERSITY   (Japan)

^b HIROSHIMA UNIVERSITY   (Japan)

^c MIE UNIVERSITY   (Japan)

^d UNIVERSITY OF TOKYO   (Japan)

^e Kizawa Memorial Hospital   (Japan)

^f KANAGAWA DENTAL COLLEGE   (Japan)

Author keywords

Autonomic activity; Brain; Decision making; ERP; PET

Indexed keywords

OXYGEN 15;

ADULT; ARTICLE; AUTONOMIC NERVOUS SYSTEM FUNCTION; BLOOD PRESSURE MEASUREMENT; BRAIN BLOOD FLOW; BRAIN FUNCTION; BRAIN REGION; CARDIOVASCULAR PARAMETERS; CINGULATE GYRUS; CONTROLLED STUDY; CORPUS STRIATUM; DECISION MAKING; ELECTROENCEPHALOGRAPHY; EVENT RELATED POTENTIAL; FEEDBACK SYSTEM; HEART RATE; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; ORBITAL CORTEX; POSITIVE FEEDBACK; POSITRON EMISSION TOMOGRAPHY; PREDICTION; PREFRONTAL CORTEX; PRIORITY JOURNAL; PUNISHMENT; REWARD; STIMULUS RESPONSE; TASK PERFORMANCE; TIME; VAGUS NERVE STIMULATION; VOLUNTEER;

ADULT; AUTONOMIC NERVOUS SYSTEM; BLOOD PRESSURE; BRAIN; DECISION MAKING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEEDBACK, PSYCHOLOGICAL; FEMALE; HEART RATE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEARNING; MALE; POSITRON-EMISSION TOMOGRAPHY; PSYCHOMOTOR PERFORMANCE; PUNISHMENT; REGRESSION ANALYSIS; REWARD; STOCHASTIC PROCESSES; VAGUS NERVE; YOUNG ADULT;

EID: 70349973867     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2009.07.060     Document Type: Article

References (90)

1. Alexander G.E., Crutcher M.D., and DeLong M.R. Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions. Prog. Brain Res. 85 (1990) 119-146
2. Beauchaine T.P., Gatzke-Kopp L., and Mead H.K. Polyvagal theory and developmental psychopathology: emotion dysregulation and conduct problems from preschool to adolescence. Biol. Psychol. 74 (2007) 174-184
3. Blackwood N., Ffytche D., Simmons A., Bentall R., Murray R., and Howard R. The cerebellum and decision making under uncertainty. Brain Res. Cogn. Brain Res. 20 (2004) 46-53
4. Blascovich J., Mendes W.B., Hunter S.B., and Salomon K. Social "facilitation" as challenge and threat. J. Pers. Soc. Psychol. 77 (1999) 68-77
5. Botvinick M., Nystrom L.E., Fissell K., Carter C.S., and Cohen J.D. Conflict monitoring versus selection-for-action in anterior cingulate cortex. Nature 402 (1999) 179-181
6. Brázdil M., Roman R., Falkenstein M., Daniel P., Jurák P., and Rektor I. Error processing-evidence from intracerebral ERP recordings. Exp. Brain Res. 146 (2002) 460-466
7. Breiter H.C., Aharon I., Kahneman D., Dale A., and Shizgal P. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30 (2001) 619-639
8. Bush G., Whalen P.J., Rosen B.R., Jenike M.A., McInerney S.C., and Rauch S.L. The counting Stroop: an interference task specialized for functional neuroimaging-validation study with functional MRI. 1998. Hum. Brain Mapp. 6 (1998) 270-282
9. Carter C.S., Braver T.S., Barch D.M., Botvinick M.M., Noll D., and Cohen J.D. Anterior cingulate cortex, error detection, and the online monitoring of performance. Science 280 (1998) 747-749
10. Carter C.S., Macdonald A.M., Botvinick M., Ross L.L., Stenger V.A., Noll D., and Cohen J.D. Parsing executive processes: strategic vs. evaluative functions of the anterior cingulate cortex. Proc. Natl. Acad. Sci. U. S. A. 97 (2000) 1944-1948
11. Carruthers M., and Taggart P. Vagotonicity of violence: biochemical and cardiac responses to violent films and television programmes. Br. Med. J. 3 (1973) 384-389
12. Cohen M.X. Neurocomputational mechanisms of reinforcement-guided learning in humans: a review. Cogn. Affect Behav. Neurosci. 8 (2008) 113-125
13. Critchley H.D., Corfield D.R., Chandler M.P., Mathias C.J., and Dolan R.J. Cerebral correlates of autonomic cardiovascular arousal: a functional neuroimaging investigation in humans. J. Physiol. 523 (2000) 259-270
14. Critchley H.D., Elliott R., Mathias C.J., and Dolan R.J. Neural activity relating to generation and representation of galvanic skin conductance responses: a functional magnetic resonance imaging study. J. Neurosci. 20 (2000) 3033-3040
15. Critchley H.D., Mathias C.J., Josephs O., O Doherty J., Zanini S., Dewar B.K., Cipolotti L., Shallice T., and Dolan R.J. Human cingulate cortex and autonomic control: converging neuroimaging and clinical evidence. Brain 126 (2003) 2139-2152
16. Critchley H.D., Tang J., Glaser D., Butterworth B., and Dolan R.J. Anterior cingulate activity during error and autonomic response. NeuroImage 27 (2005) 885-895
17. Delgado M.R., Miller M.M., Inati S., and Phelps E.A. An fMRI study of reward-related probability learning. Neuroimage 24 (2005) 862-873
18. Delorme A., and Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134 (2004) 9-21
19. Dywan J., Mathewson K.J., Choma B.L., Rosenfeld B., and Segalowitz S.J. Autonomic and electrophysiological correlates of emotional intensity in older and younger adults. Psychophysiology 45 (2008) 389-397
20. Elliott R., Dolan R.J., and Frith C.D. Dissociable functions in the medial and lateral orbitofrontal cortex: evidence from human neuroimaging studies. Cereb. Cortex 10 (2000) 308-317
21. Endo N., Saiki J., and Saito H. Determinants of occurrence of negative priming for novel shapes with matching paradigm. The Japanese Journal of Psychology 72 (2001) 204-212 [in Japanese]
22. Eppinger B., Kray J., Mock B., and Mecklinger A. Better or worse than expected? Aging, learning, and the ERN. Neuropsychologia 46 (2008) 521-539
23. Fecteau S., Knoch D., Fregni F., Sultani N., Boggio P., and Pascual-Leone A. Diminishing risk-taking behavior by modulating activity in the prefrontal cortex: a direct current stimulation study. J. Neurosci. 27 (2007) 12500-12505
24. Forman S.D., Cohen J.D., Fitzgerald M., Eddy W.F., Mintun M.A., and Noll D.C. Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of cluster-size threshold. Magn. Reson. Med. 33 (1995) 636-647
25. Gehring W.J., and Knight R.T. Prefrontal-cingulate interactions in action monitoring. Nat. Neurosci. 3 (2000) 516-520
26. Gehring W.J., and Willoughby A.R. The medial frontal cortex and the rapid processing of monetary gains and losses. Science 295 (2002) 2279-2282
27. Gianaros P.J., Derbyshire S.W., May J.C., Siegle G.J., Gamalo M.A., and Jennings J.R. Anterior cingulate activity correlates with blood pressure during stress. Psychophysiology 42 (2005) 627-635
28. Gianaros P.J., Van Der Veen F.M., and Jennings J.R. Regional cerebral blood flow correlates with heart period and high-frequency heart period variability during working-memory tasks: implications for the cortical and subcortical regulation of cardiac autonomic activity. Psychophysiology 41 (2004) 521-530
29. Groen Y., Wijers A.A., Mulder L.J., Minderaa R.B., and Althaus M. Physiological correlates of learning by performance feedback in children: a study of EEG event-related potentials and evoked heart rate. Biol. Psychol. 76 (2007) 174-187
30. Hajcak G., McDonald N., and Simons R.F. To err is autonomic: error-related brain potentials, ANS activity, and post-error compensatory behavior. Psychophysiology 40 (2003) 895-903
31. Hajcak G., McDonald N., and Simons R.F. Error-related psychophysiology and negative affect. Brain Cogn. 56 (2004) 189-197
32. Hampton A.H., and O Doherty J.P. Decoding the neural substrates of reward-related decision making with functional MRI. Proc. Natl. Acad. Sci. U. S. A. 104 (2007) 1377-1382
33. Haber S.N. The primate basal ganglia: parallel and integrative networks. J. Chem. Neuroanat. 26 (2003) 317-330
34. Haruno M., and Kawato M. Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning. Neural Netw. 19 (2006) 1242-1254
35. Herrmann M.J., Römmler J., Ehlis A.C., Heidrich A., and Fallgatter A.J. Source localization (LORETA) of the error-related-negativity (ERN/Ne) and positivity (Pe). Brain Res. Cogn. Brain Res. 20 (2004) 294-299
36. Holroyd C.B., and Coles M.G. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol. Rev. 109 (2002) 679-709
37. Holmes A.J., and Pizzagalli D.A. Spatiotemporal dynamics of error processing dysfunctions in major depressive disorder. Arch. Gen. Psychiatry 65 (2008) 179-188
38. Jennings J.R., and van der Molen M.W. Cardiac timing and the central regulation of action. Psychol. Res. 66 (2002) 337-349
39. Keay K.A., and Bandler R. Parallel circuits mediating distinct emotional coping reactions to different types of stress. Neurosci. Biobehav. Rev. 25 (2001) 669-678
40. Kimura K., Ohira H., Isowa T., Matsunaga M., and Murashima S. Regulation of lymphocytes redistribution via autonomic nervous activity during stochastic learning. Brain Behav. Immun. 21 (2007) 921-934
41. Kosson D.S., Budhani S., Nakic M., Chen G., Saad Z.S., Vythilingam M., Pine D.S., and Blair R.J. The role of the amygdala and rostral anterior cingulate in encoding expected outcomes during learning. Neuroimage 29 (2006) 1161-1172
42. Krawczyk D.C. Contributions of the prefrontal cortex to the neural basis of human decision making. Neurosci. Biobehav. Rev. 26 (2002) 631-664
43. Kringelbach M.L. The human orbitofrontal cortex: linking reward to hedonic experience. Nat. Rev. Neurosci. 6 (2005) 691-702
44. Kringelbach M.L., and Rolls E.T. The functional neuroanatomy of the human orbitofrontal cortex: evidence from neuroimaging and neuropsychology. Prog. Neurobiol. 72 (2004) 341-372
45. Labudda K., Woermann F.G., Mertens M., Pohlmann-Eden B., Markowitsch H.J., and Brand M. Neural correlates of decision making with explicit information about probabilities and incentives in elderly healthy subjects. Exp. Brain Res. 187 (2008) 641-650
46. Lane R.D., McRae K., Reiman E.M., Chen K., Ahern G.L., and Thayer J.F. Neural correlates of heart rate variability during emotion. Neuroimage 44 (2009) 213-222
47. Lane R.D., Reiman E.M., Ahern G.L., and Thayer J.F. Activity in medial prefrontal cortex correlates with vagal component of heart rate variability during emotion. Brain Cogn. 47 (2001) 97-100
48. Lee D., and Seo H. Mechanisms of reinforcement learning and decision making in the primate dorsolateral prefrontal cortex. Ann. NY. Acad. Sci. 1104 (2007) 108-122
49. Matsunaga M., Isowa T., Kimura K., Miyakoshi M., Kanayama N., Murakami H., Fukuyama S., Shinoda J., Yamada J., Konagaya T., Kaneko H., and Ohira H. Association among positive mood, brain, and cardiovascular activities in an affectively positive situation. Brain Res. 1263 (2009) 93-103
50. Matthews S.C., Paulus M.P., Simmons A.N., Nelesen R.A., and Dimsdale J.E. Functional subdivisions within anterior cingulate cortex and their relationship to autonomic nervous system function. Neuroimage 22 (2004) 1151-1156
51. McCabe P., and Schneiderman N. Psychophysiological reactions to stress. In: Schneiderman N., and Tapp J. (Eds). Behavioral Medicine: The biopsychology Approach (1985), Sage Pubns 99-131
52. McClure S.M., Laibson D.I., Loewenstein G., and Cohen J.D. Separate neural systems value immediate and delayed monetary rewards. Science 306 (2004) 503-507
53. McClure S.M., Ericson K.M., Laibson D.I., Loewenstein G., and Cohen J.D. Time discounting for primary rewards. J. Neurosci. 27 (2007) 5796-5804
54. Montague P.R., Hyman S.E., and Cohen J.D. Computational roles for dopamine in behavioural control. Nature 431 (2004) 760-767
55. Napadow V., Dhond R., Conti G., Makris N., Brown E.N., and Barbieri R. Brain correlates of autonomic modulation: combining heart rate variability with fMRI. Neuroimage 42 (2008) 169-177
56. Nieuwenhuis S., Ridderinkhof K.R., Blom J., Band G.P., and Kok A. Error-related brain potentials are differentially related to awareness of response errors: evidence from an antisaccade task. Psychophysiology 38 (2001) 752-760
57. Nieuwenhuis S., Ridderinkhof K.R., Talsma D., Coles M.G., Holroyd C.B., Kok A., and van der Molen M.W. A computational account of altered error processing in older age: dopamine and the error-related negativity. Cogn. Affect. Behav. Neurosci. 2 (2002) 19-36
58. Nieuwenhuis S., Holroyd C.B., Mol N., and Coles M.G. Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance. Neurosci. Biobehav. Rev. 28 (2004) 441-448
59. O'Connor M.F., Gündel H., McRae K., and Lane R.D. Baseline vagal tone predicts BOLD response during elicitation of grief. Neuropsychopharmacology 32 (2007) 2184-2189
60. O'Doherty J., Critchley H., Deichmann R., and Dolan R.J. Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J. Neurosci. 23 (2003) 7931-7939
61. O'Doherty J., Kringelbach M.L., Rolls E.T., Hornak J., and Andrews C. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 4 (2001) 95-102
62. O'Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., and Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304 (2004) 452-454
63. O'Doherty J.P., Hampton A., and Kim H. Model-based fMRI and its application to reward learning and decision making. Ann. N.Y. Acad. Sci. 1104 (2007) 35-53
64. Oliveira F.T., McDonald J.J., and Goodman D. Performance monitoring in the anterior cingulate is not all error related: expectancy deviation and the representation of action-outcome associations. J. Cogn. Neurosci. 19 (2007) 1994-2004
65. Ohira H., Fukuyama S., Kimura K., Nomura M., Isowa T., Ichikawa N., Matsunaga M., Kimura K., Miyakoshi M., Shinoda J., and Yamada J. Regulation of natural killer cell redistribution by prefrontal cortex during stochastic learning. Neuroimage 47 3 (2009) 897-907
66. Ohira H., Isowa T., Nomura M., Ichikawa N., Kimura K., Miyakoshi M., Iidaka T., Fukuyama S., Nakajima T., and Yamada J. Imaging brain and immune association accompanying cognitive appraisal of an acute stressor. Neuroimage 39 (2008) 500-514
67. Overbeek T.J.M., Nieuwenhuis S., and Ridderinkhof R. Dissociable components of error processing. J. Psychophysiol. 19 (2005) 319-329
68. Perini R., Milesi S., Fisher N.M., Pendergast D.R., and Veicsteinas A. Heart rate variability during dynamic exercise in elderly males and females. Eur. J. Appl. Physiol. 82 (2000) 8-15
69. Polezzi D., Daum I., Rubaltelli E., Lotto L., Civai C., Sartori G., and Rumiati R. Mentalizing in economic decision-making. Behav. Brain Res. 190 (2008) 218-223
70. Postuma R.B., and Dagher A. Basal ganglia functional connectivity based on a meta-analysis of 126 positron emission tomography and functional magnetic resonance imaging publications. Cereb. Cortex 16 (2006) 1508-1521
71. Roberts A.C. Primate orbitofrontal cortex and adaptive behaviour. Trends Cogn. Sci. 10 (2006) 83-90
72. Rogers R.D., Owen A.M., Middleton H.C., Williams E.J., Pickard J.D., Sahakian B.J., and Robbins T.W. Choosing between small, likely rewards and large, unlikely rewards activates inferior and orbital prefrontal cortex. J. Neurosci. 19 (1999) 9029-9038
73. Sailer U., Robinson S., Fischmeister F.P., Moser E., Kryspin-Exner I., and Bauer H. Imaging the changing role of feedback during learning in decision-making. Neuroimage 37 (2007) 1474-1486
74. Saul J.P., Rea R.F., Eckberg D.L., Berger R.D., and Cohen R.J. Heart rate and muscle sympathetic nerve variability during reflex changes of autonomic activity. Am. J. Physiol. 258 (1990) H713-H721
75. Sayers B.M. Analysis of heart rate variability. Ergonomics 16 (1973) 17-32
76. Schneiderman N., and McCabe P.M. Psychophysiological strategies in laboratory research. In: Schneiderman N., Weiss S.M., and Kaufmann P.G. (Eds). Handbook of Research Methods in Cardiovascular Behavioral Medicine (1989), Plenum Press, New York 349-364
77. Schultz W. Getting formal with dopamine and reward. Neuron 36 (2002) 241-263
78. Schultz W., Dayan P., and Montague P.R. A neural substrate of prediction and reward. Science 275 (1997) 1593-1599
79. Schweizer T.A., Oriet C., Meiran N., Alexander M.P., Cusimano M., and Stuss D.T. The cerebellum mediates conflict resolution. J. Cogn. Neurosci. 19 (2007) 1974-1982
80. Tanaka S.C., Doya K., Okada G., Ueda K., Okamoto Y., and Yamawaki S. Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat. Neurosci. 7 (2004) 887-893
81. Tanaka S.C., Schweighofer N., Asahi S., Shishida K., Okamoto Y., Yamawaki S., and Doya K. Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum. PLoS ONE 2 (2007) e1333
82. Thayer J.F., and Brosschot J.F. Psychosomatics and psychopathology: looking up and down from the brain. Psychoneuroendocrinology 30 (2005) 1050-1058
83. Tobler P.N., Fiorillo C.D., and Schultz W. Adaptive coding of reward value by dopamine neurons. Science 307 (2005) 1642-1645
84. Tremblay L., and Schultz W. Relative reward preference in primate orbitofrontal cortex. Nature 398 (1999) 704-708
85. Tremblay L., and Schultz W. Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. J. Neurophysiol. 83 (2000) 1877-1885
86. Turken A.U., and Swick D. The effect of orbitofrontal lesions on the error-related negativity. Neurosci. Lett. 441 (2008) 7-10
87. Ullsperger M., and von Cramon D.Y. The role of intact frontostriatal circuits in error processing. J. Cogn. Neurosci. 18 (2006) 651-664
88. van Veen V., Holroyd C.B., Cohen J.D., Stenger V.A., and Carter C.S. Errors without conflict: implications for performance monitoring theories of anterior cingulate cortex. Brain Cogn. 56 (2004) 267-276
89. Wise R.A. Brain reward circuitry: insights from unsensed incentives. Neuron 36 (2002) 229-240
90. Wong S.W., Massé N., Kimmerly D.S., Menon R.S., and Shoemaker J.K. Ventral medial prefrontal cortex and cardiovagal control in conscious humans. Neuroimage 35 (2007) 698-708