Temporal prediction errors modulate cingulate-insular coupling

NeuroImage

Volumn 71, Issue , 2013, Pages 147-157

  Limongi, Roberto ^a,b   Sutherland, Steven C ^a   Zhu, Jian ^a   Young, Michael E ^c   Habib, Reza ^a  

^a SOUTHERN ILLINOIS UNIVERSITY   (United States)

^b INSTITUTO VENEZOLANO DE INVESTIGACIONES CIENTÍFICAS   (Venezuela)

^c KANSAS STATE UNIVERSITY   (United States)

Author keywords

Cingulate cortex; Dynamic causal models; Insular cortex; Prediction error; Predictive behavior

Indexed keywords

ACCURACY; ADULT; ARTICLE; BOLD SIGNAL; BRAIN FUNCTION; BRAIN RADIOGRAPHY; BRAIN REGION; CINGULATE GYRUS; ELECTROENCEPHALOGRAM; EVOKED VISUAL RESPONSE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; HUMAN EXPERIMENT; INSULA; MALE; NEUROMODULATION; NEUROPHYSIOLOGY; PREDICTION; PRIORITY JOURNAL; TASK PERFORMANCE; TEMPORAL SUMMATION; VISUAL STIMULATION;

EID: 84873511744     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2012.12.078     Document Type: Article

References (79)

1. Aarts E., Roelofs A., Van Turennout M. Anticipatory activity in anterior cingulate cortex can be independent of conflict and error likelihood. J. Neurosci. 2008, 28:4671-4678.
2. Aggarwal M., Hyland B.I., Wickens J.R. Neural control of dopamine neurotransmission: implications for reinforcement learning. Eur. J. Neurosci. 2012, 35:1115-1123.
3. Alexander W.H., Brown J.W. Computational models of performance monitoring and cognitive control. Top. Cogn. Sci. 2010, 2:658-677.
4. Alexander W.H., Brown J.W. Medial prefrontal cortex as an action-outcome predictor. Nat. Neurosci. 2011, 14:1338-1344.
5. Bar M. Predictions: a universal principle in the operation of the human brain. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2009, 364:1181-1182.
6. Beckmann J.S., Young M.E. Stimulus dynamics and temporal discrimination: implications for pacemakers. J. Exp. Psychol. Anim. Behav. Process. 2009, 35:525-537.
7. Behrens T.E.J., Woolrich M.W., Walton M.E., Rushworth M.F.S. Learning the value of information in an uncertain world. Nat. Neurosci. 2007, 10:1214-1221.
8. Brown J.W. Medial prefrontal cortex activity correlates with time-on-task: what does this tell us about theories of cognitive control?. NeuroImage 2011, 57:314-315.
9. Brown J.W., Braver T.S. Learned predictions of error likelihood in the anterior cingulate cortex. Science 2005, 307:1118-1121.
10. Brown J.W., Braver T.S. Risk prediction and aversion by anterior cingulate cortex. Cogn. Affect. Behav. Neurosci. 2007, 7:266-277.
11. Brown J.W., Braver T.S. A computational model of risk, conflict, and individual difference effects in the anterior cingulate cortex. Brain Res. 2008, 1202:99-108.
12. Catania A.C. Reinforcement schedules and psychophysical judgments. The Theory of Reinforcement Schedules 1970, Appleton-Century-Crofts, New York. W.N. Schoenfeld (Ed.).
13. Contreras-Vidal J.L., Schultz W. A predictive reinforcement model of dopamine neurons for learning approach behavior. J. Comput. Neurosci. 1999, 6:191-214.
14. Critchley H.D. Neural mechanisms of autonomic, affective, and cognitive integration. J. Comp. Neurol. 2005, 493:154-166.
15. Critchley H.D., Mathias C.J., Dolan R.J. Neural activity in the human brain relating to uncertainty and arousal during anticipation. Neuron 2001, 29:537-545.
16. Delgado M.R., Tricomi E. Reward processing and decision making in the human striatum. Neuroscience of Decision Making 2011, 145-172. Psychology Press, New York, NW. D.R. Mandel, O. Vartanian (Eds.).
17. den Ouden H.E.M., Friston K.J., Daw N.D., McIntosh A.R., Stephan K.E. A dual role for prediction error in associative learning. Cereb. Cortex 2009, 19:1175-1185.
18. den Ouden H.E.M., Daunizeau J., Roiser J., Friston K.J., Stephan K.E. Striatal prediction error modulates cortical coupling. J. Neurosci. 2010, 30:3210-3219.
19. Douglas R.J., Martin K.A. Neuronal circuits of the neocortex. Annu. Rev. Neurosci. 2004, 27:419-451.
20. Enomoto K., Matsumoto N., Nakai S., Satoh T., Sato T.K., Ueda Y., Inokawa H., Haruno M., Kimura M. Dopamine neurons learn to encode the long-term value of multiple future rewards. Proc. Natl. Acad. Sci. U. S. A. 2011, 108:15462-15467.
21. Feldman H., Friston K. Attention, uncertainty and free-energy. Front. Hum. Neurosci. 2010, 4:1-23.
22. Forster M.R. Key concepts in model selection: performance and generalizability. J. Math. Psychol. 2000, 44:205-231.
23. Forster S.E., Brown J.W. Medial prefrontal cortex predicts and evaluates the timing of action outcomes. NeuroImage 2011, 55:253-265.
24. Friston K.J., Kiebel S.J. Predictive coding under the free-energy principle. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2009, 364:1211-1221.
25. Friston K.J., Harrison L., Penny W. Dynamic causal modelling. NeuroImage 2003, 19:1273-1302.
26. Gibbon J. Scalar expectancy theory and Weber's law in animal timing. Psychol. Rev. 1977, 84:277-325.
27. Gibbon J. On the form and location of the psychometric bisection function for time. J. Math. Psychol. 1981, 24:58-87.
28. Gibbon J., Church R.M. Time left: linear versus logarithmic subjective time. J. Exp. Psychol. Anim. Behav. Process. 1981, 7:87-107.
29. Gläscher J. Visualization of group inference data in functional neuroimaging. Neuroinformatics 2009, 7:73-82.
30. Grinband J., Savitskaya J., Wager T.D., Teichert T., Ferrera V.P., Hirsch J. Conflict, error likelihood, and RT: response to Brown & Yeung et al. NeuroImage 2011, 57:320-322.
31. Grinband J., Savitskaya J., Wager T.D., Teichert T., Ferrera V.P., Hirsch J. The dorsal medial frontal cortex is sensitive to time on task, not response conflict or error likelihood. NeuroImage 2011, 57:303-311.
32. Henson R. Efficient experimental design for fMRI. Statistical Parametric Mapping: The analysis of functional brain images 2007, 193-231. Elsevier, London. K. Friston, J. Ashburner, S.J. Kiebel, K.A. Nichols, W. Penny (Eds.).
33. Hinton S.C., Harrington D.L., Binder J.R., Durgerian S., Rao S.M. Neural systems supporting timing and chronometric counting: an FMRI study. Cogn. Brain Res. 2004, 21:183-192.
34. Huettel S.A., Song A.W., McCarthy G. Decisions under uncertainty: probabilistic context influences activation of prefrontal and parietal cortices. J. Neurosci. 2005, 25:3304-3311.
35. Klein-Flügge Miriam C., Hunt Laurence T., Bach Dominik R., Dolan Raymond J., Behrens Timothy E.J. Dissociable reward and timing signals in human midbrain and ventral striatum. Neuron 2011, 72:654-664.
36. Kosillo P., Smith A. The role of the human anterior insular cortex in time processing. Brain Struct. Funct. 2010, 214:623-628.
37. Lacouture Y., Cousineau D. How to use MATLAB to fit the ex-Gaussian and other probability functions to a distribution of response times. Tutorial. Quant. Meth. Psychol. 2008, 4:35-45.
38. Logothetis N.K. What we can't do with fMRI. MRI and Advanced Imaging in Animals and Humans 2012, 7-14. Society for Neuroscience, Washington, DC. W.B. G. (Ed.).
39. Marreiros A.C., Kiebel S.J., Friston K.J. Dynamic causal modelling for fMRI: a two-state model. NeuroImage 2008, 39:269-278.
40. Mathys C., Daunizeau J., Friston K.J., Stephan K.E. A Bayesian foundation for individual learning under uncertainty. Front. Hum. Neurosci. 2011, 5:1-20.
41. Matzke D., Wagenmakers E.-J. Psychological interpretation of the ex-Gaussian and shifted Wald parameters: a diffusion model analysis. Psychon. Bull. Rev. 2009, 16:798-817.
42. Medford N., Critchley H.D. Conjoint activity of anterior insular and anterior cingulate cortex: awareness and response. Brain Struct. Funct. 2010, 214:535-549.
43. Mesulam M.M., Mufson E.J. Insula of the old world monkey. III: efferent cortical output and comments on function. J. Comp. Neurol. 1982, 212:38-52.
44. Mufson E.J., Mesulam M.M. Insula of the old world monkey. II: afferent cortical input and comments on the claustrum. J. Comp. Neurol. 1982, 212:23-37.
45. Myung I.J. The importance of complexity in model selection. J. Math. Psychol. 2000, 44:190-204.
46. Nee D.E., Kastner S., Brown J.W. Functional heterogeneity of conflict, error, task-switching, and unexpectedness effects within medial prefrontal cortex. NeuroImage 2011, 54:528-540.
47. Nieuwenhuis S., Schweizer T.S., Mars R.B., Botvinick M.M., Hajcak G. Error-likelihood prediction in the medial frontal cortex: a critical evaluation. Cereb. Cortex 2007, 17:1570-1581.
48. Niv Y., Schoenbaum G. Dialogues on prediction errors. Trends Cogn. Sci. 2008, 12:265-272.
49. O'Doherty J.P. Neural mechanisms underlying reward and punishment learning in the human brain: insights from fMRI. Neuroscience of Decision Making 2011, 173-198. Psychology Press, New York, NY. D.R. Mandel, O. Vartanian (Eds.).
50. O'Doherty J., Kringelbach M.L., Rolls E.T., Hornak J., Andrews C. Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 2001, 4:95-102.
51. O'Doherty J., Dayan P., Friston K.J., Critchley H.D., Dolan R.J. Temporal difference models and reward-related learning in the human brain. Neuron 2003, 28:329-337.
52. O'Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., Dolan R.J. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 2004, 304:452-454.
53. O'Doherty J.P., Hampton A., Kim H. Model-based fMRI and its application to reward learning and decision making. Ann. N. Y. Acad. Sci. 2007, 1104:35-53.
54. Osman M. Controlling uncertainty: a review of human behavior in complex dynamic environments. Psychol. Bull. 2010, 136:65-86.
55. Penny W.D., Stephan K.E., Daunizeau J., Rosa M.J., Friston K.J., Schofield T.M., Leff A.P. Comparing families of dynamic causal models. PLoS Comput. Biol. 2010, 6:1-14.
56. Pitt M.A., Myung I.J., Zhang S. Toward a method of selecting among computational models of cognition. Psychol. Rev. 2002, 109:472-491.
57. Platt M.L., Huettel S.A. Risky business: the neuroeconomics of decision making under uncertainty. Nat. Neurosci. 2008, 11:398-403.
58. Ratcliff R., McKoon G. The diffusion decision model: theory and data for two-choice decision tasks. Neural Comput. 2008, 20:873-922.
59. Rescorla R.A., Wagner A.R. A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II: Current Research and Theory 1972, 64-99. Appleton-Century-Crofts, New York. A.H. Black, W.F. Prokasy (Eds.).
60. Rosa M.J., Bestmann S., Harrison L., Penny W. Bayesian model selection maps for group studies. NeuroImage 2010, 49:217-224.
61. Schultz W. Behavior-related activity of primate dopamine neurons. Rev. Neurol. (Paris) 1994, 150:634-639.
62. Schultz W. Dopamine signals for reward value and risk: basic and recent data. Behav. Brain Funct. 2010, 6:1-9.
63. Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science 1997, 275:1593-1599.
64. Schultz W., Preuschoff K., Camerer C., Hsu M., Fiorillo C.D., Tobler P.N., Bossaerts P. Explicit neural signals reflecting reward uncertainty. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2008, 363:3801-3811.
65. Singer T., Critchley H.D., Preuschoff K. A common role of insula in feelings, empathy and uncertainty. Trends Cogn. Sci. 2009, 13:334-340.
66. Stephan K.E., Penny W.D., Daunizeau J., Moran R.J., Friston K.J. Bayesian model selection for group studies. NeuroImage 2009, 46:1004-1017.
67. Stephan K.E., Penny W.D., Moran R.J., den Ouden H.E.M., Daunizeau J., Friston K.J. Ten simple rules for dynamic causal modeling. NeuroImage 2010, 49:3099-3109.
68. Suri R.E. TD models of reward predictive responses in dopamine neurons. Neural Netw. 2002, 15:523-533.
69. Suri R.E., Schultz W. Learning of sequential movements by neural network model with dopamine-like reinforcement signal. Exp. Brain Res. 1998, 121:350-354.
70. Suri R.E., Schultz W. A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 1999, 91:871-890.
71. Suri R.E., Schultz W. Temporal difference model reproduces anticipatory neural activity. Neural Comput. 2001, 13:841-862.
72. Reinforcement Learning: An Introduction 1998, MIT Press, Cambridge, MA. R.S. Sutton, A.G. Barto (Eds.).
73. Taylor K.S., Seminowicz D.A., Davis K.D. Two systems of resting state connectivity between the insula and cingulate cortex. Hum. Brain Mapp. 2009, 30:2731-2745.
74. Thines G., Costall A., Butterworth G. Michotte's Experimental Phenomenology of Perception 1990, Lawrence Erlbaum Associates, Hillsdale, NJ.
75. Tregellas J.R., Davalos D.B., Rojas D.C. Effect of task difficulty on the functional anatomy of temporal processing. NeuroImage 2006, 32:307-315.
76. Vogt B.A. Regions and subregions of the cingulate cortex. Cingulate Neurobiology and Disease 2009, 3-30. Oxford University Press, New York. B.A. Vogt (Ed.).
77. Vogt B.A., Berger G.R., Derbyshire S.W.G. Structural and functional dichotomy of human midcingulate cortex. Eur. J. Neurosci. 2003, 18:3134-3144.
78. Young M.E., Rogers E.T., Beckmann J.S. Causal impressions: predicting when, not just whether. Mem. Cognit. 2005, 33:320-331.
79. Zucchini W. An introduction to model selection. J. Math. Psychol. 2000, 44:41-61.