Self-regulation of the anterior insula: Reinforcement learning using real-time fMRI neurofeedback

NeuroImage

Volumn 88, Issue , 2014, Pages 113-124

  Lawrence, Emma J ^a   Su, Li ^a,b   Barker, Gareth J ^a   Medford, Nick ^c   Dalton, Jeffrey ^a   Williams, Steve C R ^a   Birbaumer, Niels ^d   Veit, Ralf ^d   Ranganatha, Sitaram ^d   Bodurka, Jerzy ^e,f   Brammer, Michael ^a   Giampietro, Vincent ^a   David, Anthony S ^a  

^a KING'S COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^c BRIGHTON AND SUSSEX MEDICAL SCHOOL   (United Kingdom)

^d UNIVERSITY OF TÜBINGEN   (Germany)

^e LAUREATE INSTITUTE FOR BRAIN RESEARCH   (United States)

^f UNIVERSITY OF OKLAHOMA   (United States)

Author keywords

Emotion; Insula; Neurofeedback; Real time fMRI; Reinforcement learning; Self regulation

Indexed keywords

ADULT; AFFECT; ANTERIOR CINGULATE; ANTERIOR INSULA; ARTICLE; AUTOREGULATION; BEHAVIOR; BOLD SIGNAL; CAUDATE NUCLEUS; COGNITION; CONTROLLED STUDY; ELECTRODERMAL RESPONSE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NEUROFEEDBACK; NORMAL HUMAN; PILOT STUDY; POSTERIOR INSULA; PRIORITY JOURNAL; PUTAMEN; REINFORCEMENT; REWARD; THALAMUS; BRAIN CORTEX; BRAIN MAPPING; DIAGNOSTIC IMAGING; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PROCEDURES; SELF CONTROL; YOUNG ADULT;

ADULT; AFFECT; BRAIN MAPPING; CEREBRAL CORTEX; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; NEUROFEEDBACK; REINFORCEMENT (PSYCHOLOGY); REWARD; SELF-CONTROL; YOUNG ADULT;

EID: 84892899976     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2013.10.069     Document Type: Article

References (68)

1. Anders S., Lotze M., et al. Brain activity underlying emotional valence and arousal: a response-related fMRI study. Hum. Brain Mapp. 2004, 23:200-209.
2. Beck A.T., Epstein N., Brown G. An inventory for measuring clinical anxiety: psychometric properties. J. Consult. Clin. Psychol. 1988, 56:893-897.
3. Beck A.T., Steer R.A., Garbin M.G. Psychometric properties of the Beck Depression Inventory: twenty-five years of evaluation. Clin. Psychol. Rev. 1988, 8:77-100.
4. Benjamini Y., Hochberg Y. Controlling the false discovery rate - a practical and powerful approach to multiple testing. J. R. Stat. Soc. B Methodol. 1995, 57:289-300.
5. Bodurka J., Bandettini P. Real-time software for monitoring MRI scanner operation. Neuroimage 2008, 41(Suppl. 1):S85.
6. Bradley M., Lang R. Measuring emotion: the self-assessment mannequin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 1994, 25:49-59.
7. Brammer M.J., Bullmore E.T., Simmons A., Williams S.C.R., Grasby P.M., Howard R.J., Woodruff P.W.R., Rabe-Hesketh S. Generic brain activation mapping in fMRI: a nonparametric approach. Magn. Reson. Imaging 1997, 15:763-770.
8. Bullmore E.T., Suckling J., Overmeyer S., Rabe-Hesketh S., Taylor E.And, Brammer M.J. Global voxel and cluster tests by theory and permutation for a difference between two groups of structural MR images of the brain. IEEE Trans. Med. Imaging 1999, 18:32-42.
9. Bullmore E.T., Long C., Suckling J., Fadili J., Calvert G.A., Zelaya F., Carpenter T.A., Brammer M.J. Coloured noise and computational inference in neurophysiological (fMRI) time series analysis: resampling methods in time and wavelet domains. Hum. Brain Mapp. 2001, 12:61-78.
10. Bush G., Vogt B.A., Holmes J., Dale A.M., Greve D., Jenike M.A., Rosen B.R. Dorsal anterior cingulate cortex: a role in reward-based decision making. Proc. Natl. Acad. Sci. U. S. A. 2001, 99:523-528.
11. Caria A., Veit R., et al. Regulation of the anterior insular cortex activity using real-time fMRI. Neuroimage 2007, 35:1238-1246.
12. Caria A., Sitaram R., et al. Volitional control of anterior insula activity modulates response to aversive stimuli. A real-time functional magnetic resonance imaging study. Biol. Psychiatry 2010, 68:425-432.
13. Caria A., Sitaram R., Birbaumer N. Real-time fMRI: a tool for local brain regulation. Neuroscientist 2011, 18:487-501.
14. Cox R. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 1996, 29:162-173.
15. Craig B. How do you feel - now? The anterior insula and human awareness. Nat. Rev. Neurosci. 2009, 10:59-70.
16. Crespo-Facorro, et al. Insular cortex abnormalities in schizophrenia: a structural magnetic resonance imaging study of first-episode patients. Schizophr. Res. 2000, 46:35-43.
17. Critchley, et al. Neural systems supporting interoceptive awareness. Nat. Neurosci. 2004, 7:189-195.
18. Dawson M.E., Schell A.M., Filion D.L. The electrodermal system. Handbook of Psychophysiology 2007, 159-181. Cambridge University Press, Cambridge, UK. 3rd ed. J.T. Cacioppo, L.G. Tassinary, G.G. Berntson (Eds.).
19. DeCharms R. Applications of rt-fMRI. Nat. Rev. Neurosci. 2008, 9:720-729.
20. DeCharms R., Maeda F., et al. Control over brain activation and pain learned by using real-time functional MRI. Proc. Natl. Acad. Sci. 2005, 102:18626-18631.
21. Delgado M., Stenger V., et al. Motivation-dependent responses in the human caudate nucleus. Cereb. Cortex 2004, 14:1022-1030.
22. Duerden E., Arsalidou M., Lee M., Taylor M. Lateralization of affective processing in the insula. Neuroimage 2013, 78:159-175.
23. Fairchild G., Passamonti L., et al. Brain structure abnormalities in early-onset and adolescent-onset conduct disorder. Am. J. Psychiatry 2011, 168:624-633.
24. Farb N., Segal Z., et al. Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference. Soc. Cogn. Affect. Neurosci. 2007, 2:313-322.
25. Gray M., Harrison N., et al. Modulation of emotional appraisal by false physiological feedback during fMRI. PLoS ONE 2007, 2(6):e546.
26. Hester R., Madeley J., Murphy K., Mattingley J.B. Learning from errors: error-related neural activity predicts improvements in future inhibitory control performance. J. Neurosci. 2009, 29:7158-7165.
27. Holroyd C.B., Yeung N. Motivation of extended behaviors by anterior cingulate cortex. Trends Cogn. Sci. 2012, 16:122-128.
28. Holroyd C., Nieuwenhuis S., Yeung N., Nystrom L., Mars R.B., Coles M.G., Cohen J.D. Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals. Nat. Neurosci. 2004, 7:497-498.
29. Johnson A., Hartwell K., et al. Intermittent 'real-time' fMRI feedback is superior to continuous presentation for a motor imagery task: a pilot study. J. Neuroimaging 2012, 22:58-66.
30. Johnston S., Boehm S., et al. Neurofeedback: a promising tool for the self-regulation of emotion networks. Neuroimage 2010, 49:1066-1072.
31. Johnston S., Linden D., et al. Upregulation of emotional areas through neurofeedback with a focus on positive mood. Cogn. Affect. Behav. Neurosci. 2011, 11:44-51.
32. Kumari V., Fannon D., et al. Neural changes following cognitive behaviour therapy for psychosis: a longitudinal study. Brain 2011, 134:2396-2407.
33. Lancaster J.L., Rainey L.H., Summerlin J.L., Freitas C.S., Fox P.T., Evans A.C., Toga A.W., Mazziotta J.C. Automated labeling of the human brain: a preliminary report on the development and evaluation of a forward-transform method. Hum. Brain Mapp. 1997, 5:238-242.
34. Lancaster J.L., Woldorff M.G., Parsons L.M., Liotti M., Freitas C.S., Rainey L., Kochunov P.V., Nickerson D., Mikiten S.A., Fox P.T. Automated Talairach Atlas labels for functional brain mapping". Hum. Brain Mapp. 2000, 10:120-131.
35. Lang P., Bradley M., et al. International Affective Picture System: Affective Ratings of Pictures and Instruction Manual, Technical Report A-6 2005, University of Florida, Gainsville, FL.
36. Li X., Hartwell K., et al. Volitional reduction of anterior cingulate cortex activity produces decreased cue craving in smoking cessation: a preliminary real-time fMRI study. Addict. Biol 2012, 10.1111/j.1369-1600.2012.00449.x.
37. Margulies D.S., Kelly A.M., Uddin L.Q., Biswal B.B., Castellanos F.X., Milham M.P. Mapping the functional connectivity of anterior cingulate cortex. Neuroimage 2007, 37:579-588.
38. Marks D.F. Visual imagery differences in the recall of pictures. Br. J. Psychol. 1973, 64:17-24.
39. McCraig R., Dixon M., et al. Improved modulation of rostrolateral prefrontal cortex using real-time fMRI training and meta-cognitive awareness. Neuroimage 2011, 55:1298-1305.
40. Murphy K., Garavan H. Artifactual fMRI group and condition differences driven by performance confounds. Neuroimage 2004, 21:219-228.
41. Mutschler I., Wieckhorst B., et al. Functional organization of the human anterior insula cortex. Neurosci. Lett. 2009, 457:66-70.
42. Nelson H.E. The National Adult Reading Test (NART): Test manual 1982, NFER-Nelson, Windsor.
43. Northoff G., Schneider F., et al. Differential parametric modulation of self-relatedness and emotions in different brain regions. Hum. Brain Mapp. 2009, 30:369-382.
44. O'Doherty J.P., Hampton A., Kim H. Model-based fMRI and its application to reward learning and decision making. Ann. N. Y. Acad. Sci. 2007, 1104:35-53.
45. Oldfield R.C. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 1971, 9:97-113.
46. Phillips M., Medford N., et al. Depersonalization disorder: thinking without feeling. Psychiatry Res. 2001, 108:145-160.
47. Posner J., Russell J., et al. The neurophysiological bases of emotion: an fMRI study of the affective circumplex using emotion-denoting words. Hum. Brain Mapp. 2009, 30:883-895.
48. Rota G., Sitaram R., et al. Self-regulation of regional cortical activity using rt-fMRI: the right inferior frontal gyrus and linguistic processing. Hum. Brain Mapp. 2009, 30:1605-1614.
49. Ruiz S., Lee S., et al. Acquired self-control of the insula cortex modulates emotion recognition and brain network connectivity in schizophrenia. Hum. Brain Mapp 2011, 10.1002/hbm.21427.
50. Scharnowski F., et al. Improving visual perception through neurofeedback. J. Neurosci. 2012, 32:17830-17841.
51. Schonberg T., Daw N.D., Joel D., O'Doherty J.P. Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J. Neurosci. 2007, 7:12860-12867.
52. Shapleske J., Rossell S.L., Chitnis X.A., Suckling J., Simmons A., Bullmore E.T., Woodruff P.W.R., David A.S. A computational morphometric MRI study of schizophrenia: effects of hallucinations. Cereb. Cortex 2002, 12:1331-1341.
53. Sierra M., Berrios G.E. The Cambridge Depersonalization Scale: a new instrument for the measurement of depersonalization. Psychiatry Res. 2000, 93:153-164.
54. Simmons K., Avery J., Barcalow J., Bodurka J., Drevets W., Bellgowan P. Keeping the body in mind: insula functional organization and functional connectivity integrate interoceptive, exteroceptive, and emotional awareness. Hum. Brain Mapp 2012, ([Epub] human). 10.1002/hbm.22113.
55. Singer T., Critchley H., et al. A common role of insula in feelings, empathy and uncertainty. Trends Cogn. Sci. 2009, 13:334-340.
56. Sulzer J., Haller S., Scharnowski F., Weiskopf N., Birbaumer N., Blefari M., Bruehl A., Cohen L., deCharms R., Gassert R., Goebel R., Herwig U., LaConte S., Linden D., Luft A., Seifritz E., Sitaram R. Real-time fMRI neurofeedback: progress and challenges. Neuroimage 2013, 76:386-399.
57. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction 1998, MIT Press.
58. Talairach J., Tournoux P. Co-planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System - an Approach to Cerebral Imaging 1988, Thieme Medical Publishers, New York.
59. Thirion B., Pinel P., Meriaux S., Roche A., Dehaene S., Poline J.-B. Analysis of a large fMRI cohort: statistical and methodological issues for group analysis. Neuroimage 2007, 35:105-120.
60. Ture U., et al. Topographic anatomy of the insular region. J. Neurosurg. 1999, 90:720-733.
61. Veit R., Singh V., et al. Using real-time fMRI to learn voluntary regulation of the anterior insula in the presence of threat-related stimuli. Soc. Cogn. Affect. Neurosci. 2011, 7:623-634.
62. Walach H., Buchheld N., Buttenmuller V., Kleinknecht N., Schmidt S. Measuring mindfulness-the Freiburg Mindfulness Inventory (FMI). Pers. Individ. Differ. 2006, 40:1543-1555.
63. Weiskopf N. Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI). IEEE Trans. Biomed. Eng. 2004, 51:966-970.
64. Weiskopf N. Real-time fMRI and its application to neurofeedback. Neuroimage 2012, 62:682-692.
65. Weiskopf N., Veit R., et al. Physiological self-regulation of regional brain activity using real-time functional magnetic resonance imaging (fMRI): methodology and exemplary data. Neuroimage 2003, 19:577-586.
66. Wright P.J., Mougin O.E., Totman J.J., Peters A.M., Brookes M.J., Coxon R., Morris P.E., Clemence M., Francis S.T., Bowtell R.W., Gowland P.A. Water proton T1 measurements in brain tissue at 7, 3, and 1.5T using IR-EPI, IR-TSE, and MPRAGE: results and optimization 2008.
67. Zaki J., Davis J., Ochsner K. Overlapping activity in the anterior insula during interoception and emotional experience. Neuroimage 2012, 62:493-499.
68. Zotev V., Krueger F., et al. Self-regulation of amygdala activation using real-time neurofeedback. PLoS 2011, 6(9):e24522. 10.1371/journal.pone.0024522.