Test-retest reliability of evoked BOLD signals from a cognitive-emotive fMRI test battery

NeuroImage

Volumn 60, Issue 3, 2012, Pages 1746-1758

  Plichta, Michael M ^a,c   Schwarz, Adam J ^b   Grimm, Oliver ^a   Morgen, Katrin ^a   Mier, Daniela ^a   Haddad, Leila ^a   Gerdes, Antje B M ^c   Sauer, Carina ^a   Tost, Heike ^a   Esslinger, Christine ^a,d   Colman, Peter ^e   Wilson, Frederick ^e   Kirsch, Peter ^a   Meyer Lindenberg, Andreas ^a  

^a UNIVERSITY OF HEIDELBERG   (Germany)

^b ELI LILLY AND COMPANY   (United States)

^c UNIVERSITY OF MANNHEIM   (Germany)

^d UNIVERSITY HOSPITAL MAGDEBURG   (Germany)

^e PFIZER GLOBAL RESEARCH AND DEVELOPMENT   (United Kingdom)

Author keywords

Emotion; FMRI; Intra class correlation coefficient; Reliability; Reproducibility; Reward; Working memory

Indexed keywords

AMYGDALOID NUCLEUS; ARTICLE; BOLD SIGNAL; COGNITION; CONTROLLED STUDY; CORPUS STRIATUM; CORRELATION COEFFICIENT; CROSSOVER PROCEDURE; EMOTION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; MOTIVATION; NEUROSCIENCE; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; PARALLEL DESIGN; PREFRONTAL CORTEX; PRIORITY JOURNAL; QUALITY CONTROL; RELIABILITY; TEST RETEST RELIABILITY; THREE DIMENSIONAL IMAGING; WORKING MEMORY;

BRAIN; COGNITION; EMOTIONS; EVOKED POTENTIALS; FEMALE; FUNCTIONAL NEUROIMAGING; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MOTIVATION; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; YOUNG ADULT;

EID: 84857753446     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2012.01.129     Document Type: Article

References (67)

1. Alpers G.W., Gerdes A.B., Lagarie B., Tabbert K., Vaitl D., Stark R. Attention and amygdala activity: an fMRI study with spider pictures in spider phobia. J. Neural Transm. 2009, 116:747-757.
2. Amunts K., Kedo O., Kindler M., Pieperhoff P., Mohlberg H., Shah N.J., Habel U., Schneider F., Zilles K. Cytoarchitectonic mapping of the human amygdala, hippocampal region and entorhinal cortex: intersubject variability and probability maps. Anat. Embryol. (Berl) 2005, 210:343-352.
3. Barch D.M., Mathalon D.H. Using brain imaging measures in studies of procognitive pharmacologic agents in schizophrenia: psychometric and quality assurance considerations. Biol. Psychiatry 2011, 70:13-18.
4. Bennett C.M., Miller M.B. How reliable are the results from functional magnetic resonance imaging?. ANYAS 2010, 1191:133-155.
5. Bland J.M., Altman D.G. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986, 1:307-310.
6. Bland J.M., Altman D.G. A note on the use of the intraclass correlation coefficient in the evaluation of agreement between two methods of measurement. Comput. Biol. Med. 1990, 20:337-340.
7. Bland J.M., Altman D.G. Measuring agreement in method comparison studies. Stat. Methods Med. Res. 1999, 8:135-160.
8. Blokland G.A., McMahon K.L., Thompson P.M., Martin N.G., de Zubicaray G.I., Wright M.J. Heritability of working memory brain activation. J. Neurosci. 2011, 31:10882-10890.
9. Borsook D., Becerra L., Hargreaves R. A role for fMRI in optimizing CNS drug development. Nat. Rev. Drug Discov. 2006, 5:411-424.
10. Caceres A., Hall D.L., Zelaya F.O., Williams S.C.R., Mehta M.A. Measuring fMRI reliability with the intra-class correlation coefficient. Neuroimage 2009, 45:758-768.
11. Callicott J.H., Ramsey N.F., Tallent K., Bertolino A., Knable M.B., Coppola R., Goldberg T., van Gelderen P., Mattay V.S., Frank J.A., Moonen C.T., Weinberger D.R. Functional magnetic resonance imaging brain mapping in psychiatry: methodological issues illustrated in a study of working memory in schizophrenia. Neuropsychopharmacology 1998, 18:186-196.
12. Chein J.M., Schneider W. Neuroimaging studies of practice-related change: fMRI and meta-analytic evidence of a domain-general control network for learning. Brain Res. Cogn. Brain Res. 2005, 25:607-623.
13. Del-Ben C.M., Deakin J.F., McKie S., Delvai N.A., Williams S.R., Elliott R., Dolan M., Anderson I.M. The effect of citalopram pretreatment on neuronal responses to neuropsychological tasks in normal volunteers: an fmri study. Neuropsychopharmacology 2005, 30:1724-1734.
14. de Vet H.C.W., Terwee C.B., Knol D.L., Bouter L.M. When to use agreement versus reliability measures. J. Clin. Epidemiol. 2006, 59:1033-1039.
15. Esslinger C., Walter H., Kirsch P., Erk S., Schnell K., Arnold C., Haddad L., Mier D., Opitz von Boberfeld C., Raab K., Witt S.H., Rietschel M., Cichon S., Meyer-Lindenberg A. Neural mechanisms of a genome-wide supported psychosis variant. Science 2009, 324:605.
16. The Design and Analysis of Clinical Experiments 1986, Wiley, New York. J.L. Fleiss (Ed.).
17. Fliessbach K., Rohe T., Linder N.S., Trautner P., Elger C.E., Weber B. Retest reliability of reward-related BOLD signals. Neuroimage 2010, 50:1168-1176.
18. Forbes E.E., Brown S.M., Kimak M., Ferrell R.E., Manuck S.B., Hariri A.R. Genetic variation in components of dopamine neurotransmission impacts ventral striatal reactivity associated with impulsivity 2007.
19. Forbes E.E., Olino T.M., Ryan N.D., Birmaher B., Axelson D., Moyles D.L., Dahl R.E. Reward-related brain function as a predictor of treatment response in adolescents with major depressive disorder. Cogn. Affect. Behav. Neurosci. 2010, 10:107-118.
20. Friedman L., Glover G.H. Report on a multicenter fMRI quality assurance protocol. J. Magn. Reson. Imaging 2006, 23:827-839.
21. Glahn D.C., Ragland J.D., Abramoff A., Barrett J., Laird A.R., Bearden C.E., Velligan D.I. Beyond hypofrontality: a quantitative meta-analysis of functional neuroimaging studies of working memory in schizophrenia. Hum. Brain Mapp. 2005, 25:60-69.
22. Gountouna V.-E., Job D.E., McIntosh A.M., Moorhead T.W.J., Lymer G.K.L., Whalley H.C., Hall J., Waiter G.D., Brennan D., McGonigle D.J., Ahearn T.S., Cavanagh J., Condon B., Hadley D.M., Marshall I., Murray A.D., Steele J.D., Wardlaw J.M., Lawrie S.M. Functional magnetic resonance imaging (fMRI) reproducibility and variance components across visits and scanning sites with a finger tapping task. Neuroimage 2010, 49:552-560.
23. Hahn T., Dresler T., Ehlis A.-C., Plichta M.M., Heinzel S., Polak T., Lesch K.-P., Breuer F., Jakob P.M., Fallgatter A.J. Neural response to reward anticipation is modulated by Gray's impulsivity. Neuroimage 2009, 46:1148-1153.
24. Hahn T., Heinzel S., Dresler T., Plichta M.M., Renner T.J., Markulin F., Jakob P.M., Lesch K.P., Fallgatter A.J. Association between reward-related activation in the ventral striatum and trait reward sensitivity is moderated by dopamine transporter genotype. Hum. Brain Mapp. 2011, 32:1557-1565.
25. Hariri A.R., Tessitore A., Mattay V.S., Fera F., Weinberger D.R. The amygdala response to emotional stimuli: a comparison of faces and scenes. Neuroimage 2002, 17:317-323.
26. Harmer C.J., Mackay C.E., Reid C.B., Cowen P.J., Goodwin G.M. Antidepressant drug treatment modifies the neural processing of nonconscious threat cues. Biol. Psychiatry 2006, 59:816-820.
27. Herrmann M.J., Huter T., Plichta M.M., Ehlis A.C., Alpers G.W., Muhlberger A., Fallgatter A.J. Enhancement of activity of the primary visual cortex during processing of emotional stimuli as measured with event-related functional near-infrared spectroscopy and event-related potentials. Hum. Brain Mapp. 2008, 29:28-35.
28. Johnstone T., Somerville L.H., Alexander A.L., Oakes T.R., Davidson R.J., Kalin N.H., Whalen P.J. Stability of amygdala BOLD response to fearful faces over multiple scan sessions. Neuroimage 2005, 25:1112-1123.
29. Kirsch P., Schienle A., Stark R., Sammer G., Blecker C., Walter B., Ott U., Burkart J., Vaitl D. Anticipation of reward in a nonaversive differential conditioning paradigm and the brain reward system: an event-related fMRI study. Neuroimage 2003, 20:1086-1095.
30. Kirsch P., Reuter M., Mier D., Lonsdorf T., Stark R., Gallhofer B., Vaitl D., Hennig J. Imaging gene-substance interactions: the effect of the DRD2 TaqIA polymorphism and the dopamine agonist bromocriptine on the brain activation during the anticipation of reward. Neurosci. Lett. 2006, 405:196-201.
31. Lang P.J., Bradley M.M., Fitzsimmons J.R., Cuthbert B.N., Scott J.D., Moulder B., Nangia V. Emotional arousal and activation of the visual cortex: an fMRI analysis. Psychophysiology 1998, 35:199-210.
32. Lee J.N., Hsu E.W., Rashkin E., Thatcher J.W., Kreitschitz S., Gale P., Healy L., Marchand W.R. Reliability of fMRI motor tasks in structures of the corticostriatal circuitry: implications for future studies and circuit function. Neuroimage 2010, 49:1282-1288.
33. Liou M., Su H.R., Lee J.D., Cheng P.E., Huang C.C., Tsai C.H. Functional MR images and scientific inference: reproducibility maps. J. Cogn. Neurosci. 2003, 15:935-945.
34. Machielsen W.C., Rombouts S.A., Barkhof F., Scheltens P., Witter M.P. FMRI of visual encoding: reproducibility of activation. Hum. Brain Mapp. 2000, 9:156-164.
35. Maiza O., Mazoyer B., Herve P.Y., Razafimandimby A., Dollfus S., Tzourio-Mazoyer N., Andreassen O.A. Impact of cognitive performance on the reproducibility of fMRI activation in schizophrenia. J. Psychiatry Neurosci. 2010, 35:378-389.
36. Manoach D.S., Halpern E.F., Kramer T.S., Chang Y., Goff D.C., Rauch S.L., Kennedy D.N., Gollub R.L. Test-retest reliability of a functional MRI working memory paradigm in normal and schizophrenic subjects. Am. J. Psychiatry 2001, 158:955-958.
37. Manuck S.B., Brown S.M., Forbes E.E., Hariri A.R. Temporal stability of individual differences in amygdala reactivity. Am. J. Psychiatry 2007, 164:1613-1614.
38. Meyer-Lindenberg A. From maps to mechanisms through neuroimaging of schizophrenia. Nature 2010, 468:194-202.
39. Meyer-Lindenberg A., Weinberger D.R. Intermediate phenotypes and genetic mechanisms of psychiatric disorders. Nat. Rev. Neurosci. 2006, 7:818-827.
40. Meyer-Lindenberg A., Buckholtz J.W., Kolachana B., Hariri A.R., Pezawas L., Blasi G., Wabnitz A., Honea R., Verchinski B., Callicott J.H., Egan M., Mattay V., Weinberger D.R. Neural mechanisms of genetic risk for impulsivity and violence in humans. Proc. Natl. Acad. Sci. U.S.A. 2006, 103:6269-6274.
41. Meyer-Lindenberg A., Straub R.E., Lipska B.K., Verchinski B.A., Goldberg T., Callicott J.H., Egan M.F., Huffaker S.S., Mattay V.S., Kolachana B., Kleinman J.E., Weinberger D.R. Genetic evidence implicating DARPP-32 in human frontostriatal structure, function, and cognition. J. Clin. Invest. 2007, 117:672-682.
42. Miki A., Liu G.T., Englander S.A., Raz J., van Erp T.G., Modestino E.J., Liu C.J., Haselgrove J.C. Reproducibility of visual activation during checkerboard stimulation in functional magnetic resonance imaging at 4Tesla. Jpn. J. Ophthalmol. 2001, 45:151-155.
43. Muller R., Buttner P. A critical discussion of intraclass correlation coefficients. Stat. Med. 1994, 13:2465-2476.
44. Murphy S.E., Norbury R., O'Sullivan U., Cowen P.J., Harmer C.J. Effect of a single dose of citalopram on amygdala response to emotional faces. Br. J. Psychiatry 2009, 194:535-540.
45. Patin A., Hurlemann R. Modulating amygdala responses to emotion: evidence from pharmacological fMRI. Neuropsychologia 2011, 49:706-717.
46. Pezawas L., Meyer-Lindenberg A., Drabant E.M., Verchinski B.A., Munoz K.E., Kolachana B.S., Egan M.F., Mattay V.S., Hariri A.R., Weinberger D.R. 5-HTTLPR polymorphism impacts human cingulate-amygdala interactions: a genetic susceptibility mechanism for depression. Nat. Neurosci. 2005, 8:828-834.
47. Plichta M.M., Vasic N., Wolf R.C., Lesch K.-P., Brummer D., Jacob C., Fallgatter A.J., Grön G. Neural hyporesponsiveness and hyperresponsiveness during immediate and delayed reward processing in adult attention-deficit/hyperactivity disorder. Biol. Psychiatry 2009, 65:7-14.
48. Plichta M.M., Gerdes A.B., Alpers G.W., Harnisch W., Brill S., Wieser M.J., Fallgatter A.J. Auditory cortex activation is modulated by emotion: a functional near-infrared spectroscopy (fNIRS) study. Neuroimage 2011, 55:1200-1207.
49. Raemaekers M., Vink M., Zandbelt B., van Wezel R.J., Kahn R.S., Ramsey N.F. Test-retest reliability of fMRI activation during prosaccades and antisaccades. Neuroimage 2007, 36:532-542.
50. Ramsey N.F., Jansma J.M., Jager G., Van Raalten T., Kahn R.S. Neurophysiological factors in human information processing capacity. Brain 2004, 127:517-525.
51. Rombouts S.A., Barkhof F., Hoogenraad F.G., Sprenger M., Valk J., Scheltens P. Test-retest analysis with functional MR of the activated area in the human visual cortex. AJNR Am. J. Neuroradiol. 1997, 18:1317-1322.
52. Rombouts S.A., Barkhof F., Hoogenraad F.G., Sprenger M., Scheltens P. Within-subject reproducibility of visual activation patterns with functional magnetic resonance imaging using multislice echo planar imaging. Magn. Reson. Imaging 1998, 16:105-113.
53. Rousson V., Gasser T., Seifert B. Assessing intrarater, interrater and test-retest reliability of continuous measurements. Stat. Med. 2002, 21:3431-3446.
54. Schacher M., Haemmerle B., Woermann F.G., Okujava M., Huber D., Grunwald T., Kramer G., Jokeit H. Amygdala fMRI lateralizes temporal lobe epilepsy. Neurology 2006, 66:81-87.
55. Scheres A., Milham M.P., Knutson B., Castellanos F.X. Ventral striatal hyporesponsiveness during reward anticipation in attention-deficit/hyperactivity disorder. Biol. Psychiatry 2007, 61:720-724.
56. Schwarz A.J., Becerra L., Upadhyay J., Anderson J., Baumgartner R., Coimbra A., Evelhoch J., Hargreaves R., Robertson B., Iyengar S., Tauscher J., Bleakman D., Borsook D. A procedural framework for good imaging practice in pharmacological fMRI studies applied to drug development #1: processes and requirements. Drug Discov. Today 2011, 16:583-593.
57. Schwarz A.J., Becerra L., Upadhyay J., Anderson J., Baumgartner R., Coimbra A., Evelhoch J., Hargreaves R., Robertson B., Iyengar S., Tauscher J., Bleakman D., Borsook D. A procedural framework for good imaging practice in pharmacological fMRI studies applied to drug development #2: protocol optimization and best practices. Drug Discov. Today 2011, 16(15/16):671-682.
58. Shrout P.E., Fleiss J.L. Intraclass correlations: uses in assessing rater reliability. PsyB 1979, 86:420-428. (URLJ). http://www.apa.org/journals/bul.html.
59. Specht K., Willmes K., Shah N.J., Jancke L. Assessment of reliability in functional imaging studies. J. Magn. Reson. Imaging 2003, 17:463-471.
60. Stark R., Schienle A., Walter B., Kirsch P., Blecker C., Ott U., Schafer A., Sammer G., Zimmermann M., Vaitl D. Hemodynamic effects of negative emotional pictures - a test-retest analysis. Neuropsychobiology 2004, 50:108-118.
61. Tan H.Y., Chen Q., Sust S., Buckholtz J.W., Meyers J.D., Egan M.F., Mattay V.S., Meyer-Lindenberg A., Weinberger D.R., Callicott J.H. Epistasis between catechol-O-methyltransferase and type II metabotropic glutamate receptor 3 genes on working memory brain function. Proc. Natl. Acad. Sci. U.S.A. 2007, 104:12536-12541.
62. Tegeler C., Strother S.C., Anderson J.R., Kim S.G. Reproducibility of BOLD-based functional MRI obtained at 4T. Hum. Brain Mapp. 1999, 7:267-283.
63. Wagner K., Frings L., Quiske A., Unterrainer J., Schwarzwald R., Spreer J., Halsband U., Schulze Bonhage A. The reliability of fMRI activations in the medial temporal lobes in a verbal episodic memory task. Neuroimage 2005, 28:122-131.
64. Wei X., Yoo S.S., Dickey C.C., Zou K.H., Guttmann C.R., Panych L.P. Functional MRI of auditory verbal working memory: long-term reproducibility analysis. Neuroimage 2004, 21:1000-1008.
65. Wise R.G., Preston C. What is the value of human FMRI in CNS drug development?. Drug Discov. Today 2010, 15:973-980.
66. Wise R.G., Tracey I. The role of fMRI in drug discovery. J. Magn. Reson. Imaging 2006, 23:862-876.
67. Yetkin F.Z., McAuliffe T.L., Cox R., Haughton V.M. Test-retest precision of functional MR in sensory and motor task activation. AJNR Am. J. Neuroradiol. 1996, 17:95-98.