Reliability of functional magnetic resonance imaging activation during working memory in a multi-site study: Analysis from the North American Prodrome Longitudinal Study

NeuroImage

Volumn 97, Issue , 2014, Pages 41-52

  Forsyth, Jennifer K ^a   McEwen, Sarah C ^a   Gee, Dylan G ^a   Bearden, Carrie E ^a   Addington, Jean ^b   Goodyear, Brad ^b   Cadenhead, Kristin S ^c   Mirzakhanian, Heline ^c   Cornblatt, Barbara A ^d   Olvet, Doreen M ^d   Mathalon, Daniel H ^e   McGlashan, Thomas H ^f   Perkins, Diana O ^g   Belger, Aysenil ^g   Seidman, Larry J ^h   Thermenos, Heidi W ^h   Tsuang, Ming T ^c   van Erp, Theo G M ⁱ   Walker, Elaine F ^j   Hamann, Stephan ^j   Woods, Scott W ^f   Qiu, Maolin ^f   Cannon, Tyrone D ^f   more..

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALGARY   (Canada)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d ZUCKER HILLSIDE HOSPITAL   (United States)

^e UNIVERSITY OF CALIFORNIA   (United States)

^f YALE UNIVERSITY   (United States)

^g UNIVERSITY OF NORTH CAROLINA   (United States)

^h HARVARD MEDICAL SCHOOL   (United States)

ⁱ UNIVERSITY OF CALIFORNIA   (United States)

^j EMORY UNIVERSITY   (United States)

more..

Author keywords

FMRI; G theory; Multi site; Reliability; Working memory

Indexed keywords

ADOLESCENT; ADULT; ANTERIOR CINGULATE; ARTICLE; BASAL GANGLION; BOLD SIGNAL; BRAIN CORTEX; BRAIN FUNCTION; CANADA; CEREBELLUM; CHILD; CONTROLLED STUDY; FEASIBILITY STUDY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LEFT DORSOLATERAL PREFRONTAL CORTEX; LEFT SUPERIOR PARIETAL CORTEX; LONGITUDINAL STUDY; MALE; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE SCANNER; PREFRONTAL CORTEX; PRIORITY JOURNAL; RELIABILITY; SUPPLEMENTARY MOTOR AREA; TASK PERFORMANCE; THALAMUS; TRAVEL; UNITED STATES; VALIDATION STUDY; WORKING MEMORY; BLOOD; BRAIN; CLINICAL TRIAL; IMAGE PROCESSING; MULTICENTER STUDY; MULTICENTER STUDY (TOPIC); NUCLEAR MAGNETIC RESONANCE IMAGING; PATHOLOGY; PHYSIOLOGY; PROCEDURES; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REPRODUCIBILITY; SHORT TERM MEMORY; YOUNG ADULT;

OXYGEN;

ADOLESCENT; ADULT; BRAIN; CANADA; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LONGITUDINAL STUDIES; MAGNETIC RESONANCE IMAGING; MALE; MEMORY, SHORT-TERM; MULTICENTER STUDIES AS TOPIC; OXYGEN; PSYCHOMOTOR PERFORMANCE; REACTION TIME; REPRODUCIBILITY OF RESULTS; UNITED STATES; YOUNG ADULT;

EID: 84901370390     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2014.04.027     Document Type: Article

References (40)

1. Abbott C., Juarez M., White T., Gollub R.L., Pearlson G.D., Bustillo J., Lauriello J., Ho B., Bockholt H.J., Clark V.P., Magnotta V., Calhoun V.D. Antipsychotic dose and diminished neural modulation: a multi-site fMRI study. Prog. Neuro-Psychopharmacol. Biol. Psychiatry 2011, 35(2):473-482.
2. Barch D.M., Mathalon D.H. Using brain imaging measures in studies of procognitive pharmacologic agents in schizophrenia: psychometric and quality assurance considerations. Biol. Psychiatry 2011, 70:13-18.
3. Behrens T.E.J., Johansen-Berg H., Woolrich M.W., Smith S.M., Wheeler-Kingshott C.A.M., Boulby P.A., Barker G.J., Sillery E.L., Sheehan K., Ciccarelli O., Thompson A.J., Brady J.M., Matthews P.M. Non-invasive mapping of connections between human thalamus and cortex using diffusion imaging. Nat. Neurosci. 2003, 6(7):750-757.
4. Bennett C.M., Miller M.B. How reliable are the results from functional magnetic resonance imaging?. Ann. N. Y. Acad. Sci. 2010, 1191:133-155.
5. Brown G.G., Mathalon D.H., Stern H., Ford J., Mueller B., Greve D.N., McCarthy G., Voyvodic J., Glover G., Diaz M., et al. Multisite reliability of cognitive BOLD data. NeuroImage 2011, 54:2163-2175.
6. Caceres A., Hall D.L., Zelaya F.O., Williams S.C.R., Mehta M.A. Measuring fMRI reliability with the intra-class correlation coefficient. NeuroImage 2009, 45(3):758-768.
7. Cicchetti D.V., Sparrow S.A. Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. Am. J. Ment. Defic. 1981, 86(2):127-137.
8. Colby J.B., Rudie J.D., Brown J.A., Douglas P.K., Cohen M.S., Shehzad Z. Insights into multimodal imaging classification of ADHD. Front. Syst. Neurosci. 2012, 6(59):1-18.
9. Costafreda S.G. Pooling fMRI data: meta-analysis, mega-analysis and multi-center studies. Front. Neuroinform. 2009, 3(33):1-8.
10. Fiebach C.J., Rissman J., D'Esposito M. Modulation of inferotemporal cortex activation during verbal working memory maintenance. Neuron 2006, 51(2):251-261.
11. First M.B., Spitzer R.L., Miriam G., Williams J.B.W. Structured clinical interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition. (SCID-I/P) 2002, Biometrics Research, New York States Psychiatric Institute, New York, NY.
12. Forman S.D., Cohen J.D., Fitzgerald M., Eddy W.F., Mintun M.A., Noll D.C. Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold. Magn. Reson. Med. 1995, 33(5):636-647.
13. Friedman L., Stern H., Brown G.G., Mathalon D.H., Turner J., Glover G.H., Gollub R.L., Lauriello J., Lim K.O., Cannon T., et al. Test-retest and between-site reliability in a multicenter fMRI study. Hum. Brain Mapp. 2008, 29(8):958-972.
14. Glover G.H., Mueller B.A., Turner J.A., van Erp T.G.M., Liu T.T., Greve D.N., Voyvodic J.T., Rasmussen J., Brown G.G., Keator D.B., et al. Function biomedical informatics research network recommendations for prospective multicenter functional MRI studies. J. Magn. Reson. Imaging 2012, 36(1):39-54.
15. Gountouna V.-E., Job D.E., McIntosh A.M., Moorhead T.W.J., Lymer G.K.L., Whalley H.C., Hall J., Waiter G.D., Brennan D., McGonigle D.J., et al. Functional magnetic resonance imaging (fMRI) reproducibility and variance components across visits and scanning sites with a finger tapping task. NeuroImage 2010, 49:552-560.
16. Gradin V., Gountouna V.-E., Waiter G., Ahearn T.S., Brennan D., Condon B., Marshall I., McGonigle D.J., Murray A.D., Whalley H., et al. Between- and within-scanner variability in the CaliBrain study n-back cognitive task. Psychiatry Res. Neuroimaging 2010, 184:86-95.
17. Greicius M.D., Krasnow B., Reiss A.L., Menon V. Functional connectivity in the resting brain: a network analysis of the default mode hypothesis. Proc. Natl. Acad. Sci. U.S.A. 2003, 100(1):253-258.
18. Hashimoto R.-I., Lee K.U., Preus A., McCarley R.W., Wible C.G. An fMRI study of functional abnormalities in the verbal working memory system and the relationship to clinical symptoms in chronic schizophrenia. Cereb. Cortex 2010, 20(1):46-60.
19. Hua X., Hibar D.P., Ching C.R., Boyle C.P., Rajagopalan P., Gutman B.A., Leow A.D., Toga A.W., Jack C.R., Harvey D., Weiner M.W., Thompson P.M. Unbiased tensor-based morphometry: improved robustness and sample size estimates for Alzheimer's disease clinical trials. NeuroImage 2013, 66(1):648-661.
20. Jenkinson M., Smith S. A global optimisation method for robust affine registration of brain images. Med. Image Anal. 2001, 5(2):143-156.
21. Jenkinson M., Bannister P., Brady M., Smith S. Improved optimization for the robust and accurate linear registration and motion correction of brain images. NeuroImage 2002, 17(2):825-841.
22. Koelsch S., Schulze K., Sammler D., Fritz T., Muller K., Gruber O. Functional architecture of verbal and tonal working memory: an fMRI study. Hum. Brain Mapp. 2009, 30(3):859-873.
23. Maldjian J.A., Laurienti P.J., Kraft R.A., Burdette J.H. An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. NeuroImage 2003, 19:1233-1239.
24. McGlashan T.H., Miller T.J., Woods S.W., Hoffman R.E., Davidson L. Instrument for the assessment of prodromal symptoms and states. Early. Interv. Psychotic Disord. 2001, 91:135-149.
25. Meindl T., Teipel S., Elmouden R., Mueller S., Koch W., Dietrich O., Coates U., Reiser M., Glaser C. Test-retest reproducibility of the default-mode network in healthy individuals. Hum. Brain Mapp. 2010, 31(2):237-246.
26. Mulkern R.V., Forbes P., Dewey K., Osganian S., Clark M., Wong S., Ramamurthy U., Kun L., Poussaint T.Y. Establishment and results of a magnetic resonance quality assurance program for the pediatric brain tumor consortium. Acad. Radiol. 2008, 15(9):1099-1110.
27. Salimi-Khorshidi G., Smith S.M., Keltner J.R., Wager T.R., Nichols T.E. Meta-analysis of neuroimaging data: a comparison of image-based and coordinate-based pooling of studies. NeuroImage 2009, 25:810-823.
28. Shavelson R.J., Webb N.M. Generalizability Theory: A Primer 1991, Sage, London.
29. Shrout P.E., Fleiss J.L. Intraclass correlations: uses in assessing rater reliability. Psychol. Bull. 1979, 86(2):420-428.
30. Smith S.M., Jenkinson M., Woolrich M.W., Beckmann C.F., Behrens T.E., Johansen-Berg H., Bannister P.R., De Luca M., Drobnjak I., Flitney D.E., Niazy R.K., Saunders J., Vickers J., Zhang Y., De Stefano N., Brady J.M., Matthews P.M. Advances in functional and structural MR image analysis and implementation as FSL. NeuroImage 2004, 23:S208-S219.
31. Sternberg S. High-speed scanning in human memory. Science 1966, 153:652-654.
32. Suckling J., Ohlssen D., Andrew C., Johnson G., Williams S.C.R., Graves M., Chen C.-H., Spiegelhalter D., Bullmore E. Components of variance in a multicentre functional MRI study and implications for calculation of statistical power. Hum. Brain Mapp. 2007, 29:1111-1122.
33. Voytek B., Knight R.T. Prefrontal cortex and basal ganglia contributions to visual working memory. Proc. Natl. Acad. Sci. U. S. A. 2010, 107(42):18167-18172.
34. Wager T.D., Nichols T.E. Optimization of experimental design in fMRI: a general framework using a genetic algorithm. NeuroImage 2003, 18:293-309.
35. Wechsler D. Wechsler Abbreviated Scale of Intelligence (WASI) 1999, Harcourt Assessment, San Antonio, TX.
36. White T., Magnotta V.A., Bockholt J., Williams S., Wallace S., Ehrlich S., Mueller B.A., Ho B.-C., Jung R.E., Clark V.P., Lauriello J., Bustillo J.R., Schulz S.C., Gollub R.L., Andreasen N.C., Calhoun V.D., Lim K.O. Global white matter abnormalities in schizophrenia: a multisite diffusion tensor imaging study. Schizophr. Bull. 2011, 37(1):222-232.
37. Woolrich M.W., Ripley B.D., Brady M., Smith S.M. Temporal autocorrelation in univariate linear modeling of FMRI data. NeuroImage 2001, 14(6):1370-1386.
38. Worsley K.J., Evans A.C., Marrett S., Neelin P. A three-dimensional statistical analysis for CBF activation studies in human brain. J. Cereb. Blood. Flow. Metab. 1992, 12(6):900-918.
39. Yendiki A., Greve D.N., Wallace S., Vangel M., Bockholt J., Mueller M.A., Magnotta V., Andreasen N., Manoach D.S., Gollub R.L. Multi-site characterization of an fMRI working memory paradigm: reliability of activation indices. NeuroImage 2010, 53:119-131.
40. Zou K.H., Greve D.N., Wang M., Pieper S.D., Warfield S.K., White N.S., Manandhar S., Brown G.G., Vangel M.G., Kikinis R., Wells W.M. Reproducibility of functional MR imaging: preliminary results of prospective multi-institutional study performed by biomedical informatics research network. Radiology 2005, 237:781-789.