Multisite reliability of cognitive BOLD data

NeuroImage

Volumn 54, Issue 3, 2011, Pages 2163-2175

  Brown, Gregory G ^a   Mathalon, Daniel H ^b   Stern, Hal ^c   Ford, Judith ^b   Mueller, Bryon ^d   Greve, Douglas N ^e   McCarthy, Gregory ^f   Voyvodic, James ^g   Glover, Gary ^h   Diaz, Michele ^g   Yetter, Elizabeth ^b   Ozyurt, I Burak ⁱ   Jorgensen, Kasper W ^b   Wible, Cynthia G ^j   Turner, Jessica A ^k   Thompson, Wesley K ⁱ   Potkin, Steven G ^k  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c 5226 Donald Bren Hall   (United States)

^d UNIVERSITY OF MINNESOTA   (United States)

^e MASSACHUSETTS GENERAL HOSPITAL   (United States)

^f YALE UNIVERSITY   (United States)

^g DUKE UNIVERSITY MEDICAL CENTER   (United States)

^h STANFORD UNIVERSITY   (United States)

ⁱ UNIVERSITY OF CALIFORNIA   (United States)

^j HARVARD MEDICAL SCHOOL   (United States)

^k UNIVERSITY OF CALIFORNIA   (United States)

more..

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BRAIN MAPPING; COGNITION; EFFECT SIZE; EMOTIONALITY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMAGE ANALYSIS; IMAGE PROCESSING; IMAGE QUALITY; MALE; NEUROIMAGING; PRIORITY JOURNAL; RELIABILITY; TASK PERFORMANCE; VOXEL BASED MORPHOMETRY; WORKING MEMORY;

ADULT; ALGORITHMS; COGNITION; DATA INTERPRETATION, STATISTICAL; EMOTIONS; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MEMORY, SHORT-TERM; MIDDLE AGED; OXYGEN; QUALITY CONTROL; REPRODUCIBILITY OF RESULTS; YOUNG ADULT;

EID: 78650215466     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2010.09.076     Document Type: Article

References (54)

1. Blair J., Spreen O. Predicting premorbid IQ: a revison of the natinal adult reading test. Clin. Neuropsychol. 1989, 3:129-136.
2. Bosnell R., Wegner C., Kincses Z.T., Korteweg T., Agosta F., Ciccarelli O., De Stefano N., Gass A., Hirsch J., Johansen-Berg H., et al. Reproducibility of fMRI in the clinical setting: implications for trial designs. Neuroimage 2008, 42(2):603-610.
3. Brennan R.L. Generalizability Theory 2001, Springer-Verlag, New York.
4. Caceres A., Hall D.L., Zelaya F.O., Williams S.C., Mehta M.A. Measuring fMRI reliability with the intra-class correlation coefficient. Neuroimage 2009, 45(3):758-768.
5. Carron A.V. Motor performance and response consistency as a function of age. J. Mot Behav. 1971, 3(2):105-109.
6. Casey B.J., Cohen J.D., O'Craven K., Davidson R.J., Irwin W., Nelson C.A., Noll D.C., Hu X., Lowe M.J., Rosen B.R., et al. Reproducibility of fMRI results across four institutions using a spatial working memory task. Neuroimage 1998, 8(3):249-261.
7. Cicchetti D.V., Sparrow S.A. Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. Am. J. Ment. Defic. 1981, 86(2):127-137.
8. Cohen J. Statistical Power Analysis for the Behavioral Sciences 1988, Lawrence Erlbaum Associates, Hillsdale, N.J.
9. Cohen E.R., Rostrup E., Sidaros K., Lund T.E., Paulson O.B., Ugurbil K., Kim S.G. Hypercapnic normalization of BOLD fMRI: comparison across field strengths and pulse sequences. Neuroimage 2004, 23(2):613-624.
10. Collins D.L., Neelin P., Peters T.M., Evans A.C. Automatic 3D intersubject registration of MR volumetric data in standardized Talairach space. J. Comput. Assist. Tomogr. 1994, 18(2):192-205.
11. Costafreda S.G., Brammer M.J., Vencio R.Z., Mourao M.L., Portela L.A., de Castro C.C., Giampietro V.P., Amaro E. Multisite fMRI reproducibility of a motor task using identical MR systems. J. Magn. Reson. Imaging 2007, 26(4):1122-1126.
12. Costafreda S.G., Khanna A., Mourao-Miranda J., Fu C.H. Neural correlates of sad faces predict clinical remission to cognitive behavioural therapy in depression. NeuroReport 2009, 20(7):637-641.
13. Cox R.W. AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 1996, 29:162-173.
14. Cronbach L.J. Essential of psychological testing 1970, Harper & Row, New York.
15. De Guio F., Benoit-Cattin H., Davenel A. Signal decay due to susceptibility-induced intravoxel dephasing on multiple air-filled cylinders: MRI simulations and experiments. Magma 2008, 21(4):261-271.
16. D'Esposito M. Functional neuroimaging of working memory. Handbook of functional neuroimaging of cognition 2001, The MIT Press, Cambridge, MA. R. Cabeza, A. Kingstone (Eds.).
17. Dixon W.J., Massey J., Frank J. Introduction to Statistical Analysis 1983, McGraw-Hill, New York.
18. Donaldson D.I., Buckner R.L. Effective paradigm design. Functional MRI: an introduction to methods Oxford 2001, 177-195. Oxford University Press. P.M.P. Jezzard, S.M. Smith (Eds.).
19. Dunn G. Statistical Evaluation of Measurement Errors: Design and Analysis of Reliability Studies 2004, Oxford University Press Inc., New York.
20. First M.B., Spitzer R.L., Gibbon M., Williams J.B. Structured Clinical Inteview for DSM-IV Axis I Disorders 1997, American Psychiatric Press, Inc., Washington, DC.
21. Friedman L., Glover G.H. Reducing interscanner variability of activation in a multicenter fMRI study: controlling for signal-to-fluctuation-noise-ratio (SFNR) differences. Neuroimage 2006, 33(2):471-481.
22. Friedman L., Glover G.H. Report on a multicenter fMRI quality assurance protocol. J. Magn. Reson. Imaging 2006, 23(6):827-839.
23. Friedman L., Stern H., Brown G.G., Mathalon D.H., Turner J., Glover G.H., Gollub R.L., Lauriello J., Lim K.O., Cannon T., et al. Test-retest and between-site reliability in a multicenter fMRI study. Hum. Brain Mapp. 2008, 29(8):958-972.
24. Gountouna V.E., Job D.E., McIntosh A.M., Moorhead T.W., Lymer G.K., Whalley H.C., Hall J., Waiter G.D., Brennan D., McGonigle D.J., et al. Functional magnetic resonance imaging (fMRI) reproducibility and variance components across visits and scanning sites with a finger tapping task. Neuroimage 2010, 49(1):552-560.
25. Greve, D., Mueller, B., Liu, T., Turner, J., Voyvodic, J.T., Yetter, E., Diaz, M., McCarthey, G., Wallace, S., Roach, B., et al., in press. A novel method for quantifying scanner instability in fMRI.
26. Haacke E.M., Xu Y., Cheng Y.C., Reichenbach J.R. Susceptibility weighted imaging (SWI). Magn. Reson. Med. 2004, 52(3):612-618.
27. Jack C.R., Bernstein M.A., Fox N.C., Thompson P., Alexander G., Harvey D., Borowski B., Britson P.J., LW J., Ward C., et al. The Alzheimer's Disease Neuroimaging Initiative (ADNI): MRI methods. J. Magn. Reson. Imaging 2008, 27(4):685-691.
28. Kawabori M., Kuroda S., Kudo K., Terae S., Kaneda M., Nakayama N., Iwasaki Y. Susceptibility-weighted magnetic resonance imaging detects impaired cerebral hemodynamics in the superior sagittal sinus thrombosis-case report. Neurol. Med. Chir. (Tokyo) 2009, 49(6):248-251.
29. Keator D.B., Gadde S., Grethe J.S., Taylor D.V., Potkin S.G. A general XML schema and SPM toolbox for storage of neuro-imaging results and anatomical labels. Neuroinformatics 2006, 4(2):199-212.
30. Keator D.B., Wei D., Gadde S., Bockholt J., Grethe J.S., Marcus D., Aucoin N., Ozyurt I.B. Derived data storage and exchange workflow for large-scale neuroimaging analyses on the BIRN grid. Front Neuroinformatics 2009, 3:30.
31. Lang P.J.B.M., Cuthbert B.N. International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual 2005, University of Florida, Gainesville, FL.
32. Magnusson D. Test Theory 1966, Addison-Wesley, Reading, MA.
33. Maldjian J.A., Laurienti P.J., Kraft R.A., Burdette J.H. An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. Neuroimage 2003, 19(3):1233-1239.
34. Maldjian J.A., Laurienti P.J., Burdette J.H. Precentral gyrus discrepancy in electronic versions of the Talairach atlas. Neuroimage 2004, 21(1):450-455.
35. Miller R.G. Beyond ANOVA: Basics of Applied Statistics 1986, John Wiley & Sons, New York.
36. Mulkern R.V., Forbes P., Dewey K., Osganian S., Clark M., Wong S., Ramamurthy U., Kun L., Poussaint T.Y. Establishment and results of a magnetic resonance quality assurance program for the pediatric brain tumor consortium. Acad. Radiol. 2008, 15(9):1099-1110.
37. Mumford J.A., Nichols T.E. Power calculation for group fMRI studies accounting for arbitrary design and temporal autocorrelation. Neuroimage 2008, 39(1):261-268.
38. Nevill A.M., Copas J.B. Using generalized linear models (GLMs) to model errors in motor performance. J. Mot Behav. 1991, 23(4):241-250.
39. Ogawa S., Menon R.S., Kim S.G., Ugurbil K. On the characteristics of functional magnetic resonance imaging of the brain. Annu. Rev. Biophys. Biomol. Struct. 1998, 27:447-474.
40. Ojemann J.G., Buckner R.L., Akbudak E., Snyder A.Z., Ollinger J.M., McKinstry R.C., Rosen B.R., Petersen S.E., Raichle M.E., Conturo T.E. Functional MRI studies of word-stem completion: reliability across laboratories and comparison to blood flow imaging with PET. Hum. Brain Mapp. 1998, 6(4):203-215.
41. Pearlson G. Multisite collaborations and large databases in psychiatric neuroimaging: advantages, problems, and challenges. Schizophr. Bull. 2009, 35(1):1-2.
42. Ritz C., Streibig J.C. Nonlinear regression with R 2008, Springer, New York.
43. Shavelson R.J., Webb N.M., Rowley G.L. Generalizability theory. Am. Psychol. 1989, 44:922-932.
44. Shoda Y., Mischel W., Wright J.C. The role of situational demands and cognitive competencies in behavior organization and personality coherence. J. Pers. Soc. Psychol. 1993, 65(5):1023-1035.
45. Shrout P.E., Fleiss J.L. Intraclass correlations: uses in assessing rater reliability. Psychol. Bull. 1979, 86(2):420-428.
46. Snodgrass J.G., Vanderwart M. A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. J. Exp. Psychol. Hum. Learn. 1980, 6(2):174-215.
47. Suckling J., Ohlssen D., Andrew C., Johnson G., Williams S.C., Graves M., Chen C.H., Spiegelhalter D., Bullmore E. Components of variance in a multicentre functional MRI study and implications for calculation of statistical power. Hum. Brain Mapp. 2008, 29(10):1111-1122.
48. Sutton B.P., Goh J., Hebrank A., Welsh R.C., Chee M.W., Park D.C. Investigation and validation of intersite fMRI studies using the same imaging hardware. J. Magn. Reson. Imaging 2008, 28(1):21-28.
49. Van Horn J.D., Toga A.W. Multisite neuroimaging trials. Curr. Opin. Neurol. 2009, 22(4):370-378.
50. Vlieger E.-J., Lavini C., Majoie C.B., den Heeten G.J. Reproducibility of functonal MR imaging results using two different MR systems. Am. J. Neuroradiol. 2003, 24:652-657. (April).
51. Voyvodic J.T. Activation mapping as a percentage of local excitation: fMRI stability within scans, between scans and across field strengths. Magn. Reson. Imaging 2006, 24(9):1249-1261.
52. Wainer H. Computerized Adpative Testing: A Primer 1990, Lawrence Erlbaum, Hillsdael, NJ.
53. Walter S.D.E.M.D.A. Sample size and optimal designs for reliability studies. Stat. Med. 1998, 17:101-110.
54. Zou K.H., Greve D.N., Wang M., Pieper S.D., Warfield S.K., White N.S., Manandhar S., Brown G.G., Vangel M.G., Kikinis R., et al. Reproducibility of functional MR imaging: preliminary results of prospective multi-institutional study performed by Biomedical Informatics Research Network. Radiology 2005, 237(3):781-789.