The neuro/PsyGRID calibration experiment: Identifying sources of variance and bias in multicenter MRI studies

Human Brain Mapping

Volumn 33, Issue 2, 2012, Pages 373-386

  Suckling, John ^a   Barnes, Anna ^a   Job, Dominic ^b   Brennan, David ^c   Lymer, Katherine ^d   Dazzan, Paola ^e   Marques, Tiago Reis ^e   Mackay, Clare ^f   McKie, Shane ^g   Williams, Steve R ^g   Williams, Steven C R ^e   Deakin, Bill ^g   Lawrie, Stephen ^b  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

^c SOUTHERN GENERAL HOSPITAL   (United Kingdom)

^d UNIVERSITY OF EDINBURGH   (United Kingdom)

^e KING'S COLLEGE LONDON   (United Kingdom)

^f UNIVERSITY OF OXFORD   (United Kingdom)

^g UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Magnetic resonance imaging; Multicentre; Rank test; Variance components

Indexed keywords

ADULT; ARTICLE; CALIBRATION; CONTROLLED STUDY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; GRAY MATTER; HUMAN; HUMAN EXPERIMENT; MALE; MEASUREMENT ERROR; MENTAL PERFORMANCE; NEUROIMAGING; NORMAL HUMAN; PRIORITY JOURNAL; VARIANCE; WORKING MEMORY;

ADULT; ANALYSIS OF VARIANCE; BIAS (EPIDEMIOLOGY); BRAIN MAPPING; CALIBRATION; HUMANS; LINEAR MODELS; MAGNETIC RESONANCE IMAGING; MALE; MULTICENTER STUDIES AS TOPIC;

EID: 84855958765     PISSN: 10659471     EISSN: 10970193     Source Type: Journal    
DOI: 10.1002/hbm.21210     Document Type: Article

References (52)

1. Bermel RA, Fisher E, Cohen JA (2008): The use of MR imaging as an outcome measure in multiple sclerosis clinical trials. Neuroimaging Clin N Am 18: 687-701, xi.
2. Biswal BB, Mennes M, Zuo XN, Gohel S, Kelly C, Smith SM, Beckmann CF, Adelstein JS, Buckner RL, Colcombe S, Dogonowski AM, Ernst M, Fair D, Hampson M, Hoptman MJ, Hyde JS, Kiviniemi VJ, Kötter R, Li SJ, Lin CP, Lowe MJ, Mackay C, Madden DJ, Madsen KH, Margulies DS, Mayberg HS, McMahon K, Monk CS, Mostofsky SH, Nagel BJ, Pekar JJ, Peltier SJ, Petersen SE, Riedl V, Rombouts SA, Rypma B, Schlaggar BL, Schmidt S, Seidler RD, Siegle GJ, Sorg C, Teng GJ, Veijola J, Villringer A, Walter M, Wang L, Weng XC, Whitfield-Gabrieli S, Williamson P, Windischberger C, Zang YF, Zhang HY, Castellanos FX, Milham MP. (2010): Toward discovery science of human brain function. Proc Natl Acad Sci USA 107: 4734-4739.
3. Brammer MJ, Bullmore ET, Simmons A, Williams SC, Grasby PM, Howard RJ, Woodruff PW, Rabe-Hesketh S (1997): Generic brain activation mapping in functional magnetic resonance imaging: A nonparametric approach. Magn Reson Imaging 15: 763-770.
4. Bullmore E, Fadili J, Maxim V, Sendur L, Whitcher B, Suckling J, Brammer M, Breakspear M (2004): Wavelets and functional magnetic resonance imaging of the human brain. Neuroimage 23(Suppl 1): S234-S249.
5. Bullmore E, Long C, Suckling J, Fadili J, Calvert G, Zelaya F, Carpenter TA, Brammer M (2001): Colored noise and computational inference in neurophysiological (fMRI) time series analysis: Resampling methods in time and wavelet domains. Hum Brain Mapp 12: 61-78.
6. Bullmore ET, Suckling J, Overmeyer S, Rabe-Hesketh S, Taylor E, Brammer MJ (1999): Global, voxel, and cluster tests, by theory and permutation, for a difference between two groups of structural MR images of the brain. IEEE Trans Med Imaging 18: 32-42.
7. Callicott JH, Egan MF, Mattay VS, Bertolino A, Bone AD, Verchinksi B, Weinberger DR (2003): Abnormal fMRI response of the dorsolateral prefrontal cortex in cognitively intact siblings of patients with schizophrenia. Am J Psychiatry 160: 709-719.
8. Ciumas C, Montavont A, Ryvlin P (2008): Magnetic resonance imaging in clinical trials. Curr Opin Neurol 21: 431-436.
9. Corder GW, Foreman DI (2009): Nonparametric statistics for non-statisticians: A step-by-step approach. Oxford: Wiley-Blackwell. Chapter xiii, pp 247.
10. Costafreda SG, Brammer MJ, Vencio RZ, Mourao ML, Portela LA, de Castro CC, Giampietro VP, Amaro EJr (2007): Multisite fMRI reproducibility of a motor task using identical MR systems. J Magn Reson Imaging 26: 1122-1126.
11. Deoni SC, Williams SC, Jezzard P, Suckling J, Murphy DG, Jones DK (2008): Standardized structural magnetic resonance imaging in multicentre studies using quantitative T1 and T2 imaging at 1.5 T. Neuroimage 40: 662-671.
12. Ernst RR, Anderson WA (1966): Application of Fourier transform spectroscopy to magnetic resonance. Rev Scientific Instruments 37: 93-102.
13. Fedorov V, Jones B (2005): The design of multicentre trials. Stat Methods Med Res 14: 205-248.
14. Friedman L, Glover GH (2006a) Reducing interscanner variability of activation in a multicenter fMRI study: Controlling for signal-to-fluctuation-noise-ratio (SFNR) differences. Neuroimage 33: 471-481.
15. Friedman L, Glover GH (2006b) Report on a multicenter fMRI quality assurance protocol. J Magn Reson Imaging 23: 827-839.
16. Friedman L, Glover GH, Krenz D, Magnotta V (2006): Reducing inter-scanner variability of activation in a multicenter fMRI study: Role of smoothness equalization. Neuroimage 32: 1656-1668.
17. Friedman L, Stern H, Brown GG, Mathalon DH, Turner J, Glover GH, Gollub RL, Lauriello J, Lim KO, Cannon T, Greve DN, Bockholt HJ, Belger A, Mueller B, Doty MJ, He J, Wells W, Smyth P, Pieper S, Kim S, Kubicki M, Vangel M, Potkin SG (2008): Test-retest and between-site reliability in a multicenter fMRI study. Hum Brain Mapp 29: 958-972.
18. Gao JH, Miller I, Lai S, Xiong J, Fox PT (1996): Quantitative assessment of blood inflow effects in functional MRI signals. Magn Reson Med 36: 314-319.
19. Gountouna VE, Job DE, McIntosh AM, Moorhead TW, Lymer GK, Whalley HC, Hall J, Waiter GD, Brennan D, McGonigle DJ, Ahearn TS, Cavanagh J, Condon B, Hadley DM, Marshall IDJ, Murray AD, Steele JD, Wardlaw JM, Lawrie SM (2009): Functional magnetic resonance imaging (fMRI) reproducibility and variance components across visits and scanning sites with a finger tapping task. Neuroimage 49: 552-560.
20. Greenwood JP, Maredia N, Radjenovic A, Brown JM, Nixon J, Farrin AJ, Dickinson C, Younger JF, Ridgway JP, Sculpher M, Ball SG, Plein S (2009): Clinical evaluation of magnetic resonance imaging in coronary heart disease: The CE-MARC study. Trials 10: 62.
21. Han X, Jovicich J, Salat D, van der Kouwe A, Quinn B, Czanner S, Busa E, Pacheco J, Albert M, Killiany R, Maguire P, Rosas D, Makris N, Dale A, Dickerson B, Fischl B (2006): Reliability of MRI-derived measurements of human cerebral cortical thickness: The effects of field strength, scanner upgrade and manufacturer. Neuroimage 32: 180-194.
22. Hillman BJ, Gatsonis C (2008): The American College of Radiology Imaging Network--Clinical trials of diagnostic imaging and image-guided treatment. Semin Oncol 35: 460-469.
23. ICH EG (1999): ICH Harmonised Tripartite Guideline. Statistical principles for clinical trials. International Conference on Harmonisation E9 Expert Working Group. Stat Med 18: 1905-1942.
24. Jenkinson M, Bannister P, Brady M, Smith S (2002): Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17: 825-841.
25. Leach MO, Brindle KM, Evelhoch JL, Griffiths JR, Horsman MR, Jackson A, Jayson GC, Judson IR, Knopp MV, Maxwell RJ, McIntyre D, Padhani AR, Price P, Rathbone R, Rustin GJ, Tofts PS, Tozer GM, Vennart W, Waterton JC, Williams SR, Workman P (2005): The assessment of antiangiogenic and antivascular therapies in early-stage clinical trials using magnetic resonance imaging: Issues and recommendations. Br J Cancer 92: 1599-1610.
26. Lennox BR (2009): The clinical experience and potential of brain imaging in patients with mental illness. Front Hum Neurosci 3: 46.
27. Lewis JA (1999): Statistical principles for clinical trials (ICH E9): An introductory note on an international guideline. Stat Med 18: 1903-1942.
28. Localio AR, Berlin JA, Ten Have TR, Kimmel SE (2001): Adjustments for center in multicenter studies: An overview. Ann Intern Med 135: 112-123.
29. Lund TE, Madsen KH, Sidaros K, Luo WL, Nichols TE (2006): Non-white noise in fMRI: does modelling have an impact? Neuroimage 29: 54-66.
30. Matthews PM, Honey GD, Bullmore ET (2006): Applications of fMRI in translational medicine and clinical practice. Nat Rev Neurosci 7: 732-744.
31. Maxim V, Sendur L, Fadili J, Suckling J, Gould R, Howard R, Bullmore E (2005): Fractional Gaussian noise, functional MRI and Alzheimer's disease. Neuroimage 25: 141-158.
32. Moorhead TW, Gountouna VE, Job DE, McIntosh AM, Romaniuk L, Lymer GK, Whalley HC, Waiter GD, Brennan D, Ahearn TS, Cavanagh J, Condon B, Steele JD, Wardlaw JM, Lawrie SM (2009): Prospective multi-centre voxel based morphometry study employing scanner specific segmentations: Procedure development using CaliBrain structural MRI data. BMC Med Imaging 9: 8.
33. Nichols TE, Holmes AP (2002): Nonparametric permutation tests for functional neuroimaging: A primer with examples. Hum Brain Mapp 15: 1-25.
34. Owen AM, McMillan KM, Laird AR, Bullmore E (2005): N-back working memory paradigm: A meta-analysis of normative functional neuroimaging studies. Hum Brain Mapp 25: 46-59.
35. Pell GS, Briellmann RS, Chan CH, Pardoe H, Abbott DF, Jackson GD (2008): Selection of the control group for VBM analysis: Influence of covariates, matching and sample size. Neuroimage 41: 1324-1335.
36. Peto R (1982): Statistical aspects of cancer trials. London, UK: Chapman and Hall.
37. Pinheiro JB, Bates DM (2000): Mixed-effects models in S and S-plus. Berlin: Springer-Verlag.
38. Rueckert D, Sonoda LI, Hayes C, Hill DL, Leach MO, Hawkes DJ (1999): Nonrigid registration using free-form deformations: Application to breast MR images. IEEE Trans Med Imaging 18: 712-721.
39. Senn S (1998): Some controversies in planning and analysing multi-centre trials. Stat Med 17: 1753-1765; discussion 1799-1800.
40. Sled JG, Zijdenbos AP, Evans AC (1998): A nonparametric method for automatic correction of intensity nonuniformity in MRI data. IEEE Trans Med Imaging 17: 87-97.
41. Smith SM (2002): Fast robust automated brain extraction. Hum Brain Mapp 17: 143-155.
42. Suckling J, Barnes A, Job D, Brenan D, Lymer K, Dazzan P, Marques TR, Mackay C, McKie S, Williams SR, Williams SC, Lawrie S, Deakin B (2010): Power calculations for multicenter imaging studies controlled by the false discovery rate. Hum Brain Mapp 31: 1183-1195.
43. Suckling J, Davis MH, Ooi C, Wink AM, Fadili J, Salvador R, Welchew D, Sendur L, Maxim V, Bullmore ET (2006): Permutation testing of orthogonal factorial effects in a language-processing experiment using fMRI. Hum Brain Mapp 27: 425-433.
44. Suckling J, Ohlssen D, Andrew C, Johnson G, Williams SC, Graves M, Chen CH, Spiegelhalter D, Bullmore E (2008): Components of variance in a multicentre functional MRI study and implications for calculation of statistical power. Hum Brain Mapp 29: 1111-1122.
45. Triantafyllou C, Hoge RD, Krueger G, Wiggins CJ, Potthast A, Wiggins GC, Wald LL (2005): Comparison of physiological noise at 1.5 T, 3 T and 7 T and optimization of fMRI acquisition parameters. Neuroimage 26: 243-250.
46. van Haren NE, Cahn W, Hulshoff Pol HE, Schnack HG, Caspers E, Lemstra A, Sitskoorn MM, Wiersma D, van den Bosch RJ, Dingemans PM, Schene AH, Kahn RS (2003): Brain volumes as predictor of outcome in recent-onset schizophrenia: A multi-center MRI study. Schizophr Res 64: 41-52.
47. Vierron E, Giraudeau B (2007): Sample size calculation for multicenter randomized trial: Taking the center effect into account. Contemp Clin Trials 28: 451-458.
48. Vlieger EJ, Lavini C, Majoie CB, den Heeten GJ (2003): Reproducibility of functional MR imaging results using two different MR systems. AJNR Am J Neuroradiol 24: 652-657.
49. Wilson C (1948): Streptomycin in non-tuberculous infections; summary of a report to the Medical Research Council. Lancet 2: 445.
50. Wink AM, Bullmore E, Barnes A, Bernard F, Suckling J (2008): Monofractal and multifractal dynamics of low frequency endogenous brain oscillations in functional MRI. Hum Brain Mapp 29: 791-801.
51. Worthington H (2004): Methods for pooling results from multi-center studies. J Dent Res 83 Spec No C: C119-C121.
52. Zhang YY, Brady M, Smith S (2001): Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans Med Imaging 20: 45-57.