Thresholds in fMRI studies: Reliable for single subjects?

Journal of Neuroscience Methods

Volumn 219, Issue 2, 2013, Pages 312-323

  Stevens, M Tynan R ^a,b   D'Arcy, Ryan C N ^c,d   Stroink, Gerhard ^a   Clarke, David B ^a,e   Beyea, Steven D ^a,b  

^a DALHOUSIE UNIVERSITY   (Canada)

^b IWK HEALTH CENTRE   (Canada)

^c SIMON FRASER UNIVERSITY   (Canada)

^d SURREY MEMORIAL HOSPITAL   (Canada)

^e QUEEN ELIZABETH II HEALTH SCIENCES CENTRE   (Canada)

Author keywords

Analysis threshold; Automated pipeline; Clinical fMRI; Individual subject; ROC; Test retest reliability

Indexed keywords

ARTICLE; CLASSIFICATION; CORPUS STRIATUM; ELECTROENCEPHALOGRAM; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; MOTION; POSTCENTRAL GYRUS; POSTERIOR CINGULATE; PRIMARY MOTOR CORTEX; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; RELIABILITY; REPRODUCIBILITY; SPIKE; SUPPLEMENTARY MOTOR AREA; TEST RETEST RELIABILITY; THALAMUS; VISUAL CORTEX;

ANALYSIS THRESHOLD; AUTOMATED PIPELINE; CLINICAL FMRI; INDIVIDUAL SUBJECT; ROC; TEST-RETEST RELIABILITY;

AREA UNDER CURVE; BRAIN; BRAIN MAPPING; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; REPRODUCIBILITY OF RESULTS; ROC CURVE;

EID: 84883748240     PISSN: 01650270     EISSN: 1872678X     Source Type: Journal    
DOI: 10.1016/j.jneumeth.2013.08.005     Document Type: Article

References (58)

1. Abbott D.F., Waites A.B., Lillywhite L.M., Jackson G.D. fMRI assessment of language lateralization: an objective approach. Neuroimage 2010, 50:1446-1455.
2. Afshin-Pour B., Hossein-Zadeh G-A., Strother S.C., Soltanian-Zadeh H. Enhancing reproducibility of fMRI statistical maps using generalized canonical correlation analysis in NPAIRS framework. Neuroimage 2012, 60:1970-1981.
3. Anand S.S., Zagorodnov V. Retrospective cluster size thresholding for MRF-based detection of activated regions in fMRI. Intl Conf On Biomedical and Pharmaceutical Engineering 2006, 44-47.
4. Beisteiner R., Lanzenberger R., Novak K., Edward V., Windischberger C., Erdler M., et al. Improvement of presurgical patient evaluation by generation of functional magnetic resonance risk maps. Neurosci Lett 2000, 290:13-16.
5. Bennett C.M., Miller M.B. How reliable are the results from functional magnetic resonance imaging?. Ann NY Acad Sci 2010, 1191:133-155.
6. Bosnell R., Wegner C., Kincses Z.T., Korteweg T., Agosta F., Ciccarelli O., et al. Reproducibility of fMRI in the clinical setting: implications for trial designs. Neuroimage 2008, 42:603-610.
7. Brannen J.H., Badie B., Moritz C.H., Quigley M., Meyerand M.E., Haughton V.M. Reliability of functional MR imaging with word-generation tasks for mapping Broca's area. Am J Neuroradiol 2001, 22:1711-1718.
8. Caceres A., Hall D.L., Zeleya F.O., Williams S.C.R., Mehta M.A.M. Measuring fMRI reliability with the intra-class correlation coefficient. Neuroimage 2009, 45:758-768.
9. Chen E.E., Small S.L. Test-retest reliability in fMRI of language: group and task effects. Brain Lang 2007, 102:176-185.
10. Cox R.W. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 1996, 29(3):162-173.
11. D'Arcy R.C.N., Bardouille T., Newman A.J., McWhinney S.R., DeBay D., Sadler R.M., et al. Spatial MEG laterality maps for language: clinical applications in epilepsy. Hum Brain Mapp 2012, [ePub].
12. Dice L.R. Measures of the amount of ecologic association between species. Ecology 1945, 26:297-302.
13. Duncan K.J., Pattamadilok C., Knierim I., Devlin J.T. Consistency and variability in functional localisers. Neuroimage 2009, 46:1018-1026.
14. Fernandez G., Specht K., Weis S., Tendolkar I., Reuber M., Fell J., et al. Intrasubject reproducibility of presurgical language lateralization and mapping using fMRI. Neurology 2003, 60:969-975.
15. Fesl G., Bruhns P., Rau S., Wiesmann M., Ilmberger J., Kegel G., et al. Sensitivity and reliability of language laterality assessment with a free reversed association task-a fMRI study. Eur Radiol 2010, 20:683-695.
16. Friston K.J., Holmes A., Poline J.B., Price C.J., Frith C.D. Detecting activations in PET and fMRI: levels of inference and power. Neuroimage 1996, 40:223-235.
17. Friston K.J., Holmes A.P., Worsley K.J., Poline J.B., Frith C.D., Frackowiak R.S.J. Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp 1995, 2:189-210.
18. Genovese C.R., Lazar N.A., Nichols T. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 2002, 15:870-878.
19. Genovese C.R., Noll D.C., Eddy W.F. Estimating test-retest reliability in functional MR imaging. I. Statistical methodology. Magn Reson Med 1997, 38:497-507.
20. Gonzalez-Castillo J., Talavage T.M. Reproducibility of fMRI activations associated with auditory sentence comprehension. Neuroimage 2011, 54:2138-2155.
21. Gorgolewski K.J., Storkey A.J., Bastin M.E., Pernet C.R. Adaptive thresholding for reliable topological inference in single subject fMRI analysis. Front Hum Neurosci 2012, 6(1):1-14.
22. Gountouna V-E., Job D.E., McIntosh A.M., Moorhead T.W.J., Lymer G.K.L., Whalley H.C., et al. Functional magnetic resonance imaging (fMRI) reproducibility and variance components across visits and scanning sites with a finger tapping task. Neuroimage 2010, 49:552-560.
23. Gullapalli R.P., Maitra R., Roys S.R., Smith G., Alon G., Greenspan J. Reliability estimation of grouped functional imaging data using penalized maximum likelihood. Magn Reson Med 2005, 53:1126-1134.
24. Harrington G.S., Farias S.T., Buonocore M., Yonelinas A.P. The intersubject and intrasubject reproducibility of fMRI activation during three encoding tasks: implications for clinical applications. Neuroradiology 2006, 48:495-505.
25. Jaccard P. Ètude comparative de la distribution florale dans une portion des alpes et des jura. Bull Soc Vaud Sci Nat 1901, 37:547579.
26. Kimberley T.J., Birkholz D.D., Hancock R.A., VonBank S.M., Werth T.N. Reliability of fMRI during a continuous motor task: assessment of analysis techniques. J Neuroimaging 2007, 18:18-27.
27. Kimberley T.J., Khandekar G., Borich M. fMRI reliability in subjects with stroke. Exp Brain Res 2007, 186:183-190.
28. Le T.H., Hu X. Methods for assessing accuracy and reliability in functional MRI. NMR Biomed 1997, 10:160-164.
29. Liou M., Su H.-R., Savostyanov A.N., Lee J.D., Aston J.A.D., Chuang C.-H., et al. Beyond p-values: averaged and reproducible evidence in fMRI experiments. Psychophysiology 2009, 46:367-378.
30. Liou M., Su H.R., Lee J.D., Aston J.A.D., Tsai A.C., Cheng P.E. A method for generating reproducible evidence in fMRI studies. Neuroimage 2006, 29:383-395.
31. Liou M., Su H.R., Lee J.D., Cheng P., Huang C.C., Tsai C.H. Bridging functional MR images and scientific inference: reproducibility maps. J Cogn Neurosci 2003, 15(7):935-945.
32. Logan B.R., Rowe D.B. An evaluation of thresholding techniques in fMRI analysis. Neuroimage 2004, 22:95-108.
33. Lohmann H., Deppe M., Jansen A., Schwindt W., Knecht S. Task repetition can affect functional magnetic resonance imaging-based measures of language lateralization and lead to pseudoincreases in bilaterality. J Cereb Blood Flow Metab 2004, 24:179-187.
34. Loubinoux I., Carel C., Alary F., Boulanouar K., Viallard G., Manelfe C., et al. Within-session and between-session reproducibility of cerebral sensorimotor activation: a test-retest effect evidenced with functional magnetic resonance imaging. J Cereb Blood Flow Metab 2001, 592-607.
35. Maitra R. Assessing certainty of activation or inactivation in test-retest fMRI studies. Neuroimage 2009, 47:88-97.
36. Maitra R. A re-defined and generalized percent-overlap-of-activation measure for studies of fMRI reproducibility and its use in identifying outlier activation maps. Neuroimage 2010, 50:124-135.
37. Maitra R., Roys S.R., Gullapalli R.P. Test-retest reliability estimation of functional MRI Data. Magn Reson Med 2002, 48:62-70.
38. Maldjian J.A., Laurienti P.J., Driskill L., Burdette J.H. Multiple reproducibility indices for evaluation of cognitive functional MR imaging paradigms. Am J Neuroradiol 2002, 23:1030-1037.
39. Mannfolk P., Nilsson M., Hansson H., Stahlberg F., Fransson P., Weibull A., et al. Can resting-state functional MRI serve as a complement to task-based mapping of sensorimotor function? A test-retest reliability study in healthy volunteers. J Magn Reson Imaging 2011, 34:511-517.
40. Matsuo K., Chen S.H.A., Tseng W.Y.I. AveLI: a robust lateralization index in functional magnetic resonance imaging using unbiased threshold-free computation. J Neurosci Methods 2012, 205:119-129.
41. Nichols T., Hayasaka S. Controlling the familywise error rate in functional neuroimaging: a comparative review. Stat Methods Med Res 2003, 12:419-446.
42. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 1971, 9(1):97-113.
43. Petersen S.E., Van Mier H., Fiez J.A., Raichle M.E. The effects of practice on the functional anatomy of task performance. PNAS USA 1998, 95:853-860.
44. Plichta M.M., Schwarz A.J., Grimm O., Morgen K., Mier D., Haddad L., et al. Test-retest reliability of evoked BOLD signals from a cognitive/emotive fMRI test battery. Neuroimage 2012, 60:1746-1758.
45. Raemaekers M., Vink M., Zandbelt B., Van Wezel R.J.A., Kahn R.S., Ramsey N.F. Test-retest reliability of fMRI activation during prosaccades and antisaccades. Neuroimage 2007, 36:532-542.
46. Rombouts S.A.R.B., Barkhof F., Hoogenraad F.G.C., Sprenger M., Scheltens P. Within-subject reproducibility of visual activation patterns with functional magnetic resonance imaging using multislice echo planar imaging. Magn Reson Imaging 1998, 16(2):105-113.
47. Rombouts S.A.R.B., Barkhof F., Hoogenraad F.G.C., Sprenger M., Valk J., Scheltens P. Test-retest analysis with functional MR of the activated area in the human visual cortex. Am J Neuroradiol 1997, 18:1317-1322.
48. Van Rossum G., Drake F.L. Python reference manual [Internet] 2001, PythonLabs, Virginia, USA, Available from: http://www.python.org/.
49. Ruff I.M., Brennan N.M.P., Peck K.K., Hou B.L., Tabar V., Brennan C.W., et al. Assessment of the language laterality index in patients with brain tumor using functional MR imaging: effects of thresholding, task selection, and prior surgery. Am J Neuroradiol 2008, 528-535. [ePub].
50. Sarty G.E., Borowsky R. Functional MRI activation maps from empirically defined curve fitting. Concept Magn Res 2005, 24B(1):46-55.
51. Seghier M.L. Laterality index in functional MRI: methodological issues. Magn Reson Imaging 2008, 26:594-601.
52. Seghier M.L., Lazeyras F., Pegna A.J., Annoni J.M., Zimine I., Mayer E., et al. Variability of fMRI activation during a phonological and semantic language task in healthy subjects. Hum Brain Mapp 2004, 23:140-155.
53. Skudlarski P., Constable R.T., Gore J.C. ROC Analysis of statistical methods used in functional MRI: individual subjects. Neuroimage 1999, 9:311-329.
54. Specht K., Willmes K., Shah N.J., Jäncke L. Assessment of reliability in functional imaging studies. J Magn Reson Imaging 2003, 17:463-471.
55. Strandberg M., Elfgreen C., Mannfolk P., Olsrud J., Stenberg L., Van Westen D., et al. fMRI memory assessment in healthy subjects: a new approach to view lateralization data at an individual level. Brain Imaging Behav 2011, 5:1-11.
56. Strother S.C., Lange N., Anderson J.R., Schaper K.A., Rehm K., Hansen L.K., et al. Activation pattern reproducibility: measuring the effects of group size and data analysis models. Hum Brain Mapp 1997, 5:312-316.
57. Tegeler C., Strother S.C., Anderson J.R., Kim S.G. Reproducibility of BOLD-based functional MRI obtained at 4T. Hum Brain Mapp 1999, 7:267-283.
58. Thirion B., Pinel P., Meriaux S., Roche A., Dehaene S., Poline J.B. Analysis of a large fMRI cohort: statistical and methodological issues for group analyses. NeuroImage 2007, 35:105-120.