Test-retest reliability of graph metrics of resting state MRI functional brain networks: A review

Journal of Neuroscience Methods

Volumn 253, Issue , 2015, Pages 183-192

  Andellini, Martina ^a   Cannatà, Vittorio ^a   Gazzellini, Simone ^a   Bernardi, Bruno ^a   Napolitano, Antonio ^a  

^a BAMBINO GESÙ CHILDREN S HOSPITAL   (Italy)

Author keywords

Connectivity; Functional brain networks; Graph theory; Meta summary reliability analysis; Resting state fMRI; Review; Test retest reliability

Indexed keywords

BOLD SIGNAL; CORRELATION COEFFICIENT; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; PRIORITY JOURNAL; REPRODUCIBILITY; RESTING STATE NETWORK; REVIEW; STATISTICAL ANALYSIS; TEST RETEST RELIABILITY; ALGORITHM; ANATOMY AND HISTOLOGY; BLOOD; BRAIN; BRAIN MAPPING; COMPUTER GRAPHICS; INFORMATION PROCESSING; META ANALYSIS; NUCLEAR MAGNETIC RESONANCE IMAGING; VASCULARIZATION;

OXYGEN;

ALGORITHMS; BRAIN; BRAIN MAPPING; COMPUTER GRAPHICS; DATASETS AS TOPIC; HUMANS; MAGNETIC RESONANCE IMAGING; OXYGEN; REPRODUCIBILITY OF RESULTS;

EID: 84937129714     PISSN: 01650270     EISSN: 1872678X     Source Type: Journal    
DOI: 10.1016/j.jneumeth.2015.05.020     Document Type: Review

References (67)

1. Baxter Assessing functional connectivity in the human brain by fMRI. Magn Reson Imaging 2007, 25:1347-1357.
2. Behrens T.E., Sporns O. Human connectomics. Curr Opin Neurobiol 2012, 22:144-153.
3. Birn R.M., Cornejo M.D., Molloy E.K., Patriat R., Meier T.B., Kirk G.R., et al. The influence of physiological noise correction on test-retest reliability of resting-state functional connectivity. Brain Connect 2014, 4:511-522.
4. Birn R.M., Diamond J.B., Smith M.A., Bandettini P.A. Separating respiratory-variation-related fluctuations from neuronal-activity-related fluctuations in fMRI. Neuroimage 2006, 31:1536-1548.
5. Birn R.M., Molloy E.K., Patriat R., Parker T., Meier T.B., Kirk G.R., et al. The effect of scan length on the reliability of resting-state fMRI connectivity estimates. Neuroimage 2013, 83:550-558.
6. Biswal B., Yetkin F.Z., Haughton V.M., Hyde J.S. Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magn Reson Med 1995, 34:537-541.
7. Biswal B.B., Mennes M., Zuo X.N., Gohel S., Kelly C., Smith S.M., et al. Toward discovery science of human brain function. Proc Natl Acad Sci USA 2010, 107:4734-4739.
8. Brandt D.J., Sommer J., Krach S., Bedenbender J., Kircher T., Paulus F.M., et al. Test-retest reliability of fMRI brain activity during memory encoding. Front Psychiatry 2013, 4:163.
9. Braun U., Plichta M.M., Esslinger C., Sauer C., Haddad L., Grimm O., et al. Test-retest reliability of resting-state connectivity network characteristics using fMRI and graph theoretical measures. Neuroimage 2012, 59:1404-1412.
10. Bullmore E., Sporns O. Complex brain networks: graph theoretical analysis of structural and functional systems. Nat Rev Neurosci 2009, 10:186-198.
11. Buzsaki G., Draguhn A. Neuronal oscillations in cortical networks. Science 2004, 304:1926-1929.
12. Cao H., Plichta M.M., Schafer A., Haddad L., Grimm O., Schneider M., et al. Test-retest reliability of fMRI-based graph theoretical properties during working memory, emotion processing, and resting state. Neuroimage 2014, 84:888-900.
13. Chang C., Cunningham J.P., Glover G.H. Influence of heart rate on the BOLD signal: the cardiac response function. Neuroimage 2009, 44:857-869.
14. Chou Y.H., Panych L.P., Dickey C.C., Petrella J.R., Chen N.K. Investigation of long-term reproducibility of intrinsic connectivity network mapping: a resting-state fMRI study. AJNR Am J Neuroradiol 2012, 33:833-838.
15. Fiecas M., Ombao H., van Lunen D., Baumgartner R., Coimbra A., Feng D. Quantifying temporal correlations: a test-retest evaluation of functional connectivity in resting-state fMRI. Neuroimage 2013, 65:231-241.
16. Fox M.D., Raichle M.E. Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging. Nat Rev Neurosci 2007, 8:700-711.
17. Fox M.D., Zhang D., Snyder A.Z., Raichle M.E. The global signal and observed anticorrelated resting state brain networks. J Neurophysiol 2009, 101:3270-3283.
18. Franco A.R., Mannell M.V., Calhoun V.D., Mayer A.R. Impact of analysis methods on the reproducibility and reliability of resting-state networks. Brain Connect 2013, 3:363-374.
19. Glover G.H., Li T.Q., Ress D. Image-based method for retrospective correction of physiological motion effects in fMRI: RETROICOR. Magn Reson Med 2000, 44:162-167.
20. Gong G., He Y., Evans A.C. Brain connectivity: gender makes a difference. Neuroscientist 2011, 17:575-591.
21. Gong G., Rosa-Neto P., Carbonell F., Chen Z.J., He Y., Evans A.C. Age- and gender-related differences in the cortical anatomical network. J Neurosci 2009, 29:15684-15693.
22. Guo C.C., Kurth F., Zhou J., Mayer E.A., Eickhoff S.B., Kramer J.H., et al. One-year test-retest reliability of intrinsic connectivity network fMRI in older adults. Neuroimage 2012, 61:1471-1483.
23. Hallquist M.N. The nuisance of nuisance regression: spectral misspecification in a common approach to resting-state fMRI preprocessing reintroduces noise and obscures functional connectivity. Neuroimage 2013, 82:208-225.
24. Kong J., Gollub R.L., Webb J.M., Kong J.T., Vangel M.G., Kwong K. Test-retest study of fMRI signal change evoked by electroacupuncture stimulation. Neuroimage 2007, 34:1171-1181.
25. Landis J.R., Koch G.G. The measurement of observer agreement for categorical data. Biometrics 1997, 33:159-174.
26. Liang X., Wang J., Yan C., Shu N., Xu K., Gong G., et al. Effects of different correlation metrics and preprocessing factors on small-world brain functional networks: a resting-state functional MRI study. PLoS ONE 2012, 7:e32766.
27. Liao X.H., Xia M.R., Xu T., Dai Z.J., Cao X.Y., Niu H.J., et al. Functional brain hubs and their test-retest reliability: a multiband resting-state functional MRI study. Neuroimage 2013, 83:969-982.
28. Lilliefors H.W. On the Kolmogorov-Smirnov test for normality with mean and variance unknown. J Am Stat Assoc 1967, 62:399-402.
29. Lilliefors H.W. On the Kolmogorov-Smirnov test for the exponential distribution with mean unknown. J Am Stat Assoc 1969, 64:387-389.
30. Lowe M.J., Dzemidzic M., Lurito J.T., Mathews V.P., Phillips M.D. Correlations in low-frequency BOLD fluctuations reflect cortico-cortical connections. Neuroimage 2000, 12:582-587.
31. Lowe M.J., Mock B.J., Sorenson J.A. Functional connectivity in single and multislice echoplanar imaging using resting-state fluctuations. Neuroimage 1998, 7:119-132.
32. Manoach D.S., Halpern E.F., Kramer T.S., Chang Y., Goff D.C., Rauch S.L., et al. Test-retest reliability of a functional MRI working memory paradigm in normal and schizophrenic subjects. Am J Psychiatry 2001, 158:955-958.
33. McGraw K.O., Wong S.P. Forming inferences about some intraclass correlation coefficients. Psychol Methods 1996, 1:30-46.
34. Muller R., Buttner P. A critical discussion of intraclass correlation coefficients. Stat Med 1994, 13:2465-2476.
35. Murphy K., Birn R.M., Bandettini P.A. Resting-state fMRI confounds and cleanup. Neuroimage 2013, 80:349-359.
36. Murphy K., Birn R.M., Handwerker D.A., Jones T.B., Bandettini P.A. The impact of global signal regression on resting state correlations: are anti-correlated networks introduced?. Neuroimage 2009, 44:893-905.
37. Nakagawa S., Schielzeth H. Repeatability for Gaussian and non-Gaussian data: a practical guide for biologists. Biol Rev Camb Philos Soc 2010, 85:935-956.
38. Patriat R., Molloy E.K., Meier T.B., Kirk G.R., Nair V.A., Meyerand M.E., et al. The effect of resting condition on resting-state fMRI reliability and consistency: a comparison between resting with eyes open, closed, and fixated. Neuroimage 2013, 78:463-473.
39. Petrella J.R. Use of graph theory to evaluate brain networks: a clinical tool for a small world?. Radiology 2011, 259:317-320.
40. Power J.D., Cohen A.L., Nelson S.M., Wig G.S., Barnes K.A., Church J.A., et al. Functional network organization of the human brain. Neuron 2011, 72:665-678.
41. Reijneveld J.C., Ponten S.C., Berendse H.W., Stam C.J. The application of graph theoretical analysis to complex networks in the brain. Clin Neurophysiol 2007, 118:2317-2331.
42. Rousson V., Gasser T., Seifert B. Assessing intrarater, interrater and test-retest reliability of continuous measurements. Stat Med 2002, 21:3431-3446.
43. Schroeder C.E. Low-frequency neuronal oscillations as instruments of sensory selection. Trends Neurosci 2009, 32:9-18.
44. Schwarz A.J., McGonigle J. Negative edges and soft thresholding in complex network analysis of resting state functional connectivity data. Neuroimage 2011, 55:1132-1146.
45. Shrout P.E., Fleiss J.L. Intraclass correlations: uses in assessing rater reliability. Psychol Bull 1979, 86:420-428.
46. Song J., Desphande A.S., Meier T.B., Tudorascu D.L., Vergun S., Nair V.A., et al. Age-related differences in test-retest reliability in resting-state brain functional connectivity. PLoS ONE 2012, 7:e49847.
47. Stam C.J., Reijneveld J.C. Graph theoretical analysis of complex networks in the brain. Nonlinear Biomed Phys 2007, 1:3.
48. Stevens M.T., D'Arcy R.C., Stroink G., Clarke D.B., Beyea S.D. Thresholds in fMRI studies: reliable for single subjects?. J Neurosci Methods 2013, 219:312-323.
49. Telesford Q.K., Burdette J.H., Laurienti P.J. An exploration of graph metric reproducibility in complex brain networks. Front Neurosci 2013, 7:67.
50. Telesford Q.K., Morgan A.R., Hayasaka S., Simpson S.L., Barret W., Kraft R.A., et al. Reproducibility of graph metrics in FMRI networks. Front Neuroinform 2010, 4:117.
51. Tian L., Wang J., Yan C., He Y. Hemisphere- and gender-related differences in small-world brain networks: a resting-state functional MRI study. Neuroimage 2011, 54:191-202.
52. Uhlhaas P.J., Roux F., Rodriguez E., Rotarska-Jagiela A., Singer W. Neural synchrony and the development of cortical networks. Trends Cogn Sci 2010, 14:72-80.
53. van den Heuvel M.P., Hulshoff Pol H.E. Exploring the brain network: a review on resting-state fMRI functional connectivity. Eur Neuropsychopharmacol 2010, 20:519-534.
54. van den Heuvel M.P., Stam C.J., Boersma M., Hulshoff Pol H.E. Small-world and scale-free organization of voxel-based resting-state functional connectivity in the human brain. Neuroimage 2008, 43:528-539.
55. Wang J., Zuo X., Dai Z., Xia M., Zhao Z., Zhao X., et al. Disrupted functional brain connectome in individuals at risk for Alzheimer's disease. Biol Psychiatry 2013, 73:472-481.
56. Wang J., Zuo X., He Y. Graph-based network analysis of resting-state functional MRI. Front Syst Neurosci 2010, 4:16.
57. Wang J.H., Zuo X.N., Gohel S., Milham M.P., Biswal B.B., He Y. Graph theoretical analysis of functional brain networks: test-retest evaluation on short- and long-term resting-state functional MRI data. PLoS ONE 2011, 6:e21976.
58. Wang P., Havenith M.N., Best M., Gruetzner C., Singer W., Uhlhaas P., et al. Time delays in the beta/gamma cycle operate on the level of individual neurons. Neuroreport 2010, 21:746-750.
59. Wang X., Jiao Y., Tang T., Wang H., Lu Z. Investigating univariate temporal patterns for intrinsic connectivity networks based on complexity and low-frequency oscillation: a test-retest reliability study. Neuroscience 2013, 254:404-426.
60. Weissenbacher A., Kasess C., Gerstl F., Lanzenberger R., Moser E., Windischberger C. Correlations and anticorrelations in resting-state functional connectivity MRI: a quantitative comparison of preprocessing strategies. Neuroimage 2009, 47:1408-1416.
61. Wu T., Wang L., Chen Y., Zhao C., Li K., Chan P. Changes of functional connectivity of the motor network in the resting state in Parkinson's disease. Neurosci Lett 2009, 460:6-10.
62. Zanto T.P., Pa J., Gazzaley A. Reliability measures of functional magnetic resonance imaging in a longitudinal evaluation of mild cognitive impairment. Neuroimage 2014, 84:443-452.
63. Zhang H., Zhang Y.J., Duan L., Ma S.Y., Lu C.M., Zhu C.Z. Is resting-state functional connectivity revealed by functional near-infrared spectroscopy test-retest reliable?. J Biomed Opt 2011, 16:067008.
64. Zuo X.N., Di Martino A., Kelly C., Shehzad Z.E., Gee D.G., Klein D.F., et al. The oscillating brain: complex and reliable. Neuroimage 2010, 49:1432-1445.
65. Zuo X.N., Kelly C., Adelstein J.S., Klein D.F., Castellanos F.X., Milham M.P. Reliable intrinsic connectivity networks: test-retest evaluation using ICA and dual regression approach. Neuroimage 2010, 49:2163-2177.
66. Zuo X.N., Xing X.X. Test-retest reliabilities of resting-state FMRI measurements in human brain functional connectomics: a systems neuroscience perspective. Neurosci Biobehav Rev 2014, 45:100-118.
67. Zuo X.N., Xu T., Jiang L., Yang Z., Cao X.Y., He Y., et al. Toward reliable characterization of functional homogeneity in the human brain: preprocessing, scan duration, imaging resolution and computational space. Neuroimage 2013, 65:374-386.