Multisite reliability of MR-based functional connectivity

NeuroImage

Volumn 146, Issue , 2017, Pages 959-970

  Noble, Stephanie ^a   Scheinost, Dustin ^b   Finn, Emily S ^a   Shen, Xilin ^b   Papademetris, Xenophon ^b,c   McEwen, Sarah C ^d   Bearden, Carrie E ^d   Addington, Jean ^e   Goodyear, Bradley ^f   Cadenhead, Kristin S ^g   Mirzakhanian, Heline ^g   Cornblatt, Barbara A ^h   Olvet, Doreen M ^h   Mathalon, Daniel H ⁱ   McGlashan, Thomas H ^a   Perkins, Diana O ^a   Belger, Aysenil ^j   Seidman, Larry J ^k   Thermenos, Heidi ^k   Tsuang, Ming T ^g   van Erp, Theo G M ^l   Walker, Elaine F ^m   Hamann, Stephan ^m   Woods, Scott W ^a   Cannon, Tyrone D ^a   Constable, R Todd ^b   more..

^a YALE UNIVERSITY   (United States)

^b YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c Yale University   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

^e UNIVERSITY OF CALGARY   (Canada)

^f UNIVERSITY OF CALGARY   (Canada)

^g UNIVERSITY OF CALIFORNIA   (United States)

^h ZUCKER HILLSIDE HOSPITAL   (United States)

ⁱ UNIVERSITY OF CALIFORNIA   (United States)

^j UNIVERSITY OF NORTH CAROLINA SCHOOL OF MEDICINE   (United States)

^k HARVARD MEDICAL SCHOOL   (United States)

^l UNIVERSITY OF CALIFORNIA   (United States)

^m EMORY UNIVERSITY   (United States)

more..

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; COHORT ANALYSIS; FEMALE; FUNCTIONAL CONNECTIVITY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; MALE; MOTOR CORTEX; NORMAL HUMAN; POSTERIOR CINGULATE; RESTING STATE NETWORK; TEST RETEST RELIABILITY; THALAMUS; BRAIN; BRAIN MAPPING; DEVICES; LONGITUDINAL STUDY; MULTICENTER STUDY (TOPIC); NERVE TRACT; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PROCEDURES; REPRODUCIBILITY; YOUNG ADULT;

ADULT; BRAIN; BRAIN MAPPING; FEMALE; HUMANS; LONGITUDINAL STUDIES; MAGNETIC RESONANCE IMAGING; MALE; MULTICENTER STUDIES AS TOPIC; NEURAL PATHWAYS; REPRODUCIBILITY OF RESULTS; YOUNG ADULT;

EID: 85005921772     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2016.10.020     Document Type: Article

References (78)

1. Addington, J., Cadenhead, K.S., Cannon, T.D., Cornblatt, B., McGlashan, T.H., Perkins, D.O., Seidman, L.J., Tsuang, M., Walker, E.F., Woods, S.W., North American Prodrome Longitudinal Study: a collaborative multisite approach to prodromal schizophrenia research. Schizophr. Bull. 33 (2007), 665–672.
2. Allen, E.A., Erhardt, E.B., Damaraju, E., Gruner, W., Segall, J.M., Silva, R.F., Havlicek, M., Rachakonda, S., Fries, J., Kalyanam, R., Michael, A.M., Caprihan, A., Turner, J.A., Eichele, T., Adelsheim, S., Bryan, A.D., Bustillo, J., Clark, V.P., Feldstein Ewing, S.W., Filbey, F., Ford, C.C., Hutchison, K., Jung, R.E., Kiehl, K.A., Kodituwakku, P., Komesu, Y.M., Mayer, A.R., Pearlson, G.D., Phillips, J.P., Sadek, J.R., Stevens, M., Teuscher, U., Thoma, R.J., Calhoun, V.D., A baseline for the multivariate comparison of resting-state networks. Front. Syst. Neurosci., 5, 2011, 2.
3. Andellini, M., Cannata, V., Gazzellini, S., Bernardi, B., Napolitano, A., Test-retest reliability of graph metrics of resting state MRI functional brain networks: a review. J. Neurosci. Methods 253 (2015), 183–192.
4. Anderson, J.S., Ferguson, M.A., Lopez-Larson, M., Yurgelun-Todd, D., Reproducibility of single-subject functional connectivity measurements. AJNR Am. J. Neuroradiol. 32 (2011), 548–555.
5. Bennett, C.M., Miller, M.B., How reliable are the results from functional magnetic resonance imaging?. Ann. NY Acad. Sci. 1191 (2010), 133–155.
6. Birn, R.M., Molloy, E.K., Patriat, R., Parker, T., Meier, T.B., Kirk, G.R., Nair, V.A., Meyerand, M.E., Prabhakaran, V., The effect of scan length on the reliability of resting-state fMRI connectivity estimates. Neuroimage 83 (2013), 550–558.
7. Biswal, B., Yetkin, F.Z., Haughton, V.M., Hyde, J.S., Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magn. Reson. Med. 34 (1995), 537–541.
8. Braun, U., Plichta, M.M., Esslinger, C., Sauer, C., Haddad, L., Grimm, O., Mier, D., Mohnke, S., Heinz, A., Erk, S., Test–retest reliability of resting-state connectivity network characteristics using fMRI and graph theoretical measures. Neuroimage 59 (2012), 1404–1412.
9. Brooks, J.C.W., Faull, O.K., Pattinson, K.T.S., Jenkinson, M., Physiological noise in brainstem fMRI. Front. Hum. Neurosci., 7, 2013, 623.
10. Brown, G.G., Mathalon, D.H., Stern, H., Ford, J., Mueller, B., Greve, D.N., McCarthy, G., Voyvodic, J., Glover, G., Diaz, M., Multisite reliability of cognitive BOLD data. Neuroimage 54 (2011), 2163–2175.
11. Broyd, S.J., Demanuele, C., Debener, S., Helps, S.K., James, C.J., Sonuga-Barke, E.J., Default-mode brain dysfunction in mental disorders: a systematic review. Neurosci. Biobehav. Rev. 33 (2009), 279–296.
12. Buckner, R.L., Andrews‐Hanna, J.R., Schacter, D.L., The brain's default network. Ann. NY Acad. Sci. 1124 (2008), 1–38.
13. Buckner, R.L., Sepulcre, J., Talukdar, T., Krienen, F.M., Liu, H., Hedden, T., Andrews-Hanna, J.R., Sperling, R.A., Johnson, K.A., Cortical hubs revealed by intrinsic functional connectivity: mapping, assessment of stability, and relation to alzheimer's disease. J. Neurosci. 29 (2009), 1860–1873.
14. Cannon, T.D., Sun, F., McEwen, S.J., Papademetris, X., He, G., van Erp, T.G., Jacobson, A., Bearden, C.E., Walker, E., Hu, X., Reliability of neuroanatomical measurements in a multisite longitudinal study of youth at risk for psychosis. Hum. Brain Mapp. 35 (2014), 2424–2434.
15. Chen, J., Liu, J., Calhoun, V.D., Arias-Vasquez, A., Zwiers, M.P., Gupta, C.N., Franke, B., Turner, J.A., Exploration of scanning effects in multi-site structural MRI studies. J. Neurosci. Methods 230 (2014), 37–50.
16. Cicchetti, D.V., Sparrow, S.A., Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. Am. J. Ment. Defic., 1981.
17. Cole, M.W., Pathak, S., Schneider, W., Identifying the brain's most globally connected regions. NeuroImage 49 (2010), 3132–3148.
18. Collins, F.S., Tabak, L.A., NIH plans to enhance reproducibility. Nature, 505(7485), 2014, 612.
19. Constable, R.T., Spencer, D.D., Repetition time in echo planar functional MRI. Magn. Reson. Med. 46 (2001), 748–755.
20. Constable, R.T., Scheinost, D., Finn, E.S., Shen, X., Hampson, M., Winstanley, F.S., Spencer, D.D., Papademetris, X., Potential use and challenges of functional connectivity mapping in intractable epilepsy. Front. Neurol., 2013, 4.
21. Cronbach, L., Gleser, G., Nanda, H., Rajaratnam, N., The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles, 1972, Wiley, New York.
22. D'Ardenne, K., McClure, S.M., Nystrom, L.E., Cohen, J.D., BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319 (2008), 1264–1267.
23. Feinberg, D.A., Yacoub, E., The rapid development of high speed, resolution and precision in fMRI. Neuroimage 62 (2012), 720–725.
24. Feinberg, D.A., Setsompop, K., Ultra-fast MRI of the human brain with simultaneous multi-slice imaging. J. Magn. Reson. 229 (2013), 90–100.
25. Finn, E.S., Shen, X., Scheinost, D., Rosenberg, M.D., Huang, J., Chun, M.M., Papademetris, X., Constable, R.T., Functional connectome fingerprinting: identifying individuals using patterns of brain connectivity. Nat. Neurosci. 18 (2015), 1664–1671.
26. First, M.B., Spitzer, R.L., Gibbon, M., Williams, J.B., Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition (SCID-I/P). 2005, New York State Psychiatric Institute Biometrics Research, New York.
27. Forsyth, J.K., McEwen, S.C., Gee, D.G., Bearden, C.E., Addington, J., Goodyear, B., Cadenhead, K.S., Mirzakhanian, H., Cornblatt, B.A., Olvet, D.M., Reliability of functional magnetic resonance imaging activation during working memory in a multi-site study: analysis from the North American Prodrome Longitudinal Study. Neuroimage 97 (2014), 41–52.
28. Friedman, L., Stern, H., Brown, G.G., Mathalon, D.H., Turner, J., Glover, G.H., Gollub, R.L., Lauriello, J., Lim, K.O., Cannon, T., Test–retest and between‐site reliability in a multicenter fMRI study. Hum. Brain Mapp. 29 (2008), 958–972.
29. Friston, K.J., Functional and effective connectivity in neuroimaging: a synthesis. Hum. Brain Mapp. 2 (1994), 56–78.
30. Gee, D.G., McEwen, S.C., Forsyth, J.K., Haut, K.M., Bearden, C.E., Addington, J., Goodyear, B., Cadenhead, K.S., Mirzakhanian, H., Cornblatt, B.A., Reliability of an fMRI paradigm for emotional processing in a multisite longitudinal study. Hum. Brain Mapp., 2015.
31. Glover, G.H., Mueller, B.A., Turner, J.A., van Erp, T.G., Liu, T.T., Greve, D.N., Voyvodic, J.T., Rasmussen, J., Brown, G.G., Keator, D.B., Function biomedical informatics research network recommendations for prospective multicenter functional MRI studies. J. Magn. Reson. Imaging 36 (2012), 39–54.
32. Greicius, M.D., Krasnow, B., Reiss, A.L., Menon, V., Functional connectivity in the resting brain: a network analysis of the default mode hypothesis. Proc. Natl. Acad. Sci. 100 (2003), 253–258.
33. Hacker, C.D., Laumann, T.O., Szrama, N.P., Baldassarre, A., Snyder, A.Z., Leuthardt, E.C., Corbetta, M., Resting state network estimation in individual subjects. Neuroimage 82 (2013), 616–633.
34. Hayes, A.F., Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-based Approach, 2013, Guilford Press, New York, NY.
35. Hoffman, R.E., McGlashan, T.H., Book review: neural network models of Schizophrenia. Neuroscientist 7 (2001), 441–454.
36. Holmes, C.J., Hoge, R., Collins, L., Woods, R., Toga, A.W., Evans, A.C., Enhancement of MR images using registration for signal averaging. J. Comput. Assist. Tomogr. 22 (1998), 324–333.
37. Hutchison, R.M., Womelsdorf, T., Allen, E.A., Bandettini, P.A., Calhoun, V.D., Corbetta, M., Della Penna, S., Duyn, J.H., Glover, G.H., Gonzalez-Castillo, J., Handwerker, D.A., Keilholz, S., Kiviniemi, V., Leopold, D.A., de Pasquale, F., Sporns, O., Walter, M., Chang, C., Dynamic functional connectivity: promise, issues, and interpretations. Neuroimage 80 (2013), 360–378.
38. Jann, K., Gee, D.G., Kilroy, E., Schwab, S., Smith, R.X., Cannon, T.D., Wang, D.J., Functional connectivity in BOLD and CBF data: similarity and reliability of resting brain networks. Neuroimage 106 (2015), 111–122.
39. Jones, D.T., Vemuri, P., Murphy, M.C., Gunter, J.L., Senjem, M.L., Machulda, M.M., Przybelski, S.A., Gregg, B.E., Kantarci, K., Knopman, D.S., Boeve, B.F., Petersen, R.C., Jack, C.R. Jr., Non-stationarity in the “Resting Brain's” modular architecture. PloS One, 7, 2012, e39731.
40. Joshi, A., Scheinost, D., Okuda, H., Belhachemi, D., Murphy, I., Staib, L.H., Papademetris, X., Unified framework for development, deployment and robust testing of neuroimaging algorithms. Neuroinformatics 9 (2011), 69–84.
41. Karlsgodt, K.H., Sun, D., Jimenez, A.M., Lutkenhoff, E.S., Willhite, R., Van Erp, T.G., Cannon, T.D., Developmental disruptions in neural connectivity in the pathophysiology of schizophrenia. Dev. Psychopathol. 20 (2008), 1297–1327.
42. Keator, D.B., Grethe, J.S., Marcus, D., Ozyurt, B., Gadde, S., Murphy, S., Pieper, S., Greve, D., Notestine, R., Bockholt, H.J., A national human neuroimaging collaboratory enabled by the Biomedical Informatics Research Network (BIRN). IEEE Trans. Inf. Technol. Biomed. 12 (2008), 162–172.
43. Laumann, T.O., Gordon, E.M., Adeyemo, B., Snyder, A.Z., Joo, S.J., Chen, M.-Y., Gilmore, A.W., McDermott, K.B., Nelson, S.M., Dosenbach, N.U., Functional system and areal organization of a highly sampled individual human brain. Neuron, 2015.
44. Lynall, M.-E., Bassett, D.S., Kerwin, R., McKenna, P.J., Kitzbichler, M., Muller, U., Bullmore, E., Functional connectivity and brain networks in schizophrenia. J. Neurosci. 30 (2010), 9477–9487.
45. Masterton, R.A., Carney, P.W., Jackson, G.D., Cortical and thalamic resting-state functional connectivity is altered in childhood absence epilepsy. Epilepsy Res. 99 (2012), 327–334.
46. McGlashan, T., Miller, T., Woods, S., Hoffman, R., Davidson, L., Instrument for the assessment of prodromal symptoms and states. Miller, T., Mednick, S., McGlashan, T., Libiger, J., Johannessen, J., (eds.) Early Intervention in Psychotic Disorders, 2001, Springer, Netherlands, 135–149.
47. Mueller, S., Wang, D., Fox, M.D., Pan, R., Lu, J., Li, K., Sun, W., Buckner, R.L., Liu, H., Reliability correction for functional connectivity: theory and implementation. Hum. Brain Mapp. 36:11 (2015), 4664–4680.
48. Orban, P., Madjar, C., Savard, M., Dansereau, C., Tam, A., Das, S., Evans, A.C., Rosa-Neto, P., Breitner, J.C.S., Bellec, P., Test-retest resting-state fMRI in healthy elderly persons with a family history of Alzheimer's disease. Sci. Data, 2, 2015, 150043.
49. Papademetris, X., Jackowski, A., Schultz, R., Staib, L., Duncan, J., Barillot, C., Haynor, D., Hellier, P., 2004. Integrated intensity and point-feature nonrigid registration. Medical Image Computing and Computer-Assisted Intervention-MICCAI 2004. Springer Berlin/Heidelberg, pp. 763–770.
50. Pearlson, G., Multisite collaborations and large databases in psychiatric neuroimaging: advantages, problems, and challenges. Schizophr. Bull., 35, 2009, 1.
51. Power, J.D., Fair, D.A., Schlaggar, B.L., Petersen, S.E., The development of human functional brain networks. Neuron 67 (2010), 735–748.
52. Rueckert, D., Sonoda, L.I., Hayes, C., Hill, D.L., Leach, M.O., Hawkes, D.J., Nonrigid registration using free-form deformations: application to breast MR images. IEEE Trans. Med. Imaging 18 (1999), 712–721.
53. Rutherford, A., Anova and Ancova: a GLM approach, 2011, John Wiley & Sons, Hoboken, NJ.
54. Satterthwaite, T.D., Elliott, M.A., Gerraty, R.T., Ruparel, K., Loughead, J., Calkins, M.E., Eickhoff, S.B., Hakonarson, H., Gur, R.C., Gur, R.E., Wolf, D.H., An improved framework for confound regression and filtering for control of motion artifact in the preprocessing of resting-state functional connectivity data. Neuroimage 64 (2013), 240–256.
55. Scheinost, D., Papademetris, X., Constable, R.T., The impact of image smoothness on intrinsic functional connectivity and head motion confounds. Neuroimage 95 (2014), 13–21.
56. Scheinost, D., Lacadie, C., Vohr, B.R., Schneider, K.C., Papademetris, X., Constable, R.T., Ment, L.R., Cerebral lateralization is protective in the very prematurely born. Cereb. Cortex, 2014 (bht430).
57. Scheinost, D., Benjamin, J., Lacadie, C., Vohr, B., Schneider, K.C., Ment, L.R., Papademetris, X., Constable, R.T., The intrinsic connectivity distribution: a novel contrast measure reflecting voxel level functional connectivity. Neuroimage 62 (2012), 1510–1519.
58. Scheinost, D., Kwon, S.H., Lacadie, C., Vohr, B.R., Schneider, K.C., Papademetris, X., Constable, R.T., Ment, L.R., Alterations in anatomical covariance in the prematurely born. Cereb. Cortex, 2015 (bhv248).
59. Shah, L.M., Cramer, J.A., Ferguson, M.A., Birn, R.M., Anderson, J.S., Reliability and reproducibility of individual differences in functional connectivity acquired during task and resting state. Brain Behav., 6, 2016, 5.
60. Shavelson, R.J., Webb, N.M., Rowley, G.L., Generalizability theory. Am. Psychol., 44, 1989, 922.
61. Shavelson, R.J., Baxter, G.P., Gao, X., Sampling variability of performance assessments. J. Educ. Meas. 30 (1993), 215–232.
62. Shehzad, Z., Kelly, A.C., Reiss, P.T., Gee, D.G., Gotimer, K., Uddin, L.Q., Lee, S.H., Margulies, D.S., Roy, A.K., Biswal, B.B., The resting brain: unconstrained yet reliable. Cereb. Cortex 19 (2009), 2209–2229.
63. Shen, X., Tokoglu, F., Papademetris, X., Constable, R.T., Groupwise whole-brain parcellation from resting-state fMRI data for network node identification. Neuroimage 82 (2013), 403–415.
64. Shrout, P.E., Fleiss, J.L., Intraclass correlations: uses in assessing rater reliability. Psychol. Bull., 86, 1979, 420.
65. Smith, S.M., Fast robust automated brain extraction. Hum. Brain Mapp. 17 (2002), 143–155.
66. Smith, S.M., Vidaurre, D., Beckmann, C.F., Glasser, M.F., Jenkinson, M., Miller, K.L., Nichols, T.E., Robinson, E.C., Salimi-Khorshidi, G., Woolrich, M.W., Functional connectomics from resting-state fMRI. Trends Cogn. Sci. 17 (2013), 666–682.
67. Somandepalli, K., Kelly, C., Reiss, P.T., Zuo, X.-N., Craddock, R.C., Yan, C.-G., Petkova, E., Castellanos, F.X., Milham, M.P., Di Martino, A., Short-term test–retest reliability of resting state fMRI metrics in children with and without attention-deficit/hyperactivity disorder. Dev. Cogn. Neurosci. 15 (2015), 83–93.
68. Storey, J.D., A direct approach to false discovery rates. J. R. Stat. Soc.: Ser. B Stat. Methodol. 64 (2002), 479–498.
69. Telesford, Q.K., Morgan, A.R., Hayasaka, S., Simpson, S.L., Barret, W., Kraft, R.A., Mozolic, J.L., Laurienti, P.J., Reproducibility of graph metrics in fMRI networks. Front. Neuroinform., 2010, 4.
70. Tomasi, D., Volkow, N.D., Gender differences in brain functional connectivity density. Hum. Brain Mapp. 33 (2012), 849–860.
71. Van Dijk, K.R., Sabuncu, M.R., Buckner, R.L., The influence of head motion on intrinsic functional connectivity MRI. Neuroimage 59 (2012), 431–438.
72. Van Essen, D.C., Smith, S.M., Barch, D.M., Behrens, T.E., Yacoub, E., Ugurbil, K., Consortium, W.-M.H., The WU-Minn human connectome project: an overview. Neuroimage 80 (2013), 62–79.
73. Van Horn, J.D., Toga, A.W., Multi-site neuroimaging trials. Curr. Opin. Neurol., 22, 2009, 370.
74. Wang, J.H., Zuo, X.N., Gohel, S., Milham, M.P., Biswal, B.B., He, Y., Graph theoretical analysis of functional brain networks: test-retest evaluation on short- and long-term resting-state functional MRI data. PloS One, 6, 2011, e21976.
75. Webb, N.M., Shavelson, R.J., 2005. Generalizability theory: overview. Wiley StatsRef: Statistics Reference Online.
76. Wechsler, D., Wechsler Abbreviated Scale of Intelligence. 1999, Psychological Corporation, New York, NY.
77. Zuo, X.-N., Kelly, C., Adelstein, J.S., Klein, D.F., Castellanos, F.X., Milham, M.P., Reliable intrinsic connectivity networks: test–retest evaluation using ICA and dual regression approach. Neuroimage 49 (2010), 2163–2177.
78. Zuo, X.-N., Anderson, J.S., Bellec, P., Birn, R.M., Biswal, B.B., Blautzik, J., Breitner, J.C., Buckner, R.L., Calhoun, V.D., Castellanos, F.X., An open science resource for establishing reliability and reproducibility in functional connectomics. Sci. Data, 2014, 1.