Deriving reproducible biomarkers from multi-site resting-state data: An Autism-based example

NeuroImage

Volumn 147, Issue , 2017, Pages 736-745

  Abraham, Alexandre ^a,b   Milham, Michael P ^e,f   Di Martino, Adriana ^g   Craddock, R Cameron ^e,f   Samaras, Dimitris ^c,d   Thirion, Bertrand ^a,b   Varoquaux, Gael ^a,b  

^a INRIA Parietal Project Team   (France)

^b DIF   (France)

^c STONY BROOK UNIVERSITY   (United States)

^d ECOLE CENTRALE PARIS   (France)

^e CHILD MIND INSTITUTE   (United States)

^f NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

^g NEW YORK UNIVERSITY CHILD STUDY CENTER   (United States)

Author keywords

Autism spectrum disorders; Biomarkers; Connectome; Data heterogeneity; Data pipelines; Resting state fMRI

Indexed keywords

ANTERIOR INSULA; ARTICLE; AUTISM; CLASSIFIER; CONNECTOME; DEFAULT MODE NETWORK; DISEASE MARKER; FUNCTIONAL CONNECTIVITY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; MIDDLE TEMPORAL GYRUS; PARIETAL LOBE; POST HOC ANALYSIS; PREDICTION; RESTING STATE NETWORK; SUPRAMARGINAL GYRUS; TEMPOROPARIETAL JUNCTION; ADOLESCENT; ADULT; BRAIN CORTEX; CHILD; DIAGNOSTIC IMAGING; IMAGE PROCESSING; INFORMATION PROCESSING; MULTICENTER STUDY (TOPIC); NUCLEAR MAGNETIC RESONANCE IMAGING; PATHOPHYSIOLOGY; PROCEDURES; REPRODUCIBILITY; STANDARDS;

BIOLOGICAL MARKER;

ADOLESCENT; ADULT; AUTISM SPECTRUM DISORDER; BIOMARKERS; CEREBRAL CORTEX; CHILD; CONNECTOME; DATASETS AS TOPIC; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MULTICENTER STUDIES AS TOPIC; REPRODUCIBILITY OF RESULTS;

EID: 85009236692     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2016.10.045     Document Type: Article

References (76)

1. Abraham, A., Dohmatob, E., Thirion, B., Samaras, D., Varoquaux, G., Extracting brain regions from rest fMRI with Total-Variation constrained dictionary learning. In: MICCAI, 2013, p. 607.
2. Anderson, J.S., Druzgal, T.J., Froehlich, A., DuBray, M.B., Lange, N., Alexander, A.L., Abildskov, T., Nielsen, J.A., Cariello, A.N., Cooperrider, J.R., et al. Decreased interhemispheric functional connectivity in autism. Cereb. Cortex, 2010 (bhq190).
3. Anderson, J.S., Nielsen, J.A., Froehlich, A.L., DuBray, M.B., Druzgal, T.J., Cariello, A.N., Cooperrider, J.R., Zielinski, B.A., Ravichandran, C., Fletcher, P.T., et al. Functional connectivity magnetic resonance imaging classification of autism. Brain 134:12 (2011), 3742–3754.
4. Anderson, J.S., Nielsen, J.A., Ferguson, M.A., Burback, M.C., Cox, E.T., Dai, L., Gerig, G., Edgin, J.O., Korenberg, J.R., Abnormal brain synchrony in down syndrome, NeuroImage: Clinical, 2013.
5. Avants, B.B., Tustison, N., Song, G., Advanced normalization tools (ants). Insight J 2 (2009), 1–35.
6. Beckmann, C.F., Smith, S.M., Probabilistic independent component analysis for functional magnetic resonance imaging. Trans. Med Im. 23 (2004), 137–152.
7. Behzadi, Y., Restom, K., Liau, J., Liu, T., A component based noise correction method (CompCor) for bold and perfusion based fMRI. Neuroimage, 37, 2007, 90.
8. Button, K.S., Ioannidis, J.P., Mokrysz, C., Nosek, B.A., Flint, J., Robinson, E.S., Munafò, M.R., Power failure: why small sample size undermines the reliability of neuroscience. Nat. Rev. Neurosci. 14:5 (2013), 365–376.
9. Calhoun, V.D., Adali, T., Pearlson, G.D., Pekar, J.J., A method for making group inferences from fMRI data using independent component analysis. Hum. Brain Mapp., 14, 2001, 140.
10. Calhoun, V.D., Sui, J., Kiehl, K., Turner, J., Allen, E., Pearlson, G., Exploring the psychosis functional connectome: aberrant intrinsic networks in schizophrenia and bipolar disorder, Frontiers in psychiatry 2, 2011.
11. Carp, J., The secret lives of experiments: methods reporting in the fMRI literature. Neuroimage 63:1 (2012), 289–300.
12. Castellanos, F.X., Di Martino, A., Craddock, R.C., Mehta, A.D., Milham, M.P., Clinical applications of the functional connectome. Neuroimage 80 (2013), 527–540.
13. Chen, G., Ward, B.D., Xie, C., Li, W., Wu, Z., Jones, J.L., Franczak, M., Antuono, P., Li, S.-J., Classification of alzheimer disease, mild cognitive impairment, and normal cognitive status with large-scale network analysis based on resting-state functional mr imaging. Radiology 259:1 (2011), 213–221.
14. Chen, C.P., Keown, C.L., Jahedi, A., Nair, A., Pflieger, M.E., Bailey, B.A., Müller, R.-A., Diagnostic classification of intrinsic functional connectivity highlights somatosensory, default mode, and visual regions in autism, NeuroImage: Clinical, 2015.
15. Cherkassky, V.L., Kana, R.K., Keller, T.A., Just, M.A., Functional connectivity in a baseline resting-state network in autism. Neuroreport 17:16 (2006), 1687–1690.
16. Consortium, A., et al., The adhd-200 consortium: a model to advance the translational potential of neuroimaging in clinical neuroscience, Frontiers in systems neuroscience 6, 2012.
17. Craddock, R., Holtzheimer, P. III, Hu, X., Mayberg, H., Disease state prediction from resting state functional connectivity. Magn. Reson. Med., 62, 2009, 1619.
18. Craddock, R.C., James, G.A., Holtzheimer, P.E., Hu, X.P., Mayberg, H.S., A whole brain fMRI atlas generated via spatially constrained spectral clustering. Human. Brain Mapp. 33:8 (2012), 1914–1928.
19. Craddock, R.C., Jbabdi, S., Yan, C.-G., Vogelstein, J.T., Castellanos, F.X., Di Martino, A., Kelly, C., Heberlein, K., Colcombe, S., Milham, M.P., Imaging human connectomes at the macroscale. Nat. Methods 10:6 (2013), 524–539.
20. Craddock, C., Sikka, S., Cheung, B., Khanuja, R., Ghosh, S., Yan, C., Li, Q., Lurie, D., Vogelstein, J., Burns, R., et al., Towards automated analysis of connectomes: The configurable pipeline for the analysis of connectomes (c-pac), Front Neuroinform 42, 2013.
21. Desikan, R.S., Ségonne, F., Fischl, B., Quinn, B.T., Dickerson, B.C., Blacker, D., Buckner, R.L., Dale, A.M., et al. An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage, 31, 2006, 968.
22. Desmond, J.E., Glover, G.H., Estimating sample size in functional MRI (fMRI) neuroimaging studies: statistical power analyses. J. Neurosci. Methods 118:2 (2002), 115–128.
23. Di Martino, A., Kelly, C., Grzadzinski, R., Zuo, X.-N., Mennes, M., Mairena, M.A., Lord, C., Castellanos, F.X., Milham, M.P., Aberrant striatal functional connectivity in children with autism. Biol. Psychiatry 69:9 (2011), 847–856.
24. Di Martino, A., Yan, C.-G., Li, Q., Denio, E., Castellanos, F.X., Alaerts, K., Anderson, J.S., Assaf, M., Bookheimer, S.Y., Dapretto, M., et al. The autism brain imaging data exchange: towards a large-scale evaluation of the intrinsic brain architecture in autism. Mol. Psychiatry 19:6 (2014), 659–667.
25. Dinstein, I., Pierce, K., Eyler, L., Solso, S., Malach, R., Behrmann, M., Courchesne, E., Disrupted neural synchronization in toddlers with autism. Neuron 70:6 (2011), 1218–1225.
26. Dosenbach, N.U., Nardos, B., Cohen, A.L., Fair, D.A., Power, J.D., Church, J.A., Nelson, S.M., Wig, G.S., Vogel, A.C., Lessov-Schlaggar, C.N., et al. Prediction of individual brain maturity using fMRI. Science 329:5997 (2010), 1358–1361.
27. Eickhoff, S.B., Thirion, B., Varoquaux, G., Bzdok, D., Connectivity-based parcellation: critique and implications. Human. Brain Mapp. 36:12 (2015), 4771–4792.
28. Fair, D.A., Nigg, J.T., Iyer, Bathula, S., Mills, D.K.L., Dosenbach, N.U., Schlaggar, B.L., Mennes, M., Gutman, D., Bangaru, S. et al., Distinct neural signatures detected for ADHD subtypes after controlling for micro-movements in resting state functional connectivity MRI data, Frontiers in systems neuroscience 6, 2012.
29. Fox, M., Snyder, A., Vincent, J., Corbetta, M., Van Essen, D., Raichle, M., The human brain is intrinsically organized into dynamic, anticorrelated functional networks. Proc. Ntl Acad. Sci., 102, 2005, 9673.
30. Friedman, J., Hastie, T., Tibshirani, R., Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9, 2008, 432.
31. Friston, K.J., Holmes, A.P., Worsley, K.J., Poline, J.-B., Frith, C., Frackowiak, R.S.J., Statistical parametric maps in functional imaging: a general linear approach. Hum. Brain Mapp., 1995, 189.
32. Garrity, A., Pearlson, G., McKiernan, K., Lloyd, D., Kiehl, K., Calhoun, V., Aberrant default mode functional connectivity in schizophrenia, Am. J. Psychiatry. 164, 2007.
33. Geschwind, D.H., Levitt, P., Autism spectrum disorders: developmental disconnection syndromes. Curr. Opin. Neurobiol. 17:1 (2007), 103–111.
34. Goutte, C., Toft, P., Rostrup, E., Nielsen, F.Å, Hansen, L.K., On clustering fMRI time series. NeuroImage 9:3 (1999), 298–310.
35. Greicius, M., Resting-state functional connectivity in neuropsychiatric disorders. Curr. Opin. Neurol., 21, 2008, 424.
36. Greicius, M., Srivastava, G., Reiss, A., Menon, V., Default-mode network activity distinguishes Alzheimer's disease from healthy aging: evidence from functional MRI. Proc. Natl. Acad. Sci., 101, 2004, 4637.
37. Haar, S., Berman, S., Behrmann, M., Dinstein, I., Anatomical abnormalities in autism?. Cereb. Cortex, 2014 (bhu242).
38. Hernandez, L.M., Rudie, J.D., Green, S.A., Bookheimer, S., Dapretto, M., Neural signatures of autism spectrum disorders: insights into brain network dynamics. Neuropsychopharmacology 40:1 (2015), 171–189.
39. Iidaka, T., Matsumoto, A., Nogawa, J., Yamamoto, Y., Sadato, N., Frontoparietal network involved in successful retrieval from episodic memory. spatial and temporal analyses using fMRI and ERP. Cereb. Cortex 16:9 (2006), 1349–1360.
40. Jafri, M.J., Pearlson, G.D., Stevens, M., Calhoun, V.D., A method for functional network connectivity among spatially independent resting-state components in schizophrenia. Neuroimage 39:4 (2008), 1666–1681.
41. Kapur, S., Phillips, A.G., Insel, T.R., Why has it taken so long for biological psychiatry to develop clinical tests and what to do about it& quest. Mol. Psychiatry 17:12 (2012), 1174–1179.
42. Kelly, A.C., Uddin, L.Q., Biswal, B.B., Castellanos, F.X., Milham, M.P., Competition between functional brain networks mediates behavioral variability. Neuroimage 39:1 (2008), 527–537.
43. Kennedy, D.P., Redcay, E., Courchesne, E., Failing to deactivate: resting functional abnormalities in autism. Proc. Natl. Acad. Sci. 103:21 (2006), 8275–8280.
44. Kleinhans, N.M., Müller, R.-A., Cohen, D.N., Courchesne, E., Atypical functional lateralization of language in autism spectrum disorders. Brain Res. 1221 (2008), 115–125.
45. Lashkari, D., Vul, E., Kanwisher, N., Golland, P., Discovering structure in the space of fMRI selectivity profiles. NeuroImage, 50, 2010, 1085.
46. Ledoit, O., Wolf, M., A well-conditioned estimator for large-dimensional covariance matrices. J. Multivar. Anal., 88, 2004, 365.
47. Loth, E., Spooren, W., Ham, L.M., Isaac, M.B., Auriche-Benichou, C., Banaschewski, T., Baron-Cohen, S., Broich, K., Bölte, S., Bourgeron, T., et al. Identification and validation of biomarkers for autism spectrum disorders. Nat. Rev. Drug Discov. 15:1 (2016), 70–73.
48. Lund, T.E., Nørgaard, M.D., Rostrup, E., Rowe, J.B., Paulson, O.B., Motion or activity: their role in intra-and inter-subject variation in fMRI. Neuroimage 26:3 (2005), 960–964.
49. Martinsson, P., Rokhlin, V., Tygert, M., A randomized algorithm for the decomposition of matrices. Appl. Comput. Harmon. Anal., 30, 2011, 47.
50. Mennes, M., Biswal, B.B., Castellanos, F.X., Milham, M.P., Making data sharing work: the fcp/indi experience. Neuroimage 82 (2013), 683–691.
51. Menon, V., Uddin, L.Q., Saliency, switching, attention and control: a network model of insula function. Brain Struct. Funct. 214:5–6 (2010), 655–667.
52. Monk, C.S., Peltier, S.J., Wiggins, J.L., Weng, S.-J., Carrasco, M., Risi, S., Lord, C., Abnormalities of intrinsic functional connectivity in autism spectrum disorders. Neuroimage 47:2 (2009), 764–772.
53. Murphy, K., Garavan, H., An empirical investigation into the number of subjects required for an event-related fmri study. Neuroimage 22:2 (2004), 879–885.
54. Ng, B., Dressler, M., Varoquaux, G., Poline, J.B., Greicius, M., Thirion, B., Transport on riemannian manifold for functional connectivity-based classification. In: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2014, Springer International Publishing, 2014, pp. 405–412.
55. Nielsen, J.A., Zielinski, B.A., Fletcher, P.T., Alexander, A.L., Lange, N., Bigler, E.D., Lainhart, J.E., Anderson, J.S., Multisite functional connectivity MRI classification of autism: ABIDE results, Frontiers in human neuroscience 7, 2013.
56. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., et al. Scikit-learn: machine learning in python. J. Mach. Learn. Res., 12, 2011, 2825.
57. Plitt, M., Barnes, K.A., Martin, A. Functional connectivity classification of autism identifies highly predictive brain features but falls short of biomarker standards, NeuroImage: Clinical, 2015.
58. Rane, P., Cochran, D., Hodge, S.M., Haselgrove, C., Kennedy, D.N., Frazier, J.A., Connectivity in autism: a review of mri connectivity studies. Harv. Rev. Psychiatry 23:4 (2015), 223–244.
59. Ray, S., Miller, M., Karalunas, S., Robertson, C., Grayson, D.S., Cary, R.P., Hawkey, E., Painter, J.G., Kriz, D., Fombonne, E., et al. Structural and functional connectivity of the human brain in autism spectrum disorders and attention-deficit/hyperactivity disorder: a rich club-organization study. Human. Brain Mapp. 35:12 (2014), 6032–6048.
60. Richiardi, J., Eryilmaz, H., Schwartz, S., Vuilleumier, P., Van De Ville D., Decoding brain states from fMRI connectivity graphs, Neuroimage, 2011.
61. Saxe, R., Kanwisher, N., People thinking about thinking people: the role of the temporo-parietal junction in theory of mind. Neuroimage 19:4 (2003), 1835–1842.
62. Shirer, W., Ryali, S., Rykhlevskaia, E., Menon, V., Greicius, M., Decoding subject-driven cognitive states with whole-brain connectivity patterns. Cereb. Cortex, 22, 2012, 158.
63. Shirer, W.R., Jiang, H., Price, C.M., Ng, B., Greicius, M.D., Optimization of rs-fMRI pre-processing for enhanced signal-noise separation, test-retest reliability, and group discrimination, Neuroimage, 2015.
64. Smith, S., Miller, K., Salimi-Khorshidi, G., Webster, M., Beckmann, C., Nichols, T., Ramsey, J., Woolrich, M., Network modelling methods for fMRI. Neuroimage, 54, 2011, 875.
65. Supekar, K., Uddin, L.Q., Khouzam, A., Phillips, J., Gaillard, W.D., Kenworthy, L.E., Yerys, B.E., Vaidya, C.J., Menon, V., 2013. Brain hyperconnectivity in children with autism and its links to social deficits, Cell Reports 5 (3). pp. 738–747, 2013.
66. Thirion, B., Pinel, P., Mériaux, S., Roche, A., Dehaene, S., Poline, J.-B., Analysis of a large fMRI cohort: statistical and methodological issues for group analyses. Neuroimage 35:1 (2007), 105–120.
67. Thirion, B., Varoquaux, G., Dohmatob, E., Poline, J.B., Which fMRI clustering gives good brain parcellations? Frontiers in Neuroscience, 8, 2014.
68. Van Essen, D.C., Ugurbil, K., The future of the human connectome. Neuroimage 62:2 (2012), 1299–1310.
69. Varoquaux, G., Craddock, C., Learning and comparing functional connectomes across subjects. NeuroImage, 80, 2013, 405.
70. Varoquaux, G., Sadaghiani, S., Pinel, P., Kleinschmidt, A., Poline, J.B., Thirion, B., A group model for stable multi-subject ICA on fMRI datasets. NeuroImage, 51, 2010, 288.
71. Varoquaux, G., Baronnet, F., Kleinschmidt, A., Fillard, P., Thirion B., Detection of brain functional-connectivity difference in post-stroke patients using group-level covariance modeling. In: MICCAI, 2010, pp. 200–208.
72. Vissers, M.E., Cohen, M.X., Geurts, H.M., Brain connectivity and high functioning autism: a promising path of research that needs refined models, methodological convergence, and stronger behavioral links. Neurosci. Biobehav. Rev. 36:1 (2012), 604–625.
73. Vul, E., Harris, C., Winkielman, P., Pashler, H., Puzzlingly high correlations in fmri studies of emotion, personality, and social cognition. Perspect. P Sci. 4:3 (2009), 274–290.
74. Yan, C.-G., Craddock, R.C., Zuo, X.-N., Zang, Y.-F., Milham, M.P., Standardizing the intrinsic brain: towards robust measurement of inter-individual variation in 1000 functional connectomes. Neuroimage 80 (2013), 246–262.
75. Yeo, B., Krienen, F., Sepulcre, J., Sabuncu, M., et al. The organization of the human cerebral cortex estimated by intrinsic functional connectivity. J Neurophysiol., 106, 2011, 1125.
76. Zhou, Y., Liang, M., Tian, L., Wang, K., Hao, Y., Liu, H., Liu, Z., Jiang, T., Functional disintegration in paranoid schizophrenia using resting-state fMRI. Schizophr Res. 97:1 (2007), 194–205.