Validation of non-REM sleep stage decoding from resting state fMRI using linear support vector machines

NeuroImage

Volumn 125, Issue , 2016, Pages 544-555

  Altmann, A ^a,b,f   Schroter M S ^a,c,f   Spoormaker, V I ^a   Kiem, S A ^a   Jordan, D ^d   Ilg, R ^d,e   Bullmore, E T ^c   Greicius, M D ^b   Czisch, M ^a   Samann P G ^a  

^a MAX PLANCK INSTITUTE OF PSYCHIATRY   (Germany)

^b STANFORD UNIVERSITY   (United States)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^d TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^e Asklepios Stadtklinik   (Germany)

^f UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Classification; EEG; EEG fMRI; Resting state fMRI; Sleep

Indexed keywords

ADULT; AREA UNDER THE CURVE; ARTICLE; BRAIN CORTEX; CLASSIFICATION; CONNECTOME; ELECTROENCEPHALOGRAPHY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NONREM SLEEP; NORMAL HUMAN; OCCIPITAL LOBE; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; RECEIVER OPERATING CHARACTERISTIC; RELIABILITY; REST; SLEEP STAGE; SLEEP WAKING CYCLE; SLOW WAVE SLEEP; SUBCORTEX; SUPPORT VECTOR MACHINE; WAKEFULNESS; BRAIN; BRAIN MAPPING; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PROCEDURES; VALIDATION STUDY; YOUNG ADULT;

BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; REST; SLEEP STAGES; SUPPORT VECTOR MACHINE; WAKEFULNESS; YOUNG ADULT;

EID: 84946237153     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2015.09.072     Document Type: Article

References (64)

1. AASM The AASM manual for the scoring of sleep and associated events: rules, terminology and technical specifications 2007, American Academy of Sleep Medicine, Chicago.
2. Achard S., Salvador R., Whitcher B., Suckling J., Bullmore E. A resilient, low-frequency, small-world human brain functional network with highly connected association cortical hubs. J. Neurosci. Off. J. Soc. Neurosci. 2006, 26:63-72.
3. Altmann A., Tolosi L., Sander O., Lengauer T. Permutation importance: a corrected feature importance measure. Bioinformatics 2010, 26:1340-1347.
4. Andrade K.C., Spoormaker V.I., Dresler M., Wehrle R., Holsboer F., Samann P.G., Czisch M. Sleep spindles and hippocampal functional connectivity in human NREM sleep. J. Neurosci. Off. J. Soc. Neurosci. 2011, 31:10331-10339.
5. Biswal B.B., Mennes M., Zuo X.N., Gohel S., Kelly C., Smith S.M., Beckmann C.F., Adelstein J.S., Buckner R.L., Colcombe S., Dogonowski A.M., Ernst M., Fair D., Hampson M., Hoptman M.J., Hyde J.S., Kiviniemi V.J., Kotter R., Li S.J., Lin C.P., Lowe M.J., Mackay C., Madden D.J., Madsen K.H., Margulies D.S., Mayberg H.S., McMahon K., Monk C.S., Mostofsky S.H., Nagel B.J., Pekar J.J., Peltier S.J., Petersen S.E., Riedl V., Rombouts S.A., Rypma B., Schlaggar B.L., Schmidt S., Seidler R.D., Siegle G.J., Sorg C., Teng G.J., Veijola J., Villringer A., Walter M., Wang L., Weng X.C., Whitfield-Gabrieli S., Williamson P., Windischberger C., Zang Y.F., Zhang H.Y., Castellanos F.X., Milham M.P. Toward discovery science of human brain function. Proc. Natl. Acad. Sci. U. S. A. 2010, 107:4734-4739.
6. Boly M., Phillips C., Tshibanda L., Vanhaudenhuyse A., Schabus M., Dang-Vu T.T., Moonen G., Hustinx R., Maquet P., Laureys S. Intrinsic brain activity in altered states of consciousness: how conscious is the default mode of brain function?. Ann. N. Y. Acad. Sci. 2008, 1129:119-129.
7. Braun A.R., Balkin T.J., Wesenten N.J., Carson R.E., Varga M., Baldwin P., Selbie S., Belenky G., Herscovitch P. Regional cerebral blood flow throughout the sleep-wake cycle. An H2(15)O PET study. Brain J. Neurol. 1997, 120(Pt 7):1173-1197.
8. Cecchi G., Rish I., Thyreau B., Thirion B., Plaze M., Paillere-Martinot M.-L., Martelli C., Martinot J.-L., Poline J.-B. Discriminative network models of schizophrenia. Advances in Neural Information Processing Systems 2009, 22:252-260. Y. Bengio, D. Schuurmans, J. Lafferty, C.K.I. Williams, A. Culotta (Eds.).
9. Chang C., Glover G.H. Time-frequency dynamics of resting-state brain connectivity measured with fMRI. NeuroImage 2010, 50:81-98.
10. Chang C., Lin C. LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol. 2011, 2:1-27.
11. Chen G., Chen G., Xie C., Ward B.D., Li W., Antuono P., Li S.J. A method to determine the necessity for global signal regression in resting-state fMRI studies. Magn. Reson. Med. 2012, 68:1828-1835.
12. Christoff K. Undirected thought: neural determinants and correlates. Brain Res. 2012, 1428:51-59.
13. Christoff K., Gordon A.M., Smallwood J., Smith R., Schooler J.W. Experience sampling during fMRI reveals default network and executive system contributions to mind wandering. Proc. Natl. Acad. Sci. U. S. A. 2009, 106:8719-8724.
14. Cole D.M., Smith S.M., Beckmann C.F. Advances and pitfalls in the analysis and interpretation of resting-state FMRI data. Front. Syst. Neurosci. 2010, 4:8.
15. De Havas J.A., Parimal S., Soon C.S., Chee M.W. Sleep deprivation reduces default mode network connectivity and anti-correlation during rest and task performance. NeuroImage 2012, 59:1745-1751.
16. Dosenbach N.U., Nardos B., Cohen A.L., Fair D.A., Power J.D., Church J.A., Nelson S.M., Wig G.S., Vogel A.C., Lessov-Schlaggar C.N., Barnes K.A., Dubis J.W., Feczko E., Coalson R.S., Pruett J.R., Barch D.M., Petersen S.E., Schlaggar B.L. Prediction of individual brain maturity using fMRI. Science 2010, 329:1358-1361.
17. Fawcett T. An introduction to ROC analysis. Pattern Recogn. Lett. 2006, 27:861-874.
18. Feinberg D.A., Setsompop K. Ultra-fast MRI of the human brain with simultaneous multi-slice imaging. J. Magn. Reson. 2013, 229:90-100.
19. Fornito A., Harrison B.J., Goodby E., Dean A., Ooi C., Nathan P.J., Lennox B.R., Jones P.B., Suckling J., Bullmore E.T. Functional Dysconnectivity of Corticostriatal Circuitry as a Risk Phenotype for Psychosis 2013, JAMA psychiatry.
20. Fox M.D., Raichle M.E. Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging. Nat. Rev. Neurosci. 2007, 8:700-711.
21. Fukunaga M., Horovitz S.G., van Gelderen P., de Zwart J.A., Jansma J.M., Ikonomidou V.N., Chu R., Deckers R.H., Leopold D.A., Duyn J.H. Large-amplitude, spatially correlated fluctuations in BOLD fMRI signals during extended rest and early sleep stages. Magn. Reson. Imaging 2006, 24:979-992.
22. Greicius M.D., Kiviniemi V., Tervonen O., Vainionpaa V., Alahuhta S., Reiss A.L., Menon V. Persistent default-mode network connectivity during light sedation. Hum. Brain Mapp. 2008, 29:839-847.
23. Guyon A., Cathala L., Paupardin-Tritsch D., Eugene D. Furosemide modulation of GABA(A) receptors in dopaminergic neurones of the rat substantia nigra. Neuropharmacology 2002, 43:750-763.
24. Hanley J.A., McNeil B.J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982, 143:29-36.
25. Himanen S.L., Hasan J. Limitations of Rechtschaffen and Kales. Sleep Med. Rev. 2000, 4:149-167.
26. Horovitz S.G., Braun A.R., Carr W.S., Picchioni D., Balkin T.J., Fukunaga M., Duyn J.H. Decoupling of the brain's default mode network during deep sleep. Proc. Natl. Acad. Sci. U. S. A. 2009, 106:11376-11381.
27. Hsu C.W., Lin C.J. A comparison of methods for multiclass support vector machines. IEEE Trans. Neural Netw. 2002, 13:415-425.
28. Hutchison R.M., Womelsdorf T., Allen E.A., Bandettini P.A., Calhoun V.D., Corbetta M., Della Penna S., Duyn J.H., Glover G.H., Gonzalez-Castillo J., Handwerker D.A., Keilholz S., Kiviniemi V., Leopold D.A., de Pasquale F., Sporns O., Walter M., Chang C. Dynamic functional connectivity: promise, issues, and interpretations. NeuroImage 2013, 80:360-378.
29. Kiem S.A., Andrade K.C., Spoormaker V.I., Holsboer F., Czisch M., Samann P.G. Resting state functional MRI connectivity predicts hypothalamus-pituitary-axis status in healthy males. Psychoneuroendocrinology 2013, 38:1338-1348.
30. LaConte S., Strother S., Cherkassky V., Anderson J., Hu X. Support vector machines for temporal classification of block design fMRI data. NeuroImage 2005, 26:317-329.
31. Larson-Prior L.J., Zempel J.M., Nolan T.S., Prior F.W., Snyder A.Z., Raichle M.E. Cortical network functional connectivity in the descent to sleep. Proc. Natl. Acad. Sci. U. S. A. 2009, 106:4489-4494.
32. Larson-Prior L.J., Power J.D., Vincent J.L., Nolan T.S., Coalson R.S., Zempel J., Snyder A.Z., Schlaggar B.L., Raichle M.E., Petersen S.E. Modulation of the brain's functional network architecture in the transition from wake to sleep. Prog. Brain Res. 2011, 193:277-294.
33. Maquet P. Functional neuroimaging of normal human sleep by positron emission tomography. J. Sleep Res. 2000, 9:207-231.
34. Meyer-Lindenberg A., Weinberger D.R. Intermediate phenotypes and genetic mechanisms of psychiatric disorders. Nat. Rev. Neurosci. 2006, 7:818-827.
35. Patriat R., Molloy E.K., Meier T.B., Kirk G.R., Nair V.A., Meyerand M.E., Prabhakaran V., Birn R.M. The effect of resting condition on resting-state fMRI reliability and consistency: a comparison between resting with eyes open, closed, and fixated. NeuroImage 2013, 78:463-473.
36. Pereira F., Mitchell T., Botvinick M. Machine learning classifiers and fMRI: a tutorial overview. NeuroImage 2009, 45:S199-S209.
37. Picchioni D., Duyn J.H., Horovitz S.G. Sleep and the functional connectome. NeuroImage 2013, 80:387-396.
38. Picchioni D., Pixa M.L., Fukunaga M., Carr W.S., Horovitz S.G., Braun A.R., Duyn J.H. Decreased connectivity between the thalamus and the neocortex during human nonrapid eye movement sleep. Sleep 2014, 37:387-397.
39. Platt J. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv. Large Margin Classifiers 1999, 10:61-74.
40. Rechtschaffen A., Kales A. A manual of standardized terminology, techniques, and scoring systems for sleep stages of human subjects 1968, Brain Information/Brain Research Institute.
41. Richiardi J., Eryilmaz H., Schwartz S., Vuilleumier P., Van De Ville D. Decoding brain states from fMRI connectivity graphs. NeuroImage 2011, 56:616-626.
42. Richiardi J., Gschwind M., Simioni S., Annoni J.M., Greco B., Hagmann P., Schluep M., Vuilleumier P., Van De Ville D. Classifying minimally disabled multiple sclerosis patients from resting state functional connectivity. NeuroImage 2012, 62:2021-2033.
43. Sämann P.G., Tully C., Spoormaker V.I., Wetter T.C., Holsboer F., Wehrle R., Czisch M. Increased sleep pressure reduces resting state functional connectivity. MAGMA 2010, 23:375-389.
44. Sämann P.G., Wehrle R., Hoehn D., Spoormaker V.I., Peters H., Tully C., Holsboer F., Czisch M. Development of the brain's default mode network from wakefulness to slow wave sleep. Cereb. Cortex 2011, 21:2082-2093.
45. Schröter M.S., Spoormaker V.I., Schorer A., Wohlschlager A., Czisch M., Kochs E.F., Zimmer C., Hemmer B., Schneider G., Jordan D., Ilg R. Spatiotemporal reconfiguration of large-scale brain functional networks during propofol-induced loss of consciousness. J. Neurosci. Off. J. Soc. Neurosci. 2012, 32:12832-12840.
46. Seeley W.W., Crawford R.K., Zhou J., Miller B.L., Greicius M.D. Neurodegenerative diseases target large-scale human brain networks. Neuron 2009, 62:42-52.
47. Shirer W.R., Ryali S., Rykhlevskaia E., Menon V., Greicius M.D. Decoding subject-driven cognitive states with whole-brain connectivity patterns. Cereb. Cortex 2012, 22:158-165.
48. Sing T., Sander O., Beerenwinkel N., Lengauer T. ROCR: visualizing classifier performance in R. Bioinformatics 2005, 21:3940-3941.
49. Spoormaker V.I., Schroter M.S., Gleiser P.M., Andrade K.C., Dresler M., Wehrle R., Samann P.G., Czisch M. Development of a large-scale functional brain network during human non-rapid eye movement sleep. J. Neurosci. Off. J. Soc. Neurosci. 2010, 30:11379-11387.
50. Spoormaker V.I., Gleiser P.M., Czisch M. Frontoparietal connectivity and hierarchical structure of the brain's functional network during sleep. Front. Neurol. 2012, 3:80.
51. Supekar K., Menon V., Rubin D., Musen M., Greicius M.D. Network analysis of intrinsic functional brain connectivity in Alzheimer's disease. PLoS Comput. Biol. 2008, 4.
52. Tagliazucchi E., Laufs H. Decoding wakefulness levels from typical fMRI resting-state data reveals reliable drifts between wakefulness and sleep. Neuron 2014, 82:695-708.
53. Tagliazucchi E., von Wegner F., Morzelewski A., Borisov S., Jahnke K., Laufs H. Automatic sleep staging using fMRI functional connectivity data. NeuroImage 2012, 63:63-72.
54. Tagliazucchi E., von Wegner F., Morzelewski A., Brodbeck V., Jahnke K., Laufs H. Breakdown of long-range temporal dependence in default mode and attention networks during deep sleep. Proc. Natl. Acad. Sci. U. S. A. 2013, 110:15419-15424.
55. Team R.C. R: A language and environment for statistical computing 2013, R Foundation for Statistical Computing, Vienna, Austria.
56. Tolosi L., Lengauer T. Classification with correlated features: unreliability of feature ranking and solutions. Bioinformatics 2011, 27:1986-1994.
57. Tzourio-Mazoyer N., Landeau B., Papathanassiou D., Crivello F., Etard O., Delcroix N., Mazoyer B., Joliot M. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. NeuroImage 2002, 15:273-289.
58. van den Heuvel M.P., Hulshoff Pol H.E. Exploring the brain network: a review on resting-state fMRI functional connectivity. Eur. Neuropsychopharmacol. 2010, 20:519-534.
59. Van Dijk K.R., Hedden T., Venkataraman A., Evans K.C., Lazar S.W., Buckner R.L. Intrinsic functional connectivity as a tool for human connectomics: theory, properties, and optimization. J. Neurophysiol. 2010, 103:297-321.
60. Van Dijk K.R., Sabuncu M.R., Buckner R.L. The influence of head motion on intrinsic functional connectivity MRI. NeuroImage 2012, 59:431-438.
61. Vanable P.A., Aikens J.E., Tadimeti L., Caruana-Montaldo B., Mendelson W.B. Sleep latency and duration estimates among sleep disorder patients: variability as a function of sleep disorder diagnosis, sleep history, and psychological characteristics. Sleep 2000, 23:71-79.
62. Wehrle R., Kaufmann C., Wetter T.C., Holsboer F., Auer D.P., Pollmacher T., Czisch M. Functional microstates within human REM sleep: first evidence from fMRI of a thalamocortical network specific for phasic REM periods. Eur. J. Neurosci. 2007, 25:863-871.
63. Whitlow C.T., Casanova R., Maldjian J.A. Effect of resting-state functional MR imaging duration on stability of graph theory metrics of brain network connectivity. Radiology 2011, 259:516-524.
64. Zhang D., Snyder A.Z., Fox M.D., Sansbury M.W., Shimony J.S., Raichle M.E. Intrinsic functional relations between human cerebral cortex and thalamus. J. Neurophysiol. 2008, 100:1740-1748.