Automatic Segmentation of MR Brain Images with a Convolutional Neural Network

IEEE Transactions on Medical Imaging

Volumn 35, Issue 5, 2016, Pages 1252-1261

  Moeskops, Pim ^a,b   Viergever, Max A ^a   Mendrik, Adrienne M ^a   De Vries, Linda S ^b   Benders, Manon J N L ^b   Isgum, Ivana ^a  

^a UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^b UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

Author keywords

Adult brain; automatic image segmentation; convolutional neural networks; deep learning; MRI; preterm neonatal brain

Indexed keywords

BRAIN MAPPING; CLASSIFICATION (OF INFORMATION); CONVOLUTION; IMAGE ACQUISITION; MAGNETIC RESONANCE IMAGING; NEURAL NETWORKS; TISSUE; TISSUE ENGINEERING;

ACQUISITION PROTOCOLS; ADULT BRAIN; AUTOMATIC IMAGE SEGMENTATION; AUTOMATIC SEGMENTATIONS; CONVOLUTIONAL NEURAL NETWORK; DEEP LEARNING; MULTI-SCALE INFORMATIONS; MULTIPLE CONVOLUTION;

IMAGE SEGMENTATION;

ADULT; AGED; AGING; ANATOMICAL VARIATION; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATION; BASAL GANGLION; BRAIN CORTEX; BRAIN STEM; CEREBELLUM; CEREBROSPINAL FLUID; CONVOLUTIONAL NEURAL NETWORK; GRAY MATTER; HUMAN; IMAGE PROCESSING; INFANT; KERNEL METHOD; MAJOR CLINICAL STUDY; NEUROANATOMY; NEUROIMAGING; NUCLEAR MAGNETIC RESONANCE IMAGING; NUCLEAR MAGNETIC RESONANCE SCANNER; PREMATURITY; THALAMUS; VOXEL BASED MORPHOMETRY; WHITE MATTER; YOUNG ADULT; BRAIN; DIAGNOSTIC IMAGING; MACHINE LEARNING; NEWBORN; PROCEDURES;

ADULT; AGED; BRAIN; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; INFANT, NEWBORN; INFANT, PREMATURE; MACHINE LEARNING; MAGNETIC RESONANCE IMAGING; NEURAL NETWORKS (COMPUTER); YOUNG ADULT;

EID: 84968626579     PISSN: 02780062     EISSN: 1558254X     Source Type: Journal    
DOI: 10.1109/TMI.2016.2548501     Document Type: Article

References (46)

1. D. H. Salat et al., "Thinning of the cerebral cortex in aging," Cereb Cortex, vol. 14, no. 7, pp. 721-730, 2004.
2. J. Dubois et al., "Primary cortical folding in the human newborn: An early marker of later functional development," Brain, vol. 131, pp. 2028-2041, Aug. 2008.
3. C. E. Rodriguez-Carranza, P. Mukherjee, D. Vigneron, J. Barkovich, and C. Studholme, "A framework for in vivo quantification of regional brain folding in premature neonates," NeuroImage, vol. 41, pp. 462-478, Jun. 2008.
4. M. Thambisetty et al., "Longitudinal changes in cortical thickness associated with normal aging," NeuroImage, vol. 52, no. 4, pp. 1215-1223, 2010.
5. L. J. Hogstrom, L. T. Westlye, K.B. Walhovd,and A. M. Fjell, "The structure of the cerebral cortex across adult life: Age-related patterns of surface area, thickness, and gyrification," Cereb Cortex, vol. 23, no. 11, pp. 2521-2530, 2013.
6. G. Li et al., "Mapping longitudinal development of local cortical gyrification in infants from birth to 2 years of age," J. Neurosci., vol. 34, no. 12, pp. 4228-4238, 2014.
7. A. E. Lyall et al., "Dynamic development of regional cortical thickness and surface area in early childhood," Cereb Cortex, vol. 25, no. 8, pp. 2204-2212, 2014.
8. R. Wright et al., "Automatic quantification of normal cortical folding patterns from fetal brain MRI," NeuroImage, vol. 91, pp. 21-32, 2014.
9. P. Moeskops et al., "Development of cortical morphology evaluated with longitudinal MR brain images of preterm infants," PLOS ONE, vol. 10, no. 7, p. e0131552, 2015.
10. B. Fischl et al., "Whole brain segmentation: Automated labeling of neuroanatomical structures in the human brain," Neuron, vol. 33, no. 3, pp. 341-355, 2002.
11. M. Prastawa, J. H. Gilmore, W. Lin, and G. Gerig, "Automatic segmentation of MR images of the developing newborn brain," Med. Image Anal., vol. 9, no. 5, pp. 457-466, 2005.
12. H. Xue et al., "Automatic segmentation and reconstruction of the cortex from neonatal MRI," NeuroImage, vol. 38, no. 3, pp. 461-477, 2007.
13. N. I. Weisenfeld and S. K. Warfield, "Automatic segmentation of newborn brain MRI," NeuroImage, vol. 47, no. 2, pp. 564-572, 2009.
14. P. A. Habas et al., "Atlas-based segmentation of developing tissues in the human brain with quantitative validation in young fetuses," Hum. Brain Mapp., vol. 31, no. 9, pp. 1348-1358, 2010.
15. F. Shi, Y. Fan, S. Tang, J. H. Gilmore, W. Lin, and D. Shen, "Neonatal brain image segmentation in longitudinal MRI studies," NeuroImage, vol. 49, no. 1, pp. 391-400, 2010.
16. M. J. Cardoso et al., "AdaPT: An adaptive preterm segmentation algorithm for neonatal brain MRI," NeuroImage, vol. 65, pp. 97-108, 2013.
17. A. Makropoulos et al., "Automatic whole brain MRI segmentation of the developing neonatal brain," IEEE Trans. Med. Imag., vol. 33, no. 9, pp. 1818-1831, Sep. 2014.
18. L. Wang et al., "LINKS: Learning-based multi-source integration framework for segmentation of infant brain images," NeuroImage, vol. 108, pp. 160-172, 2015.
19. P. Moeskops et al., "Automatic segmentation of MR brain images of preterm infants using supervised classification," NeuroImage, vol. 118, pp. 628-641, 2015.
20. H. A. Vrooman et al., "Multi-spectral brain tissue segmentation using automatically trained k-nearest-neighbor classification," NeuroImage, vol. 37, no. 1, pp. 71-81, 2007.
21. V. Srhoj-Egekher, M. J. Benders, M. A. Viergever, and I. Išgum, "Automatic neonatal brain tissue segmentation with MRI," in Proc. SPIE Med. Imag., 2013, pp. 86693X-86693X.
22. P. Anbeek et al., "Automatic segmentation of eight tissue classes in neonatal brain MRI," PLOS ONE, vol. 8, no. 12, p. e81895, 2013.
23. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
24. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Adv. Neural Inf. Process. Syst., 2012, pp. 1097-1105.
25. A. Prasoon et al., "Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network," in Proc. MICCAI, 2013, pp. 246-253.
26. H. R. Roth et al., "A new 2.5 D representation for lymph node detection using random sets of deep convolutional neural network observations," in Proc. MICCAI, 2014, pp. 520-527.
27. M. Veta et al., "Assessment of algorithms for mitosis detection in breast cancer histopathology images," Med. Image Anal., vol. 20, no. 1, pp. 237-248, 2015.
28. H. R. Roth, A. Farag, L. Lu, E. B. Turkbey, and R. M. Summers, "Deep convolutional networks for pancreas segmentation in CT imaging," in SPIE Med. Imag., 2015, pp. 94131G-94131G.
29. H. R. Roth et al., "DeepOrgan: Multi-level deep convolutional networks for automated pancreas segmentation," in Proc. MICCAI, 2015, pp. 556-564.
30. Y. Bar, I. Diamant, L. Wolf, and H. Greenspan, "Deep learning with non-medical training used for chest pathology identification," in Proc. SPIE Med. Imag., 2015, pp. 94140V-94140V.
31. A. de Brébisson and G. Montana, "Deep neural networks for anatomical brain segmentation," in CVPR Bioimage Comput. Workshop, 2015.
32. W. Zhang et al., "Deep convolutional neural networks for multi-modality isointense infant brain image segmentation," NeuroImage, vol. 108, pp. 214-224, 2015.
33. F. Ciompi et al., "Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box," Med. Image Anal., vol. 26, no. 1, pp. 195-202, 2015.
34. J. M. Wolterink, T. Leiner, M. A. Viergever, and I. Išgum, "Automatic coronary calcium scoring in cardiac CT angiography using convolutional neural networks," in Proc. MICCAI, 2015, pp. 589-596.
35. I. Išgum et al., "Evaluation of automatic neonatal brain segmentation algorithms: The NeoBrainS12 challenge," Med. Image Anal., vol. 20, no. 1, pp. 135-151, 2015.
36. A. M. Mendrik et al., "MRBrainS challenge: Online evaluation framework for brain image segmentation in 3T MRI scans," Comput. Intell. Neurosci., 2015.
37. P. Sermanet and Y. LeCun, "Traffic sign recognition with multi-scale convolutional networks," in Proc. Int. Joint Conf. Neural Netw.,2011, pp. 2809-2813.
38. J. Li, C. Niu, and M. Fan, "Multi-scale convolutional neural networks for natural scene license plate detection," in Adv. Neural Netw., 2012, pp. 110-119.
39. V. Nair and G. E. Hinton, "Rectified linear units improve restricted Boltzmann machines," in Proc. 27th Int. Conf. Mach. Learn., 2010, pp. 807-814.
40. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting," J. Mach. Learn. Res., vol. 15, no. 1, pp. 1929-1958, 2014.
41. T. Tieleman and G. Hinton, "Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude," in COURSERA: Neural Netw. Mach. Learn., 2012, vol. 4.
42. L. Gui et al., "Morphology-driven automatic segmentation of MR images of the neonatal brain," Med. Image Anal., vol. 16, no. 8, pp. 1565-1579, 2012.
43. D. S. Marcus et al., "Open access series of imaging studies (OASIS): Cross-sectional MRI data in young, middle aged, nondemented, and demented older adults," J. Cognitive Neurosci., vol. 19, no. 9, pp. 1498-1507, 2007.
44. B. A. Landman et al., MICCAI 2012 Workshop on Multi-Atlas Labeling. : CreateSpace Independent Publishing Platform, 2012.
45. B. Likar, M. A. Viergever, and F. Pernus, "Retrospective correction of MR intensity inhomogeneity by entropy minimization," IEEE Trans. Med. Imag., vol. 20, pp. 1398-1410, 2001.
46. S. M. Smith, "Fast robust automated brain extraction," Hum. Brain Mapp., vol. 17, no. 3, pp. 143-155, 2002.