Large-scale evaluation of ANTs and FreeSurfer cortical thickness measurements

NeuroImage

Volumn 99, Issue , 2014, Pages 166-179

  Tustison, Nicholas J ^a   Cook, Philip A ^b   Klein, Arno ^c   Song, Gang ^b   Das, Sandhitsu R ^b   Duda, Jeffrey T ^b   Kandel, Benjamin M ^b   van Strien, Niels ^c,d   Stone, James R ^a   Gee, James C ^b   Avants, Brian B ^b  

^a UNIVERSITY OF VIRGINIA   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

^c SAGE BIONETWORKS   (United States)

^d NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

Author keywords

Advanced Normalization Tools; Age prediction; Gender prediction; MRI; Open science; Scientific reproducibility

Indexed keywords

ACCURACY; ADVANCED NORMALIZATION TOOL SOFTWARE; AGE DETERMINATION; ARTICLE; AUTOMATION; COMPARATIVE EFFECTIVENESS; CONTROLLED STUDY; CORTICAL THICKNESS (BRAIN); DATA ANALYSIS SOFTWARE; EVALUATION STUDY; FEMALE; FREESURFER SOFTWARE; HUMAN; HUMAN TISSUE; IMAGE PROCESSING; MALE; MEASUREMENT REPEATABILITY; NEUROIMAGING; PREDICTION; PREDICTIVE VALIDITY; PRIORITY JOURNAL; SEX DETERMINATION; ADOLESCENT; ADULT; AGED; AGING; ALGORITHM; ANATOMY AND HISTOLOGY; BRAIN CORTEX; CHILD; COMPARATIVE STUDY; COMPUTER PROGRAM; FACTUAL DATABASE; GROWTH, DEVELOPMENT AND AGING; MIDDLE AGED; NUCLEAR MAGNETIC RESONANCE IMAGING; PHYSIOLOGY; PRESCHOOL CHILD; PROCEDURES; REPRODUCIBILITY; SEXUAL DEVELOPMENT; VERY ELDERLY; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; AGED, 80 AND OVER; AGING; ALGORITHMS; CEREBRAL CORTEX; CHILD; CHILD, PRESCHOOL; DATABASES, FACTUAL; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; REPRODUCIBILITY OF RESULTS; SEX CHARACTERISTICS; SOFTWARE; YOUNG ADULT;

EID: 84903515315     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2014.05.044     Document Type: Article

References (72)

1. Ashburner J., Friston K.J. Unified segmentation. Neuroimage 2005, 26(3):839-851. (Jul). 10.1016/j.neuroimage.2005.02.018.
2. Avants B.B., Klein A., Tustison N.J., Woo J., Gee J.C. Evaluation of an open-access, automated brain extraction method on multi-site multi-disorder data. Hum. Brain Mapp. 2010.
3. Avants B.B., Yushkevich P., Pluta J., Minkoff D., Korczykowski M., Detre J., Gee J.C. The optimal template effect in hippocampus studies of diseased populations. Neuroimage 2010, 49(3):2457-2466. (Feb). 10.1016/j.neuroimage.2009.09.062.
4. Avants B.B., Tustison N.J., Song G., Cook P.A., Klein A., Gee J.C. A reproducible evaluation of ANTs similarity metric performance in brain image registration. Neuroimage 2011, 54(3):2033-2044. (Feb). 10.1016/j.neuroimage.2010.09.025.
5. Avants B.B., Tustison N.J., Wu J., Cook P.A., Gee J.C. An open source multivariate framework for n-tissue segmentation with evaluation on public data. Neuroinformatics 2011, 9(4):381-400. (Dec). 10.1007/s12021-011-9109-y.
6. Bouix S., Martin-Fernandez M., Ungar L., Nakamura M., Koo M.S., McCarley R.W., Shenton M.E. On evaluating brain tissue classifiers without a ground truth. Neuroimage 2007, 36(4):1207-1224. (Jul). 10.1016/j.neuroimage.2007.04.031.
7. Boyes R.G., Gunter J.L., Frost C., Janke A.L., Yeatman T., Hill D.L.G., Bernstein M.A., Thompson P.M., Weiner M.W., Schuff N., Alexander G.E., Killiany R.J., DeCarli C., Jack C.R., Fox N.C., ADNI Study Intensity non-uniformity correction using N3 on 3-T scanners with multichannel phased array coils. Neuroimage 2008, 39(4):1752-1762. (Feb). 10.1016/j.neuroimage.2007.10.026.
8. Breiman L. Random forests. Machine Learning 2001, 5-32.
9. Chung M.K., Robbins S.M., Dalton K.M., Davidson R.J., Alexander A.L., Evans A.C. Cortical thickness analysis in autism with heat kernel smoothing. Neuroimage 2005, 25(4):1256-1265. (May). 10.1016/j.neuroimage.2004.12.052.
10. Clarkson M.J., Cardoso M.J., Ridgway G.R., Modat M., Leung K.K., Rohrer J.D., Fox N.C., Ourselin S. A comparison of voxel and surface based cortical thickness estimation methods. Neuroimage 2011, 57(3):856-865. (Aug). 10.1016/j.neuroimage.2011.05.053.
11. Collins D.L., Neelin P., Peters T.M., Evans A.C. Automatic 3D intersubject registration of MR volumetric data in standardized Talairach space. J. Comput. Assist. Tomogr. 1994, 18(2):192-205.
12. Dale A.M., Fischl B., Sereno M.I. Cortical surface-based analysis. I. Segmentation and surface reconstruction. Neuroimage 1999, 9(2):179-194. (Feb). 10.1006/nimg.1998.0395.
13. Das S.R., Avants B.B., Grossman M., Gee J.C. Registration based cortical thickness measurement. Neuroimage 2009, 45(3):867-879. (Apr). 10.1016/j.neuroimage.2008.12.016.
14. Davatzikos C., Bryan N. Using a deformable surface model to obtain a shape representation of the cortex. IEEE Trans. Med. Imaging 1996, 15(6):785-795. 10.1109/42.544496.
15. Desikan R.S., Ségonne F., Fischl B., Quinn B.T., Dickerson B.C., Blacker D., Buckner R.L., Dale A.M., Maguire R.P., Hyman B.T., Albert M.S., Killiany R.J. An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage 2006, 31(3):968-980. (Jul). 10.1016/j.neuroimage.2006.01.021.
16. Dickerson B.C., Bakkour A., Salat D.H., Feczko E., Pacheco J., Greve D.N., Grodstein F., Wright C.I., Blacker D., Rosas H.D., Sperling R.A., Atri A., Growdon J.H., Hyman B.T., Morris J.C., Fischl B., Buckner R.L. The cortical signature of Alzheimer's disease: regionally specific cortical thinning relates to symptom severity in very mild to mild AD dementia and is detectable in asymptomatic amyloid-positive individuals. Cereb. Cortex 2009, 19(3):497-510. (Mar). 10.1093/cercor/bhn113.
17. Dogdas B., Shattuck D.W., Leahy R.M. Segmentation of skull and scalp in 3-D human MRI using mathematical morphology. Hum. Brain Mapp. 2005, 26(4):273-285. (Dec). 10.1002/hbm.20159.
18. Du A.T., Schuff N., Kramer J.H., Rosen H.J., Gorno-Tempini M.L., Rankin K., Miller B.L., Weiner M.W. Different regional patterns of cortical thinning in Alzheimer's disease and frontotemporal dementia. Brain 2007, 130(Pt 4):1159-1166. (Apr). 10.1093/brain/awm016.
19. Fischl B., Dale A.M. Measuring the thickness of the human cerebral cortex from magnetic resonance images. Proc. Natl. Acad. Sci. U. S. A. 2000, 97(20):11050-11055. (Sep). 10.1073/pnas.200033797.
20. Fischl B., Sereno M.I., Dale A.M. Cortical surface-based analysis. II: Inflation, flattening, and a surface-based coordinate system. Neuroimage 1999, 9(1):195-207. (Jan). 10.1006/nimg.1998.0396.
21. Fischl B., Salat D.H., Busa E., Albert M., Dieterich M., Haselgrove C., van der Kouwe A., Killiany R., Kennedy D., Klaveness S., Montillo A., Makris N., Rosen B., Dale A.M. Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron 2002, 33(2):341-355. (Feb).
22. Fischl B., van der Kouwe A., Destrieux C., Halgren E., Ségonne F., Salat D.H., Busa E., Seidman L.J., Goldstein J., Kennedy D., Caviness V., Makris N., Rosen B., Dale A.M. Automatically parcellating the human cerebral cortex. Cereb. Cortex 2004, 14(3):11-22. (Jan).
23. Franklin T.R., Wang Z., Shin J., Jagannathan K., Suh J.J., Detre J.A., O'Brien C.P., Childress A.R. A VBM study demonstrating 'apparent' effects of a single dose of medication on T1-weighted MRIs. Brain Struct. Funct. 2013, 218(1):97-104.
24. Gernsbacher M.A. Presidential column: the eye of the beholder. Observer 2007, 20(1). (Jan).
25. Gronenschild E.H.B.M., Habets P., Jacobs H.I.L., Mengelers R., Rozendaal N., van Os J., Marcelis M. The effects of FreeSurfer version, workstation type, and Macintosh operating system version on anatomical volume and cortical thickness measurements. PLoS ONE 2012, 7(6):e38234. 10.1371/journal.pone.0038234.
26. Haier R.J., Karama S., Leyba L., Jung R.E. MRI assessment of cortical thickness and functional activity changes in adolescent girls following three months of practice on a visual-spatial task. BMC Res. Notes 2009, 2:174. 10.1186/1756-0500-2-174.
27. Han X., Jovicich J., Salat D., van der Kouwe A., Quinn B., Czanner S., Busa E., Pacheco J., Albert M., Killiany R., Maguire P., Rosas D., Makris N., Dale A., Dickerson B., Fischl B. Reliability of MRI-derived measurements of human cerebral cortical thickness: the effects of field strength, scanner upgrade and manufacturer. Neuroimage 2006, 32(1):180-194. (Aug). 10.1016/j.neuroimage.2006.02.051.
28. Hogstrom L.J., Westlye L.T., Walhovd K.B., Fjell A.M. The structure of the cerebral cortex across adult life: age-related patterns of surface area, thickness, and gyrification. Cereb. Cortex 2013, 23(11):2521-2530. (Nov). 10.1093/cercor/bhs231.
29. Jones S.E., Buchbinder B.R., Aharon I. Three-dimensional mapping of cortical thickness using Laplace's equation. Hum. Brain Mapp. 2000, 11(1):12-32. (Sep).
30. Jovicich J., Marizzoni M., Sala-Llonch R., Bosch B., Bartrés-Faz D., Arnold J., Benninghoff J., Wiltfang J., Roccatagliata L., Nobili F., Hensch T., Tränkner A., Schönknecht P., Leroy M., Lopes R., Bordet R., Chanoine V., Ranjeva J.P., Didic M., Gros-Dagnac H., Payoux P., Zoccatelli G., Alessandrini F., Beltramello A., Bargalló N., Blin O., Frisoni G.B., The PharmaCog Consortium Brain morphometry reproducibility in multi-center 3T MRI studies: a comparison of cross-sectional and longitudinal segmentations. Neuroimage 2013, (May). 10.1016/j.neuroimage.2013.05.007.
31. Jubault T., Gagnon J.F., Karama S., Ptito A., Lafontaine A.L., Evans A.C., Monchi O. Patterns of cortical thickness and surface area in early Parkinson's disease. Neuroimage 2011, 55(2):462-467. (Mar). 10.1016/j.neuroimage.2010.12.043.
32. Kim J.S., Singh V., Lee J.K., Lerch J., Ad-Dab'bagh Y., MacDonald D., Lee J.M., Kim S.I., Evans A.C. Automated 3-D extraction and evaluation of the inner and outer cortical surfaces using a Laplacian map and partial volume effect classification. Neuroimage 2005, 27(1):210-221. (Aug). 10.1016/j.neuroimage.2005.03.036.
33. Klein A., Tourville J. 101 labeled brain images and a consistent human cortical labeling protocol. Front. Neurosci. 2012, 6:171. 10.3389/fnins.2012.00171.
34. Klein A., Ghosh S.S., Avants B., Yeo B.T.T., Fischl B., Ardekani B., Gee J.C., Mann J.J., Parsey R.V. Evaluation of volume-based and surface-based brain image registration methods. Neuroimage 2010, 51(1):214-220. (May). 10.1016/j.neuroimage.2010.01.091.
35. Kovacevic J. From the editor-in-chief. IEEE Trans. Image Process. 2006, 15(12).
36. Kuperberg G.R., Broome M.R., McGuire P.K., David A.S., Eddy M., Ozawa F., Goff D., West W.C., Williams S.C.R., van der Kouwe A.J.W., Salat D.H., Dale A.M., Fischl B. Regionally localized thinning of the cerebral cortex in schizophrenia. Arch. Gen. Psychiatry 2003, 60(9):878-888. (Sep). 10.1001/archpsyc.60.9.878.
37. Landman B.A., Huang A.J., Gifford A., Vikram D.S., Lim I.A.L., Farrell J.A.D., Bogovic J.A., Hua J., Chen M., Jarso S., Smith S.A., Joel S., Mori S., Pekar J.J., Barker P.B., Prince J.L., van Zijl P.C.M. Multi-parametric neuroimaging reproducibility: a 3-T resource study. Neuroimage 2011, 54(4):2854-2866. (Feb). 10.1016/j.neuroimage.2010.11.047.
38. Luders E., Narr K.L., Thompson P.M., Rex D.E., Woods R.P., Deluca H., Jancke L., Toga A.W. Gender effects on cortical thickness and the influence of scaling. Hum. Brain Mapp. 2006, 27(4):314-324. (Apr). 10.1002/hbm.20187.
39. Luders E., Sánchez F.J., Tosun D., Shattuck D.W., Gaser C., Vilain E., Toga A.W. Increased cortical thickness in male-to-female transsexualism. J. Behav. Brain Sci. 2012, 2(3):357-362. (Aug). 10.4236/jbbs.2012.23040.
40. Lüsebrink F., Wollrab A., Speck O. Cortical thickness determination of the human brain using high resolution 3T and 7T MRI data. Neuroimage 2013, 70:122-131. (Apr). 10.1016/j.neuroimage.2012.12.016.
41. MacDonald D., Kabani N., Avis D., Evans A.C. Automated 3-D extraction of inner and outer surfaces of cerebral cortex from MRI. Neuroimage 2000, 12(3):340-356. (Sep). 10.1006/nimg.1999.0534.
42. Magnotta V.A., Andreasen N.C., Schultz S.K., Harris G., Cizadlo T., Heckel D., Nopoulos P., Flaum M. Quantitative in vivo measurement of gyrification in the human brain: changes associated with aging. Cereb. Cortex 1999, 9(2):151-160. (Mar).
43. Mazziotta J.C., Toga A.W., Evans A., Fox P., Lancaster J. A probabilistic atlas of the human brain: theory and rationale for its development. The International Consortium for Brain Mapping (ICBM). Neuroimage 1995, 2(2):89-101. (Jun).
44. Neary D., Snowden J., Mann D. Frontotemporal dementia. Lancet Neurol. 2005, 4(11):771-780. (Nov). 10.1016/S1474-4422(05)70223-4.
45. Otsu N. A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 1979, 9(1):62-66.
46. Price C.C., Wood M.F., Leonard C.M., Towler S., Ward J., Montijo H., Kellison I., Bowers D., Monk T., Newcomer J.C., Schmalfuss I. Entorhinal cortex volume in older adults: reliability and validity considerations for three published measurement protocols. J. Int. Neuropsychol. Soc. 2010, 16(5):846-855. (Sep). 10.1017/S135561771000072X.
47. Raji C.A., Ho A.J., Parikshak N.N., Becker J.T., Lopez O.L., Kuller L.H., Hua X., Leow A.D., Toga A.W., Thompson P.M. Brain structure and obesity. Hum. Brain Mapp. 2010, 31(3):353-364. (Mar). 10.1002/hbm.20870.
48. Reuter M., Schmansky N.J., Rosas H.D., Fischl B. Within-subject template estimation for unbiased longitudinal image analysis. Neuroimage 2012, 61(4):1402-1418. (Jul). 10.1016/j.neuroimage.2012.02.084.
49. Rosas H.D., Liu A.K., Hersch S., Glessner M., Ferrante R.J., Salat D.H., van der Kouwe A., Jenkins B.G., Dale A.M., Fischl B. Regional and progressive thinning of the cortical ribbon in Huntington's disease. Neurology 2002, 58(5):695-701. (Mar).
50. Rosas H.D., Hevelone N.D., Zaleta A.K., Greve D.N., Salat D.H., Fischl B. Regional cortical thinning in preclinical Huntington disease and its relationship to cognition. Neurology 2005, 65(5):745-747. (Sep). 10.1212/01.wnl.0000174432.87383.87.
51. Salgado-Pineda P., Delaveau P., Falcon C., Blin O. Brain T1 intensity changes after levodopa administration in healthy subjects: a voxel-based morphometry study. Br. J. Clin. Pharmacol. 2006, 62(5):546-551.
52. Scott M.L.J., Bromiley P.A., Thacker N.A., Hutchinson C.E., Jackson A. A fast, model-independent method for cerebral cortical thickness estimation using MRI. Med. Image Anal. 2009, 13(2):269-285. (Apr). 10.1016/j.media.2008.10.006.
53. Ségonne F., Dale A.M., Busa E., Glessner M., Salat D., Hahn H.K., Fischl B. A hybrid approach to the skull stripping problem in MRI. Neuroimage 2004, 22(3):1060-1075. (Jul). 10.1016/j.neuroimage.2004.03.032.
54. Shattuck D.W., Sandor-Leahy S.R., Schaper K.A., Rottenberg D.A., Leahy R.M. Magnetic resonance image tissue classification using a partial volume model. Neuroimage 2001, 13(5):856-876. (May). 10.1006/nimg.2000.0730.
55. Shrout P.E., Fleiss J.L. Intraclass correlations: uses in assessing rater reliability. Psychol. Bull. 1979, 86(2):420-428. (Mar).
56. Sled J.G., Zijdenbos A.P., Evans A.C. A nonparametric method for automatic correction of intensity nonuniformity in MRI data. IEEE Trans. Med. Imaging 1998, 17(1):87-97. (Feb). 10.1109/42.668698.
57. Smith S.M. Flexible filter neighbourhood designation. Proc. 13th Int. Conf. on Pattern Recognition 1996, vol. 1:206-212.
58. Smith S.M. Fast robust automated brain extraction. Hum. Brain Mapp. 2002, 17(3):143-155. (Nov). 10.1002/hbm.10062.
59. Smith S.M., Jenkinson M., Woolrich M.W., Beckmann C.F., Behrens T.E.J., Johansen-Berg H., Bannister P.R., De Luca M., Drobnjak I., Flitney D.E., Niazy R.K., Saunders J., Vickers J., Zhang Y., De Stefano N., Brady J.M., Matthews P.M. Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage 2004, 23(Suppl. 1):S208-S219. 10.1016/j.neuroimage.2004.07.051.
60. Talairach J., Tournoux P. Co-planar stereotaxic atlas of the human brain: 3-dimensional proportional system-an approach to cerebral imaging 1988, Thieme Medical Publishers, New York.
61. Tustison N.J., Avants B.B., Cook P.A., Zheng Y., Egan A., Yushkevich P.A., Gee J.C. N4ITK: improved N3 bias correction. IEEE Trans. Med. Imaging 2010, 29(6):1310-1320. (Jun). 10.1109/TMI.2010.2046908.
62. Tustison N.J., Johnson H.J., Rohlfing T., Klein A., Ghosh S.S., Ibanez L., Avants B. Instrumentation bias in the use and evaluation of scientific software: recommendations for reproducible practices in the computational sciences. Front. Neurosci. 2013, 7(162). 10.3389/fnins.2013.00162.
63. Vachet C., Hazlett H.C., Niethammer M., Oguz I., Cates J., Whitaker R., Piven J., Styner M. Group-wise automatic mesh-based analysis of cortical thickness. SPIE Medical Imaging: Image Processing 2011, (February). M. Benoit, D.R.H. Dawant (Eds.).
64. Walhovd K.B., Storsve A.B., Westlye L.T., Drevon C.A., Fjell A.M. Blood markers of fatty acids and vitamin D, cardiovascular measures, body mass index, and physical activity relate to longitudinal cortical thinning in normal aging. Neurobiol. Aging 2013, (Nov). 10.1016/j.neurobiolaging.2013.11.011.
65. Wang H., Suh J.W., Das S.R., Pluta J., Craige C., Yushkevich P.A. Multi-atlas segmentation with join label fusion. IEEE Trans. Pattern Anal. Mach. Intell. 2013.
66. Ward B.D. Intracranial segmentation. Technical Report 1999, Medical College of Wisconsin, (http://afni.nimh.nih.gov/pub/dist/doc/3dIntracranial.pdf).
67. Wei G., Zhang Y., Jiang T., Luo J. Increased cortical thickness in sports experts: a comparison of diving players with the controls. PLoS ONE 2011, 6(2):e17112. 10.1371/journal.pone.0017112.
68. Wilkinson G.N., Rogers C.E. Symbolic description of factorial models for analysis of variance. J. R. Stat. Soc.: Ser. C: Appl. Stat. 1973, 22(3):392-399.
69. Yamasue H., Abe O., Kasai K., Suga M., Iwanami A., Yamada H., Tochigi M., Ohtani T., Rogers M.A., Sasaki T., et al. Human brain structural change related to acute single exposure to sarin. Ann. Neurol. 2007, 61(1):37-46.
70. Yezzi A.J., Prince J.L. An Eulerian PDE approach for computing tissue thickness. IEEE Trans. Med. Imaging 2003, 22(10):1332-1339. (Oct). 10.1109/TMI.2003.817775.
71. Zeng X., Staib L.H., Schultz R.T., Duncan J.S. Segmentation and measurement of the cortex from 3-D MR images using coupled-surfaces propagation. IEEE Trans. Med. Imaging 1999, 18(10):927-937. (Oct). 10.1109/42.811276.
72. Zhang Y., Brady M., Smith S. Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans. Med. Imaging 2001, 20(1):45-57. (Jan). 10.1109/42.906424.