Reliability and validity of MRI-based automated volumetry software relative to auto-assisted manual measurement of subcortical structures in HIV-infected patients from a multisite study

NeuroImage

Volumn 51, Issue 4, 2010, Pages 1334-1344

  Dewey, Jeffrey ^a   Hana, George ^b   Russell, Troy ^a   Price, Jared ^a   McCaffrey, Daniel ^a   Harezlak, Jaroslaw ^b   Sem, Ekta ^a   Anyanwu, Joy C ^a   Guttmann, Charles R ^a   Navia, Bradford ^c   Cohen, Ronald ^d   Tate, David F ^a,e  

^a BRIGHAM AND WOMEN S HOSPITAL   (United States)

^b INDIANA UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c TUFTS MEDICAL CENTER   (United States)

^d BROWN UNIVERSITY   (United States)

^e BOSTON UNIVERSITY MEDICAL CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ADULT; AMYGDALOID NUCLEUS; ARTICLE; AUTOMATION; BRAIN REGION; CAUDATE NUCLEUS; COMPUTER PREDICTION; COMPUTER PROGRAM; CONTROLLED STUDY; DISEASE COURSE; FEMALE; HIPPOCAMPUS; HUMAN; HUMAN IMMUNODEFICIENCY VIRUS INFECTED PATIENT; IMAGE ANALYSIS; MAJOR CLINICAL STUDY; MALE; NUCLEAR MAGNETIC RESONANCE IMAGING; PRIORITY JOURNAL; PUTAMEN; RELIABILITY; VALIDITY; VOLUMETRY;

ADULT; ALGORITHMS; AUTOMATIC DATA PROCESSING; BRAIN; COHORT STUDIES; DATA INTERPRETATION, STATISTICAL; DISEASE PROGRESSION; FEMALE; HIV INFECTIONS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; REPRODUCIBILITY OF RESULTS; SOFTWARE;

EID: 77952885506     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2010.03.033     Document Type: Article

References (64)

1. Alemán-Gómez Y., Melie-García L., Valdés-Hernandez P. IBASPM: toolbox for automatic parcellation of brain structures. Presented at the 12th Annual Meeting of the Organization for Human Brain Mapping, June 11-15, 2006, Florence, Italy 2006, Vol. 27, No.1. Available on CD-Rom in NeuroImage.
2. Andersen A.H., Zhang Z., Avison M.J., Gash D.M. Automated segmentation of multispectral brain MR images. J Neurosci Methods 2002, 122:13-23.
3. Archibald S.L., Masliah E., Fennema-Notestine C., Marcotte T.D., Ellis R.J., McCutchan J.A., Heaton R.K., Grant I., Mallory M., Miller A., Jernigan T.L. Correlation of in vivo neuroimaging abnormalities with postmortem human immunodeficiency virus encephalitis and dendritic loss. Arch Neurol 2004, 61:369-376.
4. Ashburner J., Friston K. Multimodal image coregistration and partitioning-a unified framework. Neuroimage 1997, 6:209-217.
5. Ashburner J., Friston K.J. Unified segmentation. Neuroimage 2005, 26:839-851.
6. Ashburner J., Andersson J.L., Friston K.J. High-dimensional image registration using symmetric priors. Neuroimage 1999, 9:619-628.
7. Beutner K.R., Prasad G., Fletcher E., DeCarli C., Carmichael O.T. Estimating uncertainty in brain region delineations. Information Processing in Medical Imaging. In Lecture Notes in Computer Science 2009, 5636:479-490.
8. Brickman A.M., Schupf N., Manly J.J., Luchsinger J.A., Andrews H., Tang M.X., Reitz C., Small S.A., Mayeux R., DeCarli C., Brown T.R. Brain morphology in older African Americans, Caribbean Hispanics, and whites from northern Manhattan. Archives of Neurology 2008, 65:1053-1061.
9. Carmichael O.T., Aizenstein H.A., Davis S.W., Becker J.T., Thompson P.M., Meltzer C.C., Liu Y. Atlas-Based hippocampus segmentation in Alzheimer's disease and mild cognitive impairment. Neuroimage 2005, 27:979-990.
10. Carmichael O.T., Kuller L.H., Lopez O.L., Thompson P.M., Dutton R.A., Lu A., Lee S.E., Lee J.Y., Aizenstein H.J., Meltzer C.C., Liu Y., Toga A.W., Becker J.T. Cerebral ventricular changes associated with transitions between normal cognitive function, mild cognitive impairment, and dementia. Alzheimer Disease and Associated Disorders 2007, 21:14-24.
11. Cherbuin N., Anstey K.J., Réglade-Meslin C., Sachdev P.S., Greenlee M.W. In vivo hippocampal measurement and memory: a comparison of manual tracing and automated segmentation in a large community-based sample. PLoS ONE 2009, 4:e5265.
12. Csapo I., Price J., Russell T., Dewey J., Sem E., McCaffrey D., Guttman C.R., Navia B., Tate D.F. Effect of patient population specific atlases on automatic segmentation of subcortical structures in freesurfer [Abstract]. Proceedings of the International Society for Magnetic Resonance in Medicine, 17Th Meeting and Scientific Exhibition 2009.
13. Csernansky J.G., Joshi S., Wang L., Haller J.W., Gado M., Miller J.P., Grenander U., Miller M.I. Hippocampal morphometry in schizophrenia by high dimensional brain mapping. Proc Natl Acad Sci USA 1998, 95:11406-11411.
14. Elderkin-Thompson V., Ballmaier M., Hellemann G., Pham D., Kumar A. Executive function and MRI prefrontal volumes among healthy older adults. Neuropsychology 2008, 22:626-637.
15. Fischl B., Salat D.H., Busa E., Albert M., Dieterich M., Haselgrove C., van der Kouwe A., Killiany R., Kennedy D., Klaveness S., Montillo A., Makris N., Rosen B., Dale A.M. Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron 2002, 33:341-355.
16. FreeSurfer - Availabile at Accessed 9/15/2008. http://surfer.nmr.mgh.harvard.edu/.
17. FreeSurfer Wiki - Available at Accessed 10/05/2008. http://surfer.nmr.mgh.harvard.edu/fswiki.
18. González-Scarano F., Martín-García J. The neuropathogenesis of AIDS. Nat Rev Immunol 2005, 5:69-81.
19. Hall M., Whaley R., Robertson K., Hamby S., Wilkins J., Hall C. The correlation between neuropsychological and neuroanatomic changes over time in asymptomatic and symptomatic HIV-1-infected individuals. Neurology 1996, 46:1697-1702.
20. Han X., Fischl B. Atlas renormalization for improved brain MR image segmentation across scanner platforms. IEEE Trans Med Imaging 2007, 26:479-486.
21. Heckemann R.A., Hajnal J.V., Aljabar P., Rueckert D., Hammers A. Automatic anatomical brain MRI segmentation combining label propagation and decision fusion. Neuroimage 2006, 33:115-126.
22. Hickie I., Naismith S., Ward P.B., Turner K., Scott E., Mitchell P., Wilhelm K., Gordon P. Reduced hippocampal volumes and memory loss in patients with early- and late-onset depression. Br J Psychiatry 2005, 186:197-202.
23. IBASPM: Individual Brain Atlases using Statistical Parametric Mapping - Available at Accessed 11/06/2008. http://www.thomaskoenig.ch/Lester/ibaspm.htm.
24. Iosifescu D.V., Shenton M.E., Warfield S.K., Kikinis R., Dengler J., Jolesz F.A., McCarley R.W. An automated registration algorithm for measuring MRI subcortical brain structures. Neuroimage 1997, 6:13-25.
25. Jack C.R., Bentley M.D., Twomey C.K., Zinsmeister A.R. MR imaging-based volume measurements of the hippocampal formation and anterior temporal lobe: validation studies. Radiology 1990, 176:205-209.
26. Jack C.R., Theodore W.H., Cook M., McCarthy G. MRI-based hippocampal volumetrics: data acquisition, normal ranges, and optimal protocol. Magnetic Resonance Imaging 1995, 13:1057.
27. Jongen C., Biessels G.J. Structural brain imaging in diabetes: a methodological perspective. European Journal of Pharmacology 2008, 585:208-218.
28. Jovicich J., Czanner S., Han X., Salat D., van der Kouwe A., Quinn B., Pacheco J., Albert M., Killiany R., Blacker D., Maguire P., Rosas D., Makris N., Gollub R., Dale A., Dickerson B.C., Fischl B. MRI-derived measurements of human subcortical, ventricular and intracranial brain volumes: reliability effects of scan sessions, acquisition sequences, data analyses, scanner upgrade, scanner vendors and field strengths. Neuroimage 2009, 46:177-192.
29. Klauschen F., Goldman A., Barra V., Meyer-Lindenberg A., Lundervold A. Evaluation of automated brain MR image segmentation and volumetry methods. Hum Brain Mapp 2009, 30:1310-1327.
30. Konarski J.Z., McIntyre R.S., Kennedy S.H., Rafi-Tari S., Soczynska J.K., Ketter T.A. Volumetric neuroimaging investigations in mood disorders: bipolar disorder versus major depressive disorder. Bipolar Disorders 2008, 10:1-37.
31. Liu T., Chu W.C., Young G., Li K., Yeung B.H., Guo L., Man G.C., Lam W.M., Wong S.T., Cheng J.C. MR analysis of regional brain volume in adolescent idiopathic scoliosis: neurological manifestation of a systemic disease. J Magnetic Resonance Im 2008, 27:732-736.
32. Morey R.A., Petty C.M., Xu Y., Hayes J.P., Wagner H.R., Lewis D.V., LaBar K.S., Styner M., McCarthy G. A comparison of automated segmentation and manual tracing for quantifying hippocampal and amygdala volumes. Neuroimage 2009, 45:855-866.
33. Mori S., Oishi K., Jiang H., Jiang L., Li X., Akhter K., Hua K., Faria A.V., Mahmood A., Woods R., Toga A.W., Pike G.B., Neto P.R., Evans A., Zhang J., Huang H., Miller M.I., van Zijl P., Mazziotta J. Stereotaxic white matter atlas based on diffusion tensor imaging in an ICBM template. Neuroimage 2008, 40:570-582.
34. Pantel J., O'Leary D.S., Cretsinger K., Bockholt H.J., Keefe H., Magnotta V.A., Andreasen N.C. A new method for the in vivo volumetric measurement of the human hippocampus with high neuroanatomical accuracy. Hippocampus 2000, 10:752-758.
35. Paul R., Cohen R., Navia B., Tashima K. Relationships between cognition and structural neuroimaging findings in adults with human immunodeficiency virus type-1. Neurosci Biobehav Rev 2002, 26:353-359.
36. Perantie D.C., Wu J., Koller J.M., Lim A., Warren S.L., Black K.J., Sadler M., White N.H., Hershey T. Regional brain volume differences associated with hyperglycemia and severe hypoglycemia in youth with type 1 diabetes. Diabetes Care 2007, 30:2331-2337.
37. Powell S., Magnotta V.A., Johnson H., Jammalamadaka V.K., Pierson R., Andreasen N.C. Registration and machine learning-based automated segmentation of subcortical and cerebellar brain structures. Neuroimage 2008, 39:238-247.
38. Pulsipher D.T., Seidenberg M., Morton J.J., Geary E., Parrish J., Hermann B. MRI volume loss of subcortical structures in unilateral temporal lobe epilepsy. Epilepsy Behav 2007, 11:442-449.
39. Ragin A.B., Wu Y., Storey P., Cohen B.A., Edelman R.R., Epstein L.G. Diffusion tensor imaging of subcortical brain injury in patients infected with human immunodeficiency virus. J Neurovirol 2005, 11:292-298.
40. Robertson K.R., Smurzynski M., Parsons T.D., Wu K., Bosch R.J., Wu J., McArthur J.C., Collier A.C., Evans S.R., Ellis R.J. The prevalence and incidence of neurocognitive impairment in the HAART era. AIDS 2007, 21:1915-1921.
41. Shattuck D.W., Mirza M., Adisetiyo V., Hojatkashani C., Salamon G., Narr K.L., Poldrack R.A., Bilder R.M., Toga A.W. Construction of a 3D probabilistic atlas of human cortical structures. Neuroimage 2008, 39:1064-1080.
42. Shen L., Firpi H.A., Saykin A.J., West J.D. Parametric surface modeling and registration for comparison of manual and automated segmentation of the hippocampus. Hippocampus 2009, 19:588-595.
43. Sporer B., Linke R., Seelos K., Paul R., Klopstock T., Pfister H.W. HIV-induced chorea: evidence for basal ganglia dysregulation by SPECT. J Neurol 2005, 252:356-358.
44. Stout J.C., Ellis R.J., Jernigan T.L., Archibald S.L., Abramson I., Wolfson T., McCutchan J.A., Wallace M.R., Atkinson J.H., Grant I. Progressive cerebral volume loss in human immunodeficiency virus infection: a longitudinal volumetric magnetic resonance imaging study. HIV Neurobehavioral Research Center Group. Arch Neurol 1998, 55:161-168.
45. Styner M., Lieberman J.A., Pantazis D., Gerig G. Boundary and medial shape analysis of the hippocampus in schizophrenia. Medical Image Analysis 2004, 8:197-203.
46. Tae W.S., Kim S.S., Lee K.U., Nam E.-C., Kim K.W. Validation of hippocampal volumes measured using a manual method and two automated methods (FreeSurfer and IBASPM) in chronic major depressive disorder. Neuroradiology 2008, 50:569-581.
47. Tae W.S., Kim S.S., Lee K.U., Nam E.C., Kim K.W. Validation of hippocampal volumes measured with one manual and two automated methods using FreeSurfer and IBASPM in chronic major depressive disorder. Neuroradiology 2009, 51:203-204.
48. Teipel S.J., Meindl T., Grinberg L., Heinsen H., Hampel H. Novel MRI techniques in the assessment of dementia. Eur J Nuc Med Mol Im 2008, 35(Suppl 1):S58-869.
49. Thompson P.M., Mega M.S., Woods R.P., Zoumalan C.I., Lindshield C.J., Blanton R.E., Moussai J., Holmes C.J., Cummings J.L., Toga A.W. Cortical change in Alzheimer's disease detected with a disease-specific population-based brain atlas. Cereb Cortex 2001, 11:1-16.
50. Thompson P.M., Dutton R.A., Hayashi K.M., Toga A.W., Lopez O.L., Aizenstein H.J., Becker J.T. Thinning of the cerebral cortex visualized in HIV/AIDS reflects CD4+ T lymphocyte decline. Proc Natl Acad Sci USA 2005, 102:15647-15652.
51. Thompson P.M., Dutton R.A., Hayashi K.M., Lu A., Lee S.E., Lee J.Y., Lopez O.L., Aizenstein H.J., Toga A.W., Becker J.T. 3D mapping of ventricular and corpus callosum abnormalities in HIV/AIDS. Neuroimage 2006, 31:12-23.
52. Tiehuis A.M., van der Graaf Y., Visseren F.L., Vincken K.L., Biessels G.J., Appelman A.P., Kappelle L.J., Mali W.P. Diabetes increases atrophy and vascular lesions on brain MRI in patients with symptomatic arterial disease. Stroke 2008, 39:1600-1613.
53. Tzourio-Mazoyer N., Landeau B., Papathanassiou D., Crivello F., Etard O., Delcroix N., Mazoyer B., Joliot M. Automated anatomical labeling of activations in IBASPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 2002, 15:273-289.
54. Udupa J.K., Leblanc V.R., Zhuge Y., Imielinska C., Schmidt H., Currie L.M., Hirsch B.E., Woodburn J. A framework for evaluating image segmentation algorithms. Comput Med Imaging Graph 2006, 30:75-87.
55. Van Leemput K.V., Maes F., Vandermeulen D., Suetens P. Automated model-based tissue classification of MR images of the brain. IEEE Trans Med Imaging 1999, 18:897-908.
56. Walhovd K.B., Fjell A.M., Reinvang I., Lundervold A., Dale A.M., Eilertsen D.E., Quinn B.T., Salat D., Makris N., Fischl B. Effects of age on volumes of cortex, white matter and subcortical structures. Neurobiol Aging 2005, 26:1261-1270. discussion 1275-1268.
57. Warfield S.K., Zou K.H., Wells W.M. Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. IEEE Transactions on Medical Imaging 2004, 23:903-921.
58. Wessels A.M., Rombouts S.A., Remijnse P.L., Boom Y., Scheltens P., Barkhof F., Heine R.J., Snoek F.J. Cognitive performance in type 1 diabetes patients is associated with cerebral white matter volume. Diabetologia 2007, 50:1763-1769.
59. Westmoreland, P., Cretsinger, K. (a) Caudate Tracing Guidelines - Available at Accessed 9/15/2008. http://www.psychiatry.uiowa.edu/mhcrc/pdf/papers/caudate.pdf.
60. Westmoreland, P., Cretsinger, K. (b) Putamen Tracing Guidelines - Available at Accessed 9/15/2008. http://www.psychiatry.uiowa.edu/mhcrc/pdf/papers/putamen.pdf.
61. Wu M., Carmichael O., Lopez-Garcia P., Carter C.S., Aizenstein H.J. Quantitative comparison of AIR, IBASPM, and the fully deformable model for atlas-based segmentation of functional and structural MR images. Hum Brain Mapp 2006, 27:747-754.
62. Yeo B.T.T., Sabuncu M.R., Desikan R., Fischl B., Golland P. Effects of registration regularization and atlas sharpness on segmentation accuracy. Med Image Anal 2008, 12:603-615.
63. Zaidi H., Ruest T., Schoenahl F., Montandon M.L. Comparative assessment of statistical brain MR image segmentation algorithms and their impact on partial volume correction in PET. Neuroimage 2006, 32:1591-1607.
64. Zhang Y.J. A survey on evaluation methods for image segmentation. Pattern Recognition 1996, 29:1335-1346.