Improved assessment of multiple sclerosis lesion segmentation agreement via detection and outline error estimates

BMC Medical Imaging

Volumn 12, Issue , 2012, Pages

  Wack, David S ^a   Dwyer, Michael G ^a   Bergsland, Niels ^a   Di Perri, Carol ^b   Ranza, Laura ^b   Hussein, Sara ^a   Ramasamy, Deepa ^a   Poloni, Guy ^a   Zivadinov, Robert ^a,c  

^a UNIVERSITY AT BUFFALO   (United States)

^b UNIVERSITY OF PAVIA   (Italy)

^c JACOBS NEUROLOGICAL INSTITUTE   (United States)

Author keywords

Detection and outline error estimates; Index; Jaccard Index; Kappa; Lesion; Measure; Metric; MRI; Multiple sclerosis; Operator agreement; Rater agreement; ROI; Similarity index

Indexed keywords

ADOLESCENT; ADULT; AGED; ALGORITHM; ARTICLE; BRAIN; COMPUTER ASSISTED DIAGNOSIS; FEMALE; HUMAN; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; MALE; METHODOLOGY; MIDDLE AGED; MULTIPLE SCLEROSIS; NUCLEAR MAGNETIC RESONANCE IMAGING; OBSERVER VARIATION; PATHOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ADOLESCENT; ADULT; AGED; AGED, 80 AND OVER; ALGORITHMS; BRAIN; FEMALE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; MULTIPLE SCLEROSIS; OBSERVER VARIATION; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE; YOUNG ADULT;

EID: 84865439316     PISSN: None     EISSN: 14712342     Source Type: Journal    
DOI: 10.1186/1471-2342-12-17     Document Type: Article

References (19)

1. Hunttenlocher D, Klanderman G, Ruckelidge W. Comparing images using the Hausdorff distance. IEEE Trans Pattern Anal Mach Intell 1993, 15(9):850-863.
2. Liu C, Frazier P, Kumar L. Comparative assessment of the measures of thematic classification accuracy. Remote Sens Environ 2007, 107(4):606-616.
3. Udupa J, Leblanc V, Schmidt H, Imielinska C, Saha K, Grevera G, Zhuge Y, Molholt P, Currie L, Jin Y. A methodology for evaluating image segmentation algorithms. In SPIE Medical Imaging 2002, 4684:266-277.
4. Udupa J, LeBlanc V, Zhuge Y, Imielinska C, Schmidt H, Currie L, Hirsch B, Woodburn J. A framework for evaluating image segmentation algorithms. Comput Med Imaging Graph 2006, 30(2):75-87. 10.1016/j.compmedimag.2005.12.001, 16584976.
5. Chang HH, Zhuang AH, Valentino DJ, Chu WC. Performance measure characterization for evaluating neuroimage segmentation algorithms. Neuroimage 2009, 47(1):122-135. 10.1016/j.neuroimage.2009.03.068, 19345740.
6. Zijdenbos A, Dawant B, Margolin R, Palmer A. Morphometric analysis of white matter lesions in mr images: methodand validation. IEEE Trans Med Imaging 1994, 13(4):716-724. 10.1109/42.363096, 18218550.
7. Filippi M, Horsfield M, Bressi S, Martinelli V, Baratti C, Reganati P, Campi A, Miller D, Comi G. Intra-and inter-observer agreement of brain MRI lesion volume measurements in multiple sclerosis: a comparison of techniques. Brain 1995, 118(6):1593-1600. 10.1093/brain/118.6.1593, 8595488.
8. Gerig G, Jomier M, Chakos M. Valmet: A new validation tool for assessing and improving 3D object segmentation. Proceedings of the 4th International Conference on Medical Image Computing and Computer-Assisted Intervention: 2001 2001, 516-523. Springer-Verlag London, UK.
9. Warfield S, Zou K, Wells W. Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. IEEE Trans Med Imaging 2004, 23(7):903-921. 10.1109/TMI.2004.828354, 1283110, 15250643.
10. Adams H, Wagner S, Sobel D, Slivka L, Sipe J, Romine J, Beutler E, Koziol J. Hypointense and hyperintense lesions on magnetic resonance imaging in secondary-progressive MS patients. Eur Neurol 1999, 42:52-63. 10.1159/000008069, 10394049.
11. Johnston B, Atkins M, Mackiewich B, Anderson M. Segmentation of multiple sclerosis lesions in intensity correctedmultispectral MRI. IEEE Trans Med Imaging 1996, 15(2):154-169. 10.1109/42.491417, 18215898.
12. Udupa J, Wei L, Samarasekera S, Miki Y, Van Buchem M, Grossman R. Multiple sclerosis lesion quantification using fuzzy-connectednessprinciples. IEEE Trans Med Imaging 1997, 16(5):598-609. 10.1109/42.640750, 9368115.
13. Admiraal-Behloul F, Van Den Heuvel D, Olofsen H, van Osch M, van der Grond J, Van Buchem M, Reiber J. Fully automatic segmentation of white matter hyperintensities in MR images of the elderly. Neuroimage 2005, 28(3):607-617. 10.1016/j.neuroimage.2005.06.061, 16129626.
14. Dyrby T, Rostrup E, Baaré W, van Straaten E, Barkhof F, Vrenken H, Ropele S, Schmidt R, Erkinjuntti T, Wahlund L. Segmentation of age-related white matter changes in a clinical multi-center study. Neuroimage 2008, 41(2):335-345. 10.1016/j.neuroimage.2008.02.024, 18394928.
15. Kurtzke J. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology 1983, 33(11):1444-1452. 10.1212/WNL.33.11.1444, 6685237.
16. Polman C, Reingold S, Edan G, Filippi M, Hartung H, Kappos L, Lublin F, Metz L, McFarland H, O'Connor P. Diagnostic criteria for multiple sclerosis: 2005 revisions to the" McDonald Criteria". Ann Neurol 2005, 58(6):840-846. 10.1002/ana.20703, 16283615.
17. Di Perri C, Dwyer M, Wack D, Cox J, Hashmi K, Saluste E, Hussein S, Schirda C, Stosic M, Durfee J. Signal abnormalities on 1.5 and 3 Tesla brain MRI in multiple sclerosis patients and healthy controls. A morphological and spatial quantitative comparison study. Neuroimage 2009, 47(4):1352-1362. 10.1016/j.neuroimage.2009.04.019, 19371784.
18. Akaike H. A new look at the statistical model identification. IEEE Trans Automatic Control 1974, 19(6):716-723.
19. Anbeek P, Vincken K, van Osch M, Bisschops R, van der Grond J. Probabilistic segmentation of white matter lesions in MR imaging. Neuroimage 2004, 21(3):1037-1044. 10.1016/j.neuroimage.2003.10.012, 15006671.