Performance measure characterization for evaluating neuroimage segmentation algorithms

NeuroImage

Volumn 47, Issue 1, 2009, Pages 122-135

  Chang, Herng Hua ^a   Zhuang, Audrey H ^b   Valentino, Daniel J ^c,d   Chu, Woei Chyn ^a  

^a NATIONAL YANG MING UNIVERSITY   (Taiwan)

^b City of Hope Cancer Center   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d iCRco The Innovative CR Company   (United States)

Author keywords

Accuracy; Conformity; Dice; Evaluation; Jaccard; Precision; Segmentation; Sensibility; Sensitivity; Specificity; Tanimoto

Indexed keywords

ALGORITHM; ARTICLE; CONTROLLED STUDY; NEUROANATOMY; NEUROIMAGING; PERFORMANCE MEASUREMENT SYSTEM; PRIORITY JOURNAL; SCORING SYSTEM; SENSIBILITY; SENSITIVITY AND SPECIFICITY; SIMULATION; STANDARD; STRUCTURE ANALYSIS;

ALGORITHMS; BRAIN; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; SENSITIVITY AND SPECIFICITY;

EID: 67349140939     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2009.03.068     Document Type: Article

References (46)

1. Ali A.A., Dale A.M., Badea A., and Johnson G.A. Automated segmentation of neuroanatomical structures in multispectral MR microscopy of the mouse brain. NeuroImage 27 2 (2005) 425-435
2. Ashburner J., and Friston K.J. Unified segmentation. NeuroImage 26 3 (2005) 839-851
3. Bland J.M., and Altman D.G. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1 8476 (1986) 307-310
4. Caselles V., Catte F., Coll T., and Dibos F. A geometric model for active contours in image processing. Numer. Math. 66 (1993) 1-31
5. Chalana V., and Kim Y. A methodology for evaluation of boundary detection algorithms on medical images. IEEE Trans. Med. Imag. 16 5 (1997) 642-652
6. Chan T.F., and Vese L.A. Active contours without edges. IEEE Trans. Image Process. 10 2 (2001) 266-277
7. Chang, H.-H., 2006. Medical image segmentation using an electrostatic charged fluid model. Ph.D. thesis, UCLA.
8. Cox T.F., and Cox M.A. Multidimensional Scaling. 2nd Edition (2000), Chapman & Hall/CRC, Boca Raton
9. Crum W.R., Camara O., and Hill D.L. Generalized overlap measures for evaluation and validation in medical image analysis. IEEE Trans. Med. Imag. 25 11 (2006) 1451-1461
10. Dawant B.M., Hartmann S.L., Thirion J.-P., Maes F., Vandermeulen D., and Demaerel P. Automatic 3-D segmentation of internal structures of the head in MR images using a combination of similarity and free-form transformations: Part I, methodology and validation on normal subjects. IEEE Trans. Med. Imag. 18 10 (1999) 909-916
11. Dice L.R. Measures of the amount of ecologic association between species. Ecology 26 3 (1945) 297-302
12. Dogdas B., Shattuck D.W., and Leahy R.M. Segmentation of skull and scalp in 3-D human MRI using mathematical morphology. Hum. Brain Mapp. 26 4 (2005) 273-285
13. Donner A., and Zou G. Interval estimation for a difference between intraclass kappa statistics. Biometrics 58 1 (2002) 209-215
14. Duda R.O., and Hart P.E. Pattern Classification and Scene Analysis (1973), Wiley, New York
15. Fenster A., and Chiu B. Evaluation of segmentation algorithms for medical imaging. Conf. Proc. IEEE Eng. Med. Biol. Soc. 7 (2005) 7186-7189
16. Fiez J.A., Damasio H., and Grabowski T.J. Lesion segmentation and manual warping to a reference brain: intra- and interobserver reliability. Hum. Brain Mapp. 9 4 (2000) 192-211
17. Frangi A.F., Niessen W.J., Hoogeveen R.M., van Walsum T., and Viergever M.A. Model-based quantitation of 3-D magnetic resonance angiographic images. IEEE Trans. Med. Imag. 18 10 (1999) 946-956
18. Haralick R.M. Performance characterization in computer vision. CVGIP: Image Understanding 60 2 (1994) 245-249
19. Heinonen T., Dastidar P., Frey H., and Eskola H. Applications of MR image segmentation. Int. J. Bioelectromagn. 01 01 (1999) 35-46
20. Hernandez M., and Frangi A.F. Non-parametric geodesic active regions: method and evaluation for cerebral aneurysms segmentation in 3DRA and CTA. Med. Image Anal. 11 3 (2007) 224-241
21. Huttenlocher D.P., Klanderman G.A., and Rucklidge W.J. Comparing images using the Hausdorff distance. IEEE Trans. Pattern Anal. Mach. Intell. 15 9 (1993) 850-863
22. Jaccard P. The distribution of flora in the alpine zone. New Phytol. 11 2 (1912) 37-50
23. Joshi A.A., Shattuck D.W., Thompson P.M., and Leahy R.M. Surface-constrained volumetric brain registration using harmonic mappings. IEEE Trans. Med. Imag. 26 12 (2007) 1657-1669
24. Kass M., Witkin A., and Terzopoulos D. Snakes: active contour models. Int. J. Comput. Vis. 01 04 (1988) 321-331
25. Kaus M.R., Warfield S.K., Nabavi A., Black P.M., Jolesz F.A., and Kikinis R. Automated segmentation of MR images of brain tumors. Radiology 218 2 (2001) 586-591
26. Kloppel S., Stonnington C.M., Chu C., Draganski B., Scahill R.I., Rohrer J.D., Fox N.C., Jack C.R., Ashburner J., and Frackowiak R.S.J. Automatic classification of MR scans in Alzheimers disease. Brain 131 3 (2008) 681-689
27. Kwan R.K.-S., Evans A.C., and Pike G.B. MRI simulation-based evaluation of image-processing and classification methods. IEEE Trans. Med. Imag. 18 11 (1999) 1085-1097
28. MacDonald D., Kabani N., Avis D., and Evans A.C. Automated 3-D extraction of inner and outer surfaces of cerebral cortex from MRI. NeuroImage 12 3 (2000) 340-356
29. Malladi R., Sethian J.A., and Vemuri B.C. Shape modeling with front propagation: a level set approach. IEEE Trans. Pattern Anal. Mach. Intell. 17 02 (1995) 158-175
30. MGH, 2007. Internet Brain Segmentation Repository (IBSR). http://www.cma.mgh.harvard.edu/ibsr/.
31. Pham D.L., Xu C., and Prince J.L. Current methods in medical image segmentation. Annu. Rev. Biomed. Eng. 02 (2000) 315-337
32. Powell S., Magnotta V.A., Johnson H., Jammalamadaka V.K., Pierson R., and Andreasenb N.C. Registration and machine learning-based automated segmentation of subcortical and cerebellar brain structures. NeuroImage 39 1 (2008) 238-247
33. Shan Z.Y., Yue G.H., and Liu J.Z. Automated histogram-based brain segmentation in T1-weighted three-dimensional magnetic resonance head images. NeuroImage 17 3 (2002) 1587-1598
34. Sharief A.A., Badea A., Dale A.M., and Johnson G.A. Automated segmentation of the actively stained mouse brain using multi-spectral MR microscopy. NeuroImage 39 1 (2008) 136-145
35. Shattuck D.W., Sandor-Leahy S.R., Schaper K.A., Rottenberg D.A., and Leahy R.M. Magnetic resonance image tissue classification using a partial volume model. NeuroImage 13 5 (2001) 856-876
36. Smith S.M. Fast robust automated brain extraction. Hum. Brain Mapp. 17 3 (2002) 143-155
37. Suri J.S., Setarehdan S.K., and Singh S. Advanced algorithmic approaches to medical image segmentation: state-of-the-art applications in cardiology, neurology, mammography and pathology (2002), Springer-Verlag, London
38. Toga A.W., and Mazziotta J.C. Brain Mapping the Methods. 2nd Edition (2002), Academic Press, San Diego
39. Udupa J.K., LeBlanc V.R., Zhuge Y., Imielinska C., Schmidt H., Currie L.M., Hirsch B.E., and Woodburn J. A framework for evaluating image segmentation algorithms. Comput. Med. Imag. Grap. 30 2 (2006) 75-87
40. Vannier M.W., Pilgram T.K., Speidel C.M., Neumann L.R., Rickman D.L., and Schertz L.D. Validation of magnetic resonance imaging (MRI) multispectral tissue classification. Comput. Med. Imag. Grap. 15 4 (1991) 217-223
41. Warfield S.K., Zou K.H., and Wells W.M. Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. IEEE Trans. Med. Imag. 23 7 (2004) 903-921
42. Wu Y., Warfield S.K., Tan I.L., Wells W.M., Meier D.S., van Schijndel R.A., Barkhof F., and Guttmann C.R. Automated segmentation of multiple sclerosis lesion subtypes with multichannel MRI. NeuroImage 32 3 (2006) 1205-1215
43. Zhang Y.J. A survey on evaluation methods for image segmentation. Pattern Recogn. 29 8 (1996) 1335-1346
44. Zhuang A.H., Valentino D.J., and Toga A.W. Skull-stripping magnetic resonance brain images using a model-based level set. NeuroImage 32 1 (2006) 79-92
45. Zijdenbos A.P., Dawant B.M., Margolin R.A., and Palmer A.C. Morphometric analysis of white matter lesions in MR images: method and validation. IEEE Trans. Med. Imag. 13 4 (1994) 716-724
46. Zou K.H., Warfield S.K., Bharatha A., Tempany C.M., Kaus M.R., Haker S.J., Wells W.M., Jolesz F.A., and Kikinis R. Statistical validation of image segmentation quality based on a spatial overlap index. Acad. Radiol. 11 2 (2004) 178-189