Evaluation of uterine cervix segmentations using ground truth from multiple experts

Computerized Medical Imaging and Graphics

Volumn 33, Issue 3, 2009, Pages 205-216

  Gordon, Shiri ^a   Lotenberg, Shelly ^a   Long, Rodney ^b   Antani, Sameer ^b   Jeronimo, Jose ^c   Greenspan, Hayit ^a  

^a TEL AVIV UNIVERSITY   (Israel)

^b NATIONAL INSTITUTES OF HEALTH   (United States)

^c NATIONAL CANCER INSTITUTE   (United States)

Author keywords

Cervical cancer; Evaluation of segmentation; Image segmentation; Multi expert ground truth; Segmentation complexity; Uterine cervix images

Indexed keywords

CERVICAL CANCER; EVALUATION OF SEGMENTATION; MULTI-EXPERT GROUND TRUTH; SEGMENTATION COMPLEXITY; UTERINE CERVIX IMAGES;

ALGORITHMS; DIGITAL IMAGE STORAGE;

IMAGE SEGMENTATION;

ARTICLE; AUTOMATION; CERVICOGRAPHY; CLASSIFICATION ALGORITHM; COMPUTER SIMULATION; CONTROLLED STUDY; DIGITAL IMAGING; ENTROPY; GROUND TRUTH SEGMENTATION; IMAGE QUALITY; MATHEMATICAL COMPUTING; MEDICAL PHOTOGRAPHY; NATIONAL HEALTH ORGANIZATION; PRIORITY JOURNAL; RELIABILITY; SIMULTANEOUS TRUTH AND PERFORMANCE LEVEL ESTIMATION;

ALGORITHMS; CERVIX UTERI; DECISION MAKING, COMPUTER-ASSISTED; DIAGNOSTIC IMAGING; FEMALE; FUZZY LOGIC; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; SENSITIVITY AND SPECIFICITY;

EID: 60749091702     PISSN: 08956111     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compmedimag.2008.12.002     Document Type: Article

References (28)

1. Cates JE, Lefohn AE, Whitaker RT. GIST: an interactive, GPU-based level set segmentation tool for 3D medical images. Medical Image Analysis 2004;8(3):217-31.
2. Chalana V., and Kim Y. A methodology for evaluation of boundary detection algorithms on medical images. IEEE Transactions on Medical Imaging 16 5 (1997) 642-652
3. Cuadra M.B., Cammoun L., Butz T., Cuisenaire O., and Thiran J.-P. Comparison and validation of tissue modelization and statistical classification methods in T1-weighted MR brain images. IEEE Transactions on Medical Imaging 24 12 (2005) 1548-1565
4. Dampster A., Laird N., and Rubin D. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B 39 1 (1977) 1-38
5. Fawcett T. ROC Graphs: notes and practical considerations for researchers. Technical Report HPL-2003-4, HP Labs, Palo Alto, CA; 2004.
6. Fenster A., and Chiu B. Evaluation of segmentation algorithms for medical imaging. Proceedings of Engineering in Medicine and Biology Society, IEEE-EMBS 2005 (2005) 7186-7189
7. Gerig G., Jomier M., and Chakos M. Valmet: A new validation tool for assessing and improving 3D object segmentation. Lecture Notes in Computer Science 2208 (2001) 516-528
8. Gordon S., Zimmerman G., Long R., Antani S., Jeronimo J., and Greenspan H. Content analysis of uterine cervix images: initial steps towards content based indexing and retrieval of cervigrams. Proceedings of SPIE Medical Imaging 6144 (2006) 1549-1556
9. Jeronimo J., Castle P.E., Herrero R., Burk R.D., and Schiffman M. HPV testing and visual inspection for cervical cancer screening in resource-poor regions. International Journal of Gynecology and Obstetrics 83 (2003) 311-313
10. Jeronimo J., Long L.R., Neve L., Bopf M., Antani S., and Schiffman M. Digital tools for collecting data from cervigrams for research and training in colposcopy. Journal of Lower Genital Tract Disease 10 1 (2006) 16-25
11. Jeronimo J., Massad L.S., Schiffman M., and for the NIH/ASCCP Research Group. Visual appearance of the uterine cervix: correlation with human papillomavirus detection and type. American Journal of Obstetrics and Gynecology 197 1 (2007) 47.e1-47.e8
12. Jomier J., LeDigarcher V., and Aylward S.R. Comparison of vessel segmentations using staple. Proceedings of MICCAI (2005) 523-530
13. Josh S., Davis B., Homier M., and Gehrig G. Unbiased diffeomorphic atlas construction for computational anatomy. NeuroImage 23 (2004) 151-160
14. Ladak H., Wang Y., Downey D., and Fenster A. Testing and optimization of a semi-automatic prostate boundary segmentation algorithm using virtual operators. Medical Physics 30 7 (2003) 1637-1647
15. Li H., Liu T., Young G., Guo L., and Wong S.T.C. Brain tissue segmentation based on DWI/DTI data. Proceedings of IEEE International Symposium on Biomedical Imaging (ISBI) (2006) 57-60
16. Lotenberg S., Gordon S., Long R., Antani S., Jeronimo J., and Greenspan H. Automatic evaluation of uterine cervix segmentations. Proceedings of SPIE Medical Imaging (2007)
17. Martin-Fernandez M., Bouix S., Ungar L., McCarely R.W., and Shenton M.E. Two methods for validating brain tissue classifiers. Proceedings of MICCAI (2005) 512-522
18. Mattern F., Rohlfing T., and Denzler J. Adaptive performance-based classifier combination for generic object recognition. Proceedings of International Fall Workshop Vision, Modeling and Visualization (VMV) (2005) 139-146
19. Rohlfing T., Russakoff D.B., and Maurer Jr. C.R. Extraction and application of expert priors to combine multiple segmentations of human brain tissue. Proceedings of MICCAI (2003) 578-585
20. Schiffman M., and Adrianza M.E. ACUS-LSIL triage study: design, methods and characteristics of trial participants. Acta Cytologica 44 5 (2000) 726-742
21. Udupa J.K., LeBlanc V.R., Zhuge Y., Imielinska C., Schmidt H., Currie L.M., et al. A framework for evaluating image segmentation algorithms. Comuterized Medical Imaging and Graphics 30 (2006) 75-87
22. van Rijsbergen C.J. Information Retrieval (1979), Butterworths, London
23. Warfield S.K., Zou H.K., and Wells W.M. Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. IEEE Transactions on Medical Imaging 23 7 (2004) 903-921
24. Warfield S.K., Zou H.K., and Wells W.M. Validation of image segmentation by estimating rater bias and variance. Proceedings of MICCAI (2006) 839-847
25. Warfield S, Dengler J, Zaers J, Guttmann C, Wells W, Ettinger G, et al. Automatic identification of gray matter structures from MRI to improve the segmentation of white matter lesions. Journal of Image Guided Surgery 1995;1:326-38.
26. Williams G.W. Comparing the joint agreement of several raters with another rater. Biometrics 32 (1976) 619-627
27. Zimmerman G., Gordon S., and Greenspan H. Automatic landmark detection in uterine cervix images for indexing in a content-retrieval system. Proceedings of IEEE International Symposium on Biomedical Imaging (ISBI) (2006) 1348-1351
28. Zou K.H., wells W.M., Kikinis R., and Warfield S.K. Three validation metrics for automated probabilistic image segmentation of brain tumors. Statistics in Medicine 23 (2004) 1259-1282