Image segmentation evaluation: A survey of unsupervised methods

Computer Vision and Image Understanding

Volumn 110, Issue 2, 2008, Pages 260-280

  Zhang, Hui ^a   Fritts, Jason E ^b   Goldman, Sally A ^a  

^a WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

^b SAINT LOUIS UNIVERSITY   (United States)

Author keywords

Empirical goodness measure; Image segmentation; Objective evaluation; Unsupervised evaluation

Indexed keywords

ALGORITHMS; COMPUTER VISION; IMAGE ANALYSIS; REAL TIME SYSTEMS;

OBJECTIVE EVALUATION; UNSUPERVISED EVALUATION;

IMAGE SEGMENTATION;

EID: 41949100170     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2007.08.003     Document Type: Article

References (69)

1. Bowyer K.W., and Phillips P.J. Empirical evaluation techniques in computer vision (1998), Wiley-IEEE Computer Society Press
2. Erdem C.E., Sanker B., and Tekalp A.M. Performance measures for video object segmentation and tracking. IEEE Transactions on Image Processing 13 (2004) 937-951
3. E.D. Gelasca, T. Ebrahimi, M. Farias, M. Carli, S. Mitra, Towards perceptually driven segmentation evaluation metrics, in: Proceedings of Conference on Computer Vision and Pattern Recognition Workshop (CVPRW04) vol. 4, 2004.
4. Zhang Y. A survey on evaluation methods for image segmentation. Pattern Recognition 29 8 (1996) 1335-1346
5. Yang L., Albregtsen F., Lonnestad T., and Grottum P. A supervised approach to the evaluation of image segmentation methods. Computer Analysis of Images and Patterns (1995) 759-765
6. S. Chabrier, H. Laurent, B. Emile, C. Rosenburger, P. Marche, A comparative study of supervised evaluation criteria for image segmentation, in: EUSIPCO, 2004, pp. 1143-1146.
7. P. Correia, F. Pereira, Objective evaluation of relative segmentation quality, in: ICIP00, 2000, vol I, pp. 308-311.
8. Graaf C., Koster A., Vincken K., and Viergever M. Validation of the interleaved pyramid for the segmentation of 3d vector images. Pattern Recognition Letters 15 (1994) 467-475
9. R.M. Haralick, Validating image analysis algorithms, in: Keynote Address at SPIE Medical Imaging 2000, February 2000, pp. 2-16.
10. Yasnoff W.A., Mui J.K., and Bacus J.W. Error measure for scene segmentation. Pattern Recognition 9 (1977) 217-231
11. Weszka J., and Rosenfeld A. Threshold evaluation techniques. IEEE Transactions on Systems, Man and Cybernetics 8 8 (1978) 622-629
12. Lee S., Chung S., and Park R. A comparative performance study of several global thresholding techniques for segmentation. Computer Vision, Graphs, and Image Processing 52 (1990) 171-190
13. Lim Y., and Lee S. On the color image segmentation algorithms based on the thresholding and fuzzy c-means techniques. Pattern Recognition 23 (1990) 935-952
14. M. Wollborn, R. Mech, Refined procedure for objective evaluation of video generation algorithms, Doc. ISO/IEC/JTC1/SC29/WG11 M3448, March 1998.
15. Strasters K., and Gerbrands J. Three-dimensional image segmentation using split, merge and group approach. Pattern Recognition Letters 12 (1991) 307-325
16. Pal N., and Bhandari D. Image thresholding: some new techniques. Signal Processing 33 2 (1993) 139-158
17. Zhang Y., and Gerbrands J. Objective and quantitative segmentation evaluation and comparison. Signal Processing 39 (1994) 43-54
18. Correia P., and Pereira F. Objective evaluation of video segmentation quality. IEEE Transactions on Image Processing 12 2 (2003) 186-200
19. M. Van Droogenbroeck, O. Barnich, Design of statistical measures for the assessment of image segmentation schemes, in: Proceedings of International Conference on Computer Analysis of Images and Patterns, 2005(280).
20. F. Ge, S. Wang, T. Liu, Image-segmentation evaluation from the perspective of salient object extraction, in: Proceedings of IEEE Internatioanl Conference on Computer Vision and Pattern Recognition, 2006, vol. I, pp. 1146-1153.
21. Yasnoff W., and Bacus J. Scene segmentation algorithm development using error measures. AOCH 6 (1984) 45-58
22. V. Mezaris, I. Kompatsiaris, M. Strintzis, Still image objective segmentation evaluation using ground truth, in: Proceedings of Fifth COST 276 Workshop on Information and Knowledge Management for Integrated Media Communication, October 2003, pp. 9-14.
23. P. Villegas, X. Marichal, A. Salcedo, Objective evaluation of segmentation masks in video sequences, in: Workshop on Image Analysis for Multimedia Interactive Services, May 2001.
24. J.S. Cardoso, L. Corte-Real, Toward a generic evaluation of image segmentation, in: IEEE Transanctions on Image Processing (14) No. 11, pp. 1773-1782.
25. Unnikrishnan R., Pantofaru C., and Hebert M. A measure for objective evaluation of image segmentation algorithms. Empirical Evaluation Methods in Computer Vision (2005) 34
26. Haralick R.M., and Lee J.S. Context dependent edge detection and evaluation. Pattern Recognition 23 1/2 (1990) 1-19
27. Kanungo T., Jaisimha M., Palmer J., and Haralick R.M. A methodology for quantitative performance evaluation of detection algorithms. IEEE Transactions on Image Processing 4 12 (1995) 1667-1673
28. Bowyer K., Kranenburg C., and Dougherty S. Edge detector evaluation using empirical roc curves. Computer Vision and Image Understanding 84 1 (2001) 77-103
29. Yitzhaky Y., and Peli E. A method for objective edge detection evaluation and detector parameter selection. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 8 (2003) 1027-1033
30. Nguyen T., and Ziou D. Contextual and non-contextual performance evaluation of edge detectors. Pattern Recognition Letters 21 9 (2000) 805-816
31. Fram J., and Deutsch E. On the quantitative evaluation of edge detection schemes and their comparison with human performance. IEEE Transactions on Computers C-24 (1975) 616-628
32. Pratt W. Digital Image Processing (1978), John Wiley and Sons, New York
33. C. Odet, B. Belaroussi, H. Benoit-Cattin, Scalable discrepancy measures for segmentation evaluation, in: Proceedings of the IEEE International Conference on Image Processing, vol. 1, September 2002, pp. 785-788.
34. F.J. Estrada, A.D. Jepson, 'Quantitative evaluation of a novel image segmentation algorithm, in: Proceedings of IEEE Internatioanl Conference on Computer Vision and Pattern Recognition, 2005, vol II, pp. 1132-1139.
35. M. Everingham, H. Muller, B. Thomas, Evaluating image segmentation algorithms using the pareto front, in: Proceedings of the 7th European Conference on Computer Vision, June 2002, pp. 34-48.
36. Correia P., and Pereira F. Stand-alone objective segmentation quality evaluation. JASP 2002 4 (2002) 389-400
37. Otsu N. A threshold selection method from gray-level histograms. IEEE Transactions on Systems, Man and Cybernetics 9 1 (1979) 62-66
38. Levine M.D., and Nazif A.M. Dynamic measurement of computer generated image segmentations. IEEE Transactions on Pattern Analysis and Machine Intelligence 7 2 (1985) 155-164
39. Sahoo P., Soltani S., Wong A., and Chen Y. A survey of thresholding techniques. Computer Vision, Graphics, and Image Processing 41 2 (1988) 233-260
40. Liu J., and Yang Y.-H. Multi-resolution color image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 16 7 (1994) 689-700
41. Borsotti M., Campadelli P., and Schettini R. Quantitative evaluation of color image segmentation results. Pattern Recognition Letters 19 8 (1998) 741-747
42. C. Rosenberger, K. Chehdi, Genetic fusion: application to multicomponents image segmentation, in: Proceedings of ICASSP-4 Istanbul, Turkey, 2000.
43. S. Chabrier, B. Emile, H. Laurent, C. Rosenberger, P. Marche, Unsupervised evaluation of image segmentation appliation to multispectral images, in: Proceedings of the 17th international conference on pattern recognition, 2004.
44. H.-C. Chen, S.-J. Wang, The use of visible color difference in the quantitative evaluation of color image segmentation, in: Proceedings of ICASSP, 2004.
45. H. Zhang, J. Fritts, S. Goldman, An entropy-based objective evaluation method for image segmentation, in: Proceedings of SPIE- Storage and Retrieval Methods and Applications for Multimedia, 2004.
46. Haralick R., and Shapiro L. Survey: image segmentation techniques. Computer Vision, Graphics and Image Processing 29 (1985) 100-132
47. V. Meas-Yedid, S. Tilie, J.-C. Olivo-Marin, Color image segmentation based on markov random field clustering for histological image analysis, in: 16th International Conference on Pattern Recognition, 2002.
48. C.J. Darken, J. Moody, Fast adaptive k-means clustering: some empirical results, in: Proceedings of International Conference on Neural Network, vol. 2, 1990, pp. 233-238.
49. Russ J.C. The Image Processing Handbook (1998), CRC Press-IEEE Press
50. X. Wu, Adaptive split-and-merge segmentation based on piecewise least-square approximation, in: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, 1993, pp. 808-815.
51. Thakur A., and Anand R.S. A local statistics based region growing segmentation method for ultrasound medical images. International Journal of Signal Processing 1 2 (2004)
52. W. Ma, B. Manjunath, Edge-flow: a framework of boundary detection and image segmentation, in: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, 1997.
53. G. Sapiro, Color snakes, in: HP Labs Technical Reports, HPL-95-113, 1995.
54. Martin D., Fowlkes C., and Malik J. Learning to detect natural image boundaries using local brightness, color and texture cues. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 1 (2004)
55. H. Zhang, J. Fritts, S. Goldman, A co-evaluation framework for improving segmentation evaluation, in: Proceedings of SPIE- Defense and Security, Signal Processing, Sensor Fusion, and Target Recognition XIV, 2005.
56. Brodatz P. Textures, a photographic album for artistes and designers (1966), Dover, New York
57. Base of 300 synthetic images, http://www.ensibourges.fr/LVR/SIV/interpretation/evaluation/.
58. Military Graphics Collection, http://www.locked.de/en/index.html.
59. H. Zhang, J. Fritts, S. Goldman, Improved hierarchical segmentation, Washington University CSE Technical Report, 2005.
60. H. Zhang, J. Fritts, S. Goldman, A fast texture feature extraction method in hierarchical image segmentation, in: Proceedings of SPIE-Image and Video Communications and Processing, 2005.
61. D. Martin, C. Fowlkes, D. Tal, J. Malik, A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics, in: Proceedings of 8th International Conference Computer Vision, vol. 2, July 2001, pp. 416-423.
62. Edge Detection and Image Segmentation System, http://www.caip.rutgers.edu/riul/research/code/EDISON.
63. H. Zhang, S. Cholleti, S. Goldman, J. Fritts, Meta-evaluation of image segmentation using machine learning, in: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, 2006.
64. N. Jojic, B.J. Frey, A. Kannan, Epitomic analysis of appearance and shape, in: Proceedings of International Conference on Computer Vision, 2003.
65. Serra J. Image Analysis and Mathematical Morphology (1993), Academic, New York
66. Shin M.C., Goldgof D.B., and Bowyer K.W. Comparison of edge detector performance through use in an object recognition task. Computer Vision and Image Understanding 84 1 (2001)
67. M.C. Shin, D.B. Goldgof, K.W. Bowyer, S. Nikiforou, Comparison of edge detector algorithms using a structure from motion task, in: IEEE Transactions in Systems, Man and Cybernetics, vol. 4, 2001.
68. Cardoso J.S., and Corte-Real L. Toward a generic evaluation of image segmentation. IEEE Transactions on Image Processing 14 11 (2005)
69. Pichel J.C., Singh D.E., and Rivera F.F. Image segmentation based on merging of sub-optimal segmentations. Pattern Recognition Letters 10 (2006)