Separability Criteria for the Evaluation of Boundary Detection Benchmarks

IEEE Transactions on Image Processing

Volumn 25, Issue 3, 2016, Pages 1047-1055

  Lopez Molina, C ^a,b   Bustince, H ^a   De Baets, B ^b  

^a PUBLIC UNIVERSITY OF NAVARRE   (Spain)

^b GHENT UNIVERSITY   (Belgium)

Author keywords

Boundary comparison; boundary image evaluation; edge detection; error measure; segmentation

Indexed keywords

ALGORITHMS; EDGE DETECTION; IMAGE SEGMENTATION;

AUTOMATICALLY GENERATED; BOUNDARY COMPARISON; BOUNDARY DETECTION ALGORITHMS; BOUNDARY DETECTION METHOD; COMPARISON MEASURES; ERROR MEASURES; IMAGE EVALUATION; SEPARABILITY CRITERION;

BENCHMARKING;

EID: 84962710360     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2510284     Document Type: Article

References (38)

1. I. E. Abdou and W. Pratt, "Quantitative design and evaluation of enhancement/thresholding edge detectors, " Proc. IEEE, vol. 67, no. 5, pp. 753-763, May 1979.
2. P. Arbeláez, M. Maire, C. Fowlkes, and J. Malik, "Contour detection and hierarchical image segmentation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 898-916, May 2011.
3. P. A. Arbeláez Escalante, "Une approche métrique pour la segmentation d'images, " Ph. D. dissertation, Univ. Paris-Dauphine, Paris, France, 2005.
4. F. Attneave, "Dimensions of similarity, " Amer. J. Psychol., vol. 63, no. 4, pp. 516-556, 1950.
5. A. J. Baddeley, "An error metric for binary images, " in Robust Computer Vision: Quality of Vision Algorithms, W. Förstner and S. Ruwiedel, Eds. Karlsruhe, Germany: Wichmann Verlag, 1992, pp. 59-78.
6. A. J. Baddeley, "Errors in binary images and an L p version of the Hausdorff metric, " Nieuw Archief Wiskunde, vol. 10, no. 4, pp. 157-183, 1992.
7. J. C. Bezdek, R. A. Chandrasekhar, and Y. Attikouzel, "A geometric approach to edge detection, " IEEE Trans. Fuzzy Syst., vol. 6, no. 1, pp. 52-75, Feb. 1998.
8. K. Bowyer, C. Kranenburg, and S. Dougherty, "Edge detector evaluation using empirical ROC curves, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 1. 1999, pp. 354-359.
9. J. Canny, "A computational approach to edge detection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 6, pp. 679-698, Nov. 1986.
10. J. S. Cardoso and L. Corte-Real, "Toward a generic evaluation of image segmentation, " IEEE Trans. Image Process., vol. 14, no. 11, pp. 1773-1782, Nov. 2005.
11. F. J. Estrada and A. D. Jepson, "Quantitative evaluation of a novel image segmentation algorithm, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. Jun. 2005, pp. 1132-1139.
12. F. J. Estrada and A. D. Jepson, "Benchmarking image segmentation algorithms, " Int. J. Comput. Vis., vol. 85, no. 2, pp. 167-181, 2009.
13. Y. Gao, "Efficiently comparing face images using a modified Hausdorff distance, " IEE Proc.-Vis., Image, Signal Process., vol. 150, no. 6, pp. 346-350, Dec. 2003.
14. A. V. Goldberg and R. Kennedy, "An efficient cost scaling algorithm for the assignment problem, " Math. Program., vol. 71, no. 2, pp. 153-177, 1995.
15. R. M. Haralick, "Digital step edges from zero crossing of second directional derivatives, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 6, no. 1, pp. 58-68, Jan. 1984.
16. R. M. Haralick and J. S. J. Lee, "Context dependent edge detection and evaluation, " Pattern Recognit., vol. 23, nos. 1-2, pp. 1-19, 1990.
17. R. M. Haralick, S. R. Sternberg, and X. Zhuang, "Image analysis using mathematical morphology, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 9, no. 4, pp. 532-550, Jul. 1987.
18. X. Hou, A. Yuille, and C. Koch, "A meta-theory of boundary detection benchmarks, " in Proc. NIPS Workshop Human Comput. Sci. Comput. Sustainability, 2012, pp. 1-4.
19. X. Hou, A. Yuille, and C. Koch, "Boundary detection benchmarking: Beyond F-measures, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 2123-2130.
20. D. P. Huttenlocher, G. A. Klanderman, and W. J. Rucklidge, "Comparing images using the Hausdorff distance, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 9, pp. 850-863, Sep. 1993.
21. L. Kitchen and A. Rosenfeld, "Edge evaluation using local edge coherence, " IEEE Trans. Syst., Man, Cybern., vol. 11, no. 9, pp. 597-605, Sep. 1981.
22. G. Liu and R. M. Haralick, "Assignment problem in edge detection performance evaluation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. 2000, pp. 26-31.
23. G. Liu and R. M. Haralick, "Optimal matching problem in detection and recognition performance evaluation, " Pattern Recognit., vol. 35, no. 10, pp. 2125-2139, 2002.
24. C. Lopez-Molina, B. De Baets, and H. Bustince, "Quantitative error measures for edge detection, " Pattern Recognit., vol. 46, no. 4, pp. 1125-1139, 2013.
25. D. Martin, C. Fowlkes, D. Tal, and J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics, " in Proc. 8th IEEE Int. Conf. Comput. Vis., vol. 2. Jul. 2001, pp. 416-423.
26. D. R. Martin, "An empirical approach to grouping and segmentation, " Ph. D. dissertation, Dept. Elect. Eng. Comput. Sci., Univ. California, Berkeley, CA, USA, 2003.
27. D. R. Martin, C. C. Fowlkes, and J. Malik, "Learning to detect natural image boundaries using local brightness, color, and texture cues, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 5, pp. 530-549, May 2004.
28. W. McIlhagga, "The Canny edge detector revisited, " Int. J. Comput. Vis., vol. 91, no. 3, pp. 251-261, 2011
29. T. Peli and D. Malah, "A study of edge detection algorithms, " Comput. Graph. Image Process., vol. 20, no. 1, pp. 1-21, 1982.
30. J. Pont-Tuset and F. Marques, "Measures and meta-measures for the supervised evaluation of image segmentation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 2131-2138.
31. Kermit Research Unit (Ghent University). The Kermit Image Toolkit (KITT). [Online]. Available: http: //www. kermitimagetoolkit. com
32. M. A. Ruzon and C. Tomasi, "Edge, junction, and corner detection using color distributions, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1281-1295, Nov. 2001.
33. J. Serra, "Introduction to mathematical morphology, " Comput. Vis., Graph., Image Process., vol. 35, no. 3, pp. 283-305, 1986.
34. A. Tversky, "Features of similarity, " Psychol. Rev., vol. 84, no. 4, pp. 327-352, 1977.
35. A. Tversky and I. Gati, "Similarity, separability, and the triangle inequality, " Psychol. Rev., vol. 89, no. 2, pp. 123-154, 1982.
36. R. Unnikrishnan, C. Pantofaru, and M. Hebert, "Toward objective evaluation of image segmentation algorithms, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 929-944, Jun. 2007.
37. S. Venkatesh and P. L. Rosin, "Dynamic threshold determination by local and global edge evaluation, " Graph. Models Image Process., vol. 57, no. 2, pp. 146-160, 1995.
38. Y. Yitzhaky and E. Peli, "A method for objective edge detection evaluation and detector parameter selection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 8, pp. 1027-1033, Aug. 2003.