Multiscale Combinatorial Grouping for Image Segmentation and Object Proposal Generation

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 39, Issue 1, 2017, Pages 128-140

  Pont Tuset, Jordi ^a   Arbelaez, Pablo ^b   Barron, Jonathan T ^c   Marques, Ferran ^a   Malik, Jitendra ^c  

^a UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

^b UNIVERSIDAD DE LOS ANDES   (Colombia)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Image segmentation; Normalized cuts; object proposals

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER VISION;

EMPIRICAL VALIDATION; GROUPING STRATEGIES; HIGHLY ACCURATE; MULTI-SCALE INFORMATIONS; NOCV1; NORMALIZED CUTS; OBJECT PROPOSALS; STATE OF THE ART; UNIFIED APPROACH;

IMAGE SEGMENTATION;

EID: 85003890183     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2016.2537320     Document Type: Article

References (47)

1. P. Viola, M. Jones, "Robust real-time face detection, " Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, 2004.
2. N. Dalal, B. Triggs, "Histograms of oriented gradients forhuman detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2005, pp. 886-893.
3. P. Felzenszwalb, R. Girshick, D. McAllester, D. Ramanan, "Object detection with discriminatively trained part based models, "IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
4. T. Malisiewicz, A. A. Efros, "Improving spatial support forobjects via multiple segmentations, " in Proc. Brit. Mach. Vis. Conf., 2007, pp. 1-10.
5. C. Gu, J. Lim, P. Arbelaez, J. Malik, "Recognition usingregions, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 1030-1037.
6. J. Carreira, F. Li, C. Sminchisescu, "Object recognition bysequential figure-ground ranking, " Int. J. Comput. Vis., vol. 98, no. 3, pp. 243-262, 2012.
7. A. Ion, J. Carreira, C. Sminchisescu, "Probabilistic joint imagesegmentation, labeling by figure-ground composition, " Int. J. Comput. Vis., vol. 107, no. 1, pp. 40-57, 2014.
8. P. Arbelaez, B. Hariharan, C. Gu, S. Gupta, L. Bourdev, andJ. Malik, "Semantic segmentation using regions, parts, " inProc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3378-3385.
9. J. Carreira, R. Caseiro, J. Batista, C. Sminchisescu, "Semanticsegmentation with second-order pooling, " in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 430-443.
10. R. Girshick, J. Donahue, T. Darrell, J. Malik, "Rich featurehierarchies for accurate object detection, semanticsegmentation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 580-587.
11. N. Zhang, J. Donahue, R. Girshick, T. Darrell, "Part-based RCNNsfor fine-grained category detection, " in Proc. 10th Eur. Conf. Comput. Vis., 2014, pp. 834-849.
12. J. R. R. Uijlings, K. E. A. van de Sande, T. Gevers, A. W. M. Smeulders, "Selective search for object recognition, " Int. J. Comput. Vis., vol. 104, no. 2, pp. 154-171, 2013.
13. P. Krahenbuhl, V. Koltun, "Geodesic object proposals, " inProc. 13th Eur. Conf. Comput. Vis., 2014, pp. 725-739.
14. P. Rantalankila, J. Kannala, E. Rahtu, "Generating object segmentationproposals using global, local search, " in Proc. IEEEConf. Comput. Vis. Pattern Recog., 2014, pp. 2417-2424.
15. A. Humayun, F. Li, J. M. Rehg, "RIGOR: Recycling inferencein graph cuts for generating object regions, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 336-343.
16. B. Alexe, T. Deselaers, V. Ferrari, "Measuring the objectnessof image windows, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, pp. 2189-2202, Nov. 2012.
17. J. Kim, K. Grauman, "Shape sharing for object segmentation, "in Proc. 10th Eur. Conf. Comput. Vis., 2012, pp. 444-458.
18. J. Carreira, C. Sminchisescu, "CPMC: Automatic object segmentationusing constrained parametric min-cuts, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 7, pp. 1312-1328, Jul. 2012.
19. I. Endres, D. Hoiem, "Category-independent object proposalswith diverse ranking, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 2, pp. 222-234, Feb. 2014.
20. P. Arbelaez, M. Maire, C. C. Fowlkes, J. Malik, "Contourdetection, hierarchical image segmentation, " IEEE Trans. PatternAnal. Mach. Intell., vol. 33, no. 5, pp. 898-916, May 2011.
21. P. F. Felzenszwalb, D. P. Huttenlocher, "Efficient graph-basedimage segmentation, " Int. J. Comput. Vis., vol. 59, p. 2004, 2004.
22. X. Ren, L. Bo, "Discriminatively trained sparse code gradientsfor contour detection, " in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 593-601.
23. C. J. Taylor, "Towards fast, accurate segmentation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 1916-1922.
24. M. Maire, S. X. Yu, "Progressive multigrid eigensolvers formultiscale spectral segmentation, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 2184-2191.
25. S. Manen, M. Guillaumin, L. Van Gool, "Prime object proposalswith randomized Prim's algorithm, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 2536-2543.
26. C. L. Zitnick, P. Doll-ar, "Edge boxes: Locating object proposalsfrom edges, " in Proc. 13th Eur. Conf. Comput. Vis., 2014, pp. 391-405.
27. M.-M. Cheng, Z. Zhang, W.-Y. Lin, P. H. S. Torr, "BING:Binarized normed gradients for objectness estimation at 300fps, "in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 3286-3293.
28. D. Hoiem, A. Efros, M. Hebert, "Recovering occlusion boundariesfrom an image, " Int. J. Comput. Vis., vol. 91, no. 3, pp. 328-346, 2011.
29. Z. Ren, G. Shakhnarovich, "Image segmentation by cascadedregion agglomeration, " in Proc. IEEE Conf. Comput. Vis. PatternRecog., 2013, pp. 2011-2018.
30. D. Weiss, B. Taskar, "Scalpel: Segmentation cascades withlocalized priors, efficient learning, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 2035-2042.
31. L. Najman, M. Schmitt, "Geodesic saliency of watershed contoursand hierarchical segmentation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 12, pp. 1163-1173, Dec. 1996.
32. P. Arbelaez, "Boundary extraction in natural images using ultrametriccontour maps, " in Proc. Conf. Comput. Vis. Pattern Recog. Workshop, Jun. 2006, p. 182.
33. D. Martin, C. Fowlkes, J. Malik, "Learning to detect naturalimage boundaries using local brightness, color, texture cues, "IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 5, pp. 530-549, May 2004.
34. P. Dollar, C. Zitnick, "Structured forests for fast edgedetection, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 1841-1848.
35. (2014). [Online]. Available: http://www. eecs. berkeley. edu/Research/Projects/CS/vision/grouping/resources. html
36. J. Pont-Tuset, F. Marques. (2015). "Supervised evaluation ofimage segmentation, object proposal techniques, " IEEE Trans. Pattern Anal. Mach. Intell., Doi: 10. 1109/TPAMI. 2015. 2481406.
37. J. Pont-Tuset, F. Marques, "Measures, meta-measures forthe supervised evaluation of image segmentation, " in Proc. IEEEConf. Comput. Vis. Pattern Recog., 2013, pp. 2131-2138.
38. M. Maire, S. X. Yu, P. Perona, "Hierarchical sceneannotation, " in Proc. Brit. Mach. Vis. Conf., 2013, pp. 84. 1-84. 11.
39. M. Everingham, H. Muller, B. Thomas, "Evaluating imagesegmentation algorithms using the pareto front, " in Proc. 7th Eur. Conf. Comput. Vis., 2006, pp. 34-48.
40. M. Ehrgott, Multicriteria Optimization. New York, NY, USA:Springer, 2005.
41. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, andA. Zisserman. (2012). The PASCAL visual object classes challenge(VOC2012) results. Int. J. Comput. Vis., [Online]. 111(1), pp. 98-136. Available: http://www. pascal-network. org/challenges/VOC/voc2012/workshop/index. html.
42. B. Hariharan, P. Arbelaez, L. Bourdev, S. Maji, J. Malik, "Semantic contours from inverse detectors, " in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 991-998.
43. T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollar, C. Zitnick, "Microsoft COCO: Common objects incontext, " in Proc. 13th Eur. Conf. Comput. Vis., 2014, pp. 740-755.
44. J. Pont-Tuset, L. V. Gool, "Boosting object proposals: Frompascal to COCO, " in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 1546-1554.
45. J. Hosang, R. Benenson, B. Schiele, "How good are detectionproposals, really" presented at the British Machine VisionConference, Nottingham, U. K., 2014.
46. J. Hosang, R. Benenson, P. Dollar, B. Schiele, "What makes foreffective detection proposals" IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 4, pp. 814-830, Apr. 2015.
47. B. Hariharan, P. Arbelaez, R. Girshick, J. Malik, "Simultaneous detection, segmentation, " in Proc. 13th Eur. Conf. Comput. Vis., 2014, pp. 297-312.