Unsupervised multiclass region cosegmentation via ensemble clustering and energy minimization

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 24, Issue 5, 2014, Pages 789-801

  Li, Hongliang ^a   Meng, Fanman ^a   Wu, Qingbo ^a   Luo, Bing ^a  

^a UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

Cosegmentation; graph cut; multiclass regions

Indexed keywords

NETWORKS (CIRCUITS); VIDEO SIGNAL PROCESSING;

CO SEGMENTATIONS; ENERGY MINIMIZATION; ENSEMBLE CLUSTERING; EXPERIMENTAL EVALUATION; GRAPH-CUT; MULTICLASS REGIONS; SEGMENTATION METHODS; UNSUPERVISED SEGMENTATION;

IMAGE SEGMENTATION;

EID: 84900542752     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2013.2280851     Document Type: Article

References (60)

1. C.-C. Chiu, M.-Y. Ku, and L.-W. Liang, "A robust object segmentation system using a probability-based background extraction algorithm," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 4, pp. 518-528, Dec. 2010.
2. W. Wang, J. Yang, and W. Gao, "Modeling background and segmenting moving objects from compressed video," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 5, pp. 670-680, May 2008.
3. H. Li and K. N. Ngan, "Unsupervised video segmentation with low depth of field," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 12, pp. 1742-1751, Dec. 2007. (Pubitemid 350183925)
4. H. Li and K. N. Ngan, "Learning to extract focused object from low DOF images," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 11, pp. 1571-1580, Nov. 2011.
5. A. Joulin, F. Bach, and J. Ponce, "Multiclass cosegmentation," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Jun. 2012, pp. 542-549.
6. D. Batra, A. Kowdle, D. Parikh, J. Lu, and T. Chen. "iCoseg: Interactive cosegmentation with intelligent scribble guidance," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., San Francisco, CA, USA, Jun. 2010, pp. 3169-3176.
7. G. Kim and E. P. Xing, "On multiple foreground cosegmentation," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Jun. 2012, pp. 837-844.
8. C. Rother, T. Minka, A. Blake, and V. Kolmogorov, "Cosegmentation of image pairs by histogram matching-incorporating a global constraint into MRFs," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Jun. 2006, pp. 993-1000.
9. L. Mukherjee, V. Singh, and C. R. Dyer, "Half-integrality based algorithms for cosegmentation of images," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Jun. 2009, pp. 2028-2035.
10. D. S. Hochbaum and V. Singh, "An efficient algorithm for cosegmentation," in Proc. IEEE Int. Conf. Comput. Vision, Sep.-Oct. 2009, pp. 269-276.
11. A. Joulin, F. Bach, and J. Ponce, "Discriminative clustering for image cosegmentation," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Jun. 2010, pp. 1943-1950.
12. S. Vicente, V. Kolmogorov, and C. Rother, "Cosegmentation revisited: Models and optimization," in Proc. Eur. Conf. Comput. Vision, Sep. 2010, pp. 465-479.
13. G. Kim, E. P. Xing, L. Fei-Fei, and T. Kanade, "Distributed cosegmentation via submodular optimization on anisotropic diffusion," in Proc. IEEE Int. Conf. Comput. Vision, Nov. 2011, pp. 169-176.
14. F. Meng, H. Li, G. Liu, and K. N. Ngan, "Object cosegmentation based on shortest path algorithm and saliency model," IEEE Trans. Multimedia, vol. 14, no. 5, pp. 1429-1441, Oct. 2012.
15. F. Meng, H. Li, G. Liu, and K. N. Ngan, "Image cosegmentation by incorporating color reward strategy and active contours model," IEEE Trans. Cybern., vol. 43, no. 2, pp. 725-737, Apr. 2013.
16. A. Toshev, J. Shi, and K. Daniilidis, "Image matching via saliency region correspondences," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recogn., Jun. 2007, pp. 1-8.
17. H.-K. Tan and C.-W. Ngo, "Common pattern discovery using earth movers distance and local flow maximization," in Proc. IEEE Int. Conf. Comput. Vision, Oct. 2005, pp. 1222-1229. (Pubitemid 44042320)
18. J. Yuan and Y. Wu, "Spatial random partition for common visual pattern discovery," in Proc. IEEE Int. Conf. Comput. Vision, Oct. 2007, pp. 1-8.
19. M. Cho, Y. M. Shin, and K. M. Lee, "Corecognition of image pairs by data-driven Monte Carlo image exploration," in Proc. Eur. Conf. Comput. Vision, Oct. 2008, pp. 144-157.
20. H. Li and K. N. Ngan, "A cosaliency model of image pairs," IEEE Trans. Image Process., vol. 20, no. 12, pp. 3365-3375, Dec. 2011.
21. S. Vicente, C. Rother, and V. Kolmogorov, "Object cosegmentation," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2011, pp. 2217-2224.
22. K. Chang, T. Liu, and S. Lai, "From cosaliency to cosegmentation: An efficient and fully unsupervised energy minimization model," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2011, pp. 2129-2136.
23. L. Mukherjee, V. Singh, and J. Peng, "Scale-invariant cosegmentation for image groups," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2011, pp. 1881-1888.
24. L. Mukherjee, V. S. Singh, J. Xu, and M. D. Collins, "Analyzing the subspace structure of related images: Concurrent segmentation of image sets," in Proc. Eur. Conf. Comput. Vision, Oct. 2012, pp. 128-142.
25. M. D. Collins, J. Xu, L. J. Grady, and V. Singh, "Random walks for multiimage segmentation: Quasiconvexity results and GPU-based solutions," in Proc. Conf. Comput. Vision Pattern Recognit., Jun. 2012, pp. 1656-1663.
26. B. Alexe, T. Deselaers, and V. Ferrari, "What is an object?" in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Jun. 2010, pp. 73-80.
27. P. Arbelez, M. Maire, C. Fowlkes, and J. Malik, "From contours to regions: An empirical evaluation," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Jun. 2009, pp. 2294-2301.
28. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006. (Pubitemid 46405714)
29. D. Lowe, "Distinctive image features from scale-invariant key-points," Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, 2004.
30. J. Friedman, T. Hastie, and R. Tibshirani, "Additive logistic regression: A statistical view of boosting," Ann. Stat. vol. 28, no. 2, pp. 337-407, 2000. (Pubitemid 33227445)
31. L. Breiman, "Random forest," Mach. Learn., vol. 45, no. 1, pp. 5-32, Oct. 2001.
32. A. Fred and A. K. Jain, "Combining multiple clusterings using evidence accumulation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 6, pp. 835-850, Jun. 2005. (Pubitemid 40889836)
33. X. Zhang and C. E. Brodley, "Random projection for high dimensional data clustering: A cluster ensemble approach," in Proc. 20th Int. Conf. Mach. Learn., Aug. 2003, pp. 186-193.
34. D. Dai, M. Prasad, C. Leistner, and L. V. Gool, "Ensemble partitioning for unsupervised image categorization," in Proc. Eur. Conf. Comput. Vision, Oct. 2012, pp. 483-496.
35. B. J. Frey and D. Dueck, "Clustering by passing messages between data points," Science, vol. 315, no. 5814, pp. 972-976, Feb. 2007. (Pubitemid 46281181)
36. J. Wright, Y. Peng, Y. Ma, A. Ganesh, and S. Rao, "Robust principal component analysis: Exact recovery of corrupted low-rank matrices by convex optimization," in Proc. Neural Inf. Process. Syst., Dec. 2009, pp. 2080-2088.
37. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, Nov. 2001. (Pubitemid 33137959)
38. Y. Boykov and V. Kolmogorov, "An experimental comparison of mincut/max-flow algorithms for energy minimization in vision," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1124-1137, Sep. 2004.
39. A. Delong, A. Osokin, H. Isack, and Y. Boykov, "Fast approximate energy minimization with label costs," in Proc. IEEE Comput. Soc. Conf. Comput. Vision. Pattern Recognit., Jun. 2010, pp. 2173-2180.
40. B. Alexe, T. Deselaers, and V. Ferrari, "ClassCut for unsupervised class segmentation," in Proc. Eur. Conf. Comput. Vision, Sep. 2010, pp. 380-393.
41. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Ssstrunk, "SLIC superpixels compared to state-of-the-art superpixel methods," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2274-2282, May 2012.
42. B. Olshausen and D. Field, "Sparse coding with an overcomplete basis set: A strategy employed by v1?" Vision Res., vol. 37, no. 23, pp. 3311-3325, 1997. (Pubitemid 27493805)
43. H. Lee, A. Battle, R. Raina, and A. Y. Ng, "Efficient sparse coding algorithms," in Proc. Neural Inf. Process. Syst., Dec. 2006, pp. 801-808.
44. H. Li, K. N. Ngan, and Q. Liu, "FaceSeg: Automatic face segmentation for real-time video," IEEE Trans. Multimedia, vol. 11, no. 1, pp. 77-88, Jan. 2009.
45. B. C. Russell, A. A. Efros, J. Sivic, W. T. Freeman, and A. Zisserman, "Using multiple segmentations to discover objects and their extent in image collections," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2006, pp. 1605-1614.
46. Z. Li, X.-M. Wu, and S.-F. Chang, "Segmentation using superpixels: A bipartite graph partitioning approach," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2012, pp. 789-796.
47. E. Rahtu, J. Kannala, and M. Blaschko, "Learning a category independent object detection cascade," in Proc. IEEE Int. Conf. Comput. Vision, Nov. 2011, pp. 1052-1059.
48. K.-Y. Chang, T.-L. Liu, H.-T. Chen, and S.-H. Lai, "Fusing generic objectness and visual saliency for salient object detection," in Proc. IEEE Int. Conf. Comput. Vision, Nov. 2011, pp. 914-921.
49. Y. J. Lee, J. Kim, and K. Grauman, "Key-segments for video object segmentation," in Proc. IEEE Int. Conf. Comput. Vision, Nov. 2011, pp. 1995-2002.
50. I. Endres and D. Hoiem, "Category independent object proposals," in Proc. Eur. Conf. Comput. Vision, Sep. 2010, pp. 575-588.
51. J.-Y. Zhu, J. Wu, Y. Wei, E. Chang, and Z. Tu, "Unsupervised object class discovery via saliency-guided multiple class learning," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2012, pp. 3218-3225.
52. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Jun. 2010, pp. 1794-1801.
53. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Jun. 2006, pp. 2169-2178. (Pubitemid 44931582)
54. E. Nowak, F. Jurie, and B. Triggs, "Sampling strategies for bag-offeatures image classification," in Proc. 9th Eur. Conf. Comput. Vision, May 2006, pp. 490-503. (Pubitemid 44029653)
55. J. Carreira and C. Sminchisescu, "Constrained parametric min-cuts for automatic object segmentation," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Jun. 2010, pp. 3241-3248.
56. B. Fulkerson, A. Vedaldi, and S. Soatto, "Class segmentation and object localization with superpixel neighborhoods," in Proc. IEEE Int. Conf. Comput. Vision, Sep.-Oct. 2009, pp. 670-677.
57. S. Gould, T. Gao, and D. Koller, "Region-based segmentation and object detection," in Proc. Neural Inf. Process. Syst., Dec. 2009, pp. 655-663.
58. D. Kuettel and V. Ferrari, "Figure-ground segmentation by transferring window masks," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2012, pp. 558-565.
59. D. Kuettell, M. Guillaumin, and V. Ferrari, "Segmentation propagation in image net," in Proc. Eur. Conf. Comput. Vision, Oct. 2012, pp. 459-473.
60. H. Li, F. Meng, and K. N. Ngan, "Cosalient object detection from multiple images," IEEE Trans. Multimedia, vol. 15, no. 8, pp. 1-14, Dec. 2013.