Co-Saliency Detection via a Self-Paced Multiple-Instance Learning Framework

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 39, Issue 5, 2017, Pages 865-878

  Zhang, Dingwen ^a   Meng, Deyu ^b   Han, Junwei ^a  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

Co saliency detection; multiple instance learning; self paced learning

Indexed keywords

BENCHMARKING; DATA MINING; LEARNING SYSTEMS; NETWORK FUNCTION VIRTUALIZATION; OBJECT DETECTION;

BENCHMARK DATASETS; CO SALIENCIES; COMPUTER VISION APPLICATIONS; DISCRIMINATIVE CLASSIFIERS; GENERALIZATION CAPABILITY; LEARNING FRAMEWORKS; MULTIPLE INSTANCE LEARNING; SELF-PACED LEARNING;

PALMPRINT RECOGNITION;

EID: 85018479379     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2016.2567393     Document Type: Article

References (70)

1. H. Li and K. N. Ngan, "A co-saliency model of image pairs," IEEE Trans. Image Process., vol. 20 no. 12, pp. 3365-3375, Dec. 2011.
2. H. Chen, "Preattentive co-saliency detection," in Proc. IEEE Int. Conf. Image Process., 2010, pp. 1117-1120.
3. D. E. Jacobs, D. B. Goldman, and E. Shechtman, "Cosaliency: Where people look when comparing images," in Proc. 23rd Annu. ACM Symp. User Interface Softw. Technol., 2010, pp. 219-228.
4. Z. Tian, L. Wang, W. Feng, C. Pun, "Image co-saliency detection by propagating superpixel affinities," in Proc. IEEE Int. Conf. Acoustics, Speech Signal Process., 2013, pp. 2114-2118.
5. H. Li, F. Meng, and K. N. Ngan, "Co-Salient object detection from multiple images," IEEE Trans. Multimedia, vol. 15 no. 8, pp. 1896-1909, Dec. 2013.
6. H. Fu, X. Cao, and Z. Tu , "Cluster-based co-saliency detection," IEEE Trans. Image Process., vol. 22 no. 10, pp. 3766-3778, Oct. 2013.
7. Z. Liu, W. Zou, L. Li, L. Shen, and O. Le Meur, "Co-saliency detection based on hierarchical segmentation," IEEE Signal Process. Lett., vol. 21 no. 1, pp. 88-92, Jan. 2014.
8. X. Cao, Z. Tao, B. Zhang, H. Fu, and W. Feng, "Self-adaptively weighted co-saliency detection via rank constraint," IEEE Trans. Image Process., vol. 23 no. 9, pp. 4175-4186, Sep. 2014.
9. Y. Li, K. Fu, Z. Liu, and J. Yang, "Efficient saliency-model-guided visual co-saliency detection," IEEE Signal Process. Lett., vol. 22, no. 5, pp. 588-592, May 2015.
10. D. Zhang, J. Han, C. Li, and J. Wang, "Co-saliency detection via looking deep and wide," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 2994-3002.
11. J. Han, D. Zhang, X. Hu, L. Guo, J. Ren, and F. Wu, "Background prior-based salient object detection via deep reconstruction residual," IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 8, pp. 1309-1321, Aug. 2015.
12. M.-M. Cheng, G.-X. Zhang, N. J. Mitra, X. Huang, and S.-M. Hu, "Global contrast based salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 409-416.
13. Y. Luo, M. Jiang, Y. Wong, and Q. Zhao, "Multi-camera saliency," IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 10, pp. 2057-2070, Oct. 2015. DOI:10.1109/TPAMI. 2015.2392783.
14. H. Fu, D. Xu, B. Zhang, and S. Lin, "Object-based multiple foreground video co-segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3166-3173.
15. K. Tang, A. Joulin, L.-J. Li, and L. Fei-Fei, "Co-localization in realworld images," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1464-1471.
16. A. Joulin, K. Tang, and L. Fei-Fei, "Efficient image and video colocalization with Frank-Wolfe algorithm," in Proc. Eur. Conf. Comput. Vision, 2014, pp. 253-268.
17. Y. Bengio, J. Louradour, R. Collobert, and J. Weston, "Curriculum learning," in Proc. Int. Conf. Mach. Learn., 2009, pp. 41-48.
18. L. Jiang, D. Meng, S.-I. Yu, Z. Lan, S. Shan, and A. Hauptmann, "Self-paced learning with diversity," in Proc. Adv. Neural Inf. Process. Syst., 2014, pp. 2078-2086.
19. D. Zhang, D. Meng, C. Li, L. Jiang, Q. Zhao, and J. Han, "A self-paced multiple-instance learning framework for co-saliency detection," in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 594-602.
20. A. Joulin, F. Bach, and J. Ponce, "Multi-class cosegmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 542-549.
21. G. Kim, E. P. Xing, L. Fei-Fei, and T. Kanade, "Distributed cosegmentation via submodular optimization on anisotropic diffusion," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 169-176.
22. Z. Wang, and R. Liu, "Semi-supervised learning for large scale image cosegmentation," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 393-400.
23. D. Batra, A. Kowdle, D. Parikh, J. Luo, and C. Tsuhan, "iCoseg: Interactive co-segmentation with intelligent scribble guidance," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 3169-3176.
24. A. Vezhnevets, and J. M. Buhmann, "Towards weakly supervised semantic segmentation by means of multiple instance and multitask learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 3249-3256.
25. A. Vezhnevets, V. Ferrari, and J. M. Buhmann, "Weakly supervised semantic segmentation with a multi-image model," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 643-650.
26. A. Vezhnevets, V. Ferrari, and J. M. Buhmann, "Weakly supervised structured output learning for semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 845-852.
27. X. Yao, J. Han, G. Cheng, and L. Guo, "Semantic segmentation based on stacked discriminative autoencoders and contextconstrained weakly supervised learning," in Proc. 23rd ACM Int. Conf. Multimedia, 2015, pp. 1211-1214.
28. K. Zhang, W. Zhang, Y. Zheng, and X. Xue, "Sparse reconstruction for weakly supervised semantic segmentation," in Proc. Int. Joint Conf. Artif. Intell., 2013, pp. 1889-1895.
29. W. Zhang, S. Zeng, D. Wang, and X. Xue, "Weakly supervised semantic segmentation for social images," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 2718-2726.
30. T. G. Dietterich, R. H. Lathrop, and T. Lozano-Perez, "Solving the multiple instance problem with axis-parallel rectangles," Artif. Intell., vol. 89, no. 1,pp. 31-71, 1997.
31. Y. Chen, J. Bi, and J. Z. Wang, "MILES: Multiple-instance learning via embedded instance selection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp 1931-1947, Dec. 2006.
32. Z. Fu, A. Robles-Kelly, and J. Zhou, "Milis: Multiple instance learning with instance selection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 958-977, May 2011.
33. P. Siva and T. Xiang, "Weakly supervised object detector learning with model drift detection," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 343-350.
34. Q. Wang, Y. Yuan, P. Yan, and X. Li, "Saliency detection by multiple-instance learning," IEEE Trans. Cybern., vol. 43, no. 2, pp. 660-672, Apr. 2013.
35. S. Andrews, I. Tsochantaridis, and T. Hofmann, "Support vector machines for multiple-instance learning," in Proc. Adv. Neural Inf. Process. Syst., 2002, pp. 561-568.
36. P. V. Gehler, and O. Chapelle, "Deterministic annealing for multiple-instance learning," in Proc. 11th Int. Conf. Artif. Intell. Statist., 2007, pp. 123-130.
37. Y. Xiao, B. Liu, L. Cao, J. Yin, and X. Wu, "SMILE: A similaritybased approach for multiple instance learning," in Proc. Int. Conf. Data Mining, 2010, pp. 589-598.
38. M. P. Kumar, B. Packer, and D. Koller, "Self-paced learning for latent variable models," in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 1189-1197.
39. J. Supancic, and D. Ramanan, "Self-paced learning for long-term tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 2379-2386.
40. Y. Tang, Y.-B. Yang, and Y. Gao, "Self-paced dictionary learning for image classification," in Proc. 20th ACM Int. Conf. Multimedia, 2012, pp. 833-836.
41. L. Jiang, D. Meng, T. Mitamura, and A. G. Hauptmann, "Easy samples first: Self-paced reranking for zero-example multimedia search," in Proc. 22nd ACM Int. Conf. Multimedia, 2014, pp. 547-556.
42. S. Yu and L. Jiang and Z. Maoet al. "CMU-Informedia@ TRECVID 2014 Multimedia Event Detection (MED)," in Proc. TRECVID Video Retrieval Evaluation Workshop 2014, http://www-nlpir.nist. gov/projects/tvpubs/tv.pubs.14.org.html.
43. K. Fu, I. Y. Gu, C. Gong, and J. Yang, "Robust manifoldpreserving diffusion-based saliency detection by adaptive weight construction," Neurocomputing, vol. 175, pp. 336-347, 2016.
44. C. Aytekin, S. Kiranyaz, and M. Gabbouj, "Automatic object segmentation by quantum cuts," in Proc. Int. Conf. Pattern Recog., 2014, pp. 112-117.
45. C. Yang, L. Zhang, H. Lu, X. Ruan, and M.-H. Yang, "Saliency detection via graph-based manifold ranking," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3166-3173.
46. X. Yang, Q. Song, and Y. Wang, "A weighted support vector machine for data classification," Int. J. Pattern Recog. Artif. Intell., vol. 21, no. 5, pp. 961-976, 2007.
47. CVX Research, Inc, "{CVX}: Matlab Software for Disciplined Convex Programming, version 2.0.," Aug, 2012. [Online]. Available: http://cvxr.com/cvx.
48. B. Hariharan, P. Arbelaez, R. Girshick, and J.Malik, "Hypercolumns for object segmentation and fine-grained localization," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 447-456.
49. P. O. Pinheiro, R. Collobert, and P. Dollar, "Learning to segment object candidates," In Proc. Adv. Neural Inf. Process. Syst., 2015, pp. 1981-1989.
50. C. Ma, J.-B. Huang, X. Yang, and M.-H. Yang, "Hierarchical convolutional features for visual tracking," in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 3074-3082.
51. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman, "Return of the devil in the details: Delving deep into convolutional nets," in Proc. Brit. Mach. Vis. Conf., 2014.
52. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Susstrunk, "SLIC superpixels compared to state-of-the-art superpixel methods," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2274-2282, Nov. 2012.
53. P. Siva, C. Russell, T. Xiang, and L. Agapito, "Looking beyond the image: Unsupervised learning for object saliency and detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3238-3245.
54. C. Lang, J. Feng, G. Liu, J. Tang, S. Yan, and J. Luo, "Improving bottom-up saliency detection by looking into neighbors," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 6, pp. 1016-1028, Jun. 2013.
55. L. Mai, Y. Niu and F. Liu, "Saliency aggregation: A data-driven approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 1131-1138.
56. J. Winn, A. Criminisi, and T. Minka, "Object categorization by learned universal visual dictionary," in Proc. IEEE Int. Conf. Comput. Vis., 2005, pp. 1800-1807.
57. Y. Jia and M. Han, "Category-independent object-level saliency detection," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 1761-1768.
58. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequencytuned salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 1597-1604.
59. A. Vedaldi and K. Lenc, "MatConvNet-convolutional neural networks for MATLAB," in Proc. 23rd ACM Int. Conf. Multimedia, 2015, pp. 689-692.
60. J. Kim, D. Han, Y.-W. Tai, and J. Kim, "Salient region detection via high-dimensional color transform," In Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 883-890.
61. W. Zhu, S. Liang, Y. Wei, and J. Sun, "Saliency optimization from robust background detection," In Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 2814-2821.
62. Y. J. Lee, J. Kim, and K. Grauman, "Key-segments for video object segmentation," In Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 1995-2002.
63. C.-R. Huang, Y.-J. Chang, Z.-X. Yang, and Y.-Y. Lin, "Video saliency map detection by dominant camera motion removal," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 8, pp. 1336-1349, Aug. 2014.
64. Z. Liu, X. Zhang, S. Luo, and O. Le Meur, "Superpixel-based spatiotemporal saliency detection," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 9, pp. 1522-1540, Sep. 2014.
65. D. Tsai, M. Flagg, A. Nakazawa, and J. M. Rehg, "Motion coherent tracking using multi-label MRF optimization," Int. J. Comput. Vis., vol. 100, no. 2, pp. 190-202, 2012.
66. D. Tran, and J. Yuan, "Max-margin structured output regression for spatio-temporal action localization," in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 359-367.
67. M. D. Rodriguez, J. Ahmed, and M. Shah, "Action mach a spatiotemporal maximum average correlation height filter for action recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2008, pp. 1-8.
68. D. Tran, and J. Yuan, "Optimal spatio-temporal path discovery for video event detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2011, pp. 3321-3328.
69. J. Zhu, J. Wu, Y. Xu, E. Chang, and Z. Tu, "Unsupervised object class discovery via saliency-guided multiple class learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 4, pp. 862-875, Apr. 2015.
70. Q. Zhao, D. Meng, L. Jiang, Q. Xie, Z. Xu, and A. Hauptmann, "Self-paced learning for matrix factorization," in Proc. 29th AAAI Conf. Artificial Intell., 2015, pp. 3196-3202.