Cosaliency Detection Based on Intrasaliency Prior Transfer and Deep Intersaliency Mining

IEEE Transactions on Neural Networks and Learning Systems

Volumn 27, Issue 6, 2016, Pages 1163-1176

  Zhang, Dingwen ^a   Han, Junwei ^a   Han, Jungong ^b   Shao, Ling ^b,c  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b NORTHUMBRIA UNIVERSITY   (United Kingdom)

^c NANJING UNIVERSITY OF INFORMATION SCIENCE AND TECHNOLOGY   (China)

Author keywords

Cosaliency detection; deep learning; prior transfer; Stacked denoising autoencoder (SDAE)

Indexed keywords

BENCHMARKING;

CONSISTENT PERFORMANCE; DETECTION APPROACH; DETECTION METHODS; HIDDEN PATTERNS; PRIOR KNOWLEDGE; SALIENCY DETECTION; SALIENT OBJECTS; STATE OF THE ART;

DATA MINING;

EID: 84946949753     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2015.2495161     Document Type: Article

References (53)

1. J. Han, K. N. Ngan, M. Li, H.-J. Zhang, "Unsupervised extraction of visual attention objects in color images," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 1, pp. 141-145, Jan. 2006.
2. J. Han, D. Wang, L. Shao, X. Qian, G. Cheng, J. Han, "Image visual attention computation and application via the learning of object attributes," Mach. Vis. Appl., vol. 25, no. 7, pp. 1671-1683, Oct. 2013.
3. M.-M. Cheng, N. J. Mitra, X. Huang, P. H. S. Torr, S.-M. Hu, "Global contrast based salient region detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 3, pp. 569-582, Mar. 2015.
4. D. Batra, A. Kowdle, D. Parikh, J. Luo, T. Chen, "iCoseg: Interactive co-segmentation with intelligent scribble guidance," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, USA, Jun. 2010, pp. 3169-3176.
5. G. Kim, E. P. Xing, L. Fei-Fei, T. Kanade, "Distributed cosegmentation via submodular optimization on anisotropic diffusion," in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, Nov. 2011, pp. 169-176.
6. L. Mukherjee, V. Singh, J. Peng, "Scale invariant cosegmentation for image groups," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2011, pp. 1881-1888.
7. H. Fu, D. Xu, B. Zhang, S. Lin, "Object-based multiple foreground video co-segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Columbus, OH, USA, Jun. 2013, pp. 3166-3173.
8. Y. Yang, B. Geng, Y. Cai, A. Hanjalic, X.-S. Hua, "Object retrieval using visual query context," IEEE Trans. Multimedia, vol. 13, no. 6, pp. 1295-1307, Dec. 2011.
9. X. Guo, D. Liu, B. Jou, M. Zhu, A. Cai, S.-F. Chang, "Robust object co-detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 3206-3213.
10. A. Toshev, J. Shi, K. Daniilidis, "Image matching via saliency region correspondences," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Minneapolis, MN, USA, Jun. 2007, pp. 1-8.
11. H. Li, F. Meng, K. N. Ngan, "Co-salient object detection from multiple images," IEEE Trans. Multimedia, vol. 15, no. 8, pp. 1896-1909, Dec. 2013.
12. H. Li and K. N. Ngan, "A co-saliency model of image pairs," IEEE Trans. Image Process., vol. 20, no. 12, pp. 3365-3375, Dec. 2011.
13. K.-Y. Chang, T.-L. Liu, S.-H. Lai, "From co-saliency to co-segmentation: An efficient and fully unsupervised energy minimization model," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2011, pp. 2129-2136.
14. H. Fu, X. Cao, Z. Tu, "Cluster-based co-saliency detection," IEEE Trans. Image Process., vol. 22, no. 10, pp. 3766-3778, Oct. 2013.
15. Z. Liu, W. Zou, L. Li, L. Shen, O. Le Meur, "Co-saliency detection based on hierarchical segmentation," IEEE Signal Process. Lett., vol. 21, no. 1, pp. 88-92, Jan. 2014.
16. D. E. Jacobs, D. B. Goldman, E. Shechtman, "Cosaliency: Where people look when comparing images," in Proc. Annu. ACM Symp. User Interface Softw. Technol., New York, NY, USA, Oct. 2010, pp. 219-228.
17. H.-T. Chen, "Preattentive co-saliency detection," in Proc. IEEE Int. Conf. Image Process., Hong Kong, Sep. 2010, pp. 1117-1120.
18. Z. Tan, L. Wan, W. Feng, C.-M. Pun, "Image co-saliency detection by propagating superpixel affinities," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Vancouver, BC, Canada, May 2013, pp. 2114-2118.
19. X. Cao, Z. Tao, B. Zhang, H. Fu, X. Li, "Saliency map fusion based on rank-one constraint," in Proc. IEEE Int. Conf. Multimedia Expo, San Jose, CA, USA, Jul. 2013, pp. 1-6.
20. Z. Shi, P. Siva, T. Xiang, "Transfer learning by ranking for weakly supervised object annotation," in Proc. Brit. Mach. Vis. Conf., Guildford, U.K., Sep. 2012, pp. 1-5.
21. T. Deselaers, B. Alexe, V. Ferrari, "Weakly supervised localization and learning with generic knowledge," Int. J. Comput. Vis., vol. 100, no. 3, pp. 275-293, Dec. 2012.
22. Y. Bengio, "Deep learning of representations for unsupervised and transfer learning," in Proc. Unsupervised Transf. Learn. Challenge Workshop, Bellevue, WA, USA, Jul. 2011, pp. 17-36.
23. R. Girshick, J. Donahue, T. Darrell, J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Columbus, OH, USA, Jun. 2014, pp. 580-587.
24. L. Shao, F. Zhu, X. Li, "Transfer learning for visual categorization: A survey," IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 5, pp. 1019-1034, May 2015.
25. Y. Bengio et al., "Deep learners benefit more from out-of-distribution examples," in Proc. Int. Conf. Artif. Intell. Statist., Fort Lauderdale, FL, USA, Apr. 2011, pp. 164-172.
26. Y. Bengio, A. Courville, P. Vincent, "Representation learning: A review and new perspectives," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1798-1828, Aug. 2013.
27. K. He, X. Zhang, S. Ren, J. Sun, "Spatial pyramid pooling in deep convolutional networks for visual recognition," in Proc. Eur. Conf. Comput. Vis., Zürich, Switzerland, Sep. 2014, pp. 346-361.
28. X. Cao, Z. Tao, B. Zhang, H. Fu, W. Feng, "Self-adaptively weighted co-saliency detection via rank constraint," IEEE Trans. Image Process., vol. 23, no. 9, pp. 4175-4186, Sep. 2014.
29. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, P.-A. Manzagol, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion," J. Mach. Learn. Res., vol. 11, pp. 3371-3408, Jan. 2010.
30. D. E. Rumelhart, G. E. Hinton, R. J. Williams, Learning Representations by Back-Propagating Errors. Cambridge, MA, USA: MIT Press, 1988.
31. J. Han, S. He, X. Qian, D. Wang, L. Guo, T. Liu, "An objectoriented visual saliency detection framework based on sparse coding representations," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 12, pp. 2009-2021, Dec. 2013.
32. Q. Yan, L. Xu, J. Shi, J. Jia, "Hierarchical saliency detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 1155-1162.
33. X. Shen and Y. Wu, "A unified approach to salient object detection via low rank matrix recovery," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2012, pp. 853-860.
34. C. Yang, L. Zhang, H. Lu, X. Ruan, M.-H. Yang, "Saliency detection via graph-based manifold ranking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 3166-3173.
35. R. Achanta, S. Hemami, F. Estrada, S. Süsstrunk, "Frequency-tuned salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Miami, FL, USA, Jun. 2009, pp. 1597-1604.
36. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, S. Süsstrunk, "SLIC superpixels compared to state-of-the-art superpixel methods," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2274-2282, Nov. 2012.
37. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient graph-based image segmentation," Int. J. Comput. Vis., vol. 59, no. 2, pp. 167-181, Sep. 2004.
38. A. Prest, C. Schmid, V. Ferrari, "Weakly supervised learning of interactions between humans and objects," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 601-614, Mar. 2012.
39. D. Kuettel and V. Ferrari, "Figure-ground segmentation by transferring window masks," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2012, pp. 558-565.
40. B. Alexe, T. Deselaers, V. Ferrari, "Measuring the objectness of image windows," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2189-2202, Nov. 2012.
41. H.-C. Shin, M. R. Orton, D. J. Collins, S. J. Doran, M. O. Leach, "Stacked autoencoders for unsupervised feature learning and multiple organ detection in a pilot study using 4D patient data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1930-1943, Aug. 2013.
42. Y. Lin, S. Kong, D. Wang, Y. Zhuang, "Saliency detection within a deep convolutional architecture," in Proc. Workshops AAAI Conf. Artif. Intell., Québec City, QC, Canada, Jul. 2014.
43. Y. Kang, K.-T. Lee, J. Eun, S. Park, S. Choi, "Stacked denoising autoencoders for face pose normalization," in Proc. Neural Inf. Process., Stateline, NV, USA, Dec. 2013, pp. 241-248.
44. A. Sankaran, P. Pandey, M. Vatsa, R. Singh, "On latent fingerprint minutiae extraction using stacked denoising sparse autoencoders," in Proc. IEEE Int. Joint Conf. Biometrics, Clearwater, FL, USA, Oct. 2014, pp. 1-7.
45. Y. Bengio, "Practical recommendations for gradient-based training of deep architectures," in Neural Networks: Tricks of the Trade (Lecture Notes in Computer Science), K.-R. Müller, G. Montavon, G. B. Orr, Eds. Berlin, Germany: Springer-Verlag, 1998.
46. H. Jiang, J. Wang, Z. Yuan, Y. Wu, N. Zheng, S. Li, "Salient object detection: A discriminative regional feature integration approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 2083-2090.
47. J. Han, D. Zhang, S.Wen, L. Guo, T. Liu, X. Li, "Two-stage learning to predict human eye fixations via stacked denoising autoencoders," IEEE Trans. Cybern., to be published.
48. J. Han, D. Zhang, X. Hu, L. Guo, J. Ren, F. Wu, "Background prior-based salient object detection via deep reconstruction residual," IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 8, pp. 1309-1321, Aug. 2015.
49. D. Zhang, J. Han, C. Li, J. Wang, "Co-saliency detection via looking deep and wide," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Boston, MA, USA, Jun. 2015, pp. 2994-3002.
50. J. Han, D. Zhang, G. Cheng, L. Guo, J. Ren, "Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning," IEEE Trans. Geosci. Remote Sens., vol. 53, no. 6, pp. 3325-3337, Jun. 2015.
51. D. Zhang, J. Han, G. Cheng, Z. Liu, S. Bu, L. Guo, "Weakly supervised learning for target detection in remote sensing images," IEEE Geosci. Remote Sens. Lett., vol. 12, no. 4, pp. 701-705, Apr. 2015.
52. J. Han et al., "Efficient, simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding," ISPRS J. Photogramm. Remote Sens., vol. 89, pp. 37-48, Mar. 2014.
53. J. Han, C. Chen, L. Shao, X. Hu, J. Han, T. Liu, "Learning computational models of video memorability from fMRI brain imaging," IEEE Trans. Cybern., vol. 45, no. 8, pp. 1692-1703, Aug. 2015.