DISC: Deep Image Saliency Computing via Progressive Representation Learning

IEEE Transactions on Neural Networks and Learning Systems

Volumn 27, Issue 6, 2016, Pages 1135-1149

  Chen, Tianshui ^a   Lin, Liang ^a   Liu, Lingbo ^a   Luo, Xiaonan ^a   Li, Xuelong ^b  

^a SUN YAT SEN UNIVERSITY   (China)

^b XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Convolutional neural network (CNN); image labeling; representation learning; Saliency detection

Indexed keywords

COMPLEX NETWORKS; DISKS (STRUCTURAL COMPONENTS); IMAGE PROCESSING; NEURAL NETWORKS; PATTERN RECOGNITION;

COMPLEX BACKGROUND; CONVOLUTIONAL NEURAL NETWORK; FEATURE LEARNING; SALIENCY MODELING; SALIENCY REGIONS; SALIENCY REPRESENTATION; SALIENT OBJECT DETECTION; STATE-OF-THE-ART METHODS;

DISKS (MACHINE COMPONENTS);

EID: 84953291036     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2015.2506664     Document Type: Article

References (54)

1. L. Itti and C. Koch, "Computational modelling of visual attention," Nature Rev. Neurosci., vol. 2, no. 3, pp. 194-203, 2001.
2. A. Borji, D. N. Sihite, L. Itti, "Salient object detection: A benchmark," in Proc. 12th Eur. Conf. Comput. Vis., Florence, Italy, Oct. 2012, pp. 414-429.
3. X. Li, H. Lu, L. Zhang, X. Ruan, M.-H. Yang, "Saliency detection via dense and sparse reconstruction," in Proc. 14th IEEE Int. Conf. Comput. Vis., Sydney, NSW, Australia, Dec. 2013, pp. 2976-2983.
4. C. Yang, L. Zhang, H. Lu, X. Ruan, M.-H. Yang, "Saliency detection via graph-based manifold ranking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 3166-3173.
5. Q. Wang, Y. Yuan, P. Yan, X. Li, "Saliency detection by multipleinstance learning," IEEE Trans. Cybern., vol. 43, no. 2, pp. 660-672, Apr. 2013.
6. K. Wang, L. Lin, J. Lu, C. Li, K. Shi, "PISA: Pixelwise image saliency by aggregating complementary appearance contrast measures with edge-preserving coherence," IEEE Trans. Image Process., vol. 24, no. 10, pp. 3019-3033, Oct. 2015.
7. C. Christopoulos, A. Skodras, T. Ebrahimi, "The JPEG2000 still image coding system: An overview," IEEE Trans. Consum. Electron., vol. 46, no. 4, pp. 1103-1127, Nov. 2000.
8. J. Han, K. N. Ngan, M. Li, H.-J. Zhang, "Unsupervised extraction of visual attention objects in color images," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 1, pp. 141-145, Jan. 2006.
9. L. Lin, X. Wang, W. Yang, J.-H. Lai, "Discriminatively trained and-or graph models for object shape detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 5, pp. 959-972, May 2015.
10. L. Itti, C. Koch, E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
11. T. Liu et al., "Learning to detect a salient object," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 2, pp. 353-367, Feb. 2011.
12. Y. Zhai and M. Shah, "Visual attention detection in video sequences using spatiotemporal cues," in Proc. 14th ACM Int. Conf. Multimedia, Santa Barbara, CA, USA, Oct. 2006, pp. 815-824.
13. R. Achanta, S. Hemami, F. Estrada, S. Süsstrunk, "Frequency-tuned salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Miami, FL, USA, Jun. 2009, pp. 1597-1604.
14. F. Perazzi, P. Krähenbühl, Y. Pritch, A. Hornung, "Saliency filters: Contrast based filtering for salient region detection," in Proc. 25th IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2012, pp. 733-740.
15. X. Shen and Y. Wu, "A unified approach to salient object detection via low rank matrix recovery," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2012, pp. 853-860.
16. H. Jiang, J. Wang, Z. Yuan, Y. Wu, N. Zheng, S. Li, "Salient object detection: A discriminative regional feature integration approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 2083-2090.
17. A. Krizhevsky, I. Sutskever, G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Proc. Adv. Neural Inf. Process. Syst., Lake Tahoe, CA, USA, Dec. 2012, pp. 1097-1105.
18. F. J. Huang and Y. LeCun, "Large-scale learning with SVM and convolutional for generic object categorization," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., New York, NY, USA, Jun. 2006, pp. 284-291.
19. M.-M. Cheng, G.-X. Zhang, N. J. Mitra, X. Huang, S.-M. Hu, "Global contrast based salient region detection," in Proc. 24th IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 409-416.
20. T. Kadir and M. Brady, "Saliency, scale and image description," Int. J. Comput. Vis., vol. 45, no. 2, pp. 83-105, 2001.
21. N. D. B. Bruce and J. K. Tsotsos, "Saliency based on information maximization," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2005, pp. 155-162.
22. R.-J. Lin and W.-S. Lin, "A computational visual saliency model based on statistics and machine learning," J. Vis., vol. 14, no. 9, p. 1, 2014.
23. L. Mai, Y. Niu, F. Liu, "Saliency aggregation: A data-driven approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 1131-1138.
24. S. Lu, V. Mahadevan, N. Vasconcelos, "Learning optimal seeds for diffusion-based salient object detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Columbus, OH, USA, Jun. 2014, pp. 2790-2797.
25. X. Liang, S. Liu, Y. Wei, L. Liu, L. Lin, S. Yan, "Towards computational baby learning: A weakly-supervised approach for object detection," in Proc. IEEE Int. Conf. Comput. Vis., Santiago, Chile, Dec. 2015.
26. S. Ding, L. Lin, G. Wang, H. Chao, "Deep feature learning with relative distance comparison for person re-identification," Pattern Recognit., vol. 48, no. 10, pp. 2993-3003, Oct. 2015.
27. R. Zhang, L. Lin, R. Zhang, W. Zuo, L. Zhang, "Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification," IEEE Trans. Image Process., vol. 24, no. 12, pp. 4766-4779, Dec. 2015.
28. X. Liang et al., "Human parsing with contextualized convolutional neural network," in Proc. IEEE Int. Conf. Comput. Vis., Santiago, Chile, Dec. 2015.
29. L. Lin, K. Wang, W. Zuo, M. Wang, J. Luo, L. Zhang, "A deep structured model with radius-margin bound for 3D human activity recognition," Int. J. Comput. Vis., to be published.
30. C. Farabet, C. Couprie, L. Najman, Y. LeCun, "Learning hierarchical features for scene labeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1915-1929, Aug. 2013.
31. P. Sermanet, K. Kavukcuoglu, S. Chintala, Y. LeCun, "Pedestrian detection with unsupervised multi-stage feature learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 3626-3633.
32. X. Wang, L. Zhang, L. Lin, Z. Liang, W. Zuo, "Deep joint task learning for generic object extraction," in Proc. Adv. Neural Inf. Process. Syst., Montreal, QC, Canada, Dec. 2014, pp. 523-531.
33. Y. Sun, X. Wang, X. Tang, "Deep convolutional network cascade for facial point detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 3476-3483.
34. D. Eigen, C. Puhrsch, R. Fergus, "Depth map prediction from a single image using a multi-scale deep network," in Proc. Adv. Neural Inf. Process. Syst., Montreal, QC, Canada, Dec. 2014, pp. 2366-2374.
35. S. He, R. W. H. Lau, W. Liu, Z. Huang, Q. Yang, "SuperCNN: A superpixelwise convolutional neural network for salient object detection," Int. J. Comput. Vis., vol. 115, no. 3, pp. 330-344, 2015.
36. G. Li and Y. Yu. (2015). "Visual saliency based on multiscale deep features." [Online]. Available: http://arxiv.org/abs/1503.08663
37. L. Wang, H. Lu, X. Ruan, M.-H. Yang, "Deep networks for saliency detection via local estimation and global search," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Boston, MA, USA, Jun. 2015, pp. 3183-3192.
38. O. Russakovsky et al., "ImageNet large scale visual recognition challenge," Int. J. Comput. Vis., vol. 115, no. 3, pp. 211-252, Dec. 2015.
39. N. Liu, J. Han, D. Zhang, S. Wen, T. Liu, "Predicting eye fixations using convolutional neural networks," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Boston, MA, USA, Jun. 2015, pp. 362-370.
40. E. Vig, M. Dorr, D. Cox, "Large-scale optimization of hierarchical features for saliency prediction in natural images," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Columbus, OH, USA, Jun. 2014, pp. 2798-2805.
41. M. Kümmerer, L. Theis, M. Bethge. (2014). "Deep gaze I: Boosting saliency prediction with feature maps trained on ImageNet." [Online]. Available: http://arxiv.org/abs/1411.1045
42. C. Shen and Q. Zhao, "Learning to predict eye fixations for semantic contents using multi-layer sparse network," Neurocomputing, vol. 138, pp. 61-68, Aug. 2014.
43. M.-Y. Liu, O. Tuzel, S. Ramalingam, R. Chellappa, "Entropy rate superpixel segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 2097-2104.
44. J. Long, E. Shelhamer, T. Darrell, "Fully convolutional networks for semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Boston, MA, USA, Jun. 2015, pp. 3431-3440.
45. X. Xu, I. W. Tsang, D. Xu, "Soft margin multiple kernel learning," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 5, pp. 749-761, May 2013.
46. S. Alpert, M. Galun, R. Basri, A. Brandt, "Image segmentation by probabilistic bottom-up aggregation and cue integration," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Minneapolis, MN, USA, Jun. 2007, pp. 1-8.
47. Q. Yan, L. Xu, J. Shi, J. Jia, "Hierarchical saliency detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 1155-1162.
48. W. Zou, K. Kpalma, Z. Liu, J. Ronsin, "Segmentation driven lowrank matrix recovery for saliency detection," in Proc. 24th Brit. Mach. Vis. Conf., Bristol, U.K., Sep. 2013, pp. 1-13.
49. M.-M. Cheng, N. J. Mitra, X. Huang, S.-M. Hu, "SalientShape: Group saliency in image collections," Vis. Comput., vol. 30, no. 4, pp. 443-453, 2014.
50. Y. Jia et al., "Caffe: Convolutional architecture for fast feature embedding," in Proc. 22nd ACM Int. Conf. Multimedia, Orlando, FL, USA, Nov. 2014, pp. 675-678.
51. H. Jiang, J. Wang, Z. Yuan, T. Liu, N. Zheng, S. Li, "Automatic salient object segmentation based on context and shape prior," in Proc. Brit. Mach. Vis. Conf., Dundee, U.K., Aug./Sep. 2011, pp. 1-12.
52. B. Jiang, L. Zhang, H. Lu, C. Yang, M.-H. Yang, "Saliency detection via absorbing Markov chain," in Proc. IEEE Int. Conf. Comput. Vis., Sydney, NSW, Australia, Dec. 2013, pp. 1665-1672.
53. J. Harel, C. Koch, P. Perona, "Graph-based visual saliency," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2006, pp. 545-552.
54. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Minneapolis, MN, USA, Jun. 2007, pp. 1-8.