Saliency unified: A deep architecture for simultaneous eye fixation prediction and salient object segmentation

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 5781-5790

  Kruthiventi, Srinivas S S ^a   Gudisa, Vennela ^a   Dholakiya, Jaley H ^a   Babu, R Venkatesh ^a  

^a INDIAN INSTITUTE OF SCIENCE   (India)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; CONVOLUTION; FORECASTING; IMAGE SEGMENTATION; NEURAL NETWORKS; PATTERN RECOGNITION; SEMANTICS;

CONVOLUTIONAL NEURAL NETWORK; DEEP ARCHITECTURES; MULTIPLE SCALE; NETWORK ADDRESS; NETWORK CAPTURE; SALIENT OBJECTS; STATE OF THE ART; UNIFIED FRAMEWORK;

NETWORK LAYERS;

EID: 84986243887     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.623     Document Type: Conference Paper

References (50)

1. A. M. Treisman and G. Gelade, "A feature-integration theory of attention, " Cognitive psychology, vol. 12, no. 1, pp. 97-136, 1980.
2. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis, " IEEE Transactions on Pattern Analysis & Machine Intelligence, no. 11, pp. 1254-1259, 1998.
3. V. Setlur, S. Takagi, R. Raskar, M. Gleicher, and B. Gooch, "Automatic image retargeting, " in ACM MUM, 2005.
4. D. Gao and N. Vasconcelos, "Discriminant saliency for visual recognition from cluttered scenes, " in NIPS, 2004.
5. V. Mahadevan and N. Vasconcelos, "Saliency-based discriminant tracking, " in CVPR, 2009.
6. L. Itti, "Automatic foveation for video compression using a neurobiological model of visual attention, " Image Processing, IEEE Transactions on, vol. 13, no. 10, pp. 1304-1318, 2004.
7. E. Niebur, "Saliency map, " Scholarpedia, vol. 2, no. 8, 2007.
8. A. Borji, "What is a salient object a dataset and a baseline model for salient object detection, " Image Processing, IEEE Transactions on, vol. 24, no. 2, pp. 742-756, 2015.
9. Y. Li, X. Hou, C. Koch, J. M. Rehg, and A. L. Yuille, "The secrets of salient object segmentation, " in CVPR, 2014.
10. F. Perazzi, P. Krähenbühl, Y. Pritch, and A. Hornung, "Saliency filters: Contrast based filtering for salient region detection, " in CVPR, 2012.
11. H. Jiang, J. Wang, Z. Yuan, Y. Wu, N. Zheng, and S. Li, "Salient object detection: A discriminative regional feature integration approach, " in CVPR, 2013.
12. N. Bruce and J. Tsotsos, "Saliency based on information maximization, " in NIPS, 2005.
13. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency, " in NIPS, 2006.
14. T. Judd, K. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look, " in ICCV, 2009.
15. A. Borji, "Boosting bottom-up and top-down visual features for saliency estimation, " in CVPR, 2012.
16. T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, and H.-Y. Shum, "Learning to detect a salient object, " Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 33, no. 2, pp. 353-367, 2011.
17. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequency-tuned salient region detection, " in CVPR, 2009.
18. C. Sheth and R. V. Babu, "Object saliency using a background prior, " in ICASSP, 2016.
19. S. S. R and R. V. Babu, "Salient object detection via objectness measure, " in ICIP, 2015.
20. A. K. Mishra, Y. Aloimonos, L.-F. Cheong, A. Kassim, et al., "Active visual segmentation, " Pattern Analysis and Machine Intelligence, IEEE Transactions On, vol. 34, no. 4, pp. 639-653, 2012.
21. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks, " in NIPS, 2012.
22. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation, " in CVPR, 2015.
23. D. Eigen, C. Puhrsch, and R. Fergus, "Depth map prediction from a single image using a multi-scale deep network, " in NIPS, 2014.
24. L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, "Semantic image segmentation with deep convolutional nets and fully connected CRFs, " arXiv preprint arXiv: 1412. 7062, 2014.
25. R. Zhao, W. Ouyang, H. Li, and X. Wang, "Saliency detection by multi-context deep learning, " in CVPR, 2015.
26. N. Liu, J. Han, D. Zhang, S. Wen, and T. Liu, "Predicting eye fixations using convolutional neural networks, " in CVPR, 2015.
27. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition, " arXiv preprint arXiv: 1409. 1556, 2014.
28. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, et al., "Imagenet large scale visual recognition challenge, " International Journal of Computer Vision, pp. 1-42.
29. S. S. Kruthiventi, K. Ayush, and R. V. Babu, "Deepfix: A fully convolutional neural network for predicting human eye fixations, " arXiv preprint arXiv: 1510. 02927, 2015.
30. L. Itti, "Visual salience, " Scholarpedia, vol. 2, no. 9, p. 3327, 2007.
31. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman, "Return of the devil in the details: Delving deep into convolutional nets, " arXiv preprint arXiv: 1405. 3531, 2014.
32. B. Hariharan, P. Arbeláez, R. Girshick, and J. Malik, "Hypercolumns for object segmentation and fine-grained localization, " in CVPR, 2015.
33. G. Li and Y. Yu, "Visual saliency based on multiscale deep features, " arXiv preprint arXiv: 1503. 08663, 2015.
34. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going deeper with convolutions, " arXiv preprint arXiv: 1409. 4842, 2014.
35. P. Krähenbühl and V. Koltun, "Efficient inference in fully connected CRFs with Gaussian edge potentials, " arXiv preprint arXiv: 1210. 5644, 2012.
36. R. Margolin, A. Tal, and L. Zelnik-Manor, "What makes a patch distinct, " in CVPR, 2013.
37. H. Peng, B. Li, H. Ling, W. Hu, W. Xiong, and S. Maybank, "Salient object detection via structured matrix decomposition, " Technical Report, pp. 1-14, 2015.
38. M. Jiang, S. Huang, J. Duan, and Q. Zhao, "SALICON: Saliency in context, " in CVPR, 2015.
39. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional architecture for fast feature embedding, " arXiv preprint arXiv: 1408. 5093, 2014.
40. C. Yang, L. Zhang, H. Lu, X. Ruan, and M.-H. Yang, "Saliency detection via graph-based manifold ranking, " in CVPR, 2013.
41. D. Batra, A. Kowdle, D. Parikh, J. Luo, and T. Chen, "iCoSeg: Interactive co-segmentation with intelligent scribble guidance, " in CVPR, 2010.
42. Q. Yan, L. Xu, J. Shi, and J. Jia, "Hierarchical saliency detection, " in CVPR, 2013.
43. J. Li, M. D. Levine, X. An, X. Xu, and H. He, "Visual saliency based on scale-space analysis in the frequency domain, " Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 35, no. 4, pp. 996-1010, 2013.
44. R. Margolin, L. Zelnik-Manor, and A. Tal, "How to evaluate foreground maps, " in CVPR, 2014.
45. A. Borji, D. N. Sihite, and L. Itti, "Salient object detection: A benchmark, " in ECCV, 2012.
46. A. Garcia-Diaz, V. Leborán, X. R. Fdez-Vidal, and X. M. Pardo, "On the relationship between optical variability, visual saliency, and eye fixations: A computational approach, " Journal of vision, vol. 12, no. 6, p. 17, 2012.
47. J. Zhang and S. Sclaroff, "Saliency detection: A boolean map approach, " in ICCV, 2013.
48. E. Vig, M. Dorr, and D. Cox, "Large-scale optimization of hierarchical features for saliency prediction in natural images, " in CVPR, 2014.
49. J. Pan and X. Giró-i Nieto, "End-to-end convolutional network for saliency prediction, " arXiv: 1507. 01422, 2015.
50. J. Pan, K. McGuinness, E. Sayrol, N. O'Connor, and X. Giro-i Nieto, "Shallow and deep convolutional networks for saliency prediction, " in CVPR, 2016.