Spatially binned ROC: A comprehensive saliency metric

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 525-534

  Wloka, Calden ^a   Tstotsos, John ^a  

^a YORK UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL RESEARCH; BINS; COMPUTER VISION; GRAPHIC METHODS; OBJECT RECOGNITION;

ADAPTIVE WHITENING; ALGORITHM DEVELOPMENT; ALGORITHM PERFORMANCE; CENTRAL FIXATION; INFORMATION MAXIMIZATION; SPATIAL ARRANGEMENTS; VISUAL ATTENTION; VISUAL SALIENCE;

PATTERN RECOGNITION;

EID: 84986321389     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.63     Document Type: Conference Paper

References (52)

1. G. Boccignone and M. Ferraro. Modelling gaze shift as a constrained random walk. Physica A: Statistical Mechanics and its Applications, 331: 207-218, 2004.
2. A. Borji and L. Itti. Defending yarbus: Eye movements reveal observers' task. Journal of Vision, 14 (3): 29, 2014.
3. A. Borji, D. N. Sihite, and L. Itti. Objects do not predict fixations better than early saliency: A re-analysis of einhuser et al. 's data. Journal of Vision, 13: 1-4, 2013.
4. A. Borji, D. N. Sihite, and L. Itti. Quantitative analysis of human-model agreement in visual saliency modeling: A comparative study. Image Processing, IEEE Transactions on, 22 (1): 55-69, 2013.
5. A. N. Borodin and I. A. Ibragimov. Limit theorems for functionals of random walks. In V. N. Sudakov, editor, Proceedings of the Steklov Institute of Mathematics, volume 195, 1995.
6. D. Brockmann and T. Geisel. The ecology of gaze shifts. Neurocomputing, 32-33: 643-650, 2000.
7. N. D. Bruce, C. Wloka, N. Frosst, S. Rahman, and J. K. Tsotsos. On computational modeling of visual saliency: Examining whats right, and whats left. Vision Research, 116, Part B: 95-112, 2015. Computational Models of Visual Attention.
8. N. D. B. Bruce and J. K. Tsotsos. Saliency based on information maximization. Advances in Neural Information Processing, 18: 155-162, 2006.
9. Z. Bylinskii, E. M. DeGennaro, R. Rajalingham, H. Ruda, J. Zhang, and J. Tsotsos. Towards the quantitative evaluation of visual attention models. Vision Research, In Press, 2015.
10. C.-K. Chang, C. Siagian, and L. Itti. Mobile robot vision navigation and localization using gist and saliency. In Proc. Intelligent Robots and Systems (IROS), 2010.
11. E. Erdem and A. Erdem. Visual saliency estimation by nonlinearly integrating features using region covariances. Journal of Vision, 13 (4): 11, 2013.
12. S. Frintrop, G. Backer, and E. Rome. Goal-directed search with a top-down modulated computational attention system. In Pattern Recognition, volume 3663, pages 117-124. Springer Berlin Heidelberg, 2005.
13. N. M. W. Frosst, C. Wloka, and J. K. Tsotsos. The effects of image padding in saliency algorithms. Perception, 43 ECVP Abstract Supplement: 106, 2014.
14. A. Garcia-Diaz, X. R. Fdez-Vidal, X. M. Pardo, and R. Dosil. Saliency from hierarchical adaptation through decorrelation and variance normalization. Image and Vision Computing, 30 (1): 51-64, 2012.
15. S. Goferman, L. Zelnik-Manor, and A. Tal. Context-aware saliency detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34: 1915-1926, 2012.
16. D. M. Green, J. A. Swets, et al. Signal detection theory and psychophysics, volume 1. Wiley New York, 1966.
17. C. Guo and L. Zhang. A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Transactions on Image Processing, 19: 185-198, 2010.
18. J. Harel, C. Koch, and P. Perona. Graph-based visual saliency. Advances in Neural Information Processing, 19: 545-552, 2007.
19. X. Hou, J. Harel, and C. Koch. Image signature: Highlighting sparse salient regions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34: 194-201, 2012.
20. X. Hou and L. Zhang. Dynamic visual attention: Searcing for coding length increments. Neural Information Processing Systems, 21: 681-688, 2008.
21. L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20: 1254-1259, 1998.
22. M. Jiang, S. Huang, J. Duan, and Q. Zhao. Salicon: Saliency in context. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2015.
23. T. Judd, F. Durand, and A. Torralba. A benchmark of computational models of saliency to predict human fixations. Technical report, Massachusetts Institute of Technology, 2012.
24. T. Judd, K. Ehinger, F. Durand, and A. Torralba. Learning to predict where humans look. http: //people. csail. mit. edu/tjudd/WherePeopleLook/.
25. T. Judd, K. Ehinger, F. Durand, and A. Torralba. Learning to predict where humans look. In International Conference on Computer Vision, 2009.
26. C. Kanan, M. H. Tong, L. Zhang, and G. W. Cottrell. Sun: Top-down saliency using natural statistics. Visual Cognition, 17: 979-1003, 2009.
27. C. Koch and S. Ullman. Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology, 4: 219-227, 1985.
28. S. Kullback and R. A. Leibler. On information and sufficiency. The Annals of Mathematical Statistics, pages 79-86, 1951.
29. J. Li, M. D. Levine, X. An, X. Xu, and H. He. Visual saliency based on scale-space analysis in the frequency domain. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35: 996-1010, 2013.
30. I. v. d. Linde, U. Rajashekar, A. C. Bovik, and L. K. Cormack. DOVES: A database of visual eye movements. Retrieved from http: //live. ece. utexas. edu/research/doves.
31. I. v. d. Linde, U. Rajashekar, A. C. Bovik, and L. K. Cormack. DOVES: A database of visual eye movements. Spatial Vision, 22: 161-177, 2009.
32. S. Mathe and C. Sminchisescu. Dynamic eye movement datasets and learnt saliency models for visual action recognition. European Conference on Computer Vision, 2012.
33. S. Mathe and C. Sminchisescu. Action from still image dataset and inverse optimal control to learn task specific visual scanpaths. Advances in Neural Information Processing, pages 1923-1931, 2013.
34. D. Parkhurst, K. Law, and E. Niebur. Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42: 107-123, 2002.
35. D. Parkhurst and E. Niebur. Scene content selected by active vision. Spatial Vision, 16: 125-154, 2003.
36. R. J. Peters, A. Iyer, L. Itti, and C. Koch. Components of bottom-up gaze allocation in natural images. Vision Research, 45: 2397-2416, 2005. 2
37. A. Rasouli and J. K. Tsotsos. Visual saliency improves autonomous visual search. In Computer and Robot Vision (CRV), 2014.
38. N. Riche, M. Duvinage, M. Mancas, B. Gosselin, and T. Dutoit. Saliency and human fixations: State-of-the-art and study of comparison metrics. In International Conference on Computer Vision (ICCV), pages 1153-1160, 2013.
39. R. Roberts, D.-N. Ta, J. Straub, K. Ok, and F. Dellaert. Saliency detection and model-based tracking: A two part vision system for small robot navigation in forested environments. In Proc. SPIE 8387, 2012.
40. Y. Rubner, C. Tomasi, and L. J. Guibas. A metric for distributions with applications to image databases. In Computer Vision, 1998. Sixth International Conference on, pages 59-66. IEEE, 1998.
41. B. Russel, A. Torralba, K. Murphy, and W. T. Freeman. LabelMe: A database and web-based tool for image annotation. International Journal of Computer Vision, 2007.
42. B. Schauerte and R. Stiefelhagen. Quaternion-based spectral saliency detection for eye fixation prediction. In European Conference on Computer Vision, pages 116-129, 2012.
43. H. J. Seo and P. Milanfar. Static and space-time visual saliency detection by self-resemblance. Journal of Vision, 9 (12): 1-27, 2012.
44. B. W. Tatler, R. J. Baddeley, and I. D. Gilchrist. Visual correlates of fixation selection: effects of scale and time. Vision Research, 45: 643-659, 2005.
45. B. W. Tatler and B. T. Vincent. The prominence of behavioural biases in eye guidance. Visual Cognition, 17: 1029-1054, 2009.
46. A. Treisman and G. Gelade. A feature integration theory of attention. Cognitive Psychology, 12: 97-136, 1980.
47. J.-F. Tsai and K.-J. Chang. Opensource implementation of context-aware saliency detection. https: //sites. google. com/a/jyunfan. co. cc/site/opensource-1/contextsaliency.
48. J. H. van Hateren and A. van der Schaaf. Independent component filters of natural images compared with simple cells in primary visual cortex. Proceedings: Biological Sciences, 265: 359-366, 1998.
49. E. Vig, M. Dorr, and D. Cox. Space-variant descriptor sampling for action recognition based on saliency and eye movements. In A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, and C. Schmid, editors, ECCV 2012, volume 7578 of Lecture Notes in Computer Science, pages 84-97. Springer Berlin Heidelberg, 2012.
50. C. Wloka and J. K. Tsotsos. Overt fixations reflect a natural central bias. Journal of Vision, 13: 239, 2013.
51. A. Yarbus. Eye Movements and Vision. Plenum Press, 1967.
52. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell. Sun: A Bayesian framework for saliency using natural statistics. Journal of Vision, 8 (7: 32): 1-20, 2008.