Visual saliency estimation by nonlinearly integrating features using region covariances

Journal of Vision

Volumn 13, Issue 4, 2013, Pages

  Erdem, Erkut ^a   Erdem, Aykut ^a  

^a HACETTEPE UNIVERSITY   (Turkey)

Author keywords

Computational saliency model; Feature integration; Region covariances; Visual attention

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; ATTENTION; BIOLOGICAL MODEL; EYE MOVEMENT; HUMAN; PHYSIOLOGY; PSYCHOPHYSICS; STATISTICAL MODEL;

ANALYSIS OF VARIANCE; ATTENTION; EYE MOVEMENTS; HUMANS; MODELS, BIOLOGICAL; MODELS, STATISTICAL; PSYCHOPHYSICS;

EID: 84878384522     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/13.4.11     Document Type: Article

References (64)

1. Achanta, R., Hemami, S., Estrada, F., & Susstrunk, S. (2009). Frequency-tuned salient region detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1597-1604).
2. Achanta, R., & Susstrunk, S. (2009). Saliency detection for content-aware image resizing. In IEEE International Conference on Image Processing (ICIP) (pp. 1005-1008).
3. Avidan, S., & Shamir, A. (2007). Seam carving for content-aware image resizing. ACM Transactions on Graphics, 26(3).
4. Bangalore, S. M., & Ma, W.-Y. (1996). Texture features and learning similarity. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(8), 837-842.
5. Borji, A., & Itti, L. (2012). Exploiting local and global patch rarities for saliency detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 478-485).
6. Bruce, N., & Tsotsos, J. (2006). Saliency based on information maximization. In Y. Weiss, B. Scholkopf, & J. Platt, Advance in Neural Information Processing Systems (NIPS), pp. 155-162. Cambridge, MA: MIT Press.
7. Bruce, N., & Tsotsos, J. (2009). Saliency, attention, and visual search: An information theoretic approach. Journal of Vision, 9(3):5, 1-24, http://www.journalofvision.org/content/9/3/5, doi:10.1167/9.3. 5. [PubMed] [Article]
8. Butko, N. J., Lingyun, Z., Cottrell, G. W., & Movellan, J. R. (2008). Visual saliency model for robot cameras. In IEEE International Conference on Robotics and Automation (ICRA) (pp. 2398-2403).
9. Callaghan, T. C. (1989). Interference and domination in texture segregation: Hue, geometric form, and line orientation. Perception and Pyschophysics, 46(4), 299-311.
10. Callaghan, T. C. (1990). Interference and dominance in texture segregation. In D. Brogan (Ed.), Visual search (pp. 81-87). New York: Taylor & Francis.
11. Cerf, M., Frady, E., & Koch, C. (2009). Faces and text attract gaze independent of the task: Experimental data and computer model. Journal of Vision, 9(12): 10, 1-15, http://www.journalofvision.org/content/9/12/10, doi:10.1167/9.12.10. [PubMed] [Article]
12. Cerf, M., Harel, J., Einhaeuser, W., & Koch, C. (2007). Predicting human gaze using low-level saliency combined with face detection. In J. C. Platt, D. Koller, Y. Singer, & S. Rowels, Advance in Neural Information Processing Systems (NIPS), pp. 241- 248. Cambridge, MA: MIT Press.
13. Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., & Hu, S.-M. (2011). Global contrast based salient region detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR)(pp. 409- 416).
14. Duan, L., Wu, C., Miao, J., Qing, L., & Fu, Y. (2011). Visual saliency detection by spatially weighted dissimilarity. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 473- 480).
15. Eckstein, M. P., Thomas, J. P., Palmer, J., & Shimozaki, S. S. (2000). A signal detection model predicts the effects of set size on visual search accuracy for feature, conjunction, triple conjunction, and disjunction displays. Perception and Pyschophysics, 62(3), 425-451.
16. Föerstner, W., & Moonen, B. (1999). A metric for covariance matrices (Tech. Rep.). Department of Geodesy and Geoinformatics, Stuttgart University, Germany.
17. Gao, D., Han, S., & Vasconcelos, N. (2009). Discriminant saliency, the detection of suspicious coincidences, and applications to visual recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(6), 989-1005.
18. Gao, D., & Vasconcelos, N. (2007). Bottom-up saliency is a discriminant process. In IEEE International Conference on Computer Vision (ICCV) (pp. 1-6).
19. Goferman, S., Zelnik-Manor, L., & Tal, A. (2010). Context-aware saliency detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2376-2383).
20. Green, D. M., & Swets, J. A. (1966). Signal detection theory and psychophysics. New York: John Wiley.
21. Harel, J., Koch, C., & Perona, P. (2007). Graph-based visual saliency. In B. Scholkopf, J. Platt, & T. Hoffman (Eds.), Advance in Neural Information Processing Systems (NIPS), pp. 545-552. Cambridge, MA: MIT Press.
22. Hong, X., Chang, H., Shan, S., Chen, X., & Gao, W. (2009). Sigma set: A small second order statistical region descriptor. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1802- 1809).
23. Hou, X., & Zhang, L. (2007). Saliency detection: A spectral residual approach. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1-8).
24. Itti, L., Koch, C., & Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11), 1254-1259.
25. Judd, T., Durand, F., & Torralba, A. (2012. January). A benchmark of computational models of saliency to predict human fixations (Tech. Rep. No. MITCSAIL- TR-2012-001). Cambridge, MA: MIT
26. Computer Science and Artificial Intelligence Laboratory. Judd, T., Ehinger, K., Durand, F., & Torralba, A. (2009). Learning to predict where humans look. In IEEE International Conference on Computer Vision (ICCV) (pp. 2106-2113).
27. Julier, S., & Uhlmann, J. K. (1996). A general method for approximating nonlinear transformations of probability distributions (Tech. Rep.). Robotics Research Group, Department of Engineering Science, University of Oxford.
28. Karklin, Y., & Lewicki, M. S. (2009). Emergence of complex cell properties by learning to generalize in natural scenes. Nature, 457, 83-86.
29. Koch, C., & Ullman, S. (1985). Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology, 4(4), 219-227.
30. Li, J., Levine, M. D., An, X., Xu, X., & He, H. (2012). Visual saliency based on scale-space analysis in the frequency domain. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(4), 996-1010.
31. Liu, T., Jian Sun, X. T., Nan-Ning Zheng, & Shum, H.- Y. (2007). Learning to detect a salient object. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 1-8).
32. Parkhurst, D., Law, K., & Niebur, E. (2002). Modeling the role of salience in the allocation of overt visual attention. Vision Research, 42(1), 107-123.
33. Pele, O., & Werman, M. (2009). Fast and robust earth movers distances. In IEEE International Conference on Computer Vision (ICCV) (pp. 460-467).
34. Peters, R., Iyer, A., Itti, L., & Koch, C. (2005). Components of bottom-up gaze allocation in natural images. Vision Research, 45(18), 2397-2416.
35. Porikli, F., Tuzel, O., & Meer, P. (2006). Covariance tracking using model update based on Lie algebra. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 728-735).
36. Portilla, J., & Simoncelli, E. P. (2000). A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision, 40(1), 49-71.
37. Puzicha, J., Hofmann, T., & Buhmann, J. M. (1997). Non-parametric similarity measures for unsupervised texture segmentation and image retrieval. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 267-272).
38. Rahtu, E., Kannala, J., Salo, M., & Heikkilä, J. (2010). Segmenting salient objects from images and videos. In Kostas Daniilidis, Petros Maragos, & Nikos Paragios (Eds.), European Conference of Computer Vision (ECCV), Series: Lecture Notes in Computer Science, pp. 366-379. Berlin, Heidelberg: Springer.
39. Rosenholtz, R. (2000). Significantly different textures: A computational model of pre-attentive texture segmentation. In David Vernon (Ed.), European Conference of Computer Vision, Series: Lecture Notes in Computer Science, pp. 197-211. Berlin, Heidelberg: Springer.
40. Rosenholtz, R. (2001). Search asymmetries?. What search asymmetries? Perception & Psychophysics, 63(3), 476-489.
41. Rosenholtz, R. (1999). A simple saliency model predicts a number of motion popout phenomena. Vision Research, 39, 3157-3163.
42. Rosenholtz, R., Nagy, A. L., & Bell, N. R. (2004). The effect of background color on asymmetries in color search. Journal of Vision, 4(3):9, 224-240, http://www.journalofvision.org/content/4/3/9, doi:10. 1167/4.3.9. [PubMed] [Article]
43. Rubinstein, M., Gutierrez, D., Sorkine, O., & Shamir, A. (2010). A comparative study of image retargeting. ACM Transactions on Graphics, 29(5):160, 1- 10.
44. Rubner, Y., Tomasi, C., & Guibas, L. J. (2000). The earth mover's distance as a metric for image retrieval. International Journal of Computer Vision, 40, 99-121.
45. Rutishauser, U., Walther, D., Koch, C., & Perona, P. (2004). Is bottom-up attention useful for object recognition? In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 37- 44).
46. Seo, H. J., & Milanfar, P. (2009). Static and space-time visual saliency detection by self-resemblance. Journal of Vision, 9(12):15, 1-27, http://www.journalofvision.org/content/9/12/15, doi:10.1167/9. 12.15. [PubMed] [Article]
47. Siagian, C., & Itti, L. (2007). Rapid biologicallyinspired scene classification using features shared with visual attention. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(2), 300-312.
48. Tatler, B. W. (2007). The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. Journal of Vision, 7(14):4, 1-17, http://www.journalofvision.org/content/7/14/4, doi:10.1167/7.14.4. [PubMed] [Article]
49. Tatler, B. W., Baddeley, R. J., & Gilchrist, I. D. (2005). Visual correlates of fixation selection: Effects of scale and time. Vision Research, 45(5), 643-659.
50. Torralba, A. (2003). Modeling global scene factors in attention. Journal of the Optical Society of America A, 20(7), 1407-1418.
51. Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006). Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review, 113(4), 766-786.
52. Treisman, A., & Gelade, G. (1980). A feature integration theory of attention. Cognitive Psychology, 12, 97-136.
53. Tseng, P.-H., Carmi, R., Cameron, I. G., Munoz, D. P., & Itti, L. (2009). Quantifying center bias of observers in free viewing of dynamic natural scenes. Journal of Vision, 9(7):4, 1-16, http://www. journalofvision.org/content/9/7/4, doi:10.1167/9.7. 4. [PubMed] [Article]
54. Tuzel, O., Porikli, F., & Meer, P. (2006). Region covariance: A fast descriptor for detection and classification. In Ales? Lonards, Horst Bischof, & Axel Pinz (Eds.), European Conference of Computer Vision (ECCV), Series: Lecture Notes in Computer Science (3952), pp. 589-600. Berlin, Heidelberg: Springer.
55. Tuzel, O., Porikli, F., & Meer, P. (2008). Pedestrian detection via classification on Riemannian manifolds. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(10), 1713-1727.
56. Viola, P., & Jones, M. (2001). Rapid object detection using a boosted cascade of simple features. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 511-518).
57. Voorhees, H., & Poggio, T. (1988). Computing texture boundaries from images. Nature, 333, 364-367.
58. Wang, Y.-S., Tai, C.-L., Sorkine, O., & Lee, T.-Y. (2008). Optimized scale-and-stretch for image resizing. ACM Transaction on Graphics, 27(5):118, 1-8.
59. Wang, Z., Lu, L., & Bovik, A. C. (2003). Foveation scalable video coding with automatic fixation selection. IEEE Transactions on Image Processing, 12, 243-254.
60. Wolfe, J. M. (1994). Guided search 2.0: A revised model of visual search. Psychonomic Bulletin & Review, 1(2), 202-238.
61. Wolfe, J. M., Cave, K. R., & Franzel, S. L. (1989). Guided search: An alternative to the feature integration model for visual search. Journal of Experimental Psychology: Human Perception & Performance, 15(3), 419-433.
62. Zhang, L., Tong, M. H., Marks, T. K., Shan, H., & Cottrell, G. W. (2008). SUN: A Bayesian framework for saliency using natural statistics. Journal of Vision, 8(7):32, 1-20, http://www.journalofvision.org/content/8/7/32, doi:10.1167/8.7.32. [PubMed] [Article]
63. Zhao, Q., & Koch, C. (2011). Learning a saliency map using fixated locations in natural scenes. Journal of Vision, 11(3):9, 1-15, http://www.journalofvision. org/content/11/3/9, doi:10.1167/11.3.9. [PubMed] [Article]
64. Zhao, Q., & Koch, C. (2012). Learning visual saliency by combining feature maps in a nonlinear manner using AdaBoost. Journal of Vision, 12(6):22, 1-15, http://www.journalofvision.org/content/12/6/22, doi:10.1167/12.6.22. [PubMed] [Article]