Computational modeling of top-down visual attention in interactive environments

BMVC 2011 - Proceedings of the British Machine Vision Conference 2011

Volumn , Issue , 2011, Pages

  Borji, Ali ^a   Sihite, Dicky N ^a   Itti, Laurent ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; EYE MOVEMENTS; INTERACTIVE COMPUTER GRAPHICS;

BIOLOGICAL VISION SYSTEMS; BOTTOM-UP AND TOP-DOWN; BOTTOM-UP SALIENCIES; COMPUTATIONAL MODEL; DISCRIMINATIVE CLASSIFIERS; INTERACTIVE ENVIRONMENTS; TOP-DOWN VISUAL ATTENTIONS; UNIFIED FRAMEWORK;

COMPUTER VISION;

EID: 84898481177     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.5244/C25.85     Document Type: Conference Paper

References (44)

1. http://code.google.com/p/bnt/.
2. http://www.cis.rit.edu/pelz/scanpaths/scanpaths.htm.
3. Garcia-Diaz A., Fdez-Vidal X. R., Pardo X. M., and Dosil R. Decorrelation and distinctiveness providewith human-like saliency. In Proc. ACIVS (LNCS), 2009.
4. D. Ballard, M. Hayhoe, and J. Pelz. Memory representations in natural tasks. Journal of Cog. Neurosci., 7(1):66-80, 1995.
5. D. DeCarlo and A. Santella. Stylization and abstraction of photographs. ACM Transactions on Graphics, 21(3):769-776, 2002.
6. Vig E., Dorr M., Martinetz T., and Barth E. A learned saliency predictor for dynamic natural scenes. In Proc. ICANN, 2010.
7. Kootstra G., Nederveen A., and de Boer B. Paying attention to symmetry. In Proc. BMVC, 2008.
8. Willems G., Tuytelaars T., and Gool. V. G. An efficient dense and scale-invariant spatio-temporal interest point detector. In Proc. LNCS, 2008.
9. C. Guo and L. Zhang. A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Transactions on Image Processing, 19(1): 185-198, 2010.
10. L. Itti and C. Koch. Computational modeling of visual attention. Nat. Rev. Neurosci., 2(3): 194-203, 2001.
11. L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions PAMI, 20(11):1254-1259, 1998.
12. Harel J., Koch C., and Perona P. Graph-based visual saliency. In Proc. NIPS, 2006.
13. Peters R. J. and Itti L. Beyond bottom-up: Incorporating task-dependent influences into a computational model of spatial attention. In Proc. CVPR, 2007.
14. Rapantzikos K., Avrithis Y., and Kollias S. Dense saliency-based spatiotemporal feature points for action recognition. In Proc. CVPR, 2009.
15. Itti L. Automatic foveation for video compression using a neurobiological model of visual attention. IEEE Trans. Image Process, 13(10), 2004.
16. Itti L. and Baldi P. A principled approach to detecting surprising events in video. In Proc. CVPR, 2005.
17. M. Land and M. Hayhoe. In what ways do eye movements contribute to everyday activities? Vision Research, 41(25):3559-3565, 2001.
18. M. F. Land and D. N. Lee. Where we look when we steer. Nature, 369:742-744, 1994.
19. I. Laptev. On space-time interest points. International Journal of Computer Vision, 64(2):107-123, 2005.
20. M M. Corbetta and G. L. Shulman. Control of goalâǎ Řdirected and stimulusâǎ Řdriven attention in the brain. Nature Review Neuroscience, 3(3):201-215, 2002.
21. M. Mancas. Computational attention: Modelisation and application to audio and image processing, 2007. PhD. thesis.
22. O. LeMeur, P. LeCallet, D. Barba, and D. Thoreau. A coherent computational approach tomodel bottom-up visual attention. IEEE Trans. Pattern Anal. Mach. Intell., 28(5):802-817, 2006.
23. Sprague N. and Ballard D. H. Eye movements for reward maximization. In Proc. NIPS, 2003.
24. V. Navalpakkam and L. Itti. Modeling the influence of task on attention. Vision Research, 45(2): 205-231, 2005.
25. Bruce N.D.B. and Tsotsos J.K. Saliency based on information maximization. In Proc. NIPS, 2005.
26. A. Oikonomopoulos, I. Patras, and M. Pantic. Spatiotemporal salient points for visual recognition of human actions. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 36(3):710-719, 2006.
27. Bian P. and Zhang L. Biological plausibility of spectral domain approach for spatiotemporal visual saliency. In Proc. LNCS, 2009.
28. Achanta R., Hemami S., Estrada F., and Susstrunk S. Frequency-tuned salient region detection. In Proc. CVPR, 2009.
29. K. Rayner. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 85:618-660, 1998.
30. R. D. Rimey and C. M. Brown. Controlling eye movements with hidden markov models. International Journal of Computer Vision, 7(1):47-65, 1991.
31. Peters R.J. and Itti L. Congruence between model and human attention reveals unique signatures of critical visual events. In Proc. NIPS, 2008.
32. M. Rubinstein, A. Shamir, and S. Avidan. Improved seam carving for video retargeting. ACM Transactions on Graphics (SIGGRAPH), 2008.
33. Goferman S., Zelnik-Manor L., and Tal A. Context-aware saliency detection. In Proc. CVPR, 2010.
34. D. S. Wooding S. Mannan, K. H. Ruddock. Fixation patterns made during brief examination of 2-d images. Perception, 27:1059-1072, 1997.
35. H.J. Seo and P. Milanfar. Static and space-time visual saliency detection by self-resemblance. Journal of Vision, 9(12):1-27, 2009.
36. C. Siagian and L. Itti. Rapid biologically-inspired scene classification using features shared with visual attention. IEEE Transactions PAMI, 29(2):300-312, 2007.
37. C. Siagian and L. Itti. Biologically inspired mobile robot vision localization. IEEE Transactions on Robotics, 25(4):861-873, 2009.
38. Judd T., Ehinger K., Durand F., and Torralba A. Learning to predict where humans look. In Proc. ICCV, 2009.
39. B. W. Tatler. The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. Journal of Vision, 7(4):1-17, 2007.
40. A. Torralba. Modeling global scene factors in attention. Journal of Optical Society of America, 20(7):1407-1418, 2003.
41. Kienzle W., Wichmann A. F. and Scholkopf B., and Franz M. O. A nonparametric approach to bottom-up visual saliency. In Proc. NIPS, 2007.
42. D. Walther and C. Koch. Modeling attention to salient protoobjects. Neural Networks, 19(9): 1395-1407, 2006.
43. Hou X. and Zhang L. Saliency detection: A spectral residual approach. In Proc. CVPR, 2007.
44. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell. Sun: A bayesian framework for saliency using natural statistics. Journal of Vision, 8(32):1-20, 2008.