Touch saliency: Characteristics and prediction

IEEE Transactions on Multimedia

Volumn 16, Issue 6, 2014, Pages 1779-1791

  Ni, Bingbing ^a   Xu, Mengdi ^b   Nguyen, Tam V ^c,d   Wang, Meng ^e   Lang, Congyan ^f   Huang, Zhongyang ^g   Yan, Shuicheng ^c  

^a ADVANCED DIGITAL SCIENCES CENTER   (Singapore)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^d SINGAPORE POLYTECHNIC   (Singapore)

^e HEFEI UNIVERSITY OF TECHNOLOGY   (China)

^f BEIJING JIAOTONG UNIVERSITY   (China)

^g OmniVision Technologies   (Singapore)

Author keywords

Fixations; middle level object category features; touch saliency; visual saliency

Indexed keywords

FIXATIONS; OBJECT CATEGORIES; TOUCH SALIENCY; VISUAL SALIENCY;

EID: 84907911523     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2014.2329275     Document Type: Article

References (46)

1. M. Xu, B. Ni, J. Dong, Z. Huang, M. Wang, and S. Yan, "Touch saliency," in ACM Multimedia, 2012.
2. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
3. N. D. Bruce and J. K. Tsotsos, "Saliency based on information maximization," in Proc. Advances Neural Inf. Process. Syst., 2005.
4. T. Avraham and M. Lindenbaum, "Esaliency (extended saliency): Meaningful attention using stochastic image modeling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 4, pp. 693-708, Apr. 2010.
5. S. Ramanathan, H. Katti, N. Sebe, M. Kankanhalli, and T.-S. Chua, "An eye fixation database for saliency detection in images," in Proc. Eur. Conf. Comput. Vis., 2010.
6. R. Hong, M. Wang, M. Xu, S. Yan, and T.-S. Chua, "Dynamic captioning: Video accessibility enhancement for hearing impairment," in ACM Multimedia, 2010.
7. R. Hong, M. Wang, X.-T. Yuan, M. Xu, J. Jiang, S. Yan, and T.-S. Chua, "Video accessibility enhancement for hearing impaired users," ACM Trans. Multimedia Comput., Commun., Appl., vol. 7S, no. 1, pp. 24-42, 2011.
8. V. Setlur, S. Takagi, R. Raskar, M. Gleicher, and B. Gooch, "Automatic image retargeting," in Proc. Int. Conf. Mobile Ubiquitous Multimedia, 2005.
9. M. Wang, Y. Sheng, B. Liu, and X.-S. Hua, "In-image accessibility indication," IEEE Trans. Multimedia, vol. 12, no. 4, pp. 330-336, Jun. 2010.
10. O. L. Meur, P. L. Callet, D. Barba, and D. Thoreau, "A coherent computational approach to model the bottom-up visual attention," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 802-817, May 2006.
11. T. Liu, J. Sun, N.-N. Zheng,X. Tang, and H.-Y. Shum, "Learning to detect a salient object," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
12. T. Judd, K. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look," in Proc. 2009 IEEE 12th Int. Conf. Comput. Vis., 2009, pp. 2106-2113 .
13. N. D. B. Bruce and J. K. Tsotsos, "Saliency, attention, and visual search: An information theoretic approach," J. Vis., vol. 9, no. 3, pp. 1-24, 2009.
14. K. Ehinger, B. Hidalgo-Sotelo, A. Torralba, and A. Oliva, "Modeling search for people in 900 scenes," Visual Cog., vol. 17, pp. 945-978, 2009.
15. I. van der Linde, U. Rajashekar, A. C. Bovik, and L. K. Cormack, "Doves: A database of visual eye movements," Spatial Vis., vol. 22, no. 2, pp. 161-177, 2009.
16. C. Lang, G. Liu, J. Yu, and S. Yan, "Saliency detection by multitask sparsity pursuit," IEEE Trans. Image Process., vol. 21, no. 3, pp. 1327-1338, Mar. 2012.
17. S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-aware saliency detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 10, pp. 1915-1926, Oct. 2012.
18. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequencytuned salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2009, pp. 1597-1604.
19. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Advances in Neural Information Processing Systems, B. Schölkopf, J. Platt, and T. Hoffman, Eds. Cambridge,MA, USA: MIT Press, 2007, pp. 545-552.
20. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
21. L. Zhang, M. H. Tong, T. K.Marks, H. Shan, and G.W. Cottrell, "Sun: A Bayesian framework for saliency using natural statistics," J. Vis., vol. 8, no. 7, pp. 32-32, 2008.
22. A. Borji, D. N. Sihite, and L. Itti, "Salient object detection: A benchmark," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 414-429.
23. T. Judd, F. Durand, and A. Torralba, "A benchmark of computational models of saliency to predict human fixations," MIT Comput. Sci. and AI Lab., Cambridge, MA, USA, Tech. Rep. No. MIT-CSAIL-TR-2012-001, 2012.
24. A. Bragdon, E. Nelson-Brown, Y. Li, and K. Hinckley, "Experimental analysis of touch-screen gesture designs in mobile environments," in Proc. Int. Conf. Hum. Factors Comput. Syst., 2011.
25. O. LeMeur, P. Le Callet, D. Barba, and D. Thoreau, "A coherent computational approach to model bottom-up visual attention," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 802-817, 2006.
26. A. M. Treisman and G. Gelade, "A feature-integration theory of attention," Cognitive Psychol., vol. 12, no. 1, pp. 97-136, 1980.
27. V. Gopalakrishnan, Y. Hu, and D. Rajan, "Random walks on graphs for salient object detection in images," IEEE Trans. Image Process., vol. 19, no. 12, pp. 3232-3242, Dec. 2010.
28. Y. Hu, D. Rajan, and L.-T. Chia, "Detection of visual attention regions in images using robust subspace analysis," J. Vis. Commun. Image Represent., vol. 19, no. 3, pp. 199-216, 2008.
29. J. Li, M. D. Levine, X. An, X. Xu, and H. He, "Visual saliency based on scale-space analysis in the frequency domain," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 4, pp. 996-1010, Apr. 2013.
30. L. Itti and C. Koch, "A comparison of feature combination strategies for saliency-based visual attention systems," SPIE Hum. Vis. Electron. Imag. IV, vol. 3644, pp. 373-382, 1999.
31. L. Itti and C. Koch, "Feature combination strategies for saliency-based visual attention systems," J. Electron. Imag., vol. 10, no. 1, pp. 161-169, 2001.
32. V. Navalpakkam and L. Itti, "Search goal tunes visual features optimally," Neuron, vol. 53, no. 4, pp. 605-617, 2007.
33. G. Liu, Z. Lin, S. Yan, J. Sun, Y. Yu, and Y. Ma, "Robust recovery of subspace structures by low-rank representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 171-184, Jan. 2013.
34. M. Cerf, J. Harel,W. Einhäuser, and C.Koch, "Predicting human gaze using low-level saliency combined with face detection," in Proc. Adv. Neural Inf. Process. Syst., 2008, pp. 1-7.
35. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Süsstrunk, "SLIC superpixels compared to state-of-the-art superpixel methods," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2274-2282, May 2012.
36. B. Fulkerson, A. Vedaldi, and S. Soatto, "Class segmentation and object localization with superpixel neighborhoods," in Proc. 2009 IEEE 12th Int. Conf. Comput. Vis., 2009, pp. 670-677.
37. J. Tighe and S. Lazebnik, "Superparsing: Scalable nonparametric image parsing with superpixels," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 352-365.
38. G. Shu, A. Dehghan, and M. Shah, "Improving an object detector and extracting regions using superpixels," in Proc. 2013 IEEE Conf. Comput. Vis. Pattern Recog., 2012, pp. 3721-3727.
39. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
40. B.W. Tatler, R. J. Baddeley, and I. D. Gilchrist et al., "Visual correlates of fixation selection: Effects of scale and time," Vis. Res., vol. 45, no. 5, pp. 643-659, 2005.
41. N. Ouerhani, R. VonWartburg, H. Hugli, and R. Muri, "Empirical validation of the saliency-based model of visual attention," Electron. Lett. Comput. Vis. Image Anal., vol. 3, no. 1, pp. 13-24, 2004.
42. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041 , Dec. 2006.
43. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2005, vol. 1, pp. 886-893.
44. J. Carreira, R. Caseiro, J. Batista, and C. Sminchisescu, "Semantic segmentation with second-order pooling," in Proc. Eur. Conf. Comput. Vis., 2012.
45. G. A. Miller et al., "Wordnet: A lexical database for English," Commun. ACM, vol. 38, no. 11, pp. 39-41, 1995.
46. E.P.Simoncelli andW. T. Freeman, "The steerable pyramid:Aflexible architecture formulti-scale derivative computation," in Proc. Int. Conf. Image Process., 1995, vol. 3, pp. 444-447.