A video saliency detection model in compressed domain

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 24, Issue 1, 2014, Pages 27-38

  Fang, Yuming ^a   Lin, Weisi ^b   Chen, Zhenzhong ^c   Tsai, Chia Ming ^d   Lin, Chia Wen ^e  

^a JIANGXI UNIVERSITY OF FINANCE AND ECONOMICS   (China)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c WUHAN UNIVERSITY   (China)

^d NATIONAL CHUNG CHENG UNIVERSITY   (Taiwan)

^e NATIONAL TSING HUA UNIVERSITY   (Taiwan)

Author keywords

Compressed domain; video saliency detection; visual attention

Indexed keywords

COMPRESSED DOMAIN; DISCRETE COSINE TRANSFORM COEFFICIENTS; IMAGE PROCESSING APPLICATIONS; REGIONS OF INTEREST; STATIC SALIENCY MAP; VIDEO OVER INTERNET; VIDEO SALIENCIES; VISUAL ATTENTION;

LUMINANCE; TEXTURES;

IMAGE SEGMENTATION;

EID: 84892587672     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2013.2273613     Document Type: Article

References (38)

1. A. Treisman and G. Gelade, "A feature-integration theory of attention," Cognitive Psychology, vol. 12, no. 1, pp. 97-136, 1980.
2. J. Wolfe, "Guided search 2.0: A revised model of guided search," Psychonomic Bull. Rev., vol. 1, no. 2, pp. 202-238, 1994.
3. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
4. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Int. Conf. Comput. Vision Pattern Recognit., Jun. 2007, pp. 1-8.
5. C. Guo and L. Zhang, "A novel multi-resolution spatiotemporal saliency detection model and its applications in image and video compression," IEEE Trans. Image Process., vol. 19, no. 1, pp. 185-198, Jan. 2010.
6. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequency- tuned salient region detection," in Proc. IEEE Int. Conf. Comput. Vision Pattern Recognit., Jun. 2009, pp. 1597-1604.
7. S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-aware saliency detection," in Proc. IEEE Int. Conf. Comput. Vision Pattern Recognit., Jun. 2010, pp. 2376-2383.
8. L. Itti and P. Baldi, "Bayesian surprise attracts human attention," Adv. Neural Inform. Process. Syst., vol. 46, nos. 8-9, pp. 1194-1209, Apr. 2006.
9. Y. Zhai and M. Shah, "Visual attention detection in video sequences using spatiotemporal cues," in Proc. ACM Int. Conf. Multimedia, 2006, pp. 815-824. (Pubitemid 47113641)
10. ISO/IEC JTC1, Information technology-Coding of audio-visual objects Part2: Visual, ISO/IEC 14492-2, (MPEG-4 Visual), Version 1: Apr. 1999, Version 2: Feb. 2000, Version 3: May 2004.
11. Y. L. Huang and R. F. Chang, "Texture features for DCT-coded image retrieval and classification," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., vol. 6. 1999, pp. 3013-3016.
12. C. Theoharatos, V. K. Pothos, N. A. Laskaris, G. Economou, and S. Fotopoulos, "Multivariate image similarity in the compressed domain using statistical graph matching," Pattern Recognit., vol. 39, pp. 1892-1904, Oct. 2006. (Pubitemid 43947097)
13. B. A. Wandell, Foundations of Vision. Springfield, MA, USA: Sinauer Associates, 1995.
14. Y. Fang, Z. Chen, W. Lin, and C. Lin, "Saliency-based image retargeting in the compressed domain," in Proc. ACM MM, 2011, pp. 1049-1052.
15. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," Adv. Neural Inform. Process. Syst., vol. 19, pp. 545-552, MIT Press, 2007.
16. X. Hou and L. Zhang, "Dynamic visual attention: Searching for coding length increments," Adv. Neural Inform. Process. Syst., vol. 21, pp. 681-688, MIT Press, 2008.
17. T. Ebrahimi and C. Home, "MPEG-4 natural video coding: An overview," Signal Process. Image Commun., vol. 15, no. 4, pp. 365-385, 2000. (Pubitemid 30535889)
18. R. Talluri, "Error-resilient video coding in the ISO MPEG-4 standard," IEEE Commun. Mag., vol. 36, no. 6, pp. 112-119, Jun. 1998. (Pubitemid 128570591)
19. R. J. Peters and L. Itti, "Applying computational tools to predict gaze direction in interactive visual environments," ACM Trans. Appl. Perception, vol. 5, no. 2, pp. 1-19, 2008.
20. S. Kullback, Information Theory and Statistics. New York, NY, USA: Wiley, 1959.
21. S. Kullback and R. A. Leibler, "On information and sufficiency," Ann. Math. Stat., vol. 22, no. 1, pp. 79-86, 1951.
22. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd ed. San Diego, CA, USA: Academic Press, 1990.
23. C. W. Therrien, Decision Estimation and Classication: An Introduction to Pattern Recognition and Related Topics. New York, NY, USA: Wiley, 1989.
24. M. M. Chun and K. Nakayama, "On the functional role of implicit visual memory for the adaptive deployment of attention across scenes," Visual Cognition, vol. 7, nos. 1-3, pp. 65-81, 2000. (Pubitemid 30353621)
25. M. F. Land and S. Furneaux, "The knowledge base of the oculomotor system," Philosoph. Trans. Roy. Soc. London B, Biol. Sci., vol. 352, pp. 1231-1239, Aug. 1997. (Pubitemid 27393105)
26. R. A. Rensink, "Seeing, sensing, and scrutinizing," Vision Res., vol. 40, no. 10-12, pp. 1469-1487, 2000. (Pubitemid 30216461)
27. J. M. Wolfe, S. J. Butcher, and M. Hyle, "Changing your mind: On the contributions of top-down and bottom-up guidance in visual search for feature singletons," J. Experimental Psychol. Human Perception Performance, vol. 29, no. 2, pp. 483-502, 2003. (Pubitemid 37189359)
28. J. Braun and D. Sagi, "Vision outside the focus of attention," Perception Psychophysics, vol. 48, no. 1, pp. 45-48, 1990.
29. Z. Lu, W. Lin, X. Yang, E. Ong, and S. Yao, "Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation," IEEE Trans. Image Process., vol. 14, no. 11, pp. 1928-1942, Nov. 2005. (Pubitemid 41655695)
30. H. Pashler, The psychology of attention. Cambridge, MA, USA: MIT Press, 1997.
31. C. Koch and S. Ullman, "Shifts in selective visual attention: Towards the underlying neural circuitry," Human Neurobiology, vol. 4, no. 4, pp. 219-227, 1985. (Pubitemid 16176695)
32. A. Treisman and S. Gormican, "Feature analysis in early vision: Evidence from search asymmetries," Psychology Rev., vol. 95, no. 1, pp. 15-48, 1988.
33. C. Chamaret, J. C. Chevet, and O. Le Meur, "Spatio-temporal combination of saliency maps and eye-tracking assessment of different strategies," in Proc. Int. Conf. Image Process., 2010, pp. 1377-1387.
34. N. Otsu, "A threshold selection method from gray-level histograms," IEEE Trans. Syst., Man, Cybern., vol. 9, no. 1, pp. 62-66, Jan. 1979. (Pubitemid 9413341)
35. O. Le Meur, A. Ninassi, P. Le Callet, and D. Barba, "Do video coding impairments disturb the visual attention deployment?" Signal Process. Image Commun., vol. 25, no. 8, pp. 597-609, 2010.
36. F. M. Porikli, "Real-time video object segmentation for MPEG-encoded video sequences," in Proc. SPIE Conf. Real-Time Imagining VIII, vol. 5297. 2004, pp. 195-203.
37. F. Cavalli, R. Cucchiara, M. Piccardi, and A. Prati, "Performance analysis of MPEG-4 decoder and encoder," in Proc. Int. Symp. Video/Image Process. Multimedia Commun., 2002, pp. 227-231.
38. Y. Fang, Z. Chen, W. Lin, and C.-W. Lin, "Saliency detection in the compressed domain for adaptive image retargeting," IEEE Trans. Image Process., vol. 21, no. 9, pp. 3888-3901, Sep. 2012.