Transition of visual attention assessment in stereoscopic images with evaluation of subjective visual quality and discomfort

IEEE Transactions on Multimedia

Volumn 17, Issue 12, 2015, Pages 2198-2209

  Kim, Haksub ^a   Lee, Sanghoon ^a  

^a Yonsei University   (South Korea)

Author keywords

Eye tracker; human visual system; saliency entropy; stereoscopic; subjective quality discomfort assessment; transition of visual attention (ToVA)

Indexed keywords

ENTROPY; QUALITY CONTROL; STEREO IMAGE PROCESSING;

EYE TRACKERS; HUMAN VISUAL SYSTEM; STEREOSCOPIC; SUBJECTIVE QUALITY; VISUAL ATTENTION;

BEHAVIORAL RESEARCH;

EID: 84960849583     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2015.2493367     Document Type: Article

References (35)

1. Q. Huynh-Thu, M. Barkowsky, and P. Le Callet, "The importance of visual attention in improving the 3D-TV viewing experience: Overview and new perspectives," IEEE Trans. Broadcast., vol. 57, no. 2, pp. 421-431, Jun. 2011.
2. H. Kim, S. Lee, and A. C. Bovik, "Saliency prediction on stereoscopic videos," IEEE Trans. Image Process., vol. 23, no. 4, pp. 1476-1490, Apr. 2014.
3. M. Barkowsky, K. Wang, R. Cousseau, K. Brunnstrom, R. Olsson, and P. Le Callet, "Subjective quality assessment of error concealment strategies for 3D-TV in the presence of asymmetric transmission errors," in Proc. Packet Video Workshop, 2010, pp. 193-200.
4. M. Lambooij, W. IJsselsteijn, M. Fortuin, and I. Heynderickx, "Visual discomfort and visual fatigue of stereoscopic displays: A review," J. Imaging Sci. Technol., vol. 53, no. 3, p. 4, 2009, Art. ID 0302011.
5. L. Itti and C. Koch, "Computational modeling of visual attention," Nature Rev. Neurosci., vol. 2, pp. 194-203, 2001.
6. L. Itti and C. Koch, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
7. N. Bruce and J. K. Tsotsos, "Saliency, attention, and visual search: An information theoretic approach," J. Vis., vol. 9, no. 3, pp. 1-24, 2009.
8. L. Itti and P. Baldi, "Bayesian surprise attracts human attention," Vis. Res., vol. 49, no. 10, pp. 1295-1306, 2009.
9. L. Zhang, M. H. Tong, T. K. Marks, H. Shan, and G. W. Cottrell, "SUN: A bayesian framework for saliency using natural statistics," J. Vis., vol. 8, no. 7, pp. 1-20, 2008.
10. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Proc. Adv. Neural Inf. Process. Syst., 2006, pp. 545-552.
11. U. Rajashekar, I. Van Der Linde, A. C. Bovik, and L. K. Cormack, "GAFFE: A gaze-attentive fixation finding engine," IEEE Trans. Image Process., vol. 17, pp. 564-573, Apr. 2008.
12. Y. Ma, X. Hua, L. Lu, and H. Zhang, "A generic framework of user attention model and its application in video summarization," IEEE Trans. Multimedia, vol. 7, pp. 907-919, Oct. 2005.
13. S. Kullback, "The kullback-leibler distance," American Statistician, vol. 41, no. 4, pp. 340-340, 1987.
14. Image safety. reducing the incidence of undesirable biomedical effects caused by visual image sequences, ISO/IWA3:2005, 2005.
15. T. Kim, J. Kang, S. Lee, and A. C. Bovik, "Multimodal interactive continuous scoring of subjective 3D video quality of experience," IEEE Trans. Multimedia, vol. 16, no. 2, pp. 387-402, Feb. 2014.
16. S. Yang, T. Schlieski, B. Selmins, S. Cooper, R. Doherty, P. Corriveau, and J. Sheedy, "Stereoscopic viewing and reported perceived immersion and symptoms," Optometry Vis. Sci., vol. 89, no. 7, pp. 1068-1080, 2012.
17. A. K. Moorthy, C. C. Su, A. Mittal, and A. C. Bovik, "Subjective evaluation of stereoscopic image quality," Signal Process.: Image Commun., vol. 28, no. 8, pp. 870-883, 2013.
18. Subjective video quality assessment methods for multimedia applications, ITU-T Recommendation P.910, ITU, 2008.
19. Y. Liu, L. K. Cormack, and A. C. Bovik, "Dichotomy between luminance and disparity features at binocular fixations," J. Vis., vol. 10, no. 12, pp. 1-17, 2010.
20. M. J. Chen, L. K. Cormack, and A. C. Bovik, "No-reference quality assessment of natural stereopairs," IEEE Trans. Image Process., vol. 22, no. 9, pp. 3379-3391, Sep. 2013.
21. K. T. Mullen, "The contrast sensitivity of human colour vision to redgreen and blue-yellow chromatic gratings," J. Physiol., vol. 359, no. 1, pp. 381-400, 1985.
22. Y. Zhang, G. Jiang, M. Yu, and K. Chen, "Stereoscopic visual attention model for 3D video," in Advances in Multimedia Modeling, ser. Lecture Notes in Comput. Sci.. Berlin, Germany: Springer-Verlag, 2010, vol. 5916, pp. 314-324.
23. Reference softwares for depth estimation and view synthesis, ISO/IEC JTC1/SC29/WG11 MPEG 20081 M15377, Apr. 2008.
24. Z. Wang, A. C. Bovik, and H. R. Sheikh, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
25. L. Goldmann, F. D. Simone, and T. Ebrahimi, "Impact of acquisition distortions on the quality of stereoscopic images," in Proc. Int. Workshop Video Process. Quality Metrics Consumer Electron., 2010.
26. J. Park, H. Oh, S. Lee, and A. C. Bovik, "3D visual discomfort predictor: Analysis of disparity and neural activity statistics," IEEE Trans. Image Process., vol. 24, no. 3, pp. 1101-1114, Mar. 2015.
27. K. Lee and S. Lee, "3D perception based quality pooling: Stereopsis, binocular rivalry, and binocular suppression," IEEE J. Sel. Topics Signal Process., vol. 9, no. 3, pp. 533-545, Apr. 2015.
28. K. Lee, A. K. Moorthy, S. Lee, and A. C. Bovik, "3D visual activity assessment based on natural scene statistics," IEEE Trans. Image Process., vol. 23, no. 1, pp. 450-465, Jan. 2014.
29. T. Qhshima, H. Yamamoto, and H. Tamura, "Gaze-directed adaptive rendering for interacting with virtual space," in Proc. VRAIS, 1996, pp. 103-110.
30. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video compression with optimal rate control," IEEE Trans. Image Process., vol. 10, no. 7, pp. 977-992, Jul. 2001.
31. S. Lee and A. C. Bovik, "Fast algorithms for foveated video processing," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 2, pp. 149-162, Feb. 2003.
32. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video quality assessment," IEEE Trans. Multimedia, vol. 4, no. 1, pp. 129-132, Mar. 2002.
33. W. S. Geisler and J. S. Perry, "A real-time foveated multi-resolution system for low-bandwidth video communication," in Proc. SPIE, 1998, vol. 3299, pp. 294-305.
34. D. Walther, U. Rutishauser, C. Koch, and P. Perona, "On the usefulness of attention for object recognition," in Proc. 8th Eur. Conf. Comput. Vis., 2004, pp. 96-103.
35. K. Seshadrinathan, R. Soundararajan, A. C. Bovik, and L. K. Cormack, "Study of subjective and objective quality assessment of video," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1427-1441, Jun. 2010.