Multimodal interactive continuous scoring of subjective 3D video quality of experience

IEEE Transactions on Multimedia

Volumn 16, Issue 2, 2014, Pages 387-402

  Kim, Taewan ^a   Kang, Jiwoo ^a   Lee, Sanghoon ^a   Bovik, Alan C ^b  

^a Yonsei University   (South Korea)

^b The University of Texas at Austin   (United States)

Author keywords

3D quality of experience (QoE); empirical 3D distortion; interactive continuous subjective quality assessment; Multimodal interactive continuous scoring of quality (MICSQ); subjective assessment; visual comfort evaluation

Indexed keywords

CONTINUOUS SCORING; QUALITY OF EXPERIENCE (QOE); SUBJECTIVE ASSESSMENTS; SUBJECTIVE QUALITY ASSESSMENTS; VISUAL COMFORT;

QUALITY CONTROL; QUALITY OF SERVICE; THREE DIMENSIONAL;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84893404236     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2013.2292592     Document Type: Article

References (40)

1. M. Lambooij,W. IJsselsteijn, M. Fortuin, and I. Heynderickx, "Visual discomfort and visual fatigue of stereoscopic displays: A review," J. Imag. Sci. Technol., vol. 53, p. 030201, 2009.
2. W. J. Tam, F. Speranza, S. Yano, K. Shimono, and H. Ono, "Stereoscopic 3D-TV: Visual comfort," IEEE Trans. Broadcast., vol. 57, no. 2, pp. 335-346, Jun. 2011.
3. M. Lambooij, W. IJsselsteijn, and I. Heynderickx, "Visual discomfort of 3D TV: Assessment methods and modeling," Displays, vol. 32, no. 4, pp. 209-218, 2011.
4. S. J. Daly,R.T.Held, andD.M.Hoffman, "Perceptual issues in stereoscopic signal processing," IEEE Trans. Broadcast., vol. 57, no. 2, pp. 347-361, Jun. 2011.
5. K. Lee, A. K. Moorthy, S. Lee, and A. C. Bovik, "3D Visual activity assessment based on natural scene statistics," IEEE Trans. Image Process., to be published.
6. F. Zilly, J. Kluger, and P. Kauff, "Production rules for stereo acquisition," Proc. IEEE, vol. 99, no. 4, pp. 590-606, Apr. 2011.
7. S. Yano, S. Ide, T. Mitsuhashi, and H. Thwaites, "A study of visual fatigue and visual comfort for 3D HDTV/HDTV images," Displays, vol. 23, pp. 191-201, 2002. (Pubitemid 35213903)
8. S. Yano, M. Emoto, and T. Mitsuhashi, "Two factors in visual fatigue caused by stereoscopic HDTVimages," Displays, vol. 25, pp. 141-150, 2004.
9. T. Naganuma, I. Nose, K. Inoue, A. Takemoto, N. Katsuyama, and M. Taira, "Information processing of geometrical features of a surface based on binocular disparity cues: An fMRI study," Neurosci. Res., vol. 51, no. 2, pp. 147-155, 2005. (Pubitemid 40164950)
10. X. Cao, A. C. Bovik, Y. Wang, and Q. Dai, "Converting 2D video to 3D: An efficient path to a 3D experience," IEEE Multimedia, vol. 18, no. 4, pp. 12-17, Apr. 2011.
11. F. Speranza et al., "Effect of disparity and motion on visual comfort of stereoscopic images," in Proc. Stereoscopic Displays and Virtual Reality Syst. XIII, 2006, vol. 6055, pp. 60550B1-60550B9.
12. T. Shibata, J. Kim, D. M. Hoffman, and M. S. Banks, "The zone of comfort: Predicting visual discomfort with stereo displays," J. Vision, vol. 11, no. 8, pp. 1-29, 2011.
13. I. Ohzawa, G. C. Deangelis, and R. D. Freeman, "Stereoscopic depth discrimination in the visual cortex: Neurons ideally suited as disparity detectors," Science, vol. 249, pp. 1037-1041, 1990.
14. W. I. Jsselsteijn, H. de Ridder, R. Hamberg, D. Bouwhuis, and J. Freeman, "Perceived depth and the feeling of presence in 3DTV," Displays, vol. 18, pp. 207-214, 1998. (Pubitemid 128435295)
15. S. Pastoor, "Human factors of 3DTV: An overview of current research at Heinrich-Hertz-Institut Berlin," in Proc. IEE Colloq. Stereoscopic Television, 1992, pp. 111-114.
16. Standard for the Quality Assessment of Three Dimensional (3D) Displays, 3D Contents and 3D Devices Based on Human Factors, IEEE P3333.1, 2012 [Online]. Available: http://grouper.ieee.org/groups/3dhf
17. Image Safety. Reducing the Incidence of Undesirable Biomedical Effects Caused by Visual Image Sequences, International Standard Organization: IWA3: 2005, 2005.
18. Subjective Video Quality Assessment Methods for Multimedia Applications, ITU-T Recommendation P.910, ITU, Geneva, Switzerland, 2008.
19. G. Saygili, C. G. Gurler, and A. M. Tekalp, "Evaluation of asymmetric stereo video coding and rate scaling for adaptive 3D video streaming," IEEE Trans. Broadcast., vol. 57, no. 2, pp. 593-601, Jun. 2011.
20. L. Zhang, Q. Peng, Q. H. Wang, and X. Wu, "Stereoscopic perceptual video coding based on just-noticeable-distortion profile," IEEE Trans. Broadcast., vol. 57, no. 2, pp. 572-581, Jun. 2011.
21. L. Goldmann, F. De Simone, and T. Ebrahimi, "A comprehensive database and subjective evaluation methodology for quality of experience in stereoscopic video," Electron. Imag., 3D Image Process. Applicat., 2010.
22. S. Yang, T. Schlieski, B. Selmins, S. Cooper, R. Doherty, P. Corriveau, and J. Sheedy, "Stereoscopic viewing and reported perceived immersion and symptoms," Optom. Vis. Sci., vol. 89, no. 7, pp. 1068-1080, Jul. 2012.
23. ITU-R, Methodology for the Subjective Assessment of the Quality of Television Pictures, ITU-R, Tech. Rep. BT.500-13, 2012.
24. M. Steffin, Visual-Haptic Interfaces:Modification ofMotor and Cognitive Performance [Online]. Available: http://emedicine. medscape.com/article/1136674- overview [Online]. Available: http://emedicine.medscape.com/article/1136674- overview
25. D. Jia, A. Bhatti, S. Nahavandi, and B. Horan, "Human performance measures for interactive haptic-audio-visual interfaces," IEEE Trans. Haptics, vol. 6, no. 1, pp. 46-57, Jan.-Mar. 2013.
26. M. Massimino, "Sensory substitution for force feedback in space teleoperation," Ph.D. dissertation, MIT, Dept. Mech. Eng., Cambridge, MA, USA, 1992.
27. S. Ricciardi et al., "Dependability issues in visual-haptic interfaces," J. Visual Lang. Comput., vol. 21, no. 1, pp. 33-40, Feb. 2010.
28. T. Barbieri and L. Sbattella, N. Tokareva and B. Kotsik, Eds., UNESCO Institute for Information Technologies in Education, Moscow, Russia, "Providing Enhanced Content Accessibility to Images for Visually Impaired Users," Specialized Training Course ICTs in Education for People With Special Needs, pp. 234-235, 2006.
29. K. Hale, K. Stanney, and L. Malone, "Enhancing virtual environment spatial awareness training and transfer through tactile and vestibular cues," Ergonomics, vol. 52, no. 2, pp. 187-203, 2009.
30. R. J. Stone, "Applications of virtual environments: An overview," in Handbook of Virtual Environments. Mahwah, NJ, USA: Lawrence Erlbaum, 2002, pp. 827-856.
31. L. Kim, M. Han, S. Shin, and S. Park, "Haptic dial system for multimodal prototyping," in Proc. 18th Int. Conf. Artificial Reality and Telexistence (ICAT 2008), 2008.
32. M. Tanimoto, T. Fujii, K. Suzuki, N. Fukushima, and Y. Mori, "Reference softwares for depth estimation and view synthesis," in ISOIIEC JTClISC29/WGlI MPEG 20081 MI5377, Apr. 2008.
33. K. Seshadrinathan, R. Soundararajan, A. C. Bovik, and L. K. Cormack, "Study of subjective and objective quality assessment of video," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1427-1441, Jun. 2010.
34. ETRI & GIST 3DV Sequences [Online]. Available: FTP://203.253.pp. 128142
35. C. D.Wickens, Engineering Psychology andHuman Performance, 2nd ed. New York, NY, USA: Harper Collins, 1992.
36. G. C. S. Woo, "The effect of exposure time on the foveal size of Panum's area," Vis. Res., vol. 14, no. 7, pp. 473-480, 1974.
37. D.Walther, U. Rutishauser, C. Koch, and P. Perona, "On the usefulness of attention for object recognition," in Proc. 8th Eur. Conf. Computer Vision, 2004.
38. T.A.Munch,R.Azeredo da Silveira, S. Siegert, T. J. Viney, G. B. Awatramani, and B. Roska, "Approach sensitivity in the retina processed by a multifunctional neural circuit," Nature Neurosci., vol. 12, no. 10, pp. 1308-1316, 2009.
39. W. Blohm, I. P. Beldie, K. Schenke, K. Fazel, and S. Pastoor, "Stereoscopic image representation with synthetic depth of field," J. Soc. Inf. Displ., vol. 5, no. 3, pp. 307-313, 1997.
40. H. Liou and N. Brennan, "Anatomically accurate, finite model eye for optical modeling," J. Opt. Soc. Amer. A, vol. 14, no. 8, pp. 1684-1695, 1997. (Pubitemid 127569236)