Visual importance- and discomfort region-selective low-pass filtering for reducing visual discomfort in stereoscopic displays

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 23, Issue 8, 2013, Pages 1408-1421

  Jung, Yong Ju ^a   Sohn, Hosik ^a   Lee, Seong Il ^a   Speranza, Filippo ^b   Ro, Yong Man ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b Radio Science Branch   (Canada)

Author keywords

Depth of focus (DOF) blur; stereoscopic image; visual comfort improvement; visual discomfort

Indexed keywords

BACKGROUND REGION; DEPTH OF FOCUS; LOW-PASS FILTERING; STEREOSCOPIC DISPLAY; STEREOSCOPIC IMAGE; STEREOSCOPIC VIEWING; VISUAL COMFORT; VISUAL DISCOMFORT;

BINOCULAR VISION; SIGNAL FILTERING AND PREDICTION;

DISPLAY DEVICES;

EID: 84878745204     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2013.2244796     Document Type: Article

References (47)

1. I. P. Howard and B. J. Rogers, Seeing in Depth. Ontario, Canada: I Porteous, Jun. 2002.
2. L. M. J. Meesters, W. A. IJsselsteijn, and P. J. H. Seuntiens, "A survey of perceptual evaluations and requirements of three-dimensional TV," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 3, pp. 381-391, Mar. 2004.
3. P. Benzie, J. Watson, P. Surman, I. Rakkolainen, K. Hopf, H. Urey, V. Sainov, and C. Kopylow, "A survey of 3-D TV displays: Techniques and technologies," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1647-1658, Nov. 2007.
4. M. Lambooij, W. A. IJsselsteijn, M. Fortuin, and I. Heynderickx, "Visual discomfort and visual fatigue of stereoscopic displays: A review," J. Imaging Sci. Technol., vol. 53, no. 3, pp. 1-14, 2009.
5. W. J. Tam, F. Speranza, S. Yano, K. Shimono, and H. Ono, "Stereoscopic 3D-TV: Visual comfort," IEEE Trans. Broadcast., vol. 57, no. 2, pp. 335-346, Jun. 2011.
6. D. A. Atchison and G. Smith, Optics of the Human Eye. Oxford, U.K.: Butterworth-Heinemann, 2000.
7. B. Wang and K. J. Ciuffreda, "Depth of focus of the human eye: Theory and clinical applications," Survey Ophthalmol., vol. 51, no. 75, pp. 75-85, 2006. (Pubitemid 43083376)
8. S. Marcos, E. Moreno, and R. Navarro, "The depth-of-field of the human eye from objective and subjective measurements," Vision Res., vol. 39, no. 12, pp. 2039-2049, 1999. (Pubitemid 29155388)
9. Y. Okada, K. Ukai, J. S. Wolffsohn, B. Gilmartin, A. Iijima, and T. Bando, "Target spatial frequency determines the response to conflicting defocus-and convergence-driven accommodative stimuli," Vision Res., vol. 46, no. 4, pp. 475-484, 2006. (Pubitemid 41797421)
10. C. Schor, I. Wood, and J. Ogawa, "Binocular sensory fusion is limited by spatial resolution," Vision Res., vol. 24, no. 7, pp. 661-665, 1984. (Pubitemid 14122274)
11. M. Wöpking, "Viewing comfort with stereoscopic pictures: An experimental study on the subjective effects of disparity magnitude and depth of focus," J. Soc. Inform. Display, vol. 3, no. 3, pp. 101-103, Dec. 1995.
12. L. Leroy, P. Fuchs, and G. Moreau, "Visual fatigue reduction for immersive stereoscopic displays by disparity, content, and focus-point adapted blur," IEEE Trans. Ind. Electron., vol. 59, no. 10, pp. 3998-4004, Oct. 2012.
13. W. Blohm, I. P. Beldie, K. Schenke, K. Fazel, and S. Pastoor, "Stereoscopic image representation with synthetic depth of field," J. Soc. Inform. Display, vol. 5, no. 3, pp. 307-313, 1997.
14. T. Blum, M. Wieczorek, A. Aichert, R. Tibrewal, and N. Navab, "The effect of out-of-focus blur on visual discomfort when using stereo displays," in Proc. IEEE Int. Symp. Mixed Augmented Reality, Oct. 2010, pp. 13-17.
15. G. M. Um, F. Speranza, L. Zhang, W. J. Tam, R. Renaud, L. B. Stelmach, and C. H. Ahn, "Investigation on the effect of disparity-based asymmetrical filtering on stereoscopic video," in Proc. SPIE, vol. 5150. 2003, pp. 110-118.
16. G. Sun and N. Holliman, "Evaluating methods for controlling depth perception in stereoscopic cinematography," in Proc. SPIE, vol. 7237. Jan. 2009, pp. 1-12.
17. P. Burt and B. Julesz, "A disparity gradient limit for binocular fusion," Science, vol. 208, no. 444, pp. 615-617, 1980. (Pubitemid 10041980)
18. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
19. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Proc. Advanced Neural Inform. Process. Syst., vol. 19. 2007, pp. 545-552.
20. C. Guo and L. Zhang, "A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression," IEEE Trans. Image Process., vol. 19, no. 1, pp. 185-198, Jan. 2010.
21. Q. Huynh-Thu, M. Barkowsky, and P. Le Callet, "The importance of visual attention in improving the 3D-TV viewing experience: Overview and new perspectives," IEEE Trans. Broadcast., vol. 57, no. 2, pp. 421-431, Jun. 2011.
22. L. Jansen, S. Onat, and P. Konig, "Influence of disparity on fixation and saccades in free viewing of natural scenes," J. Vision, vol. 9, no. 1, pp. 1-19, 2009.
23. T. Jost, N. Ouerhani, R. Wartburg, R. Muri, and H. Hugli, "Contribution of depth to visual attention: Comparison of a computer model and human behavior," in Proc. Early Cognitive Vision Workshop, 2004, pp. 1-4.
24. Y. Liu, L. K. Cormack, and A. C. Bovik, "Dichotomy between luminance and disparity features at binocular fixations," J. Vision, vol. 10, no. 12, pp. 1-17, 2010.
25. Y.-F. Ma, X.-S. Hua, L. Lu, and H.-J. Zhang, "A generic framework of user attention model and its application in video summarization," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 907-919, Oct. 2005. (Pubitemid 41452519)
26. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002. (Pubitemid 34550429)
27. H. Sohn, Y. J. Jung, S. Lee, H. W. Park, and Y. M. Ro, "Investigation of object thickness for visual discomfort prediction in stereoscopic images," in Proc. SPIE, vol. 8288. 2012, p. 82880Q.
28. Y. J. Jung, S. Lee, H. Sohn, H. W. Park, and Y. M. Ro, "Visual comfort assessment metric based on salient object motion information in stereoscopic video," J. Electron. Imaging, vol. 21, no. 1, p. 011008-1, 2012.
29. D. Chan, H. Buisman, C. Theobalt, and S. Thrun, "A noise-aware filter for real-time depth upsampling," in Proc. ECCV Workshop Multi-Camera Multi-Modal Sensor Fusion Algorithms Appl., pp. 1-12, 2008.
30. N. Fan, N. Huang, D. S. C. Lam, and C. K. Leung, "Measurement of photoreceptor layer in glaucoma: A spectral-domain optical coherence tomography study," J. Ophthalmology, vol. 2011, article 264803, Apr. 2011.
31. Y. J. Jung, H. Sohn, S. Lee, and Y. M. Ro. (2012) IVY Lab Stereoscopic Image Database for Synthetic DOF Blur [Online]. Available: http://ivylab.kaist. ac.kr/demo/3D/dofblur.htm
32. Methodology for the Subjective Assessment of the Quality of Television Pictures, ITU-R BT.500-11, 2002.
33. Subjective Assessment for Stereoscopic Television Pictures, ITU-R BT.1438, 2000.
34. A. Woods, "Understanding crosstalk in stereoscopic displays," presented in Keynote Presentation at the Three-Dimensional Systems and Applications Conference, Tokyo, Japan, May 19-21, 2010.
35. M. Lambooij, W. A. I. Jsselsteijn, and I. Heynderickx, "Visual discomfort of 3D TV: Assessment methods and modeling," Displays, vol. 32, no. 4, pp. 209-218, 2011.
36. M. Lang, A. Hornung, O. Wang, S. Poulakos, A. Smolic, and M. Gross, "Nonlinear disparity mapping for stereoscopic 3D," ACM Trans. Graph., vol. 29, no. 4, article 75, 2010.
37. Y. J. Jung, H. Sohn, and Y. M. Ro, "Visual discomfort visualizer using stereo vision and time-of-flight depth cameras," IEEE Trans. Consum. Electron., vol. 58, no. 2, pp. 246-254, May 2012.
38. D. Kim and K. Sohn, "Visual fatigue prediction for stereoscopic image," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 5, pp. 231-236, 2011.
39. T. Shibata, J. Kim, D. M. Hoffman, and M. S. Banks, "The zone of comfort: Predicting visual discomfort with stereo displays," J. Vision, vol. 11, no. 8, pp. 1-29, 2011.
40. J. Konrad, "Enhancement of viewer comfort in stereoscopic viewing: Parallax adjustment," in Proc. SPIE, vol. 3639. 1999, pp. 179-190.
41. N. Holliman, "Mapping perceived depth to regions of interest in stereoscopic images," in Proc. SPIE, vol. 5291. 2004, pp. 117-128.
42. C.-H. Chang, C.-K. Liang, and Y.-Y. Chuang, "Content-aware display adaptation and interactive editing for stereoscopic images," IEEE Trans. Multimedia, vol. 13, no. 4, pp. 589-601, Aug. 2011.
43. H. Pan, C. Yuan, and S. J. Daly, "3D video disparity scaling for preference and prevention of discomfort," in Proc. SPIE, vol. 7863. 2011, p. 786306.
44. F. Devernay, S. Duchêne, and A. Ramos-Peon, "Adapting stereoscopic movies to the viewing conditions using depth-preserving and artifact-free novel view synthesis," in Proc. SPIE, vol. 7863. 2011, p. 786302.
45. C. Fehn, "A 3D-TV approach using depth-image-based rendering (DIBR)," in Proc. 3rd VIIP, Sep. 2003, pp. 93-104.
46. H.-Y. Shum, S. B. Kang, and S.-C. Chan, "Survey of image-based representations and compression techniques," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 11, pp. 1020-1037, Nov. 2003.
47. G. B. Akar, A. M. Tekalp, C. Fehn, and M. R. Civanlar, "Transport methods in 3DTV: A survey," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1622-1630, Nov. 2007.