Visual comfort amelioration technique for stereoscopic images: Disparity remapping to mitigate global and local discomfort causes

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 24, Issue 5, 2014, Pages 745-758

  Sohn, Hosik ^a   Jung, Yong Ju ^a   Lee, Seong Il ^a   Speranza, Filippo ^b   Ro, Yong Man ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b Radio Science Branch   (Canada)

Author keywords

Disparity remapping; stereoscopic image; visual comfort assessment; visual discomfort reduction

Indexed keywords

VIDEO SIGNAL PROCESSING;

DEPTH RANGE; LOCAL DISCOMFORTS; REMAPPING; STEREOSCOPIC IMAGE; SUBJECTIVE ASSESSMENTS; VISUAL COMFORT; VISUAL COMFORT ASSESSMENTS; VISUAL DISCOMFORT;

NETWORKS (CIRCUITS);

EID: 84900531990     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2013.2291281     Document Type: Article

References (47)

1. I. P. Howard and B. J. Rogers, Seeing in Depth. Toronto, ON, Canada: I Porteous, Jun. 2002.
2. L. M. J. Meesters, W. A. IJsselsteijn, and P. J. H. Seuntiens, "A survey of perceptual evaluations and requirements of tree-dimensional TV," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 3, pp. 381-391, Mar. 2004.
3. P. Benzie, J. Watson, P. Surman, I. Rakkolainen, K. Hopf, H. Urey, et al., "A survey of 3DTV displays: Techniques and technologies," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1647-1658, Nov. 2007.
4. D.-H. Kang, E.-J. Lee, J.-H. Lee, and J.-K. Song, "Perceptual strength of 3-D crosstalk in both achromatic and color images in stereoscopic 3-D displays," IEEE Trans. Image Process., vol. 21, no. 7, pp. 3253-3261, Jul. 2012.
5. M. Lambooij, M. Fortuin, W. A. IJsselsteijn, B. J. Evans, and I. Heynderickx, "Susceptibility to visual discomfort of 3-D displays by visual performance measures," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 12, pp. 1913-1923, Dec. 2011.
6. W. J. Tam, F. Speranza, S. Yano, K. Shimono, and H. Ono, "Stereoscopic 3D-TV: Visual comfort," IEEE Trans. Broadcast., vol. 57, no. 2, pp. 335-346, Jun. 2011.
7. M. Lambooij, W. A. IJsselsteijn, and I. Heynderickx, "Visual discomfort and visual fatigue of stereoscopic displays: A review," J. Imag. Sci. Technol., vol. 53, no. 3, pp. 1-14, May 2009.
8. K. N. Ogle, Researches in Binocular Vision. Philadelphia, PA, USA: Saunders, 1950.
9. D. M. Hoffman, A. R. Girshick, K. Akeley, and M. S. Banks, "Vergence accommodation conflicts hinder visual performance and cause visual fatigue," J. Vis., vol. 8, pp. 1-30, Mar. 2008.
10. M. Wöpking, "Viewing comfort with stereoscopic pictures: An experimental study on the subjective effects of disparity magnitude and depth of focus," J. Soc. Inf. Display, vol. 3, no. 3, pp. 101-103, 1995.
11. S. Yano, M. Emoto, and T. Mitsuhashi, "Two factors in visual fatigue caused by stereoscopic HDTV images," Displays, vol. 25, no. 4, pp. 141-150, Nov. 2004.
12. M. Lang, A. Hornung, O. Wang, S. Poulakos, A. Smolic, and M. Gross, "Nonlinear disparity mapping for stereoscopic 3D," ACM Trans. Graph., vol. 29, no. 4, pp. 1-10, 2010.
13. N. Holliman, "Mapping perceived depth to regions of interest in stereoscopic images," in Proc. SPIE, vol. 5291, pp. 117-128, 2004.
14. C.-H. Chang, C.-K. Liang, and Y.-Y. Chuang, "Content-aware display adaptation and interactive editing for stereoscopic images," IEEE Trans. Multimedia, vol. 13, no. 4, pp. 589-601, Aug. 2011.
15. H. Pan, C. Yuan, and S. Daly, "3D video disparity scaling for preference and prevention of discomfort," in Proc. Stereoscopic Displays Applicat. XXII, vol. 7863, pp. 786306-1-786306-8, 2011.
16. Y. J. Jung, H. Sohn, S. Lee, F. Speranza, and Y. M. Ro, "Visual importance- and discomfort region-selective low-pass filtering for reducing visual discomfort in stereoscopic displays," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 8, pp. 1408-1421, Aug. 2013.
17. W. Blohm, I. P. Beldie, K. Schenke, K. Fazel, and S. Pastoor, "Stereoscopic image representation with synthetic depth of field," J. Soc. Inf. Display, vol. 5, no. 3, pp. 307-313, 1997.
18. C. Schor, I. Wood, and J. Ogawa, "Binocular sensory fusion is limited by spatial resolution," Vis. Res., vol. 24, no. 7, pp. 661-665, 1984. (Pubitemid 14122274)
19. C. Schor, T. Heckmann, and C. W. Tyler, "Binocular fusion limits are independent of contrast, luminance gradient and component phases," Vis. Res., vol. 29, no. 7, pp. 821-835, 1989. (Pubitemid 19166843)
20. L. M. Wilcox and R. F. Hess, "Dmax for stereopsis depends on size, not spatial frequency content," Vis. Res., vol. 35, no. 8, pp. 1061-1069, Apr. 1995.
21. A. E. Kertesz, "Effect of stimulus size on fusion and vergence," J. Opt. Soc. Am., vol. 71, no. 3, pp. 289-293, Mar. 1981.
22. H. Sohn, Y. J. Jung, S. Lee, H. W. Park, and Y. M. Ro, "Investigation of object thickness for visual discomfort prediction in stereoscopic images," in Proc. SPIE Stereoscopic Displays Applicat. XXIII, vol. 8288. pp. 82880Q-1-82880Q-8, 2012.
23. H. Sohn, Y. J. Jung, S. Lee, and Y. M. Ro, "Predicting visual discomfort using object size and disparity information in stereoscopic images," IEEE Trans. Broadcast., vol. 59, no. 1, pp. 28-37, Mar. 2013.
24. Y. J. Jung, S. Lee, H. Sohn, H. W. Park, and Y. M. Ro, "Visual comfort assessment metric based on salient object motion information in stereoscopic video," J. Electron. Imag., vol. 21, no. 1, pp. 011008-1-011008-16, 2012.
25. W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, Numerical Recipes. Cambridge, U.K.: Cambridge Univ. Press, 1986.
26. Z. Wang and Q. Li, "Information content weighting for perceptual image quality assessment," IEEE Trans. Image Process., vol. 20, no. 5, pp. 1185-1198, May 2011.
27. D. Kim and K. Sohn, "Visual fatigue prediction for stereoscopic image," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 2, pp. 231-236, Feb. 2011.
28. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002. (Pubitemid 34550429)
29. Y. J. Jung, H. Sohn, and Y. M. Ro, "Visual discomfort visualizer using stereo vision and time-of-flight depth cameras," IEEE Trans. Consum. Electron., vol. 58, no. 2, pp. 246-254, May 2012.
30. H. Sohn, Y. J. Jung, S. Lee, H. W. Park, and Y. M. Ro, "Attention modelbased visual comfort assessment for stereoscopic depth perception," in Proc. Int. Conf. Dig. Signal Process., Jul. 2011, pp. 1-6.
31. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
32. G. Sun and N. Holliman, "Evaluating methods for controlling depth perception in stereoscopic cinematography," in Proc. SPIE Stereoscopic Displays Virtual Reality Syst. XX, vol. 7237, no. 1. pp. 72370I-1-72370I-12, 2009.
33. B. Mendiburu, 3D Movie Making: Stereoscopic Digital Cinema From Script to Screen. Burlington, MA, USA: Focal Press, 2009.
34. T. D. Sanger, "Stereo disparity computation using Gabor filters," Biol. Cybern., vol. 59, no. 6, pp. 405-418, 1988.
35. Y. J. Jung, H. Sohn, S.-I Lee, and Y. M. Ro. (2012) IVY Lab Stereo 3D Image Database for Visual Discomfort Prediction [Online]. Available: http://ivylab.kaist.ac.kr/demo/3DVCA/3DVCA.htm
36. ITU-R BT.500-11, "Methodology for the subjective assessment of the quality of television pictures," 2002.
37. F. Speranza, W. J. Tam, R. Renaud, and N. Hur, "Effect of disparity and motion on visual comfort of stereoscopic images," in Proc. SPIE Stereoscopic Displays Virtual Reality Syst. XIII, vol. 6055. Feb. 2006, pp. 60550B-2-60550B-10.
38. M. Tanimoto, T. Fujii, and K. Suzuki, "Depth estimation reference software (DERS) 5.0," ISO/IEC JTC1/SC29/WG11 M16923, Lausanne, Switzerland, Oct. 2009.
39. J. R. Quinlan, "Learning with continuous classes," in Proc. Aust. Joint Conf. Artif. Intell., 1992, pp. 343-348.
40. A. Bernstein, J. Ekanayake, and M. Pinzger, "Improving defect prediction using temporal features and nonlinear models," in Proc. Int. Workshop Principles Softw. Evol., Sep. 2007, pp. 11-18. (Pubitemid 351438678)
41. H. Sohn, Y. J. Jung, S.-I Lee, and Y. M. Ro. (2013) IVY Lab Stereo 3D Image Database for Disparity Remapping [Online]. Available: http://ivylab.kaist. ac.kr/demo/3D/DisparityRemapping.htm
42. C. M. Zaroff, M. Knutelska, and T. E. Frumkes, "Variation in stereoacuity: Normative description, fixation disparity, and the roles of aging and gender," Invest. Ophth. Vis. Sci., vol. 44, pp. 891-900, Feb. 2003. (Pubitemid 36159742)
43. M. Farre, O. Wang, M. Lang, N. Stefanoski, A. Hornung, and A. Smolic, "Automatic content creation for multiview autostereoscopic displays using image domain warping," in Proc. Int. Conf. Multimedia Expo, Jul. 2011, pp. 1-6.
44. ITU-R BT.1438, "Subjective assessment for stereoscopic television pictures," 2000.
45. R. S. Kennedy, N. E. Lane, K. S. Berbaum, and M. G. Lilienthal, "Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness," Int. J. Aviat. Psychol., vol. 3, no. 3, pp. 203-220, 1993.
46. J. F. Hair, W. C. Black, B. J. Babin, R. E. Anderson, and R. L. Tatham, Multivariate Data Analysis. Upper Saddle River, NJ, USA: Pearson/Prentice-Hall, 2006.
47. M. Lambooij, W. IJsselsteijn, D. G. Bouwhuis, and I. Heynderickx, "Evaluation of stereoscopic images: Beyond 2D quality," IEEE Trans. Broadcast., vol. 57, no. 2, pp. 432-444, Jun. 2011.