3D visual discomfort prediction: Vergence, foveation, and the physiological optics of accommodation

IEEE Journal on Selected Topics in Signal Processing

Volumn 8, Issue 3, 2014, Pages 415-427

  Park, Jincheol ^a   Lee, Sanghoon ^a   Bovik, Alan Conrad ^b  

^a Yonsei University   (South Korea)

^b The University of Texas at Austin   (United States)

Author keywords

Accommodation and vergence mismatch; blur cycle width; differential blur; disparity; foveation; perceptible local bandwidth; physiological optics; stereoscopic display; visual discomfort

Indexed keywords

ALGORITHMS; BANDWIDTH; BINOCULAR VISION; DISPLAY DEVICES; OPTICS; PHYSIOLOGY; STEREO IMAGE PROCESSING;

BLUR CYCLE WIDTH; DIFFERENTIAL BLUR; DISPARITY; FOVEATION; LOCAL BANDWIDTHS; PHYSIOLOGICAL OPTICS; STEREOSCOPIC DISPLAY; VERGENCES; VISUAL DISCOMFORT;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84901264464     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2014.2311885     Document Type: Article

References (59)

1. M. Lambooij, W. IJsselsteijn, M. Fortuin, and I. Heynderickx, "Visual discomfort and visual fatigue of stereoscopic displays: A review, " J. Imaging Sci. Technol., vol. 53, no. 3, pp. 030201-030201-14, May 2009.
2. H. Sohn, Y. J. Jung, S. Lee, and Y. M. Ro, "Predicting visual discomfort using object size and disparity information in stereoscopic images, " IEEE Trans. Boradcast., vol. 59, no. 1, pp. 28-37, Mar. 2013.
3. T. W. Dillon and H. H. Emurian, "Some factors affecting reports of visual fatigue resulting from use of a VDU, " Comput. in Human Behaviour, vol. 12, pp. 49-59, 1996. (Pubitemid 126394319)
4. M. Emoto, T. Niida, and F. Okana, "Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television, " J. Display Technol., vol. 1, pp. 328-340, 2005. (Pubitemid 43001032)
5. J. S. Cooper, C. R. Burns, S. A. Cotter, K. M. Daum, J. M. Griffin, and M. M. Scheiman, "Optometric clinical practice guideline care of the patient with accommodative and vergence dysfunction, " Amer. Opto-metric Assoc., 2001.
6. F. Zilly, J. Kluger, and P. Kauff, "Production rules for stereo acquisition, " Proc. IEEE, vol. 99, no. 4, pp. 590-606, 2011.
7. K. Lee, A. K. Moorthy, S. Lee, and A. C. Bovik, "3D Visual activity assessment based on natural scene statistics, " IEEE Trans. Image Process., vol. 23, no. 1, pp. 450-465, Jan. 2014.
8. H. Kim, S. Lee, and A. C. Bovik, "Saliency measurement on stereoscopic videos, " IEEE Trans. Image Process., vol. 23, no. 4, pp. 1476-1490, Apr. 2014.
9. S. M. Haigh, L. Barningham, M. Berntsen, L. V. Coutts, E. S. T. Hobbs, J. Irabor, E. M. Lever, P. Tang, and A. J. Wilkins, "Discomfort and the cortical haemo-dynamic response to coloured gratings, " Vis. Res., vol. 89, pp. 47-53, Aug. 2013.
10. I. Juricevic, L. Land, A. J. Wilkins, and M. A. Webster, "Visual discomfort and natural image statistics, " Perception, vol. 39, no. 7, pp. 884-899, 2010.
11. T. Kim, J. Kang, S. Lee, and A. C. Bovik, "Multimodal interactive continuous scoring of subjective 3D video quality of experience, " IEEE Trans. Multimedia, vol. 16, no. 2, pp. 387-402, Feb. 2014.
12. C. M. Schor and J. C. Kotulak, "Dynamic interactions between accommodation and convergence are velocity sensitive, " Vision Res., vol. 26, pp. 927-942, 1986. (Pubitemid 16071575)
13. S. Eadie, L. S. Gray, P. Carlin, and M. Mon-Williams, "Modelling adaptation effects in vergence and accommodation after exposure to a simulated virtual reality stimulus, " Ophthalmic Physiol. Opt., vol. 20, pp. 242-251, 2000. (Pubitemid 30154149)
14. R. Suryakumar and W. R. Bobier, "Gain and movement time of convergence-accommodation in preschool children, " Optom. Vision Sci., vol. 81, pp. 835-843, 2004. (Pubitemid 39489069)
15. D. M. Hoffman and M. S. Banks, "Focus information is used to interpret binocular images, " J. Vis., vol. 10, no. 5, pp. 1-17, May 2010.
16. S. J. Watt, K. Akeley, M. O. Ernst, and M. S. Banks, "Focus cues affact perceived depth, " J. Vis., vol. 5, no. 10, pp. 834-862, Dec. 2005. (Pubitemid 43013353)
17. I. P. Howard, Seeing in Depth: Basic Mechanisms. Toronto, ON, Canada: Porteous, 2002.
18. Y. J. Jung, H. Sohn, S. Lee, F. Speranza, and Y. M. Ro, "Visual importance-and discomfort region-selective low-pass filtering for reducing visual discomfort in stereoscopic displays, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 8, pp. 1408-1421, Aug. 2013.
19. R. T. Held, E. A. Cooper, J. F. O'Brien, and M. S. Banks, "Using blur to affect perceived distance and size, " ACM Trans. Graph., vol. 29, no. 2, Mar. 2010, Article 19.
20. J. Wang, M. Barkowsky, V. Ricordel, and P. Le Callet, "Quantifying how the combination of blur and disparity affects the perceived depth, " in Proc. SPIE, Feb. 2011, vol. 7865, pp. 78650K-78650K-10.
21. S. Ide, H. Yamanoue, M. Okui, and F. Okano, "Parallax distribution for ease of viewing in stereoscopic HDTV, " in Proc. Stereoscopic Displays Virtual Reality Syst. IX, 2002, vol. 4660, pp. 38-45. (Pubitemid 34918008)
22. Y. Nojiri, H. Yamanoue, A. Hanazato, and F. Okano, "Measurement of parallax distribution and its application to the analysis of visual comfort for stereoscopic HDTV, " in Proc. Stereoscopic Displays Virtual Reality Syst. X, 2003, vol. 5006, pp. 195-205.
23. S. Yano, S. Ide, T. Mitsuhashi, and H. Thwaites, "A study of visual fatigue and visual comfort for 3D HDTV/HDTV images, " Displays, vol. 23, no. 4, pp. 191-201, Jun. 2002. (Pubitemid 35213903)
24. J. Choi, D. Kim, S. Choi, and K. Sohn, "Visual fatigue modeling and analysis for steroscopic video, " Opt. Eng., vol. 51, no. 1, pp. 017206. 017206-11, Jan. 2010.
25. D. Kim and K. Sohn, "Visual fatigue prediction for steroscopic image, " IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 2, pp. 231-236, Feb. 2011.
26. B. Scholkopf, A. Smola, R. Williamson, and P. Bartlett, "New support vector algorithms, " Neural Computat., vol. 12, no. 5, pp. 1207-1245, 2000.
27. S. J. Huston and V. Jayaraman, "Studying sensorimotor integration in insect, " Current Opinion Neurobiol., vol. 21, pp. 527-534, 2011.
28. R. Shadmehr, M. A. Smith, and J. W. Krakauer, "Error correction, sensory prediction, and adaptation in motor control, " Annu. Rev. Neu-rosci., vol. 33, pp. 89-108, 2010.
29. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video compression with optimal rate control, " IEEE Trans. Image Process., vol. 10, no. 7, pp. 977-992, Jul. 2001. (Pubitemid 32650874)
30. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video quality assessment, " IEEE Trans. Multimedia, vol. 4, no. 1, pp. 129-132, Mar. 2002. (Pubitemid 34291535)
31. S. Lee and A. C. Bovik, "Fast algorithms for foveated video processing, " IEEE Trans. Circuit Syst. Video Technol., vol. 13, no. 2, pp. 149-162, Feb. 2003.
32. M. S. Banks, A. B. Sekuler, and S. J. Anderson, "Peripheral spatial vision: limits imposed by optics, photoreceptors, and receptor pooling, " J. Opt. Soc. Amer., vol. 8, pp. 1775-1787, Nov. 1991.
33. W. S. Geisler and J. S. Perry, "A real-time foveated multiresolution system for low-bandwidth video communication, " in Proc. SPIE, 1998, vol. 3299.
34. A. Pentland, "A new sense for depth of field, " IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-9, no. 4, pp. 523-531, Jul. 1987.
35. D. A. Atchison, "Accommodation and presbyopia, " Ophthalmic. Physiol. Opt., vol. 15, no. 4, pp. 255-272, Jul. 1995.
36. H. Schneider, A. Bacskulin, and R. Guthoff, History of Accommodation Research, R. Guthoff and K. Ludwig, Eds. Heidelberg, Germany: Kaden Verlag, 2001, Current Aspects of Human Accommodation, pp. 11-23.
37. W. N. Charman, "The eye in focus: accommodation and presbyopia, " Clinical and Experimental Optometry, vol. 91, no. 3, pp. 207-225, May 2008.
38. H. Cheng, J. K. Barnett, A. S. Vilupuru, J. D. Marsack, S. Kasthuri-rangan, R. A. Applegate, and A. Roorda, "A population study on changes in wave aberrations with accommodation, " J. Vis., vol. 4, no. 4, pp. 272-280, Apr. 2004. (Pubitemid 39057798)
39. A. B. Watson, G. Y. Yang, J. A. Solomon, and J. Villasenor, "Visibility of wavelet quantization noise, " IEEE Trans. Image Process., vol. 6, no. 8, pp. 1164-1175, Aug. 1997. (Pubitemid 127768411)
40. W. N. Charman and H. Whitefoot, "Pupil diameter and depth-of-field of human eye as measured by laser speckle, " Optica Acta., vol. 24, no. 12, pp. 1211-1216, 1977. (Pubitemid 8389414)
41. S. Marcos, E. Moreno, and R. Navarro, "The depth-of-field of the human eye from objective and subjective measurements, " Vi s. R e s., vol. 39, no. 12, pp. 2039-2049, 1999. (Pubitemid 29155388)
42. Standard for the Quality Assessment of Three Dimensional (3D) Displays, 3D Contents and 3D Devices based on Human Factors, IEEE P3333.1, 2012 [Online]. Available: http://grouper.ieee.org/groups/3dhf
43. S. Yano, M. Emoto, and T. Mitsuhashi, "Two factors in visual fatigue caused by stereoscopic HDTV images, " Displays, vol. 25, no. 4, pp. 141-150, Oct. 2004.
44. M. Pinson and S. Wolf, "A new standardized method for objectively measuring video quality, " IEEE Trans. Broadcast, vol. 50, no. 3, pp. 312-322, Sep. 2004.
45. A. K. Moorthy and A. C. Bovik, "Visual importance pooling for image quality assessment, " IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 193-201, Apr. 2009.
46. K. Seshadrinathan and A. C. Bovik, "Motion-tuned spatio-temporal quality assessment of natural videos, " IEEE Trans. Image Process., vol. 19, no. 2, pp. 335-350, Feb. 2010.
47. J. Park, K. Seshadrinathan, S. Lee, and A. C. Bovik, "VQPooling: Video quality pooling adaptive to perceptual distortion severity, " IEEE Trans. Image Process., vol. 22, no. 2, pp. 610-620, Feb. 2013.
48. "Methodology for the subjective assessment of the quality of television pictures, " ITU-R, 2002, Tech. Rep. BT.500-11, ITU-R.
49. "Subjective assessment of stereoscopic television pictures, " ITU-R, 2000, Tech. Rep. BT.1438.
50. H. G. Longbotham and A. C. Bovik, "Theory of order statistic filters and their relationship to linear FIR filters, " IEEE Trans. Acoust., Speech, Signal Process., vol. 97, no. 2, pp. 275-287, Feb. 1989.
51. D. Sun, S. Roth, and M. Black, "Secrets of optical flow estimation and their principles, " in Proc. CVPR, 2010.
52. D. Sun, S. Roth, and M. Black, "Optical Flow Software, " 2010 [Online]. Available: http://www.cs.brown.edu/~black/
53. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms, " Int. J. Comput. Vis., vol. 47, pp. 7-42, Apr. 2002. (Pubitemid 34428419)
54. D. Scharstein and R. Szeliski, "Middlebury stereo evaluation-Version 2, " [Online]. Available: vision.middlebury.edu/stereo/
55. M. A. Saad, A. C. Bovik, and C. Charrier, "Blind image quality assessment: A natural scene statistics approach in the DCT domain, " IEEE Trans. Image Process., vol. 20, no. 8, pp. 3339-3352, Aug. 2012.
56. C. Changand C. Lin, "LIBSVM:A library forsupportvectormachines, " 2001 [Online]. Available: http://www.csie.ntu.edu.tw/cjlin/libsvm/
57. M.-J. Chen, L. K. Cormack, and A. C. Bovik, "No-reference quality assessment of natural stereopairs, " IEEE Trans. Image Process., vol. 22, no. 9, pp. 3379-3391, Sep. 2013.
58. M.-J. Chen, C.-C. Su, D.-K. Kwon, L. K. Cormack, and A. C. Bovik, "Full-reference quality assessment of stereopairs accounting for rivalry, " Signal Process.: Image Communicat., vol. 28, no. 10, pp. 1143-1155, Oct. 2013.
59. M.-J. Chen, A. C. Bovik, and L. K. Cormack, "Study of distortion con-spicuity on stereoscopically viewed 3D images, " in Proc. IEEE 10th IVMSP Workshop, Jun. 2011, pp. 24-29.