3D perception based quality pooling: Stereopsis, binocular rivalry, and binocular suppression

IEEE Journal on Selected Topics in Signal Processing

Volumn 9, Issue 3, 2015, Pages 533-545

  Lee, Kwanghyun ^a   Lee, Sanghoon ^a  

^a Yonsei University   (South Korea)

Author keywords

3D perception; Binocular rivalry; Binocular suppression; Human; Stereo image quality pooling; Stereopsis

Indexed keywords

BINOCULAR VISION; BINOCULARS; CODING ERRORS; DEPTH PERCEPTION; IMAGE CODING; IMAGE QUALITY; IMAGE SEGMENTATION; STEREO VISION; VIRTUAL REALITY; VISION;

3D PERCEPTION; BINOCULAR RIVALRY; BINOCULAR SUPPRESSIONS; HUMAN; STEREO IMAGE QUALITY POOLING; STEREOPSIS;

STEREO IMAGE PROCESSING;

EID: 84933052705     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2015.2393296     Document Type: Article

References (54)

1. E. Lantz, "Future directions in visual display systems, " in Computer Graphics. New York, NY, USA: ACM Press/ACM SIGGRAPH, 1997, pp. 38-42.
2. H. Ono, R. Angus, and P. Gregor, "Binocular single vision achieved by fusion and suppression, " Percept. Psychophys., vol. 21, no. 6, pp. 513-521, 1977.
3. V. Aleshin, V. Afanasiev, A. Bobkov, S. Klimenko, V. Kuliev, and D. Novgorodtsev, "Visual 3D perception of motion environment and visibility factors in virtual space, " in Trans. Comput. Sci., XVI, Lecture Notes on Comput. Sci. 7380. Berlin/Heidelberg, Germany: Springer- Verlag, pp. 17-33.
4. I. P. Howard and B. J. Rogers, "Seeing in depth, " in Depth Perception. Toronto, ON, USA: I Porteous, vol. 2.
5. W. J. M. Levelt, On Binocular Rivalry. Paris, France: Mouton, 1968.
6. R. Blake, D. H. Westendorf, and R. Overton, "What is suppressed during binocular rivalry?, " Perception, vol. 9, no. 2, pp. 223-31, 1980.
7. R. Blake, R. P. O'Shea, and T. J. Mueller, "Spatial zones of binocular rivalry in central and peripheral vision, " Vis. Neurosci., vol. 8, pp. 469-478, 1992.
8. S. Takase, S. Yukumatsu, and K. Bingushi, "Local binocular fusion is involved in global binocular rivalry, " Vis. Res., vol. 48, pp. 1978-1803, 2008.
9. R. Breveglieri, K. Hadjidimitrakis, A. Bosco, S. P. Sabatini, C. Galletti, and P. Fattori, "Eye position encoding in three-dimensional space: Integration of version and vergence signals in the medial posterior parietal cortex, " J. Neurosci., vol. 32, no. 1, pp. 159-169, Jan. 2012.
10. H. Kim, S. Lee, and A. C. Bovik, "Saliency prediction on stereoscopic videos, " IEEE Trans. Image Process., vol. 23, no. 4, pp. 1476-1490, Apr. 2014.
11. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video compression with optimal rate control, " IEEE Trans. Image Process., vol. 10, no. 7, pp. 977-992, Jul. 2001.
12. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video quality assessment, " IEEE Trans. Multimedia, vol. 4, no. 1, pp. 129-132, Mar. 2002.
13. S. Lee and A. C. Bovik, "Fast algorithms for foveated video processing, " IEEE Trans. Circuit Syst. Video Technol., vol. 13, no. 2, pp. 149-162, Feb. 2003.
14. W. S. Geisler and J. S. Perry, "A real-time foveated multiresolution system for low bandwidth video communication, " in Proc. SPIE, 1998, vol. 3299.
15. K. Lee, A. K. Moorthy, S. Lee, and A. C. Bovik, "3D Visual Activity Assessment based on Natural Scene Statistics, " IEEE Trans. Image Process., vol. 23, no. 1, pp. 450-465, Jan. 2014.
16. S. L. P. Yasakethu, C. T. E. R. Hewage, W. A. C. Fernando, and A. M. Kondoz, "Quality analysis for 3D video using 2D video quality models, " IEEE Trans. Consumer Electron., vol. 54, no. 4, pp. 1969-1976, Nov. 2008.
17. A. Boev, A. Gotchev, K. Egiazarian, A. Aksay, and G. B. Akar, "Toward compound stereo-video quality metric: A specific encoder-based framework, " in Proc. IEEE Southwest Symp. Image Anal. Interpret., Jun. 2006, pp. 218-222.
18. J. Yang, C. Hou, Y. Zhou, Z. Zhang, and J. Guo, "Objective quality assessment method of stereo images, " in Proc. 3DTV-CON, 2009.
19. P. Gorley and N. Holliman, "Stereoscopic image quality metrics and compression, " in Proc. SPIE, 2008, vol. 6803, p. 05.
20. A. Benoit, P. LeCallet, P. Campisi, and R. Cousseau, "Quality assessment of stereoscopic images, " EURASIP J. Image Video Process., pp. 1-13, 2008-2009.
21. J. You, L. Xing, A. Perkis, and X. Wang, "Perceptual quality assessment for stereoscopic images based on 2D image quality metrics and disparity analysis, " in Proc. Int. Workshop VIdeo Process Qaulity Metrics Consumer Electron., 2010.
22. M. Lambooij, W. Ijsselsteijn, D. G. Bouwhuis, and I. Heynderickx, "Evaluation of stereoscopic images: Beyond 2D quality, " IEEE Trans. Broadcast., vol. 57, no. 2, pp. 432-444, Jun. 2011.
23. K. Ha and M. Kim, "A perceptual quality assessment metric using temporal complexity and disparity information for stereoscopic video, " in Proc. IEEE Int. Conf. Image Process., Sep. 2011, pp. 2525-2528.
24. C. T. E. R. Hewage, S. T. Worrall, S. Dogan, S. Villette, and A. M. Knodoz, "Quality evaluation of color plus depth map-based stereoscopic video, " IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 304-318, Apr. 2009.
25. M. J. Chen, C. C. Su, D. L. Kwon, L. K. Cormack, and A. C. Bovik, "Full-Reference Quality Assessment of Stereopairs Accounting for Rivalry, " Signal Processing: Image Commun., vol. 28, no. 9, pp. 1143-1155, Oct. 2013.
26. A. Maalouf and M. C. Larabi, "CYCLOP: A stereo color image quality assessment metric, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process, May 2011, pp. 1161-1164.
27. X. Wang, S. Kwong, and Y. Zhang, "Considering binocular spatial sensitivity in stereoscopic image quality assessment, " in Proc. IEEE Vis. Commun. Image Process., Nov. 2011, pp. 1-4.
28. F. Shao, W. Lin, S. Gu, G. Jiang, and T. Srikanthan, "Perceptual fullreference quality assessment of stereoscopic images by considering binocular visual characteristics, " IEEE Trans. Image Process., vol. 22, no. 5, pp. 1940-1953, May 2013.
29. J. Park, K. Seshadrinathan, S. Lee, and A. C. Bovik, "VQPooling: Video quality pooling adaptive to perceptual distortion severity, " IEEE Trans. Image Process., vol. 22, no. 4, pp. 610-620, Feb. 2013.
30. A. K. Moorthy and A. C. Bovik, "Visual importance pooling for image quality assessment, " IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 193-201, Apr. 2009.
31. M. Pinson and S. Wolf, "A new standardized method for objectively measuring video quality, " IEEE Trans. Broadcast., vol. 50, no. 3, pp. 312-322, Sep. 2004.
32. T. Ohshima, H. Yamamoto, and H. Tamura, "Gaze-directed adaptive rendering for interacting with virtual space, " in Proc. IEEE Virtual Reality Ann. Int. Symp. (VRAIS), Santa Clara, CA, USA, 1996, pp. 103-110.
33. J. D. Nquyenkim and G. C. DeAngelis, "Disparity-based coding of three-dimensional surface orientation by macaque middle temporal neurons, " J. Neurosci., vol. 23, pp. 7117-7128, Aug. 2003.
34. J. C. Read, G. P. Phillipson, I. Serrano-Pedraza, A. D. Milner, and A. J. Parker, "Stereoscopic vision in the absence of the lateral occipital cortex, " PLoS ONE 5, p. E12608, 2010.
35. L. G. Ungerleider and M. Mishkin, Analysis of Visual Behavior. Cambridge, MA, USA: MIT press, 1982.
36. P. Janssen, R. R. Vogels, and G. A. Orban, "Three-dimensional shape coding in inferior temporal cortex, " Neuron, vol. 27, pp. 385-397, Sep. 2000.
37. F. Tong, M. Meng, and R. Blake, "Neural bases of binocular rivalry, " Trends Cogn. Sci., vol. 10, no. 11, pp. 502-511, Sep. 2006.
38. N. Logothetis, "Single units and conscious vision, " Philos. Trans. R. Soc. Lond. B. Biol. Sci., vol. 353, no. 1377, pp. 1801-1818, Nov. 1998.
39. M. J. Chen, A. C. Bovik, and L. K. Cormack, "Study on distortion conspicuity in stereoscopically viewed 3D images, " in Proc. IVMSP, 2011.
40. M. Meenes, "A phenomenological description of retinal rivalry, " Amer. J. Psychol., vol. 42, pp. 260-269.
41. R. Blake, "A primer on binocular rivalry, including current controversies, " Brain Mind, vol. 2, pp. 5-38, 2001.
42. D. Walther, U. Rutishauser, C. Koch, and P. Perona, "On the usefulness of attention for object recognition, " in Proc. 8th Eur. Conf. Comput. Vis., 2004, pp. 96-103.
43. IEEE Standards Association Stereoscopic Database, 2008 [Online]. Available: http://grouper.ieee.org/groups/3dhf/
44. M. Tanimoto, T. Fujii, K. Suzuki, N. Fukushima, and Y. Mori, "Reference softwares for depth estimation and view synthesis, " ISO/IEC JTC1/SC29/WG11 MPEG 20081 M15377, Apr. 2008.
45. M. S. Banks, S. Gepshtein, and M. S. Landy, "Why is spatial stereoresolution so low?, " J. Neurosci., vol. 24, no. 9, pp. 2077-2089, Mar. 2004.
46. L. K. Cormack, D. D. Lander, and S. Ramakrishnan, "Element density and the efficiency of binocular matching, " J. Opt. Soc. Amer. A, vol. 14, no. 4, pp. 723-730, Apr. 1997.
47. K. I. Beverley and D. Regan, "Visual perception of changing size: The effect of object size, " J. Vis. Res., vol. 19, no. 10, pp. 1093-1104, 1979.
48. "ITU-R Methodology for the subjective assessment of the quality of television pictures, " 2002, Tech. Rep. BT.500-11.
49. "ITU-R Subjective assessment of stereoscopic television pictures, " 2002, Tech. Rep. BT.1438.
50. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency, " Adv. Neural Inf. Process. Syst., pp. 545-552, 2006.
51. P. Neri, "A stereoscopic look at visual cortex, " J. Neurophysiol., vol. 93, pp. 1823-1826, 2005.
52. A. K. Moorthy, C.-C. Su, A. Mittal, and A. C. Bovik, "Subjective evaluation of stereoscopic image quality, " Signal Process.: Image Commun., Sep. 2012.
53. M. J. Chen, L. K. Cormack, and A. C. Bovik, "No-Reference Quality Assessment of Natural Stereopairs, " IEEE Trans. Image Process., vol. 22, no. 9, pp. 3379-3391, Sep. 2013.
54. K. Seshadrinathan, R. Soundararajan, A. C. Bovik, and L. K. Cormack, "Study of subjective and objective quality assessment of video, " IEEE Trans. Image Process., vol. 19, no. 6, pp. 1427-1441, Jun. 2010.