Depth sensation enhancement using the just noticeable depth difference

IEEE Transactions on Image Processing

Volumn 21, Issue 8, 2012, Pages 3624-3637

  Jung, Seung Won ^a   Ko, Sung Jea ^b  

^a Samsung Advanced Institute of Technology (SAIT)   (South Korea)

^b Korea University   (South Korea)

Author keywords

Depth enhancement; Depth image based rendering; Depth sensation; Human visual system (HVS); Just noticeable depth difference (JNDD)

Indexed keywords

DEPTH ENHANCEMENT; DEPTH IMAGE BASED RENDERING; DEPTH SENSATION; HUMAN VISUAL SYSTEMS; JUST NOTICEABLE DEPTH DIFFERENCE (JNDD);

ALGORITHMS; IMAGE PROCESSING;

QUALITY CONTROL;

ALGORITHM; ARTICLE; BIOMIMETICS; COMPUTER ASSISTED DIAGNOSIS; DEPTH PERCEPTION; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; PHYSIOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; THREE DIMENSIONAL IMAGING; PROCEDURES;

ALGORITHMS; BIOMIMETICS; DEPTH PERCEPTION; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 84864147836     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2191569     Document Type: Article

References (41)

1. H.-Y. Shum, S. B. Kang, and S.-C. Chan, "Survey of image-based representations and compression techniques," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 11, pp. 1020-1037, Nov. 2003.
2. C. Fehn, "Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3-D-TV," Proc. SPIE, vol. 5291, no. 2, pp. 93-104, 2004.
3. A. Smolic and D. McCutchen, "3DAV exploration of video-based rendering technology in MPEG," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 3, pp. 348-356, Mar. 2004.
4. W. J. Tam, G. Alain, L. Zhang, T. Martin, and R. Renaud, "Smoothing depth maps for improved stereoscopic image quality," in Proc. Int. Soc. Opt. Eng. Conf. 3-D TV Video Display III, 2004, pp. 162-172. (Pubitemid 40512677)
5. L. Zhang and W. J. Tam, "Stereoscopic image generation based on depth images for 3-D TV," IEEE Trans. Broadcast., vol. 51, no. 2, pp. 191-199, Jun. 2005. (Pubitemid 40819422)
6. Y. K. Park, K. Jung, Y. Oh, S. Lee, J. K. Kim, G. Lee, H. Lee, K. Yun, N. Hur, and J. Kim, "Depth-image-based rendering for 3DTV service over T-DMB," Signal Process. Image Commun., vol. 24, nos. 1-2, pp. 122-136, Jan. 2009.
7. K.-J. Oh, S. Yea, and Y.-S. Ho, "Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-D video," in Proc. Picture Coding Symp., 2009, pp. 1-4.
8. P.-J. Lee and Effendi, "Nongeometric distortion smoothing approach for depth map preprocessing," IEEE Trans. Multimedia, vol. 13, no. 2, pp. 246-254, Apr. 2011.
9. D. Grest, J. Woetzel, and R. Koch, "Nonlinear body pose estimation from depth images," in Proc. DAGM-Symp., 2005, pp. 285-292. (Pubitemid 41520666)
10. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, and M. Finocchio, "Realtime human pose recognition in parts from single depth images," in Proc. IEEE Conf. Comput. Vis. Pattern Recogn., Jun. 2011, pp. 1297-1304.
11. J. Kopf, M. F. Chen, D. Lischinski, and M. Uyttendaele, "Joint bilateral upsampling," ACM. Trans. Graph., vol. 26, no. 3, pp. 1-96, Jul. 2007.
12. Q. Yang, R. Yang, J. Davis, and D. Nister, "Spatial-depth super resolution for range images," in Proc. IEEE Conf. Comput. Vis. Pattern Recogn., Minneapolis, MN, Jun. 2007, pp. 1-8.
13. E. Ekmekcioglu, M. Mrak, S. T. Worrall, and A. M. Kondoz, "Edge adaptive upsampling of depth map videos for enhanced free-viewpoint video quality," Electron. Lett., vol. 45, no. 7, pp. 353-354, Mar. 2009.
14. F. Garcia, B. Mirbach, B. Ottersten, F. Grandidier, and A. Cuesta, "Pixel weighted average strategy for depth sensor data fusion," in Proc. IEEE Conf. Image Process., Sep. 2010, pp. 2805-2808.
15. K.-J. Oh, S. Yea, A. Vetro, and Y.-S. Ho, "Depth reconstruction filter and down/up sampling for depth coding in 3-D video," IEEE Signal Process. Lett., vol. 16, no. 9, pp. 747-750, Sep. 2009.
16. W. Lin, L. Dong, and P. Xue, "Visual distortion gauge based on discrimination of noticeable contrast changes," IEEE Trans. Circuit Syst. Video Technol., vol. 15, no. 7, pp. 900-909, Jul. 2005. (Pubitemid 41119225)
17. A. Liu, W. Lin, M. Paul, C. Deng, and F. Zhang, "Just noticeable difference for images with decomposition model for separating edge and textured regions," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 11, pp. 1648-1652, Nov. 2010.
18. Y. Zhao, Z. Chen, C. Zhu, Y.-P. Tan, and L. Yu, "Binocular justnoticeable-difference model for stereoscopic images," IEEE Signal Process. Lett., vol. 18, no. 1, pp. 19-22, Jan. 2011.
19. S.-W. Jung, J.-Y. Jeong, and S.-J. Ko, "Sharpness enhancement of stereo images using binocular just-noticeable-difference," IEEE Trans. Image Process., vol. 21, no. 3, pp. 1191-1199, Mar. 2012.
20. S.-W. Jung and S.-J. Ko, "Depth enhancement considering just noticeable difference in depth," IEICE Trans. Fund. Elect., vol. 95, no. 3, pp. 673-675, Mar. 2012.
21. V. D. Silva, A. Fernando, S. Worrall, H. K. Arachchi, and A. Kondoz, "Sensitivity analysis of the human visual system for depth cues in stereoscopic 3-D displays," IEEE Trans. Multimedia, vol. 13, no. 3, pp. 498-506, Jun. 2011.
22. D. V. S. X. De Silva, E. Ekmekcioglu, W. A. C. Fernando, and S. T. Worrall, "Display dependent preprocessing of depth maps based on just noticeable depth difference modeling," IEEE J. Sel. Topics Signal Process., vol. 5, no. 2, pp. 335-351, Apr. 2011.
23. D. Scharstein and R. Szeliski, "High-accuracy stereo depth maps using structured light," in Proc. IEEE Comput. Vis. Pattern Recogn., vol. 1. Jun. 2003, pp. 195-202.
24. J. M. L. Murillo and A. A. Rodriguez, "Algorithms for Gaussian bandwidth selection in kernel density estimators," in Proc. Neural Inf. Process. Syst., 2008, pp. 1-6.
25. S. L. P. Yasakethu, D. V. S. X. De Silva, W. A. C. Fernando, and A. Kondoz, "Predicting sensation of depth in 3D video," Electron. Lett., vol. 46, no. 12, pp. 837-839, Jun. 2010.
26. R. Fletcher, "A modified Marquardt subroutine for nonlinear least squares," Atomic Energy Research Establishment, Harwell, England, Rep. AERE-R6799, 1971.
27. L. T. Ha, S.-W. Jung, K.-S. Choi, and S.-J. Ko, "Image sementation based on a modified graph-cut algorithm," Electron. Lett., vol. 46, no. 16, pp. 1121-1123, Aug. 2010.
28. C. Rother, V. Kolmogorov, and A. Blake, "GrabCut interactive foreground extraction using iterated graph cuts," ACM Tran. Graph., vol. 23, no. 3, pp. 309-314, Aug. 2004.
29. B. Dellen, G. Alenya, S. Foix, and C. Torras, "Segmenting color images into surface patches by exploiting sparse depth data," in Proc. IEEE Appl. Comput. Vision Workshop, Kona, HI, Jan. 2011, pp. 591-598.
30. M. Wallenberg, M. Felsberg, P.-E. Forssén, and B. Dellen, "Channel coding for joint colour and depth segmentation," in Proc. Deutsche Arbeitsgemeinschaft F̈r Mustererkennung Symp., 2011, pp. 306-315.
31. W. Chen, J. Fournier, M. Barkowsky, and P. L. Callet, "New stereoscopic video shooting rule based on stereoscopic distortion parameters and comfortable viewing zone," Proc. SPIE, vol. 7863, pp. 78631-1-78631-13, Jan. 2011.
32. L. Xing, J. You, T. Ebrahimi, and A. Perkis, "Factors impacting quality of experience in stereoscopic images," in Proc. SPIE, vol. 7863, pp. 786304-1-786304-8, Jan. 2011.
33. S. M. Smith and J. M. Brady, "SUSAN-a new approach to low level image processing," int. J. Comput. Vision, vol. 23, no. 1, pp. 45-78, May 1997. (Pubitemid 127717027)
34. D. Whitley, "A genetic algorithm tutorial," Dept. Comput. Sci., Colorado State Univ., Fort Collins, CO, Tech. Rep. CS-93-103, Mar. 1993.
35. G. Winter, J. Periaux, M. Galan, and P. Cuesta, Genetic Algorithms in Engineering and Computer Science. New York: Wiley, 1996.
36. S. Hashemi, S. Kiani, N. Noroozi, and M. E. Moghaddam, "An image contrast enhancement method based on genetric algorithm," Pattern Recog. Lett., vol. 31, no. 13, pp. 167-171, Oct. 2010.
37. J. H. Holland, Adaption in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. Cambridge, MA: MIT Press, 1992.
38. A. Telea, "An image inpainting technique based on the fast marching method," J. Graphics Tools, vol. 9, no. 1, pp. 23-34, 2004.
39. Methodology for the Subjective Assessment of the Quality of Television Pictures, Standard ITU-R BT.500-11, 2002.
40. Description of Exploration Experiments in 3-D Video Coding, Standard ISO/IEC JTC1/SC29/WG11, Doc. N10173, Oct. 2008.
41. Poznan Multiview Video Test Sequences and Camera Parameters, Standard ISO/IEC JTC1/SC29/WG11 MPEG, Doc. 2009/M17050, Oct. 2009.