Depth-aided inpainting for disocclusion restoration of multi-view images using depth-image-based rendering

Journal of Zhejiang University: Science A

Volumn 10, Issue 12, 2009, Pages 1738-1749

  Luo, Kai ^a   Li, Dong Xiao ^a   Feng, Ya Mei ^a   Zhang, Ming ^a  

^a ZHEJIANG UNIVERSITY   (China)

Author keywords

3D TV; Depth aided inpainting; Depth image based rendering (DIBR); Disocclusion restoration; Image warping; Multi view image; Stereoscopic image

Indexed keywords

DEPTH IMAGE BASED RENDERING; DEPTH-IMAGE-BASED RENDERING (DIBR); DISOCCLUSION; IMAGE WARPING; INPAINTING; MULTI-VIEW IMAGE; STEREOSCOPIC IMAGE;

ALGORITHMS; COLOR IMAGE PROCESSING; CONVERGENCE OF NUMERICAL METHODS; IMAGE RECONSTRUCTION; IMAGE UNDERSTANDING; LAGRANGE MULTIPLIERS; MATHEMATICAL MORPHOLOGY; RESTORATION; SIGNAL TO NOISE RATIO; VIDEO AMPLIFIERS; WEAVING;

THREE DIMENSIONAL;

EID: 75649141228     PISSN: 1673565X     EISSN: 18621775     Source Type: Journal    
DOI: 10.1631/jzus.A0820806     Document Type: Article

References (25)

1. G.B. Akar A.M. Tekalp C. Fehn M.R. Civanlar 2007 Transport methods in 3DTV: a survey IEEE Trans. Circ. Syst. Video Technol. 17 11 1622 1630 10.1109/TCSVT.2007.905365 (Pubitemid 350030820)
2. Chen, W.Y., Chang, Y.L., Lin, S.F., Ding, L.F., Chen, L.G., 2005. Efficient Depth Image Based Rendering with Edge Dependent Depth Filter and Interpolation. IEEE Int. Conf. on Multimedia and Expo, p.1314-1317. [doi:10.1109/ICME.2005.1521671]
3. A. Criminisi P. Perez K. Toyama 2004 Region filling and object removal by exemplar-based image inpainting IEEE Trans. Image Process. 13 9 1200 1212 10.1109/TIP.2004.833105
4. Daribo, I., Tillier, C., Pesquet-Popescu, B., 2007. Distance Dependent Depth Filtering in 3D Warping for 3DTV. IEEE 9th Workshop on Multimedia Signal Processing, p.312-315. [doi:10.1109/MMSP.2007.4412880]
5. C. Fehn 2004 Depth-Image-Based Rendering (DIBR), Compression, and Transmission for a New Approach on 3D-TV SPIE 5291 93 104 10.1117/12.524762
6. C. Fehn E. Cooke O. Schreer P. Kauff 2002 3D analysis and image-based rendering for immersive TV applications Signal Process. Image Commun. 17 9 705 715 10.1016/S0923-5965(02)00079-6 (Pubitemid 35214478)
7. C. Fehn R. de la Barre S. Pastoor 2006 Interactive 3-DTV: concepts and key technologies Proc. IEEE 94 3 524 538 10.1109/JPROC.2006.870688
8. M. Flierl A. Mavlankar B. Girod 2007 Motion and disparity compensated coding, for multiview video IEEE Trans. Circ. Syst. Video Technol. 17 11 1474 1484 10.1109/TCSVT.2007.903780 (Pubitemid 350025509)
9. Gonzalez, R.C., Woods, R.E., 2002. Digital Image Processing (2nd Ed.). Prentice Hall, Upper Saddle River, New Jersey, USA.
10. Gonzalez, R.C., Woods, R.E., Eddins, S.L., 2005. Digital Image Processing Using Matlab. Prentice Hall, Upper Saddle River, New Jersey, USA.
11. Hartley, R.I., Zisserman, A., 2000. Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge, UK.
12. P. Kauff N. Atzpadin C. Fehn M. Muller O. Schreer A. Smolic R. Tanger 2007 Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability Signal Process. Image Commun. 22 2 217 234 10.1016/j.image.2006.11.013 (Pubitemid 46412731)
13. J. Lee C. Kim 2007 Removing Foreground Objects by Using Depth Information from Multi-view Images SPIE 6696 669627 669629 10.1117/12.735824
14. McMillan, L., 1997. An Image-based Approach to Three-dimensional Computer Graphics. PhD Thesis, University of North Carolina at Chapel Hill, USA.
15. P. Merkle A. Smolic K. Muller T. Wiegand 2007 Efficient prediction structures for multiview video coding IEEE Trans. Circ. Syst. Video Technol. 17 11 1461 1473 10.1109/TCSVT.2007.903665 (Pubitemid 350025508)
16. Shade, J., Gortler, S., He, L.W., Szeliski, R., 1998. Layered Depth Images. 25th Annual Conf. on Computer Graphics and Interactive Techniques, p.231-242. [doi:10.1145/280814.280882]
17. A. Smolic K. Mueller N. Stefanoski J. Ostermann A. Gotchev G.B. Akar G. Triantafyllidis A. Koz 2007 Coding algorithms for 3DTV: a survey IEEE Trans. Circ. Syst. Video Technol. 17 11 1606 1621 10.1109/TCSVT.2007.909972 (Pubitemid 350025518)
18. Z. Tauber Z.N. Li M.S. Drew 2007 Review and preview: disocclusion by inpainting for image-based rendering IEEE Trans. Syst. Man Cybern. Part C-Appl. Rev. 37 4 527 540 10.1109/TSMCC.2006.886967 (Pubitemid 47064289)
19. C. Vázquez W.J. Tam F. Speranza 2006 Stereoscopic Imaging: Filling Disoccluded Areas in Depth Image-based Rendering SPIE 6392 63920D 12 10.1117/12.685047 (Pubitemid 46104126)
20. Wang, L., Jin, H., Yang, R., Gong, M., 2008. Stereoscopic Inpainting: Joint Color and Depth Completion from Stereo Images. IEEE Conf. on Computer Vision and Pattern Recognition, p.1-8. [doi:10.1109/CVPR.2008.4587704]
21. Wang, W., Huo, L., Zeng, W., Huang, Q., Gao, W., 2007. Depth Image Segmentation for Improved Virtual View Image Quality in 3-DTV. Int. Symp. on Intelligent Signal Processing and Communication Systems, p.300-303. [doi:10.1109/ISPACS.2007.4445883]
22. Xu, G., Zhang, Z., 1996. Epipolar Geometry in Stereo Motion and Object Recognition. Kluver Academic Publishers, Dordrecht, The Netherlands.
23. S.U. Yoon Y.S. Ho 2007 Multiple color and depth video coding using a hierarchical representation IEEE Trans. Circ. Syst. Video Technol. 17 11 1450 1460 10.1109/TCSVT.2007.905363 (Pubitemid 350025507)
24. L. Zhang W.J. Tam 2005 Stereoscopic image generation based on depth images for 3D TV IEEE Trans. Broadcast. 51 2 191 199 10.1109/TBC.2005.846190 (Pubitemid 40819422)
25. C.L. Zitnick S.B. Kang M. Uyttendaele S. Winder R. Szeliski 2004 High-quality video view interpolation using a layered representation ACM Trans. Graph. 23 3 600 608 10.1145/1015706.1015766 (Pubitemid 40163756)