Video completion using bandlet transform

IEEE Transactions on Multimedia

Volumn 14, Issue 6, 2012, Pages 1591-1601

  Mosleh, Ali ^a   Bouguila, Nizar ^b   Ben Hamza, A ^b  

^a Dept of Electrical and Computer Engineering   (Canada)

^b NONE   (Canada)

Author keywords

Bandlets; inpainting; motion; video completion

Indexed keywords

BANDLETS; FILLING IN; FOREGROUND/BACKGROUND SEGMENTATION; GEOMETRY PROPERTIES; INPAINTING; MOTION; MOTION INFORMATION; MOVING OBJECTS; NONSTATIONARY; PRE-PROCESSING STEP; PRIORITY-BASED; STATIONARY CAMERAS; TEMPORAL CONSISTENCY; TRANSFORM DOMAIN; VIDEO COMPLETION; VIDEO SEQUENCES;

ALGORITHMS;

CAMERAS;

EID: 84870562981     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2012.2198802     Document Type: Article

References (30)

1. J. Jia and C.-K. Tang, "Image repairing: Robust image synthesis by adaptive ND tensor voting," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition. (CVPR), Jun. 2003, pp. 643-650.
2. O. Guleryuz, "Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising-part I: Theory," IEEE Trans. Image Process., vol. 15, no. 3, pp. 539-554, Mar. 2006. (Pubitemid 43257554)
3. O. G. Guleryuz, "Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising-part II: Adaptive algorithms," IEEE Trans. Image Process., vol. 15, no. 3, pp. 555-571, Mar. 2006. (Pubitemid 43257555)
4. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, "Image inpainting," in Proc. 27th Annu. Conf. Computer Graphics and Interactive Techniques. (SIGGRAPH), 2000, pp. 417-424. (Pubitemid 32394006)
5. T. F. Chan and J. Shen, "Mathematical models for local nontexture inpaintings," SIAM J. Appl. Math, vol. 62, pp. 1019-1043, 2001.
6. M. Bertalmio, A. L. Bertozzi, and G. Sapiro, "Navier-stokes, fluid dynamics, and image and video inpainting," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), 2001, pp. I355-362. (Pubitemid 34068977)
7. M. Bertalmio, "Strong-continuation, contrast-invariant inpainting with a third-order optimal pde," IEEE Trans. Image Process., vol. 16, no. 7, pp. 1934-1938, Jul. 2006. (Pubitemid 43985071)
8. M. Ghoniem, Y. Chahir, and A. Elmoataz, "Geometric and texture inpainting based on discrete regularization on graphs," in Proc. 16th IEEE Int. Conf. Image Processing (ICIP), Nov. 7-10, 2009, pp. 1349-1352.
9. O. Alatas, P. Yan, and M. Shah, "Spatio-temporal regularity flow (spref): Its estimation and applications," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 5, pp. 584-589, May 2007. (Pubitemid 46685668)
10. A. Criminisi, P. Perez, and K. Toyama, "Region filling and object removal by exemplar-based image inpainting," IEEE Trans. Image Process., vol. 13, no. 9, pp. 1200-1212, Sep. 2004.
11. K. Patwardhan, G. Sapiro, and M. Bertalmio, "Video inpainting of occluding and occluded objects," in Proc. IEEE Int. Conf. Image Processing (ICIP), Sep. 2005, pp. II69-72.
12. K. A. Patwardhan, G. Sapiro, and M. Bertalmio, "Video inpainting under constrained camera motion," IEEE Trans. Image Process., vol. 16, no. 2, pp. 4545-553, Feb. 2007.
13. T. K. Shih, N. C. Tang, W.-S. Yeh, T.-J. Chen, and W. Lee, "Video inpainting and implant via diversified temporal continuations," in Proc. 14th Annu. ACM Int. Conf. Multimedia, Santa Barbara, CA, 2006, pp. 133-136. (Pubitemid 47113521)
14. T. K. Shih, N. C. Tang, and J.-N. Hwang, "Exemplar-based video inpainting without ghost shadow artifacts by maintaining temporal continuity," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 3, pp. 347-360, Mar. 2009.
15. Y.-T. Jia, S.-M. Hu, and R. R. Martin, "Video completion using tracking and fragment merging," Vis. Comput., vol. 21, pp. 601-610, Sep. 2005. (Pubitemid 41316183)
16. Y. Wexler, E. Shechtman, and M. Irani, "Space-time completion of video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 463-476, Mar. 2007. (Pubitemid 46336421)
17. Y. Zhang, J. Xiao, and M. Shah, "Motion layer based object removal in videos," in Proc. 7th IEEE Workshops Application of Computer Vision (WACV/MOTIONS'05), Jan. 2005, pp. 516-521.
18. N. Tang, C.-T. Hsu, C.-W. Su, T. Shih, and H.-Y. Liao, "Video inpainting on digitized vintage films via maintaining spatiotemporal continuity," IEEE Trans. Multimedia, vol. 13, no. 4, pp. 602-614, Aug. 2011.
19. S.-C. S. Cheung, J. Zhao, andM. V. Venkatesh, "Efficient object-based video inpainting," in Proc. IEEE Int. Conf. Image Processing (ICIP), Atlanta, GA, Oct. 2006, pp. 705-708.
20. J. Jia, Y.-W. Tai, T.-P. Wu, and C.-K. Tang, "Video repairing under variable illumination using cyclic motions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 832-839, May 2006.
21. C.-H. Ling, C.-W. Lin, C.-W. Su, Y.-S. Chen, and H.-Y. Liao, "Virtual contour guided video object inpainting using posture mapping and retrieval," IEEE Trans. Multimedia, vol. 13, no. 2, pp. 292-302, Apr. 2011.
22. A. Mosleh, N. Bouguila, and A. B. Hamza, "A video completion method based on bandlet transform," in Proc. IEEE Int. Conf. Multimedia and Expo. (ICME), Barcelona, Spain, Jul. 2011, pp. 1-6.
23. A. Criminisi, G. Cross, A. Blake, and V. Kolmogorov, "Bilayer segmentation of live video," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR), 2006, pp. 53-60. (Pubitemid 44931312)
24. E. L. Pennec and S. Mallat, "Sparse geometric image representations with bandelets," IEEE Trans. Image Process., vol. 14, no. 4, pp. 423-438, Apr. 2005. (Pubitemid 40552380)
25. E. L. Pennec and S. Mallat, "Bandelet image approximation and compression," SIAM Multiscale Model. Simul., vol. 4, pp. 992-1039, 2005. (Pubitemid 44340296)
26. S. Mallat and G. Peyre, "Surface compression with geometric bandelets," ACM Trans. Graph., vol. 24, pp. 601-608, Jul. 2005.
27. S. Mallat and G. Peyre, "Orthogonal bandlets bases for geometric image approximation," Commun. Pure Appl. Math., vol. 61, pp. 1173-1212, Jul. 2008.
28. S. Mallat and G. Peyre, "A review of bandlet methods for geometrical image representation," Numer. Algorithms, vol. 44, pp. 205-234, Mar. 2007.
29. Information Technology-Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to About 1,5 Mbit/s, ISO/IEC Std. 11, 1993.
30. J. Starck, M. Elad, and D. Donoho, "Redundant multiscale transforms and their application for morphological component separation," Adv. Imag. Electron Phys., vol. 132, pp. 287-348, 2004.