Text-video completion using structure repair and texture propagation

IEEE Transactions on Multimedia

Volumn 13, Issue 1, 2011, Pages 29-39

  Tsai, Tsung Han ^a   Fang, Chih Lun ^a  

^a NATIONAL CENTRAL UNIVERSITY   (Taiwan)

Author keywords

Spatio temporal consistency; structure texture completion; text removal; video completion

Indexed keywords

BLOCK MATCHING; CONVENTIONAL APPROACH; DESIGN COMPLEXITY; MANUAL INTERACTION; MULTI-FRAME; NEW MODEL; SPATIO-TEMPORAL; SPLINE CURVE; STRUCTURE INFORMATION; STRUCTURE-TEXTURE COMPLETION; SUPERIMPOSED TEXT; TEXT REGION; TEXT REMOVAL; TV PROGRAMS; VIDEO COMPLETION;

ALGORITHMS; REPAIR;

TEXTURES;

EID: 78951476743     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2010.2091497     Document Type: Article

References (28)

1. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, "Image inpainting," in Proc. ACM Conf. Comp. Graphics (SIGGRAPH), New Orleans, LA, Jul. 2000.
2. M. Bertalmio, A. L. Bertozzi, and G. Sapiro, "Navier-stokes, fluid dynamics, and image and video inpainting," in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 2001, pp. 355-362.
3. C. Ballester, M. Bertalmio, V. Caselles, G. Sapiro, and J. Verdera, "Filling-in by joint interpolation of vector fields and gray levels," IEEE Trans. Image Process., vol. 10, no. 8, pp. 1200-1211, Aug. 2001.
4. M. M. Oliveira, B. Bowen, R. McKenna, and Y. S. Chang, "Fast digital image inpainting," in Proc. Conf. Visualization, Imaging and Image Processing, 2001, pp. 261-266.
5. A. Criminisi, P. Pérez, and K. Toyama, "Region filling and object removal by exemplar-based image inpainting," IEEE Trans. Image Process., vol. 13, no. 9, pp. 1200-1212, Sep. 2004.
6. N. Komodakis and G. Tziritas, "Image completion using global optimization," in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 2006, pp. 442-452.
7. T. K. Shih and R. C. Chang, "Digital inpainting-survey and multilayer image inpainting algorithms," in Proc. 3rd Int. Conf. Information Technology and Application, 2005, pp. 15-24.
8. J. Sun, L. Yuan, J. Jia, and H. Y. Shum, "Image completion with structure propagation," in Proc. ACM Conf. Comp. Graphics (SIGGRAPH), 2005, vol. 24, pp. 861-868.
9. M. Bertalmio, V. Caselles, G. Sapiro, and S. Osher, "Simultaneous structure and texture image inpainting," IEEE Trans. Image Process., vol. 12, no. 8, pp. 882-889, Aug. 2003.
10. Y. L. Chen, C. T. Hsieh, and C. H. Hsu, "Progressive image inpainting based on wavelet transform," IEICE Trans. Fundam., vol. E88-A, no. 10, pp. 2826-2834, Oct. 2005.
11. K. A. Patwardhan and G. Sapiro, "Projection based image and video inpainting using wavelets," in Proc. IEEE Int. Conf. Image Processing, 2003, pp. 857-860.
12. H. Yamauchi, J. Haber, and H. P. Seidel, "Image restoration using multiresolution texture synthesis and image inpainting," in Proc. IEEE Int. Conf. Computer Graphics International, 2003, pp. 120-125.
13. O. G. Guleryuz, "Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising-part I: Theory," IEEE Trans. Image Process., vol. 15, no. 3, pp. 539-554, Mar. 2006.
14. O. G. Guleryuz, "Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising-part II: Adaptive algorithms," IEEE Trans. Image Process., vol. 15, no. 3, pp. 555-571, Mar. 2006.
15. J. B. Kim, H. J. Kim, and S. Wachenfeld, "Restoration of regions occluded by a caption in TV scene," in Proc. TENCON Conf., 2003.
16. T. H. Tsai, C. L. Fang, and H. Y. Lin, "Progressive videotext regions inpainting based on edge detection and statistic method," in Proc. Int. Multi Conf. Engineering and Computer Scientists, 2006.
17. B. T. Chun, Y. Bae, and T. Y. Kim, "A method for original image recovery for caption areas in video," in Proc. Conf. IEEE Syst., Man, Cybernetics, 1999.
18. C. W. Lee, K. Jung, and H. J. Kim, "Automatic text detection and removal in video sequences," Pattern Recognit. Lett., vol. 24, no. 15, pp. 2607-2623, Nov. 2003.
19. Y. Wexler, E. Shechtman, and M. Irani, "Space-time video completion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 463-476, Mar. 2007.
20. T. Shiratori, Y. Matsushita, S. B. Kang, and X. Tang, "Video completion by motion field transfer," in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 2006, pp. 411-418.
21. Y. Chen, Y. Hu, O. C. Au, H. Li, and C. W. Chen, "Video error concealment using spatio-temporal boundary matching and partial differential equation," IEEE Trans. Multimedia, vol. 10, no. 1, pp. 2-15, Jan. 2008.
22. K. A. Patwardhan, G. Sapiro, and M. Bertalmio, "Video inpainting under constrained camera motion," IEEE Trans. Image Process., vol. 16, no. 2, pp. 545-553, Feb. 2007.
23. J. Jia, Y. W. Tai, T. P. Wu, and C. K. Tang, "Video repairing under variable illumination using cyclic motions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 832-83, May 2006.
24. M. V. Venkatesh, S. C. S. Cheung, and J. Zhao, "Efficient object-based video inpainting," Pattern Recognit. Lett., vol. 30, no. 2, pp. 168-179, Jan. 2009.
25. Y. Shen, F. Lu, X. Cao, and H. Foroosh, "Video completion for perspective camera under constrained motion," in Proc. IEEE Int. Conf. Pattern Recognition, 2006, pp. 63-66.
26. T. H. Tsai, Y. C. Chen, and C. L. Fang, "2DVTE: A two-directional videotext extractor for rapid and elaborate design," Pattern Recognit., vol. 42, no. 7, pp. 1496-1510, 2009.
27. C. L. Fang and T. H. Tsai, "Advertisement video completion using hierarchical model," in Proc. IEEE Int. Conf. Multimedia and Expo., 2008.
28. J. Canny, "A computational approach to edge detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-8, no. 6, pp. 679-698, Nov. 1986.