Exemplar-based video inpainting without ghost shadow artifacts by maintaining temporal continuity

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 19, Issue 3, 2009, Pages 347-360

  Shih, Timothy K ^a   Tang, Nick C ^b   Hwang, Jenq Neng ^c  

^a NATIONAL TAIPEI UNIVERSITY OF EDUCATION   (Taiwan)

^b TAMKANG UNIVERSITY   (Taiwan)

^c University of Washington   (United States)

Author keywords

Digital inpainting; Image completion; Motion map segmentation; Object removal; Object tracking; Video inpainting; Video special effect

Indexed keywords

ALGORITHMS; CAMERAS; IMAGE MATCHING; IMAGE PROCESSING; SPECIAL EFFECTS;

DIGITAL INPAINTING; IMAGE COMPLETION; MOTION MAP SEGMENTATION; OBJECT REMOVAL; OBJECT TRACKING; VIDEO INPAINTING; VIDEO SPECIAL EFFECT;

COMPUTER GRAPHICS;

EID: 63349086187     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2009.2013519     Document Type: Article

References (19)

1. A. Criminisi, P. Perez, and K. Toyama, "Region filling and object removal by exemplar-based image inpainting," IEEE Trans. Image Process., vol. 13, no. 9, pp. 1200-1212, Sep. 2004.
2. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal.Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002.
3. I. Drori, D. Cohen-Or, and H. Yeshurun, "Fragment-based image completion," ACM Trans. Graphics (SIGGRAPH), vol. 22, pp. 303-312, 2003, San Diego, CA.
4. K. Hariharakrishnan and D. Schonfeld, "Fast object tracking using adaptive block matching," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 853-859, Oct. 2005.
5. J. Hays and A. A. Efros, "Scene completion using millions of photographs," ACM Trans. Graphics (SIGGRAPH 2007), vol. 26, no. 3, Aug. 2007.
6. J. Jia, T. P. Wu, Y. W. Tai, and C. K. Tang, "Video repairing: Inference of foreground and background under severe occlusion," in Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR), Jun.-Jul. 2004, pp. 364-371.
7. J. Jia, Y. W. Tai, T. P. Wu, and C. K. Tang, "Video repairing under variable illumination using cyclic motions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 832-839, May 2006.
8. Y. T. Jia, S. M. Hu, and R. R. Martin, "Video completion using tracking and fragment merging," in Proc. Pacific Graphics 2005, Visual Computing, Sep. 2005, vol. 21, pp. 601-610.
9. C. Kim and J. N. Hwang, "Video object extraction for object-oriented applications," J. VLSI Signal Process.-Syst. Signal, Image, Video Technol., vol. 29, no. 1/2, pp. 7-22, Aug. 2001.
10. A. C. Kokaram and S. J. Godsill, "Joint detection, interpolation, motion and parameter estimation for image sequences with missing data," in Proc. Int. Conf. Image Process., Oct. 1997, vol. 2, pp. 191-194.
11. F. Nielsen and R. Nock, "ClickRemoval: Interactive pinpoint image object removal," in Proc. 13th Annu. ACM Int. Conf. Multimedia, 2005, pp. 315-318.
12. K. A. Patwardhan, G. Sapiro, and M. Bertalmio, "Video inpainting of occluding and occluded objects," in Proc. IEEE Int. Conf. Image Process., Sep. 2005, vol. 2, pp. 69-72.
13. K. A. Patwardhan, G. Sapiro, and M. Bertalmio, "Video inpainting under constrained camera motion," IEEE Trans. Image Process., vol. 16, no. 2, pp. 545-553, Feb. 2007.
14. L. M. Po and W. C. Ma, "A novel four-step search algorithm for fast block motion estimation," IEEE Trans. Circuits Syst. Video Technol., vol. 6, no. 2, pp. 313-317, Jun. 1996.
15. T. K. Shih, N. C. Tang, W. S. Yeh, T. J. Chen, and W. Lee, "Video inpainting and implant via diversified temporal continuations," in Proc. ACM Multimedia Conf., Oct. 2006, pp. 133-136.
16. T. K. Shih, N. C. Tang, and J. N. Hwang, "Ghost shadow removal in multi-layered video inpainting," in Proc. IEEE Int. Conf. Multimedia & Expo. (ICME 2007), Jul. 2007, pp. 1471-1474.
17. J. Sun, L. Yuan, J. Jia, and H. Y. Shum, "Image completion with structure propagation," in Proc. ACM SIGGRAPH, 2005, vol. 24, pp. 861-868.
18. Y. Wexler, E. Shechtman, and M. Irani, "Space-time completion of video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 463-476, Mar. 2007.
19. Y. Zhang, J. Xiao, and M. Shah, "Motion layer based object removal in videos," in Proc. 7th IEEE Workshop Appl. Comput. Vision, 2005, pp. 516-521.