Video motion interpolation for special effect applications

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 41, Issue 5, 2011, Pages 720-732

  Shih, Timothy K ^a   Tang, Nick C ^b   Tsai, Joseph C ^c   Hwang, Jenq Neng ^d  

^a NATIONAL CENTRAL UNIVERSITY   (Taiwan)

^b INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

^c TAMKANG UNIVERSITY   (Taiwan)

^d University of Washington   (United States)

Author keywords

Image completion; mean shift; motion interpolation; object tracking; video falsifying; video forgery; video inpainting; video special effect

Indexed keywords

IMAGE COMPLETION; MEAN SHIFT; MOTION INTERPOLATION; OBJECT TRACKING; VIDEO FALSIFYING; VIDEO FORGERY; VIDEO INPAINTING; VIDEO SPECIAL EFFECT;

PATTERN RECOGNITION; SPECIAL EFFECTS; TERRORISM; THREE DIMENSIONAL; USER INTERFACES;

INTERPOLATION;

EID: 80052043404     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2010.2077674     Document Type: Article

References (26)

1. M. Ahmed and R. Ward, "A rotation invariant rule-based thinning algorithm for character recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 12, pp. 1672-1678, Dec. 2002.
2. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002. (Pubitemid 34550429)
3. A. Criminisi, P. Perez, and K. Toyama, "Region filling and object removal by exemplar-based image inpainting, " IEEE Trans. Image Process., vol. 13, no. 9, pp. 1200-1212, Sep. 2004.
4. I. Drori, D. Cohen-Or, and H. Yeshurun, "Fragment-based image completion, " in Proc. ACM Trans. Graphics (SIGGRAPH), vol. 22, San Diego, CA, 2003, pp. 303-312.
5. H. Farid, "Image forgery detection, " Signal Process. Mag., IEEE, vol. 26, no. 2, pp. 16-25, Mar. 2009.
6. K. Hariharakrishnan and D. Schonfeld, "Fast object tracking using adaptive block matching, " IEEE Trans. Multimedia, vol. 7, no. 5, pp. 853-859, Oct. 2005. (Pubitemid 41452513)
7. J. Hays and A. A. Efros, "Scene completion using millions of photographs, " in Proc. ACM Trans. Graphics (SIGGRAPH 2007), 2008, vol. 51, no. 10, pp. 87-94.
8. C.-C. Hsu, T.-Y. Hung, C.-W. Lin, and C.-T. Hsu, "Video forgery detection using correlation of noise residue, " in Proc. 2008 IEEE 10th Workshop Multimedia Signal Process., Oct. 8-10, pp. 170-174.
9. J. Jia, T.-P. Wu, Y.-W. Tai, and C.-K. Tang, "Video repairing: Inference of foreground and background under severe occlusion, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun./Jul. 2004, pp. 364-371.
10. J. Jia, Y.-W. Tai, T.-P. Wu, and C.-K. Tang, "Video repairing under variable illumination using cyclic motions, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 832-839, May 2006.
11. Y.-T. Jia, S.-M. Hu, and R. R. Martin, "Video completion using tracking and fragment merging, " Visual Comput, vol. 21, no. 8-10, pp. 601-610, 2005. (Pubitemid 41316183)
12. M. K. Johnson and H. Farid, "Exposing digital forgeries in complex lighting, " IEEE Trans. Inf. Forensics Security, vol. 2, no. 3, pp. 450-461, Sep. 2007. (Pubitemid 47290579)
13. A. C. Kokaram and S. J. Godsill, "Joint detection, interpolation, motion and parameter estimation for image sequences with missing data, " in Proc. Int. Conf. Image Proc. Oct. 26-29, 1997, vol. 2, pp. 191-194.
14. V. Kwatra, A. Schodl, I. Essa, G. Turk, and A. Bobick, "Graphcut textures: Image and video synthesis using graph cuts, " in ACM SIGGRAPH 2003, vol. 22, pp. 277-286.
15. F. Nielsen and R. Nock, "ClickRemoval: Interactive pinpoint image object removal, " in Proc. 13th Annu. ACM Int. Conf. Multimedia 2005, pp. 315-318.
16. K. A. Patwardhan, G. Sapiro, and M. Bertalmio, "Video inpainting of occluding and occluded objects, " in Proc. 2005 IEEE Int. Conf. Image Process., Genova, pp. II, pp. 69-72.
17. K. A. Patwardhan, G. Sapiro, and M. Bertalmío, "Video inpainting under constrained camera motion, " IEEE Trans. Image Proc., pp. 545-553, Feb. 2007. (Pubitemid 46421694)
18. S. Peleg, "Video mosaicing for non-chronological time editing, " in presented at the 2007 IAPR Conf. Mach. Vision Applications, Tokyo, Japan, May 16-18, 2007.
19. L.-M. Po and W. C. Ma, "A novel four-step search algorithm for fast block motion estimation, " IEEE Trans. Video Tech., vol. 6, no. 3, pp. 313-317, Jun. 1996. (Pubitemid 126777411)
20. A. Rav-Acha, Y. Pritch, D. Lischinski, and S. Peleg, "Evolving time fronts: Spatio-Temporal video warping, " Tech. Rep. 2005-10, The Hebrew University of Jerusalem.
21. T. K. Shih, N. C. Tang, W.-S. Yeh, T.-J. Chen, and W. Lee, "Video inpainting and implant via diversified temporal continuations, " in Proc. 2006 ACM Multimedia Conf., Santa Barbara, CA, Oct. 23-27, 2006, pp. 133-136. (Pubitemid 47113521)
22. T. K. Shih, N. C. Tang, and J.-N. Hwang, "Ghost shadow removal in multi-layered video inpainting, " in proc. IEEE 2007 Int. Conf. Multimedia Expo, Beijing, China, Jul. 2-5, pp. 1471-1474.
23. J. Sun, L. Yuan, J. Jia, and H. Y. Shum, "Image completion with structure propagation, " in Proc. ACM SIGGRAPH 2005, vol. 24, no. 3, pp. 861-868.
24. R. Urtasun, D. J. Fleet, A. Hertzmann, and P. Fua, "Priors for people tracking from small training sets, " in in Proc. 10th IEEE Int. Conf. Comput. Vis., Oct. 17-21, 2005, vol. 1, pp. 403-410. (Pubitemid 44054986)
25. Y. Wexler, E. Shechtman, and M. Irani, "Space-Time completion of video, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 463-476, Mar. 2007. (Pubitemid 46336421)
26. Y. Zhang, J. Xiao, and M. Shah, "Motion layer based object removal in videos, " in Proc. Seventh IEEE Workshops Appl. Comput. Vis., 2005, pp. 516-521 (in the generated falsified video story).