Virtual contour guided video object inpainting using posture mapping and retrieval

IEEE Transactions on Multimedia

Volumn 13, Issue 2, 2011, Pages 292-302

  Ling, Chih Hung ^a   Lin, Chia Wen ^b   Su, Chih Wen ^c   Chen, Yong Sheng ^a   Liao, Hong Yuan Mark ^a  

^a NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

^b NATIONAL TSING HUA UNIVERSITY   (Taiwan)

^c INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

Author keywords

Object completion; posture mapping; posture sequence retrieval; synthetic posture; video inpainting

Indexed keywords

OBJECT COMPLETION; POSTURE MAPPING; POSTURE SEQUENCE RETRIEVAL; SYNTHETIC POSTURE; VIDEO INPAINTING;

MAPPING;

THREE DIMENSIONAL;

EID: 79952976368     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2010.2095000     Document Type: Article

References (30)

1. K. A. Patwardhan, G. Sapiro, and M. Bertalmío, "Video inpainting under constrained camera motion," IEEE Trans. Image Process., vol. 16, no. 2, pp. 545-553, Feb. 2007. (Pubitemid 46421694)
2. Y. T. Jia, S. M. Hu, and R. R. Martin, "Video completion using tracking and fragment merging," Visual Comput., vol. 21, no. 8-10, pp. 601-610, Aug. 2005. (Pubitemid 41316183)
3. Y. Wexler, E. Shechtman, and M. Irani, "Space-time completion of video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 1-14, Mar. 2007.
4. V. Cheung, B. J. Frey, and N. Jojic, "Video epitomes," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., San Diego, CA, Jun. 2005, pp. 42-49.
5. T. K. Shih, N. C. Tang, and J.-N. Hwang, "Exemplar-based video inpainting without ghost shadow artifacts by maintaining temporal continuity," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 3, pp. 347-360, Mar. 2009.
6. Y. Shen, F. Lu, X. Cao, and H. Foroosh, "Video completion for perspective camera under constrained motion," in Proc. IEEE Conf. Pattern Recognit., Hong Kong, China, Aug. 2006, pp. 63-66.
7. J. Jia, Y.-W. Tai, T.-P. Wu, and C.-K. Tang, "Video repairing under variable illumination using cyclic motions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 832-839, May 2006.
8. S.-C. S. Cheung, J. Zhao, and M. V. Venkatesh, "Efficient object-based video inpainting," in Proc. IEEE Conf. Image Process., Atlanta, GA, Oct. 2006, pp. 705-708.
9. M. Bertalmio, A. L. Bertozzi, and G. Sapiro, "Navier-stokes, fluid dynamics, and image and video inpainting," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Kauai,, HI, Dec. 2001, pp. 355-362.
10. T. Ding, M. Sznaier, and O. I. Camps, "A rank minimization approach to video inpainting," in Proc. IEEE Conf. Comput. Vis., Rio de Janeiro, Brazil, Oct. 2007, pp. 1-8.
11. Y. Matsushita, E. Ofek, W. Ge, X. Tang, and H.-Y. Shum, "Full frame video stabilization with motion inpainting," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 7, pp. 1150-1163, Jul. 2006.
12. M. V. Venkatesh, S.-C. Cheung, J. Paruchuri, J. Zhao, and T. Nguyen, "Protecting and managing privacy information in video surveillance system," in Protecting Privacy in Video Surveillance, A. Senior, Ed. New York: Springer, 2009.
13. A. Efros and T. Leung, "Texture synthesis by non-parametric sampling," in Proc. IEEE Conf. Comput. Vis., 1999, vol. 2, pp. 1033-1038. (Pubitemid 32079980)
14. L. Wei and M. Levoy, "Fast texture synthesis using tree structured vector quantization," in Proc. ACM SIGGRAPH, 2000, pp. 479-488. (Pubitemid 32394012)
15. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, "Image inpainting," in Proc. ACM SIGGRAPH, 2000, pp. 417-424. (Pubitemid 32394006)
16. A. Criminisi, P. Perez, and K. Toyama, "Region filling and object removal by exemplar-based image inpainting," IEEE Trans. Image Process., vol. 13, no. 9, pp. 1200-1212, Sep. 2004.
17. J. Sun, L. Yuan, J. Jia, and H.-Y. Shum, "Image completion with structure propagation," ACMTrans. Graph., vol. 24, no. 3, pp. 861-868, Jul. 2005.
18. T. Huang, S. Chen, J. Liu, and X. Tang, "Image inpainting by global structure and texture propagation," in Proc. ACM Conf. Multimedia, Augsburg, Germany, Sep. 2007, pp. 517-520.
19. I. Haritaoglu, D. Harwood, and L. S. Davis, "W4: Who? When? Where? What? A real-time system for detecting and tracking people," in Proc. IEEE Int. Conf. Automatic Face Gesture Recognit., Los Alamitos, CA, 1998, pp. 222-227.
20. Y. Li, J. Sun, C.-K. Tang, and H.-Y. Shum, "Lazy snapping," ACM Trans. Graph., vol. 23, no. 3, pp. 303-308, Aug. 2004.
21. Y. Li, J. Sun, and H.-Y. Shum, "Video object cut and paste," ACM Trans. Graph., vol. 24, no. 3, pp. 595-600, Aug. 2005.
22. L. Yatziv and G. Sapiro, "Fast image and video colorization using chrominance blending," IEEE Trans. Image Process., vol. 15, no. 5, pp. 1120-1129, May 2006.
23. S. Belongie, J. Malik, and J. Puzicha, "Shape matching and object recognition using shape contexts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 4, pp. 509-522, Apr. 2002. (Pubitemid 34448769)
24. Y.-M. Liang, S.-W. Shih, C.-C. A. Shih, H.-Y. M. Liao, and C.-C. Lin, "Learning atomic human actions using variable-length Markov models," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 1, pp. 268-280, Jan. 2009.
25. A. Elgammal and C.-S. Lee, "Inferring 3D body pose from silhouettes using activity manifold learning," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Washington, DC, Jun. 2004, pp. 681-688.
26. T. H. Corman, C. E. Leiserson, R. L. Rivest, and C. Stein, Introduction to Algorithms, 2nd ed. Cambridge, MA: MIT Press, 2001.
27. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based object tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, pp. 564-577, May 2003.
28. X. Bai, L. J. Latecki, and W.-Y. Liu, "Skeleton pruning by contour partitioning with discrete curve evolution," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 449-462, Mar. 2007. (Pubitemid 46336420)
29. D. Cremers, S. J. Osher, and S. Soatto, "Kernel density estimation and intrinsic alignment for shape priors in level set segmentation," Int. J. Comput. Vis., vol. 69, no. 3, pp. 335-351, Sep. 2006. (Pubitemid 43847176)
30. NTHU Video Inpainting Project. [Online]. Available: http://www.ee. nthu.edu.tw/cwlin/inpainting/inpainting.htm.