Two-dimensional mesh-based mosaic representation for manipulation of video objects with occlusion

IEEE Transactions on Image Processing

Volumn 9, Issue 9, 2000, Pages 1617-1630

  Toklu, Candemir ^b   Erdem, A Tanju ^a,c   Tekalp, A Murat ^d,e  

^a IEEE

^b SIEMENS CORPORATE RESEARCH   (United States)

^c EASTMAN KODAK COMPANY   (United States)

^d UNIVERSITY OF ROCHESTER   (United States)

^e SABANCI UNIVERSITY   (Turkey)

Author keywords

Mosaic synthesis; Object based video editing; Occlusion; Rendering; Two dimensional augmented reality; Two dimensional mesh tracking

Indexed keywords

IMAGE CODING; IMAGE COMPRESSION; IMAGE SEGMENTATION; OBJECT RECOGNITION; OPTIMIZATION;

LOCAL AFFINE MODELS; MOSAIC SYNTHESIS; OCCLUSION; TWO DIMENSIONAL MESH TRACKING; VIDEO OBJECT PLANES;

IMAGE RECONSTRUCTION;

EID: 0034258781     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/83.862644     Document Type: Article

References (36)

1. C. Toklu, A. T. Erdem, M. I. Sezan, and A. M. Tekalp, "Tracking motion and intensity variations using hierarchical 2-D mesh modeling," Graph. Models Image Process., vol. 58, pp. 553-573, Nov. 1996.
2. P. E. Eren, C. Toklu, and A. M. Tekalp, "Object-based video manipulation and composition using 2D meshes in VRML," in Proc. IEEE Workshop Multimedia Signal Processing, Princeton, NJ, June 23-25, 1997.
3. The Virtual Reality Modeling Language, ISO/IEC DIS 14772-1, Apr. 4, 1997.
4. Overview of the MPEG-4 Standard, ISO/IEC JTC1/SC29/WG11 N1730, July 1997.
5. C. Toklu, A. M. Tekalp, A. T. Erdem, and M. I. Sezan, "2-D mesh-based tracking of deformable objects with occlusion," in IEEE Int. Conf. Image Processing, vol. 2, Lausanne, Switzerland, Sept. 16-19, 1996.
6. _, "Simultaneous alpha map generation and 2-D mesh tracking for multimedia applications," in IEEE Int. Conf. Image Processing, Santa Barbara, CA, Oct. 26-29, 1997.
7. Y.-S. Yao and R. Chellappa, "Tracking a dynamic set of feature points," IEEE Trans. Image Processing, vol. 4, pp. 1382-1395, Oct. 1995.
8. M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active contour models," Int. J. Comput. Vis., vol. 1, no. 4, pp. 321-331, 1988.
9. F. Leymarie and M. Levine, "Tracking deformable objects in the plane using an active contour model," IEEE Trans. Pattern Anal. Machine Intell., vol. 15, pp. 617-634, June 1993.
10. K. Fujimura, N. Yokoya, and K. Yamamoto, "Motion tracking of deformable objects by active contour models using multiscale dynamic programming," J. Vis. Commun. Image Represent., vol. 4, pp. 382-391, Dec. 1993.
11. C. Kervrann and F. Heitz, "Robust tracking of stochastic deformable models in long image sequences," in IEEE Int. Conf. Image Processing, Austin, TX, Nov. 1994.
12. Y. Y. Tang and C. Y. Suen, "New algorithms for fixed and elastic geometric transformation models," IEEE Trans. Image Processing, vol. 3, pp. 355-366, July 1994.
13. F. G. Meyer and P. Bouthemy, "Region-based tracking using affine motion models in long image sequences," Comput. Vis. Graph. Image Process., vol. 60, pp. 119-140, Sept. 1994.
14. B. Bascle and R. Deriche, "Region tracking through image sequences," in Proc. Int. Conf. Computer Vision, 1995, pp. 302-307.
15. F. Moscheni, F. Dufaux, and M. Kunt, "Object tracking based on temporal and spatial information," in IEEE Int. Conf. Acoust., Speech, Signal Processing, Atlanta, GA, May 1996.
16. M. Hotter, "Object-oriented analysis-synthesis coding based on moving two-dimensional objects," Signal Process. Image Commun., vol. 2, no. 4, pp. 409-428, 1990.
17. T. Chen, Y. Wang, H. P. Graf, and C. Swain, "A new framework interpolation scheme for talking head sequences," in IEEE Int. Conf. Image Processing, vol. 2, Washington, DC, Oct. 23-16, 1995, pp. 591-594.
18. J. Nieweglowski, T. Campbell, and P. Haavisto, "A novel video coding scheme based on temporal prediction using digital image warping," IEEE Trans. Consumer Electron., vol. 39, pp. 141-150, Aug. 1993.
19. M. Dudon, O. Avaro, and G. Eude, "Object-oriented motion estimation," in Picture Coding Symp., CA, Sept. 1994, pp. 284-287.
20. Y. Nakaya and H. Harashima, "Motion compensation based on spatial transformations," IEEE Trans. Circuits Syst. Video Technol., vol. 4, pp. 339-357, June 1994.
21. Y. Wang and O. Lee, "Active mesh - A feature seeking and tracking image sequence representation scheme," IEEE Trans. Image Processing, vol. 3, pp. 610-624, Sept. 1994.
22. C.-L. Huang and C.-Y. Hsu, "A new motion compensation method for image sequence coding using hierarchical grid interpolation," IEEE Trans. Circuits Syst. Video Technol., vol. 4, pp. 42-52, Feb. 1994.
23. R. Szeliski and H.-Y. Shum, "Motion estimation with quadtree splines," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, pp. 1199-1210, Dec. 1996.
24. Y. Altunbaşak and A. M. Tekalp, "Closed-form connectivity-preserving solutions for motion compensation using 2-D meshes," IEEE Trans. Image Processing, vol. 6, pp. 1255-1269, Sept. 1997.
25. _, "Occlusion-adaptive content-based 2-D mesh design and tracking for object-based coding," IEEE Trans. Image Processing, vol. 6, pp. 1270-1280, Sept. 1997.
26. P. Hsu, K. J. R. Liu, and T. Chen, "An adaptive interpolation scheme for 2-D mesh motion compensation," in IEEE Int. Conf. Image Processing, vol. 3, Santa Barbara, CA, Oct. 1997, pp. 546-549.
27. M. Irani et al., "Efficient representations of video sequences and their applications," Signal Process. Image Commun., vol. 8, pp. 327-351, 1996.
28. H. S. Sawhney and S. Ayer, "Compact representation of videos through dominant and multiple motion estimation," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, no. 8, pp. 814-830, 1996.
29. R. Szeliski, "Video mosaics for virtual environments," Comput. Graph. Applicat., pp. 22-30, Mar. 1996.
30. S. Mann and R. Picard, "Video orbits of the projective group: A simple approach to featureless estimation of parameters," IEEE Trans. Image Processing, vol. 6, pp. 1281-1295, Sept. 1997.
31. A. M. Tekalp, Digital Video Processing. Englewood Cliffs, NJ: Prentice-Hall, 1995.
32. J. M. Regh and A. P. Witkin, "Visual tracking with deformation models," in IEEE Int. Conf. Robotics Automation, vol. 1, Sacramento, CA, Apr. 9-11, 1991, pp. 844-850.
33. J. R. Bergen, P. Anandan, K. J. Hanna, and R. Hingorani, "Hierarchical model-based motion estimation," in Proc. 2nd Eur. Conf. Computer Vision, Santa Margherita Ligure, Italy, May 18-23, 1992, pp. 237-252.
34. C.-S. Fuh and P. Maragos, "Motion displacement estimation using an affine model forimage matching," Opt. Eng., vol. 30, no. 7, pp. 881-887, 1991.
35. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. 7th Int. Conf. Artif. Intell., Vancouver, B.C., Canada, 1981, pp. 674-679.
36. P. J. Rousseeuw and A. M. Leroy, Robust Regression and Outlier Detection. New York: John Wiley, 1987.