Unwrap mosaics: A new representation for video editing

ACM Transactions on Graphics

Volumn 27, Issue 3, 2008, Pages

  Rav Acha, Alex ^a   Kohli, Pushmeet ^b   Rother, Carsten ^b   Fitzgibbon, Andrew ^b  

^a WEIZMANN INSTITUTE OF SCIENCE   (Israel)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Layers; Mosaicing; Motion estimation; Video editing

Indexed keywords

3D SURFACE MODELING; A-PRIORI; DEFORMING OBJECTS; EDITING OPERATIONS; FORMATION PROCESSES; LAYERS; MOSAICING; MOTION ESTIMATION; TEXTURE MAPS; VIDEO EDITING;

FILMS; TEXTURES;

THREE DIMENSIONAL;

EID: 49249134293     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1360612.1360616     Document Type: Article

References (38)

1. LTD., 2008. Boujou 4: The virtual interchangeable with the real, http://www.2d3.com.
2. AGARWALA, A., DONTCHEVA, M., AGRAWALA, M., DRUCKER, S. M., COLBURN, A., CURLESS, B., SALESIN, D., AND COHEN, M. F. 2004. Interactive digital photomontage. ACM Trans. Graph. (Proc of SIGGRAPH) 23, 3, 294-302.
3. BAKER, S., SCHARSTEIN, D., LEWIS, J. P., ROTH, S., BLACK, M., AND SZELISKI, R. 2007. A database and evaluation methodology for optical flow. In Proc. ICCV.
4. BHAT, P., ZITNICK, C. L., SNAVELY, N., AGARWALA, A., AGRAWALA, M., COHEN, M., CURLESS, B., AND KANG, S. B. 2007. Using photographs to enhance videos of a static scene. In Eurographics Symposium on Rendering.
5. BLACK, M. J., AND ANANDAN, P. 1993. A framework for the robust estimation of optical flow. In Proc. ICCV, 231-236.
6. BLAKE, A., AND ZISSERMAN, A. 1987. Visual Reconstruction. MIT Press.
7. BOYKOV, Y., AND JOLLY, M.-P. 2001. Interactive graph cuts for optimal boundary and region segmentation of objects in n-D images. In Proc. ICCV, 105-112.
8. BRAND, M. 2001. Morphable 3D models from video. In Proc. CVPR, vol. 2, 456-463.
9. BREGLER, C., HERTZMANN, A., AND BIERMANN, H. 2000. Recovering non-rigid 3D shape from image streams. In Proc. CVPR, 690-696.
10. BROWN, M., AND LOWE, D. G. 2007. Automatic panoramic image stitching using invariant features. Intl. J. Comput. Vision 74, 1, 59-73.
11. BROX, T., BRUHN, A., PAPENBERG, N., AND WEICKERT, J. 2004. High accuracy optical flow estimation based on a theory for warping. In Proc. ECCV, 25-36.
12. BRUHN, A., WEICKERT, J., AND SCHNORR, C. 2005. Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods. Intl. J. of Computer Vision 61, 3, 211-231.
13. COSTEIRA, J. P., AND KANADE, T. 1998. A multibody factorization method for independently moving objects. Intl. J. of Computer Vision 29, 3, 159-179.
14. COX, M., AND COX, M. A. A. 2001. Multidimensional Scaling. Chapman and Hall.
15. DEBEVEC, P. E., TAYLOR, C. J., AND MALIK, J. 1996. Modeling and rendering architecture from photographs. In Proc. ACM Siggraph.
16. FLEET, D., JEPSON, A., AND BLACK, M. 2002. A layered motion representation with occlusion and compact spatial support. In Proc. ECCV, 692-706.
17. FREY, B. J., JOJIC, N., AND KANNAN, A. 2003. Learning appearance and transparency manifolds of occluded objects in layers. In Proc. CVPR.
18. GAY-BELLILE, V., BARTOLI, A., AND SAYD, P. 2007. Direct estimation of non-rigid registrations with image-based self-occlusion reasoning. In Proc. ICCV.
19. GU, X., GORTLER, S. J., AND HOPPE, H. 2002. Geometry images. ACM Trans. Graph. (Proc. of SIGGRAPH), 355-361.
20. IRANI, M., ANANDAN, P., AND HSU, S. 1995. Mosaic based representations of video sequences and their applications. In Proc. ICCV.
21. LEMPITSKY, V., AND IVANOV, D. 2007. Seamless mosaicing of image-based texture maps. In Proc. CVPR, 1-6.
22. LI, Y., SUN, J., AND SHUM, H.-Y. 2005. Video object cut and paste. ACM Trans. Graph. (Proc: of SIGGRAPH) 24, 3, 595-600.
23. RAV-ACHA, A., KOHLI, P., ROTHER, C., AND FITZGIBBON, A. 2008. Unwrap mosaics. Tech. rep., Microsoft Research. http://research.microsoft.com/unwrap.
24. SAND, P., AND TELLER, S. J. 2006. Particle video: Long-range motion estimation using point trajectories. In Proc. CVPR, 2195-2202.
25. SEETZEN, H., HEIDRICH, W., STUERZLINGER, W., WARD, G., WHITEHEAD, L., TRENTACOSTE, M., GHOSH, A., AND VOROZCOVS, A. 2004. High dynamic range display systems. ACM Trans. Graph. (Proc. of SIGGRAPH) 23, 3, 760-768.
26. SEITZ, S. M., CURLESS, B., DIEBEL, J., SCHARSTEIN, D., AND SZELISKI, R. 2006. A comparison and evaluation of multi-view stereo reconstruction algorithms. In Proc. CVPR, vol. 1, 519-526.
27. SEYMOUR, M. 2006. Art of optical flow, fxguide.com: Feature Stories (Dec).
28. SHADE, J. W., GORTLER, S. J., HE, L.-W., AND SZELISKI, R. 1998. Layered depth images. In Proc. ACM Siggraph, 231.-242.
29. SHI, J., AND MALIK, J. 1997. Normalized cuts and image segmentation. In Proc: CVPR, 731-743.
30. THORMÄHLEN, T., AND BROSZIO, H., 2008. Voodoo Camera Tracker: A tool for the integration of virtual and real scenes. http://www.digilab.uni-hannover.de/docs/manual.html.
31. TOKLU, C., ERDEM, A. T., AND TEKALP, A. M. 2000. Two-dimensional mesh-based mosaic representation for manipulation of video objects with occlusion. IEEE Trans. Image Proc: 9, 9, 1617-1630.
32. TORRESANI, L., HERTZMANN, A., AND B.REGLER, C. 2008. Non-rigid structure-from-motion: Estimating shape and motion with hierarchical priors. IEEE Trans. RAMI, (to appear).
33. TURK, G., AND LEVOY, M. 1994. Zippered polygon meshes from range images. In Proc: ACM Siggraph, 311-318.
34. VAN DEN HENGEL, A., DICK, A., THORMÄHLEN, T., WARD, B., AND TORR, P. H. S. 2007. VideoTrace: Rapid interactive scene modelling from video. ACM Trans. Graph. (Proc: of SIGGRAPH).
35. WANG, J. Y. A., AND ADELSON, E. H. 1994. Representing moving images with layers. IEEE Trans. Image Proc 3, 5, 625-638.
36. WOODFORD, O. J., REID, I. D., AND FITZGIBBON, A. W. 2007. Efficient new-view synthesis using pairwise dictionary priors. In Proc: CVPR.
37. ZHOU, K., WANG, X., TONG, Y., DESBRUN, M., GUO, B., AND SHUM, H.-Y. 2005. Texture-Montage: Seamless texturing of surfaces from multiple images. ACM Trans. Graph. (Proc of SIGGRAPH), 1148-1155.
38. ZIGELMAN, G., KIMMEL, R., AND KIRYATI, N. 2002. Texture mapping using surface flattening via multi-dimensional scaling. IEEE Trans. on Visualization and Computer Graphics 8, 2, 198-207.