Unwrap mosaics: A new representation for video editing

SIGGRAPH'08: International Conference on Computer Graphics and Interactive Techniques, ACM SIGGRAPH 2008 Papers 2008

Volumn , Issue , 2008, Pages

  Rav Acha, Alex ^a   Kohli, Pushmeet ^b   Rother, Carsten ^b   Fitzgibbon, Andrew ^b  

^a WEIZMANN INSTITUTE OF SCIENCE   (Israel)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Layers; Mosaicing; Motion estimation; Video editing

Indexed keywords

3D SURFACE MODELS; A-PRIORI; DEFORMING OBJECTS; EDITING OPERATIONS; FORMATION PROCESS; LAYERS; MOSAICING; TEXTURE MAPS; VIDEO EDITING;

COMPUTER GRAPHICS; FILMS; FOURIER TRANSFORMS; INTERACTIVE COMPUTER GRAPHICS; MOTION ESTIMATION; TEXTURES; TWO DIMENSIONAL; VIDEO AMPLIFIERS;

THREE DIMENSIONAL;

EID: 57649107322     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. LTD., 2008. Boujou 4: The virtual interchangeable with the real. http://www.2d3.com.
2. AGARWALA, A., DONTCHEVA, M., AGRAWALA, M., DRUCKER, S. M., COLBURN, A., CURLESS, B., SALESIN, D., AND COHEN, M. F. 2004. Interactive digital photomontage. ACM Trans. Graph. (Proc. of SIGGRAPH) 23, 3, 294-302.
3. BAKER, S., SCHARSTEIN, D., LEWIS, J. P., ROTH, S., BLACK, M., AND SZELISKI, R. 2007. A database and evaluation methodology for optical flow. In Proc: ICCV.
4. BHAT, P., ZITNICK, C. L., SNAVELY, N., AGARWALA, A., AGRAWALA, M., COHEN, M., CURLESS, B., AND KANG, S. B. 2007. Using photographs to enhance videos of a static scene. In Eurographics Symposium on Rendering.
5. BLACK, M. J., AND ANANDAN, P. 1993. A framework for the robust estimation of optical flow. In Proc. ICCV, 231-236.
6. BLAKE, A., AND ZISSERMAN, A. 1987. Visual Reconstruction. MIT Press.
7. BOYKOV, Y., AND JOLLY, M.-P. 2001. Interactive graph cuts for optimal boundary and region segmentation of objects in n-D images. In Proc. ICCV, 105-112.
8. BRAND, M. 2001. Morphable 3D models from video. In Proc. CVPR, vol. 2, 456-463.
9. BREGLER, C., HERTZMANN, A., AND BLERMANN, H. 2000. Recovering non-rigid 3D shape from image streams. In Proc. CVPR, 690-696.
10. BROWN, M., AND LOWE, D. G. 2007. Automatic panoramic image stitching using invariant features. Intl. J. Comput. Vision 74, 1, 59-73.
11. BROX, T., BRUHN, A., PAPENBERG, N., AND WEICKERT, J. 2004. High accuracy optical flow estimation based on a theory for warping. In Proc. ECCV, 25-36.
12. BRUHN, A., WEICKERT, J., AND SCHNÖRR, C. 2005. Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods. Intl. J. of Computer Vision 61, 3, 211-231.
13. COSTEIRA, J. P., AND KANADE, T. 1998. A multibody factorization method for independently moving objects. Intl. J. of Computer Vision 29,3,159-179.
14. COX, M., AND COX, M. A. A. 2001. Multidimensional Scaling. Chapman and Hall.
15. DEBEVEC, P. E., TAYLOR, C. J., AND MALIK, J. 1996. Modeling and rendering architecture from photographs. In Proc. ACM Siggraph.
16. FLEET, D., JEPSON, A., AND BLACK, M. 2002. A layered motion representation with occlusion and compact spatial support. In Proc. ECCV, 692-706.
17. FREY, B. J., JOJIC, N., AND KANNAN, A. 2003. Learning appearance and transparency manifolds of occluded objects in layers. In Proc. CVPR.
18. GAY-BELLILE, V., BARTOLI, A., AND SAYD, P. 2007. Direct estimation of non-rigid registrations with image-based self-occlusion reasoning. In Proc. ICCV.
19. GU, X., GORTLER, S. J., AND HOPPE, H. 2002. Geometry images. ACM Trans. Graph. (Proc. of SIGGRAPH), 355-361.
20. IRANI, M., ANANDAN, P., AND HSU, S. 1995. Mosaic based representations of video sequences and their applications. In Proc. ICCV.
21. LEMPITSKY, V., AND IVANOV, D. 2007. Seamless mosaicing of image-based texture maps. In Proc. CVPR, 1-6.
22. LI, Y., SUN, J., AND SHUM, H.-Y. 2005. Video object cut and paste. ACM Trans. Graph. (Proc. of SIGGRAPH) 24, 3, 595-600.
23. RAV-ACHA, A., KOHLI, P., ROTHER, C., AND FLTZGIBBON, A. 2008. Unwrap mosaics. Tech. rep., Microsoft Research. http://research.microsoft.com/unwrap.
24. SAND, P., AND TELLER, S. J. 2006. Particle video: Longrange motion estimation using point trajectories. In Proc. CVPR, 2195-2202.
25. SEETZEN, H., HEIDRICH, W., STUERZLINGER, W., WARD, G., WHITEHEAD, L., TRENTACOSTE, M., GHOSH, A., AND VOROZCOVS, A. 2004. High dynamic range display systems. ACM Trans. Graph. (Proc. of SIGGRAPH) 23, 3, 760-768.
26. SEITZ, S. M., CURLESS, B., DIEBEL, J., SCHARSTEIN, D., AND SZELISKI, R. 2006. A comparison and evaluation of multi-view stereo reconstruction algorithms. In Proc. CVPR, vol. 1, 519-526.
27. SEYMOUR, M. 2006. Art of optical flow. fxguide.com: Feature Stories (Dec.).
28. SHADE, J. W., GORTLER, S. J., HE, L.-W., AND SZELISKI, R. 1998. Layered depth images. In Proc. ACM Siggraph, 231-242.
29. SHI, J., AND MALIK, J. 1997. Normalized cuts and image segmentation. In Proc. CVPR, 731-743.
30. THORMÄHLEN, T., AND BROSZIO, H., 2008. Voodoo Camera Tracker: A tool for the integration of virtual and real scenes. http://www.digilab.uni-hannover.de/docs/manual.html.
31. TOKLU, C., ERDEM, A. T., AND TEKALP, A. M. 2000. Two-dimensional mesh-based mosaic representation for manipulation of video objects with occlusion. IEEE Trans. Image Proc. 9, 9, 1617-1630.
32. TORRESANI, L., HERTZMANN, A., AND BREGLER, C. 2008. Non-rigid structure-from-motion: Estimating shape and motion with hierarchical priors. IEEE Trans. PAMI, (to appear).
33. TURK, G., AND LEVOY, M. 1994. Zippered polygon meshes from range images. In Proc. ACM Siggraph, 311-318.
34. VAN DEN HENGEL, A., DICK, A., THORMÄHLEN, T., WARD, B., AND TORR, P. H. S. 2007. VideoTrace: Rapid interactive scene modelling from video. ACM Trans. Graph. (Proc. of SIGGRAPH).
35. WANG, J. Y. A., AND ADELSON, E. H. 1994. Representing moving images with layers. IEEE Trans. Image Proc. 3, 5, 625-638.
36. WOODFORD, O. J., REID, I. D., AND FLTZGIBBON, A. W. 2007. Efficient new-view synthesis using pairwise dictionary priors. In Proc. CVPR.
37. ZHOU, K., WANG, X., TONG, Y., DESBRUN, M., GUO, B., AND SHUM, H.-Y. 2005. Texture-Montage: Seamless texturing of surfaces from multiple images. ACM Trans. Graph. (Proc. of SIGGRAPH), 1148-1155.
38. ZIGELMAN, G., KIMMEL, R., AND KIRYATI, N. 2002. Texture mapping using surface flattening via multi-dimensional scaling. IEEE Trans, on Visualization and Computer Graphics 8, 2, 198-207.