The video mesh: A data structure for image-based three-dimensional video editing

2011 IEEE International Conference on Computational Photography, ICCP 2011

Volumn , Issue , 2011, Pages

  Chen, Jiawen ^a   Paris, Sylvain ^b   Wang, Jue ^b   Matusik, Wojciech ^a   Cohen, Michael ^c   Durand, Frédo ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b ADOBE RESEARCH   (United States)

^c MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

3D EFFECTS; 3D VIDEO; 3D VIEWPOINT; CAMERA CONTROLS; DEPTH OF FIELD; DEPTH VALUE; GRAPHICS HARDWARE; IMAGE-BASED; INTERACTIVE EDITING; MOVING OBJECTS; OBJECT BOUNDARIES; POINT SET; POST-EXPOSURE; SPARSE SET; VIDEO EDITING;

COLOR PHOTOGRAPHY; COMPUTER GRAPHICS; DATA STRUCTURES; IMAGE PROCESSING; OPTICAL FLOWS; PIXELS; USER INTERFACES;

THREE DIMENSIONAL;

EID: 79956137750     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCPHOT.2011.5753118     Document Type: Conference Paper

References (39)

1. Adobe Systems, Inc. After Effects CS4, 2008.
2. A. Agarwala, A. Hertzmann, D. H. Salesin, and S. M. Seitz. Keyframe-based tracking for rotoscoping and animation. ACM Transactions on Graphics, 23(3):584-591, 2004.
3. C. Barnes, E. Shechtman, A. Finkelstein, and D. B. Goldman. PatchMatch: A randomized correspondence algorithm for structural image editing. SIGGRAPH 2009.
4. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester. Image inpainting. In SIGGRAPH 2000.
5. N. Cammas, S. Pateux, and L. Morin. Video coding using non-manifold mesh. In Proceedings of the 13th European Signal Processing Conference, 2005.
6. Y.-Y. Chuang, A. Agarwala, B. Curless, D. Salesin, and R. Szeliski. Video matting of complex scenes. ACM Transactions on Graphics, 21(3):243-248, 2002.
7. P. E. Debevec, C. J. Taylor, and J. Malik. Modeling and rendering architecture from photographs. In SIGGRAPH 1996.
8. A. A. Efros and T. K. Leung. Texture synthesis by nonparametric sampling. In ICCV 1999.
9. J. Gomes, L. Darsa, B. Costa, and L. Velho. Warping and morphing of graphical objects. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1998.
10. M. Guttman, L. Wolf, and D. Cohen-Or. Semi-automatic stereo extraction from video footage. In ICCV 2009.
11. R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, June 2000.
12. K. Hormann, B. Lévy, and A. Sheffer. Mesh parameterization: Theory and practice. In ACM SIGGRAPH Course Notes. ACM, 2007.
13. B. K. P. Horn and B. G. Schunck. Determining optical flow. Artificial Intelligence, 17(1-3):185-203, 1981.
14. Y. Horry, K. Anjyo, and K. Arai. Tour into the picture: Using a spidery mesh interface to make animation from a single image. In SIGGRAPH 1997.
15. M. Irani, P. Anandan, and S. Hsu. Mosaic based representations of video sequences and their applications. In ICCV, 1995.
16. E. A. Khan, E. Reinhard, R. Fleming, and H. Buelthoff. Image-based material editing. SIGGRAPH 2006.
17. S. Koppal, C. L. Zitnick, M. Cohen, S. B. Kang, B. Ressler, and A. Colburn. A viewer-centric editor for stereoscopic cinema. IEEE CG&A.
18. A. Levin, D. Lischinski, and Y. Weiss. A Closed Form Solution to Natural Image Matting. CVPR 2006.
19. B. Lévy. Dual domain extrapolation. SIGGRAPH 2003.
20. Y. Li, J. Sun, and H.-Y. Shum. Video object cut and paste. SIGGRAPH 2005.
21. C. Liu, A. Torralba, W. T. Freeman, F. Durand, and E. H. Adelson. Motion magnification. SIGGRAPH 2005.
22. N. Molino, Z. Bao, and R. Fedkiw. A virtual node algorithm for changing mesh topology during simulation. ACM Transactions on Graphics, 23(3):385-392, 2004.
23. B. M. Oh, M. Chen, J. Dorsey, and F. Durand. Image-based modeling and photo editing. In SIGGRAPH 2001.
24. Quantel Ltd. Pablo. http://goo.gl/M7d4, 2010.
25. A. Rav-Acha, P. Kohli, C. Rother, and A. Fitzgibbon. Unwrap mosaics: a new representation for video editing. ACM Transactions on Graphics, 27(3):17:1-17:11, 2008.
26. P. Sand and S. Teller. Particle video: Long-range motion estimation using point trajectories. In CVPR 2006.
27. S. M. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski. A comparison and evaluation of multi-view stereo reconstruction algorithms. In CVPR 2006.
28. J. Shi and C. Tomasi. Good features to track. CVPR 1994.
29. S. N. Sinha, D. Steedly, R. Szeliski, M. Agrawala, and M. Pollefeys. Interactive 3D architectural modeling from unordered photo collections. SIGGRAPH Asia 2008.
30. R. Szeliski. Video mosaics for virtual environments. IEEE CG&A 1996.
31. R. Szeliski and P. Golland. Stereo matching with transparency and matting. IJCV 1999.
32. R. S. Szeliski. Video-based rendering. In Vision, Modeling, and Visualization, page 447, 2004.
33. The Foundry Visionmongers Ltd. Ocula. http://www.thefoundry.co.uk/ products/ocula/, 2009.
34. A. van den Hengel, A. Dick, T. Thormählen, B. Ward, and P. H. S. Torr. VideoTrace: rapid interactive scene modelling from video. SIGGRAPH 2007.
35. J. Wang, P. Bhat, R. A. Colburn, M. Agrawala, and M. F. Cohen. Interactive video cutout. SIGGRAPH 2005.
36. J.Wang and M. Cohen. Optimized color sampling for robust matting. In CVPR 2007.
37. J. Y. A. Wang and E. H. Adelson. Representing moving images with layers. IEEE Trans. on Image Proc., 1994.
38. G. Zhang, Z. Dong, J. Jia, L. Wan, T. Wong, and H. Bao. Refilming with depth-inferred videos. IEEE Transactions on Visualization and Computer Graphics, 15(5):828-840, 2009.
39. L. Zhang, G. Dugas-Phocion, J.-S. Samson, and S. M. Seitz. Single view modeling of free-form scenes. In CVPR 2001.