4D Model Flow: Precomputed Appearance Alignment for Real-time 4D Video Interpolation

Computer Graphics Forum

Volumn 34, Issue 7, 2015, Pages 173-182

  Casas, Dan ^a,b   Richardt, Christian ^b,c   Collomosse, John ^a   Theobalt, Christian ^b   Hilton, Adrian ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

^b MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^c Intel Visual Computing Institute   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ALIGNMENT; DIGITAL STORAGE; INTERPOLATION; VIDEO RECORDING; VIDEO SIGNAL PROCESSING;

DYNAMIC APPEARANCE; OPTICAL FLOW COMPUTATION; PARAMETRIC INTERPOLATION; PARAMETRIZATIONS; REAL-TIME RENDERING; SURFACE APPEARANCE; VIDEO INTERPOLATION; VISUAL QUALITIES;

RENDERING (COMPUTER GRAPHICS);

EID: 84945199255     PISSN: 01677055     EISSN: 14678659     Source Type: Journal    
DOI: 10.1111/cgf.12756     Document Type: Conference Paper

References (30)

1. Buehler C., Bosse M., McMillan L., Gortler S., Cohen M.,: Unstructured lumigraph rendering. In SIGGRAPH (2001), pp. 425-432. 1, 5
2. Beeler T., Hahn F., Bradley D., Bickel B., Beardsley P., Gotsman C., Sumner R.W., Gross M.,: High-quality passive facial performance capture using anchor frames. ACM Transactions on Graphics (SIGGRAPH) 30, 4 (2011), 75: 1-10. 1, 2
3. Budd C., Huang P., Klaudiny M., Hilton A.,: Global non-rigid alignment of surface sequences. International Journal of Computer Vision 102, 1-3 (2013), 256-270. 1, 2, 4, 5
4. Bradley D., Heidrich W., Popa T., Sheffer A.,: High resolution passive facial performance capture. ACM Transactions on Graphics (SIGGRAPH) 29, 4 (2010), 41. 2
5. Casas D., Tejera M., Guillemaut J., Hilton A.,: Interactive animation of 4D performance capture. IEEE Transactions on Visualization and Computer Graphics 19, 5 (2013), 762-773. 2, 3, 6, 8
6. Casas D., Volino M., Collomosse J., Hilton A.,: 4D video textures for interactive character appearance. Computer Graphics Forum (Eurographics) 33, 2 (2014), 371-380. 1, 2, 3, 8
7. de Aguiar E., Stoll C., Theobalt C., Ahmed N., Seidel H.-P., Thrun S.,: Performance capture from sparse multi-view video. ACM Transactions on Graphics (SIGGRAPH) 27, 3 (2008), 98: 1-10. 1, 2, 4
8. Debevec P., Yu Y., Borshukov G.,: Efficient view-dependent image-based rendering with projective texture-mapping. In Rendering Techniques (1998), pp. 105-116. 1, 4
9. Eisemann M., De Decker B., Magnor M., Bekaert P., de Aguiar E., Ahmed N., Theobalt C., Sellent A.,: Floating textures. Computer Graphics Forum (Eurographics) 27, 2 (2008), 409-418. 2
10. Farnebäck G.,: Two-frame motion estimation based on polynomial expansion. In Image Analysis (Proceedings of SCIA) (2003), pp. 363-370. 5, 8
11. Flagg M., Nakazawa A., Zhang Q., Kang S.B., Ryu Y.K., Essa I., Rehg J.M.,: Human video textures. In I3D (2009), pp. 199-206. 2
12. Huang P., Hilton A., Starck J.,: Human motion synthesis from 3D video. In CVPR (2009), pp. 1478-1485. 2
13. Klaudiny M., Budd C., Hilton A.,: Towards optimal non-rigid surface tracking. In ECCV (2012). 7, 8
14. Liao J., Lima R.S., Nehab D., Hoppe H., Sander P.V.,: Semi-automated video morphing. Computer Graphics Forum (EGSR) 33, 4 (2014), 51-60. 2
15. Liu C., Yuen J., Torralba A.,: SIFT flow: Dense correspondence across scenes and its applications. IEEE Transactions on Pattern Analysis and Machine Intelligence 33, 5 (2011), 978-994. 2
16. Pons J.-P., Keriven R., Faugeras O.,: Multi-view stereo reconstruction and scene flow estimation with a global image-based matching score. International Journal of Computer Vision 72, 2 (2007), 179-193. 3
17. Quiroga J., Brox T., Devernay F., Crowley J.,: Dense semi-rigid scene flow estimation from RGBD images. In ECCV (2014), pp. 567-582. 3
18. Starck J., Hilton A.,: Surface capture for performance-based animation. IEEE Computer Graphics and Application 27 (2007), 21-31. 2
19. Sun D., Roth S., Black M.J.,: A quantitative analysis of current practices in optical flow estimation and the principles behind them. International Journal of Computer Vision 106, 2 (2014), 115-137. 2, 8
20. Tsiminaki V., Franco J.-S., Boyer E.,: High resolution 3D shape texture from multiple videos. In CVPR (2014), pp. 1502-1509. 1, 2
21. Vlasic D., Baran I., Matusik W., Popovic J.,: Articulated mesh animation from multi-view silhouettes. ACM Transactions on Graphics (SIGGRAPH) 27, 3 (2008), 97: 1-9. 2
22. Vedula S., Baker S., Rander P., Collins R., Kanade T.,: Three-dimensional scene flow. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 3 (2005), 475-480. 2, 3
23. Valgaerts L., Bruhn A., Zimmer H., Weickert J., Stoll C., Theobalt C.,: Joint estimation of motion, structure and geometry from stereo sequences. In ECCV (2010), pp. 568-581. 3
24. Volino M., Casas D., Collomosse J., Hilton A.,: Optimal representation of multiple view video. In BMVC (2014). 3, 5
25. Vogel C., Schindler K., Roth S.,: Piecewise rigid scene flow. In ICCV (2013), pp. 1377-1384. 3
26. Wedel A., Brox T., Vaudrey T., Rabe C., Franke U., Cremers D.,: Stereoscopic scene flow computation for 3d motion understanding. International Journal of Computer Vision 95, 1 (2011), 29-51. 3
27. Xu F., Liu Y., Stoll C., Tompkin J., Bharaj G., Dai Q., Seidel H.-P., Kautz J., Theobalt C.,: Video-based characters: Creating new human performances from a multi-view video database. ACM Transactions on Graphics (SIGGRAPH) 30, 4 (2011), 32: 1-10. 2
28. Zaharescu A., Boyer E., Horaud R.,: Keypoints and local descriptors of scalar functions on 2D manifolds. International Journal of Computer Vision 100 (2012), 78-98. 2
29. Zhou Q.-Y., Koltun V.,: Color map optimization for 3D reconstruction with consumer depth cameras. ACM Transactions on Graphics (SIGGRAPH) 33, 4 (2014), 155: 1-10. 2
30. Zitnick C.L., Kang S.B., Uyttendaele M., Winder S., Szeliski R.,: High-quality video view interpolation using a layered representation. ACM Transactions on Graphics (SIGGRAPH) 23, 3 (2004), 600-608. 2