Performance capture of high-speed motion using staggered multi-view recording

Computer Graphics Forum

Volumn 31, Issue 7 PART1, 2012, Pages 2019-2028

  Wu, Di ^a   Liu, Yebin ^a   Ihrke, Ivo ^b,c   Dai, Qionghai ^a   Theobalt, Christian ^b  

^a TSINGHUA UNIVERSITY   (China)

^b MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^c SAARLAND UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER GRAPHICS;

COMMODITY HARDWARE; DEBLURRING ALGORITHMS; HIGH-SPEED MOTION; MODEL BASED APPROACH; MODEL-BASED MOTION CAPTURES; MODEL-BASED OPC; MOTION BLURRED IMAGE; PERFORMANCE CAPTURE;

IMAGE ENHANCEMENT;

EID: 84879807120     PISSN: 01677055     EISSN: 14678659     Source Type: Journal    
DOI: 10.1111/j.1467-8659.2012.03194.x     Document Type: Article

References (50)

1. AGRAWAL A., GUPTA M., VEERARAGHAVAN A., NARASIMHAN S.: Optimal coded sampling for temporal super-resolution. In Proc. IEEE CVPR (2010), pp. 599-606. 1
2. BRADLEY D., ATCHESON B., IHRKE I., HEIDRICH W.: Synchronization and Rolling Shutter Compensation for Consumer Video Camera Arrays. In Proc. ProCams (2009). 2
3. BEN-EZRA M., NAYAR S.: Motion-based Motion Deblurring. IEEE Trans. PAMI 26, 6 (2004), 689-698. 3
4. BEN-EZRA M., ZOMET A., NAYAR S.: Video Superresolution using Controlled Subpixel Detector Shifts. IEEE Trans. PAMI 27, 6 (2005), 977-987. 2
5. BOJSEN-HANSEN M., LI H., WOJTAN C.: Tracking surfaces with evolving topology. ACM Trans. Graph. (SIGGRAPH) 31, 4 (2012). 3
6. BRADLEY D., POPA T., SHEFFER A., HEIDRICH W., BOUBEKEUR T.: Markerless garment capture. ACM Trans. Graph. (SIGGRAPH) 27, 3 (2008), 99. 3
7. BUB G., TECZA M., HELMES M., LEE P., KOHL P.: Temporal Pixel Multiplexing for Simultaneous High-Speed, High-Resolution Imaging. Nature Methods 7 (2010), 209-211. 2
8. CAGNIART C., BOYER E., ILIC S.: Free-form mesh tracking: a patch-based approach. In Proc. IEEE CVPR (2010). 3
9. CHO S.,MATSUSHITA Y., LEE S.: Removing non-uniform motion blur from images. In Proc. of ICCV (2007). 3
10. CARRANZA J., THEOBALT C., MAGNOR M., SEIDEL H.-P.: Free-viewpoint video of human actors. In ACM Trans. Graph. (SIGGRAPH) (2003). 3, 7
11. DE AGUIAR E., STOLL C., THEOBALT C., AHMED N., SEIDEL H.-P., THRUN S.: Performance capture from sparse multi-view video. ACM Trans. Graph. (SIGGRAPH) 27 (2008). 1, 3
12. DING Y., MCCLOSKEY S., YU J.: Analysis of motion blur with a flutter shutter camera for non-linear motion. In Proc. ECCV (2010), pp. 15-30. 3
13. DAI S., WU Y.: Motion from blur. In Proc. IEEE CVPR (2008). 5
14. EINARSSON P., CHABERT C.-F., JONES A., MA W.-C., LAMOND B., HAWKINS T., BOLAS M. T., SYLWAN S., DEBEVEC P. E.: Relighting human locomotion with flowed reflectance fields. In Rendering Techniques (2006), pp. 183-194. 1, 3
15. FURUKAWA Y., PONCE J.: Carved visual hulls for image-based modeling. International journal of computer vision 81, 1 (2009), 53-67. 3
16. FERGUS R., SINGH B., HERTZMANN A., ROWEIS S. T., FREEMAN. W. T.: Removing camera shake from a single photograph. ACM Trans. Graph. (SIGGRAPH) (2006). 3
17. GOLDLUECKE B., CREMERS D.: Superresolution texture maps for multiview reconstruction. In Proc. ICCV (2009), pp. 1-8. 5
18. GALL J., STOLL C., AGUIAR E., THEOBALT C., ROSENHAHN B., SEIDEL H.-P.: Motion capture using joint skeleton tracking and surface estimation. In Proc. IEEE CVPR (2009), pp. 1746-1753. 4, 5
19. JOSHI N., KANG S.-B., ZITNICK L., SZELISKI R.: Image Deblurring using Inertial Measurement Sensors. ACM Trans. Graph. (SIGGRAPH) 24, 3 (2010), 15-22. 3
20. JOSHI N., SZELISKI R., KRIEGMAN D. J.: PSF Estimation using Sharp Edge Prediction. In Proc. IEEE CVPR (2008). 3
21. LAURENTINI A.: The Visual Hull Concept for Silhouette- Based Image Understanding. IEEE Trans. PAMI (1994), 150-162. 4
22. LI K., DAI Q., XU W., YANG J.: Temporal-dense dynamic 3d reconstruction with low frame rate cameras. IEEE Journal of Selected Topics in Signal Processing (2012). 2, 3
23. LEVIN A., FERGUS R., DURAND F., FREEMAN W.: Image and Depth from a Conventional Camera with a Coded Aperture. ACM Trans. Graph. (SIGGRAPH) 26, 3 (2007), 70. 8
24. LI H., LUO L., VLASIC D., PEERS P., POPOVIĆ J., PAULY M., RUSINKIEWICZ S.: Temporally coherent completion of dynamic shapes. ACM Trans. Graph. 31, 1 (2012), 2:1-2:11. 3
25. LEVIN A., LISCHINSKI D.,WEISS Y.: Aclosed-form solution to natural image matting. IEEE Trans. PAMI (2007), 228-242. 5
26. LEVIN A., SAND P., CHO T. S., DURAND F., FREEMAN W. T.: Motion-invariant photography. ACM Trans. Graph. (SIGGRAPH) 27, 3 (2008). 3
27. NARASIMHAN S. G., KOPPAL S. J., YAMAZAKI S.: Temporal Dithering of Illumination for Fast Active Vision. In Proc. ECCV (2008), pp. 830-844. 2
28. RASKAR R., AGRAWAL A., TUMBLIN J.: Coded exposure photography: Motion deblurring via fluttered shutter. ACM Trans. Graph. (SIGGRAPH) 25, 3 (2006), 795-804. 3
29. RICHARDSON W.: Bayesian-based iterative method of image restoration. JOSA 62, 1 (1972), 55-59. 5
30. SHECHTMAN E., CASPI Y., IRANI M.: Increasing Space- Time Resolution in Video. In Proc. ECCV (2002), pp. 753-768. 2, 3
31. SHECHTMAN E., CASPI Y., IRANI M.: Space-Time Super-Resolution. IEEE Trans. PAMI 27, 4 (2005), 531-545. 2, 3
32. SHAN Q., JIA J., AGARWALA A.: High-quality motion deblurring from a single image. ACM ToG (SIGGRAPH) (2008). 3
33. THEOBALT C., ALBRECHT I., HABER J., MAGNOR M., SEIDEL H.-P.: Pitching a baseball: tracking high-speed motion with multi-exposure images. ACM Trans. Graph. (SIGGRAPH) 23 (2004), 540-547. 2
34. TEVS A., BERNER A., WAND M., IHRKE I., BOKELOH M., KERBER J., SEIDEL H.-P.: Animation cartographyintrinsic reconstruction of shape and motion. ACM Trans. Graph. 31, 2 (Apr. 2012), 12:1-12:15. 3
35. TAI Y.-W., HAO D., BROWN M. S., LIN S.: Correction of Spatially Varying Image and Video Motion Blur using a Hybrid Camera. IEEE Trans. PAMI 32, 6 (2010), 1012-1028. 3
36. TAI Y.-W., KONG N., LIN S., SHIN S. Y.: Coded exposure imaging for projective motion deblurring. In Proc. IEEE CVPR (2010). 5
37. TUNG T., NOBUHARA S., MATSUYAMA T.: Complete multi-view reconstruction of dynamic scenes from probabilistic fusion of narrow and wide baseline stereo. In Proc. of ICCV (2009), pp. 1709 -1716. 3
38. TAI Y.-W., TAN P., BROWN M. S.: Richardson-lucy deblurring for scenes under projective motion path. IEEE Trans. PAMI 33, 8 (2011), 1603 -1618. 3
39. THEOBALT C., WUERMLIN S., DE AGUIAR E., NIEDERBERGER C.: New trends in 3d video. In Eurographics Courses (2007). 3
40. VLASIC D., BARAN I., MATUSIK W., POPOVIĆ J.: Articulated mesh animation from multi-view silhouettes. ACM Trans. Graph. (SIGGRAPH) (2008). 3
41. VLASIC D., PEERS P., BARAN I., DEBEVEC P., POPOVIĆ J., RUSINKIEWICZ S., MATUSIK W.: Dynamic shape capture using multi-view photometric stereo. In ACM Trans. Graph. (SIGGRAPH Asia) (2009). 1, 3
42. VEERARAGHAVAN A., REDDY D., RASKAR R.: Coded strobing photography: Compressive sensing of high speed periodic videos. IEEE Trans. PAMI 33, 4 (2011), 671 -686. 2
43. WENGER A., GARDNER A., TCHOU C., UNGER J., HAWKINS T., DEBEVEC P.: Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans. Graph. (SIGGRAPH) 24 (2005), 756-764. 1, 3
44. WETZSTEIN G., IHRKE I., LANMAN D., HEIDRICH W.: State of the Art in Computational Plenoptic Imaging. In Proc. Eurographics (STAR) (2011), pp. 25-48. 2
45. WILBURN B., JOSHI N., VAISH V., LEVOY M., HOROWITZ M.: High Speed Video using a Dense Array of Cameras. In Proc. IEEE CVPR (2004), pp. 294-301. 1, 2, 3
46. WILBURN B., JOSHI N., VAISH V., TALVALA E.-V., ANTUNEZ E., BARTH A., ADAMS A., HOROWITZ M., LEVOY M.: High Performance Imaging using Large Camera Arrays. ACM Trans. Graph. (SIGGRAPH) 24, 3 (2005), 765-776. 2, 3
47. WU C., LIU Y., DAI Q., WILBURN B.: Fusing multiview and photometric stereo for 3d reconstruction under uncalibrated illumination. IEEE Trans. Vis. Comput. Graph. (2010). 5
48. WHYTE O., SIVIC J., ZISSERMAN A., PONCE J.: Nonuniform deblurring for shaken images. In Proc. IEEE CVPR (2010). 3
49. WASCHBÜSCH M., WÜRMLIN S., COTTING D., SADLO F., GROSS M.: Scalable 3D video of dynamic scenes. In Proc. Pacific Graphics (2005), pp. 629-638. 3
50. ZITNICK C. L., KANG S. B., UYTTENDAELE M., WINDER S. A. J., SZELISKI R.: High-quality video viewinterpolation using a layered representation. ACM Trans. Graph. (SIGGRAPH) 23, 3 (2004), 600-608. 3