Augmenting physical avatars using projector-based illumination

ACM Transactions on Graphics

Volumn 32, Issue 6, 2013, Pages

  Bermano, Amit ^a,b   Bruschweiler, Philipp ^a,b   Grundhöfer, Anselm ^a   Iwai, Daisuke ^c   Bickel, Bernd ^a   Gross, Markus ^a,b  

^a DISNEY RESEARCH   (United States)

^b ETH ZURICH   (Switzerland)

^c OSAKA UNIVERSITY   (Japan)

Author keywords

Animatronics; Projector camera systems

Indexed keywords

ANIMATRONICS; LOW-FREQUENCY MOTION; MECHANICAL CONSTRAINTS; PHYSICAL CONSTRAINTS; PHYSICAL LIMITATIONS; PROJECTOR-CAMERA SYSTEM; SPATIO-TEMPORAL OPTIMIZATIONS; SUBSURFACE SCATTERING;

COMPUTER GRAPHICS;

ANIMATION;

EID: 84887838348     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2508363.2508416     Document Type: Article

References (42)

1. ALIAGA, D. G., YEUNG, Y. H., LAW, A., SAJADI, B., AND MAJUMDER, A. 2012. Fast high-resolution appearance editing using superimposed projections. ACM Trans. Graph. 31, 2, 13:1-13:13.
2. BEELER, T., HAHN, F., BRADLEY, D., BICKEL, B., BEARDSLEY, P., GOTSMAN, C., SUMNER, R. W., AND GROSS, M. 2011. High-quality passive facial performance capture using anchor frames. In ACM Trans. Graph., vol. 30, ACM, 75.
3. BICKEL, B., KAUFMANN, P., SKOURAS, M., THOMASZEWSKI, B., BRADLEY, D., BEELER, T., JACKSON, P., MARSCHNER, S., MATUSIK, W., AND GROSS, M. 2012. Physical face cloning. ACM Trans. Graph. 31, 4.
4. BIMBER, O., AND EMMERLING, A. 2006. Multifocal projection: A multiprojector technique for increasing focal depth. Trans. Visualization and Computer Graphics 12, 4, 658-667.
5. BIMBER, O., IWAI, D., WETZSTEIN, G., AND GRUNDHOFER, A. 2007. The Visual Computing of Projector-Camera Systems. In Proc. Eurographics (State-of-the-Art Report), 23-46.
6. BLANZ, V., AND VETTER, T. 1999. A morphable model for the synthesis of 3d faces. In Proc. Computer graphics and interactive techniques, 187-194.
7. CHUANG, E., AND BREGLER, C. 2002. Performance driven facial animation using blendshape interpolation. Computer Science Technical Report, Stanford University 2, 2, 3.
8. DEBEVEC, P. E., AND MALIK, J. 1997. Recovering high dynamic range radiance maps from photographs. In Proc. of ACM SIGGRAPH, 369-378.
9. D'EON, E., AND IRVING, G. 2011. A quantized-diffusion model for rendering translucent materials. In ACM Trans. Graph., vol. 30, 56.
10. EKMAN, P., AND FRIESEN, W. V. 1977. Facial action coding system.
11. GHOSH, A., AND DEBEVEC, P. 2008. Estimating multi-layer scattering in faces using direct-indirect separation. In ACM SIGGRAPH 2008 talks, SIGGRAPH '08, 2:1-2:1.
12. GROSSE, M., WETZSTEIN, G., GRUNDHO FER, A., AND BIMBER, O. 2010. Coded aperture projection. ACM Trans. Graph. 29, 3, 22:1-22:12.
13. GRUNDHOFER, A. 2013. Practical non-linear photometric projector compensation. In 2nd Int. Workshop on Computational Cameras and Display.
14. HARTLEY, R. I., AND ZISSERMAN, A. 2004. Multiple View Geometry in Computer Vision. Cambridge University Press.
15. HARVILLE, M., CULBERTSON, B., SOBEL, I., GELB, D., FITZHUGH, A., AND TANGUAY, D. 2006. Practical methods for geometric and photometric correction of tiled projector. In Computer Vision and Pattern Recognition Workshop, 5-5.
16. HAVALDAR, P., PIGHIN, F., AND LEWIS, J. 2006. Performance driven facial animation. In ACM SIGGRAPH Courses.
17. ISHIGURO, H. 2006. Interactive humanoids and androids as ideal interfaces for humans. In Proc. International Conference on Intelligent user interfaces, 2-9.
18. KAZHDAN, M., BOLITHO, M., AND HOPPE, H. 2006. Poisson surface reconstruction. In Proc. SGP.
19. KURATATE, T., MATSUSAKA, Y., PIERCE, B., AND CHENG, G. 2011. Mask-bot: A life-size robot head using talking head animation for human-robot communication. In Int. Conference on Humanoid Robots (Humanoids), 99-104.
20. LAW, A. J., ALIAGA, D. G., SAJADI, B., MAJUMDER, A., AND PIZLO, Z. 2011. Perceptually based appearance modification for compliant appearance editing. Comput. Graph. Forum 30, 8, 2288-2300.
21. LI, H., SUMNER, R. W., AND PAULY, M. 2008. Global correspondence optimization for non-rigid registration of depth scans. In Computer Graphics Forum, vol. 27, 1421-1430.
22. LI, H., WEISE, T., AND PAULY, M. 2010. Example-based facial rigging. ACM Trans. Graph. 29, 4, 32.
23. LINCOLN, P., WELCH, G., NASHEL, A., ILIE, A., STATE, A., AND FUCHS, H. 2009. Animatronic shader lamps avatars. In Proc. Int. Symposium on Mixed and Augmented Reality, 27-33.
24. LIPMAN, Y., SORKINE, O., LEVIN, D., AND COHEN-OR, D. 2005. Linear rotation-invariant coordinates for meshes. ACM Trans. Graph. 24, 3, 479-487.
25. MISAWA, K., ISHIGURO, Y., AND REKIMOTO, J. 2012. Ma petite cherie: what are you looking at?: a small telepresence system to support remote collaborative work for intimate communication. In Proc. Augmented Human International Conference, ACM, New York, NY, USA, AH '12, 17:1-17:5.
26. MOUBAYED, S. A., EDLUND, J., AND BESKOW, J. 2012. Taming mona lisa: Communicating gaze faithfully in 2d and 3d facial projections. ACM Trans. Interact. Intell. Syst. 1, 2 (Jan.).
27. NAGASE, M., IWAI, D., AND SATO, K. 2011. Dynamic defocus and occlusion compensation of projected imagery by modelbased optimal projector selection in multi-projection environment. Virtual Real. 15, 2-3 (June), 119-132.
28. NISHIO, S., ISHIGURO, H., AND HAGITA, N. 2007. Humanoid Robots: New Developments. I-Tech, ch. Geminoid: Teleoperated Android of an Existing Person.
29. NOH, J.-Y., AND NEUMANN, U. 2001. Expression cloning. In Proc. Conf. on Comp. Graph. and Int. Techniques, 277-288.
30. OYAMADA, Y., AND SAITO, H. 2008. Defocus blur correcting projector-camera system. In Proc. Int. Conference on Advanced Concepts for Intelligent Vision Systems, 453-464.
31. RASKAR, R., WELCH, G., CUTTS, M., LAKE, A., STESIN, L., AND FUCHS, H. 1998. The office of the future: A unified approach to image-based modeling and spatially immersive displays. In Proc. Conf. on Comp. Graph. and Int. Techniques, 179-188.
32. RASKAR, R., WELCH, G., LOW, K.-L., AND BANDYOPADHYAY, D. 2001. Shader lamps: Animating real objects with imagebased illumination. In Proc. Eurographics Workshop on Rendering Techniques, 89-102.
33. SCHAEFER, S., MCPHAIL, T., AND WARREN, J. 2006. Image deformation using moving least squares. In ACM Trans. Graph., vol. 25, 533-540.
34. SEN, P., CHEN, B., GARG, G., MARSCHNER, S. R., HOROWITZ, M., LEVOY, M., AND LENSCH, H. 2005. Dual photography. ACM Trans. Graph. 24, 3, 745-755.
35. SEOL, Y., LEWIS, J., SEO, J., CHOI, B., ANJYO, K., AND NOH, J. 2012. Spacetime expression cloning for blendshapes. ACM Trans. Graph. 31, 2, 14.
36. SUKTHANKAR, R., STOCKTON, R. G., AND MULLIN, M. D. 2001. Smarter presentations: Exploiting homography in cameraprojector systems. In Proc. Int. Conference on Computer Vision, vol. 1, IEEE, 247-253.
37. TENA, J. R., HAMOUZ, M., HILTON, A., AND ILLINGWORTH, J. 2006. A validated method for dense non-rigid 3d face registration. In Int. Conf. on Video and Signal Based Surveillance.
38. WANG, Z., BOVIK, A. C., SHEIKH, H. R., AND SIMONCELLI, E. P. 2004. Image quality assessment: From error visibility to structural similarity. Trans. on Image Processing 13, 4, 600-612.
39. WETZSTEIN, G., AND BIMBER, O. 2007. Radiometric compensation through inverse light transport. In Computer Graphics and Applications, 2007. PG '07., 391-399.
40. WEYRICH, T., MATUSIK, W., PFISTER, H., BICKEL, B., DONNER, C., TU, C., MCANDLESS, J., LEE, J., NGAN, A., JENSEN, H. W., ET AL. 2006. Analysis of human faces using a measurement-based skin reflectance model. ACM Trans. Graph. 25, 3, 1013-1024.
41. ZHANG, L., AND NAYAR, S. 2006. Projection defocus analysis for scene capture and image display. ACM Trans. Graph. 25, 3, 907-915.
42. ZHANG, Z. 2000. A flexible new technique for camera calibration. Trans. Pattern Anal. Mach. Intell. 22, 11 (Nov.), 1330-1334.