3D puppetry: A Kinect-based interface for 3D animation

UIST'12 - Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology

Volumn , Issue , 2012, Pages 423-433

  Held, Robert T ^a   Gupta, Ankit ^b   Curless, Brian ^b   Agrawala, Maneesh ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Animation; Object tracking; Tangible user interface

Indexed keywords

3D ANIMATION; 3D MODELS; 3D SHAPE MATCHING; DEPTH SENSORS; LIGHTING CONTROLS; OBJECT TRACKING; ON THE FLIES; PHYSICAL OBJECTS; REAL TIME; RIGID OBJECTS; SYSTEM SUPPORTS; SYSTEM USE; TANGIBLE USER INTERFACES; VIRTUAL CAMERA;

ANIMATION; THREE DIMENSIONAL COMPUTER GRAPHICS;

USER INTERFACES;

EID: 84869030637     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (34)

1. Autodesk. 123D Catch. http://www.123dapp.com/catch.
2. Autodesk. 3ds Max. http://usa.autodesk.com/3ds-max/.
3. Autodesk. Maya. http://usa.autodesk.com/maya/.
4. Avrahami, D., Wobbrock, J. O., and Izadi, S. Portico: tangible interaction on and around a tablet. In Proc. UIST (2011), 347-356.
5. Barnes, C., Jacobs, D. E., Sanders, J., Goldman, D. B., Rusinkiewicz, S., Finkelstein, A., and Agrawala, M. Video Puppetry: A performative interface for cutout animation. ACM TOG (Proc. SIGGRAPH) 27, 5 (2008), 124:1-124:9.
6. Besl, P., and McKay, N. A method for registration of 3-D shapes. IEEE PAMI 14 (1992), 239-256.
7. Blender Foundation. Blender. http://www.blender.org.
8. Cline, D., Jeschke, S., White, K., Razdan, A., and Wonka, P. Dart throwing on surfaces. Computer Graphics Forum 28, 4 (2009), 1217-1226.
9. Dontcheva, M., Yngve, G., and Popović, Z. Layered acting for character animation. ACM TOG (Proc. SIGGRAPH) 22 (2003), 409-416.
10. Freedman, B., Shpunt, A., Machline, M., and Arieli, Y. Depth mapping using projected patterns. Patent. US8150142 (2012).
11. Gallo, L., Placitelli, A., and Ciampi, M. Controller-free exploration of medical image data: Experiencing the kinect. In Proc. CBMS (2011), 1-6.
12. Google. Google 3D Warehouse. http://sketchup.google.com/3dwarehouse/.
13. Heindl, C., and Kopf, C. ReconstructMe. http://reconstructme.net.
14. Horn, B. K. P. Closed-form solution of absolute orientation using unit quaternions. JOSA A 4, 4 (1987), 629-642.
15. Iason Oikonomidis, N. K., and Argyros, A. Efficient model-based 3D tracking of hand articulations using kinect. In Proc. BMVC (2011), 101.1-101.11.
16. Ishii, H., and Ullmer, B. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proc. CHI (1997), 234-241.
17. Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. Kinectfusion: real-time 3D reconstruction and interaction using a moving depth camera. In Proc. UIST (2011), 559-568.
18. Johnson, M. P., Wilson, A., Blumberg, B., Kline, C., and Bobick, A. Sympathetic interfaces: Using a plush toy to direct synthetic characters. In Proc. CHI (1999), 152-158.
19. Joung, J. H., An, K. H., Kang, J. W., Chung, M. J., and Yu, W. 3D environment reconstruction using modified color ICP algorithm by fusion of a camera and a 3D laser range finder. In Proc. IROS (2009), 3082-3088.
20. Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K., and Tachibana, K. Virtual object manipulation on a table-top AR environment. In Proc. ISAR (2000), 111-119.
21. Klemmer, S. R., Li, J., Lin, J., and Landay, J. A. Papier- mâché: Toolkit support for tangible input. In Proc. CHI (2004), 399-406.
22. Lee, G. A., Kim, G. J., and Billinghurst, M. Immersive authoring: What you experience is what you get (wyxiwyg). Comm. ACM 48, 7 (2005), 76-81.
23. Lowe, D. G. Object recognition from local scale-invariant features. In Proc. ICCV (1999), 1150-1157.
24. Numaguchi, N., Nakazawa, A., Shiratori, T., and Hodgins, J. K. A puppet interface for retrieval of motion capture data. In Proc. SCA (2011), 157-166.
25. Oore, S., Terzopoulos, D., and Hinton, G. E. A desktop input device and interface for interactive 3D character animation. In Proc. Graphics Interface (2002), 133-140.
26. OpenNI Organization. OpenNI. http://openni.org.
27. Schmidt, R., and Singh, K. meshmixer: an interface for rapid mesh composition. In ACM TOG (Proc. SIGGRAPH) (2010), 6:1.
28. Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A. Real-time human pose recognition in parts from single depth images. In Proc. CVPR (2011), 1297-1304.
29. Sturman, D. J. Computer puppetry. IEEE Computer Graphics and Applications 18, 1 (1998), 38-45.
30. Tomasi, C., and Manduchi, R. Bilateral filtering for gray and color images. In Proc. ICCV (1998), 839-846.
31. Wang, R. Y., and Popović, J. Real-time hand-tracking with a color glove. In ACM TOG (Proc. SIGGRAPH) (2009), 63:1-63:8.
32. Willow Garage. Robotics Operating System. http://ros.org.
33. Wu, C. SiftGPU: A GPU implementation of scale invariant feature transform (SIFT). http://cs.unc.edu/ ccwu/siftgpu, 2007.
34. Ziola, R., Grampurohit, S., Landes, N., Fogarty, J., and Harrison, B. Examining interaction with general-purpose object recognition in LEGO OASIS. In Proc. IEEE VL/HCC (2011), 65-68.