6D hands: Markerless hand tracking for computer aided design

UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology

Volumn , Issue , 2011, Pages 549-557

  Wang, Robert Y ^a,c   Paris, Sylvain ^b   Popovic, Jovan ^b,d  

^a Gear Systems   (United States)

^b ADOBE RESEARCH   (United States)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^d UNIVERSITY OF WASHINGTON   (United States)

Author keywords

3D object manipulation; Computer aided design; Hand tracking

Indexed keywords

3D OBJECT; CAD MODELS; CAD SOFTWARES; COMPUTER AIDED; CONSTRAINT SPECIFICATIONS; FREE SPACE; HAND-TRACKING; INPUT SPACE; MARKERLESS; MECHANICAL ASSEMBLY; POSE ESTIMATION; WEBCAMS;

COMPUTER CONTROL; COMPUTER SOFTWARE; MAMMALS; NAVIGATION; QUERY LANGUAGES; THREE DIMENSIONAL; TRACKING (POSITION); USER INTERFACES;

COMPUTER AIDED DESIGN;

EID: 80755169469     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2047196.2047269     Document Type: Conference Paper

References (27)

1. Maneesh Agrawala, Andrew C. Beers, Bernd Fröhlich, Patrick M. Hanrahan, Ian McDowall, and Mark Bolas. The two-user responsive workbench: Support for collaboration through independent views of a shared space. In Proceedings of SIGGRAPH 97, pages 327-332, 1997.
2. Vassilis Athitsos and Stan Sclaroff. Estimating 3D hand pose from a cluttered image. In Computer Vision and Pattern Recognition (CVPR), volume 2, pages 432-439, 2003.
3. Hrvoje Benko and Andrew Wilson. Depthtouch: Using depth-sensing camera to enable freehand interactions on and above the interactive surface. Technical Report MSR-TR-2009-23, Microsoft, 2009.
4. Hrvoje Benko and Andrew D. Wilson. Multi-point interactions with immersive omnidirectional visualizations in a dome. In Interactive Tabletops and Surfaces (ITS), pages 19-28, 2010.
5. Francois Bérard, Jessica Ip, Mitchel Benovoy, Dalia El-Shimy, Jeffrey Blum, and Jeremy Cooperstock. Did "Minority Report" Get it Wrong? Superiority of the Mouse over 3D Input Devices in a 3D Placement Task. Human-Computer Interaction-INTERACT 2009, pages 400-414, 2009.
6. Lawrence D. Cutler, Bernd Fröhlich, and Pat Hanrahan. Two-handed direct manipulation on the responsive workbench. In Proc. of Interactive 3D Graphics (I3D), 1997.
7. Martin de La Gorce, Nikos Paragios, and David J. Fleet. Model-Based Hand Tracking with Texture, Shading and Self-occlusions. In Computer Vision and Pattern Recognition (CVPR), pages 1-8, 2008.
8. Michael Glueck, Keenan Crane, Sean Anderson, Andres Rutnik, and Azam Khan. Multiscale 3D reference visualization. In Proc. of Interactive 3D Graphics and Games (I3D), pages 225-232, 2009.
9. Otmar Hilliges, Shahram Izadi, Andrew D. Wilson, Steve Hodges, Armando Garcia-Mendoza, and Andreas Butz. Interactions in the air: adding further depth to interactive tabletops. In User Interface Software and Technology (UIST), pages 139-148, 2009.
10. Daniel F. Keefe, David B. Karelitz, Eileen L. Vote, and David H. Laidlaw. Artistic collaboration in designing vr visualizations. IEEE Computer Graphics and Applications, 25(2):18-23, 2005. (Pubitemid 40556054)
11. Kenrick Kin, Tom Miller, Björn Bollensdorff, Tony DeRose, Björn Hartmann, and Maneesh Agrawala. Eden: A professional multitouch tool for constructing virtual organic environments. In Human Factors in Computing Systems (CHI), 2011.
12. Wilmot Li, Maneesh Agrawala, Brian Curless, and David Salesin. Automated generation of interactive 3D exploded view diagrams. ACM Trans. on Graphics, 27(3), 2008.
13. S. Malik and J. Laszlo. Visual touchpad: a two-handed gestural input device. In Int. Conf. on Multimodal interfaces, pages 13-15, 2004.
14. Cristina Manresa, Javier Varona, Ramon Mas, and Francisco J. Perale. Real-time hand tracking and gesture recognition for human-computer interaction. Electronic Letters on Computer Vision and Image Analysis, 2000.
15. Maurice Masliah and Paul Milgram. Measuring the allocation of control in a 6 degree-of-freedom docking experiment. In Human Factors in Computing Systems (CHI), pages 25-32, 2000.
16. Niloy J. Mitra, Yong-Liang Yang, Dong-Ming Yan, Wilmot Li, and Maneesh Agrawala. Illustrating how mechanical assemblies work. ACM Trans. on Graphics, 29(3), 2010.
17. Ji-Young Oh and Wolfgang Stuerzlinger. Moving objects with 2D input devices in cad systems and desktop virtual environments. Proc. of Graphics Interface, pages 195-202, 2005. (Pubitemid 43211966)
18. Christian Plagemann, Varun Ganapathi, Daphne Koller, and Sebastian Thrun. Real time identification and localization of body parts from depth images. In Int. Conf. on Robotics and Automation (ICRA), 2010.
19. Javier Romero, Hedvig Kjellstrm, and Danica Kragic. Hands in action: real-time 3D reconstruction of hands in interaction with objects. In Int. Conf. on Robotics and Automation (ICRA), pages 458-463, 2010.
20. Markus Schlattmann and Reinhard Klein. Efficient bimanual symmetric 3D manipulation for markerless hand-tracking. In Virtual Reality International Conference (VRIC), 2009.
21. Jamie Shotton, Andrew Fitzgibbon, Mat Cook, Toby Sharp, Mark Finocchio, Richard Moore, Alex Kipman, and Andrew Blake. Real-Time Human Pose Recognition in Parts from Single Depth Images. In Computer Vision and Pattern Recognition (CVPR), 2011.
22. Chris Stauffer and W.E.L. Grimson. Adaptive background mixture models for real-time tracking. In Computer Vision and Pattern Recognition (CVPR), volume 2, pages 246-252, 1999.
23. Wolfgang Stuerzlinger and Chadwick Wingrave. The Value of Constraints for 3D User Interfaces. Dagstuhl Seminar on VR, 2010.
24. Erik B. Sudderth, Michael I. Mandel, T. Freeman, and S. Willsky. Distributed occlusion reasoning for tracking with nonparametric belief propagation. In Neural Information Processing Systems (NIPS), pages 1369-1376, 2004.
25. Robert Y Wang and Jovan Popovic. Real-time hand-tacking with a color glove. ACM Trans. on Graphics, 28(3): 1-8, 2009.
26. Andrew D. Wilson. Robust computer vision-based detection of pinching for one and two-handed gesture input. In User Interface Software and Technology (UIST), pages 255-258, 2006. (Pubitemid 47142448)
27. Thomas G. Zimmerman, Jaron Lanier, Chuck Blanchard, Steve Bryson, and Young Harvill. A hand gesture interface device. In Human Factors in Computing Systems (CHI), pages 189-192, 1987.