HoloDesk: Direct 3D interactions with a situated see-through display

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2012, Pages 2421-2430

  Hilliges, Otmar ^a   Kim, David ^a,b   Izadi, Shahram ^a   Weiss, Malte ^a,c   Wilson, Andrew D ^d  

^a MICROSOFT RESEARCH   (United Kingdom)

^b NEWCASTLE UNIVERSITY   (United Kingdom)

^c RWTH AACHEN UNIVERSITY   (Germany)

^d MICROSOFT RESEARCH   (United States)

Author keywords

3D physics interactions; Augmented reality (AR); Kinect; Natural human grasping; See through display

Indexed keywords

3D GRAPHICS; 3D INTERACTIONS; 3D SCENES; ALGORITHM MODEL; APPLICATION SCENARIO; HALF-SILVERED MIRRORS; INPUT DEVICES; INTERACTIVE SYSTEM; KINECT; NATURAL HUMAN GRASPING; NON-RIGID; OPTICAL SEE-THROUGH DISPLAY; PHYSICAL OBJECTS; QUALITATIVE STUDY; REAL-WORLD OBJECTS; TARGET ACQUISITION; VIRTUAL DISPLAYS; VIRTUAL IMAGES; VIRTUAL OBJECTS; VIRTUAL WORLDS;

AUGMENTED REALITY; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; VIRTUAL REALITY;

THREE DIMENSIONAL;

EID: 84862063837     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2207676.2208405     Document Type: Conference Paper

References (40)

1. Agrawala, M., et al. The two-user responsive workbench: support for collaboration through individual views of a shared space. In Proc. ACM SIGGRAPH (1997), 327-332.
2. Bimber, O., et al. The extended virtual table: An optical extension for table-like projection systems. Presence: Teleoper. Virtual Environ. 10 (December 2001), 613-631.
3. Bimber, O., and Raskar, R. Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters, Ltd., Natick, MA, USA, 2005.
4. Brox, T., et al. High accuracy optical flow estimation based on a theory for warping. Computer 4, May (2004).
5. Butler, A., et al. Vermeer: Direct Interaction with a 360°Viewable 3D Display. In Proc. ACM UIST (2011).
6. Czernuszenko, M., et al. The immersadesk and infinity wall projection-based virtual reality displays. SIGGRAPH Comput. Graph. 31 (May 1997), 46-49.
7. Feng, Z., et al. Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In Proc. IEEE ISMAR (2008), 193-202.
8. Graham, E. D., and MacKenzie, C. L. Physical versus virtual pointing. In Proc. ACM CHI (1996), 292-299.
9. Grossman, T., and Wigdor, D. Going Deeper: a Taxonomy of 3D on the Tabletop. In Proc. ACM ITS, IEEE (Oct. 2007), 137-144.
10. Hachet, M., et al. Toucheo: Multitouch and Stereo Combined in a Seamless Workspace. In Proc. ACM UIST (Oct. 2011).
11. Hancock, M., Carpendale, S., and Cockburn, A. Shallow-Depth 3D Interaction: design and evaluation of one-, two- and three-touch techniques. In Proc. ACM CHI (2007), 1147-1156.
12. Hilliges, O., et al. Interactions in the Air: Adding Further Depth to Interactive Tabletops. In Proc. ACM UIST (2009), 139-148.
13. Hoffman, D., et al. Vergenceaccommodation conflicts hinder visual performance and cause visual fatigue. IJVR 8, 3 (2008), 33.
14. Izadi, S., et al. C-Slate: A Multi-Touch and Object Recognition System for Remote Collaboration using Horizontal Surfaces. In IEEE Tabletop, vol. 0, IEEE (2007), 3-10.
15. Izadi, S., et al. Going beyond the display. In Proc. ACM UIST, ACM (2008), 269.
16. Izadi, S., et al. KinectFusion: Real-time 3D Reconstruction and Interaction Using a Moving Depth Camera. In Proc. ACM UIST, ACM (2011).
17. Johnson, A., Scharver, C., and Leigh, J. Designing Cranial Implants in a Haptic Augmented Reality Environment. Communications of the ACM 47, 8 (2004), 32-38.
18. Kakehi, Y., et al. Tablescape Plus: Interactive Small-sized Vertical Displays on a Horizontal Tabletop Display. In Proc. ACM ITS, IEEE (2007), 155-162.
19. Kim, S. W., Treskunov, A., and Marti, S. DRIVE: Directly Reaching Into Virtual Environment with bare hand manipulation behind mobile display. In Proc. IEEE 3D UI (2011), 107-108.
20. Knödel, S., and Hachet, M. Multi-touch RST in 2D and 3D Spaces: Studying the Impact of Directness on User Performance. In Proc. IEEE 3D UI (2011).
21. Lee, T., and Hollerer, T. Handy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking. In Proc. ISWC, IEEE (2007), 1-8.
22. Malik, S., and Laszlo, J. Visual touchpad: a two-handed gestural input device. In Proc. ACM ICMI (2004), 289.
23. Martinet, A., et al. The design and evaluation of 3d positioning techniques for multi-touch displays. In Proc. IEEE 3D UI (2010), 115-118.
24. McKenna, M. Interactive viewpoint control and three-dimensional operations. In Proc SI3D, vol. 25, ACM (1992), 53-56.
25. Mulder, J. D., and Liere, R. V. The personal space station: Bringing interaction within reach. In Proc. VRIC (2002).
26. Nakashima, B. K., et al. A 2D-3D Integrated Tabletop Environment for Multi-user Collaboration. Computer Animation and Virtual Worlds 18, 1 (November 2006 2007), 39-56.
27. Olwal, A., et al. ASTOR: An Autostereoscopic Optical See-through Augmented Reality System. In Proc. IEEE ISMAR, IEEE (2005), 24-27.
28. Papagiannakis, G., et al. A survey of mobile and wireless technologies for augmented reality systems. Comput. Animat. Virtual Worlds 19 (February 2008), 3-22.
29. Paris, S., and Durand, F. A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach. IJCV 81, 1 (Dec. 2007), 24-52.
30. Poston, T., and Serra, L. The virtual workbench: dextrous VR. In Proc. ACM VRST (1994), 111-121.
31. Prachyabrued, M., and Borst, C. W. Dropping the ball: Releasing a virtual grasp. In Proc. ACM VRST (2011), 59-66.
32. Reisman, J. L., et al. A screen-space formulation for 2D and 3D direct manipulation. In Proc. ACM UIST (2009), 69-78.
33. Stavness, I., Lam, B., and Fels, S. pCubee : A Perspective-Corrected Handheld Cubic Display. In Proc. ACM CHI (2010), 1381-1390.
34. Ware, C., Arthur, K., and Booth, K. S. Fish Tank Virtual Reality. In Proc. ACM CHI, ACM (1993), 37-42.
35. Wilson, A. D. Depth-Sensing Video Cameras for 3D Tangible Tabletop Interaction. In Proc. ACM ITS, IEEE (2007), 201-204.
36. Wilson, A. D. Simulating Grasping Behavior on an Imaging Interactive Surface. In Proc. ACM ITS, ACM (2007), 125-132.
37. Wilson, A. D., and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proc. ACM UIST (2010), 273-282.
38. Wilson, A. D., et al. Bringing Physics to the Surface. In Proc. ACM UIST (2008), 67-76.
39. Yoshida, T., et al. Repro3d: full-parallax 3d display using retro-reflective projection technology. In Proc. ACM SIGGRAPH, ACM (2010).
40. Zhang, Z. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 11 (2000), 1330-1334