3D user interfaces: New directions and perspectives

IEEE Computer Graphics and Applications

Volumn 28, Issue 6, 2008, Pages 20-36

  Bowman, Doug A ^a   Coquillart, Sabine ^b   Froehlich, Bernd ^c   Hirose, Michitaka ^d   Kitamura, Yoshifumi ^e   Kiyokawa, Kiyoshi ^e   Stuerzlinger, Wolfgang ^f  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^b INRIA   (France)

^c BAUHAUS UNIVERSITY WEIMAR   (Germany)

^d UNIVERSITY OF TOKYO   (Japan)

^e OSAKA UNIVERSITY   (Japan)

^f YORK UNIVERSITY   (Canada)

Author keywords

3D UI; 3D user interfaces; Augmented reality; Biosignal interfaces; Collaborative 3D user interfaces; Electroencephalography; Haptic interfaces; Input devices; Multidisplay environments; Navigation; Pseudo haptics; Sensors; Three dimensional displays; Virtual environment; Virtual reality; Visualization

Indexed keywords

3D UI; 3D USER INTERFACES; AUGMENTED REALITY; BIOSIGNAL INTERFACES; COLLABORATIVE 3D USER INTERFACES; INPUT DEVICES; MULTIDISPLAY ENVIRONMENTS; PSEUDO-HAPTICS; VIRTUAL ENVIRONMENT;

COMPUTER SUPPORTED COOPERATIVE WORK; HAPTIC INTERFACES; SURFACE CHEMISTRY; THREE DIMENSIONAL; VIRTUAL REALITY;

USER INTERFACES;

ARTICLE; COMPUTER GRAPHICS; COMPUTER INTERFACE; COMPUTER PROGRAM; FORECASTING; INFORMATION DISSEMINATION; INFORMATION RETRIEVAL; INTERNET; METHODOLOGY; THREE DIMENSIONAL IMAGING;

COMPUTER GRAPHICS; FORECASTING; IMAGING, THREE-DIMENSIONAL; INFORMATION DISSEMINATION; INFORMATION STORAGE AND RETRIEVAL; INTERNET; SOFTWARE; USER-COMPUTER INTERFACE;

EID: 57049120148     PISSN: 02721716     EISSN: None     Source Type: Journal    
DOI: 10.1109/MCG.2008.109     Document Type: Article

References (61)

1. K. Hinckley et al., "A Survey of Design Issues in Spatial Input," Proc. 1994 ACM Symp. User Interface Software and Technology, ACM Press, 1994, pp. 213-222.
2. R. Jacob et al., "Integrality and Separability of Input Devices," ACM Trans. Computer-Human Interaction, vol. 1, no. 1, 1994, pp. 3-26.
3. B. Froehlich et al., "The GlobeFish and the GlobeMouse: Two New Six Degree of Freedom Input Devices for Graphics Applications," Proc. 2006 ACM Conf. Human Factors in Computing Systems, ACM Press, 2006, pp. 191-199.
4. A. Kulik, R. Blach, and B. Froehlich, "Two-4-Six"-a Handheld Device for 3D-Presentations," Proc. 2006 IEEE Symp. 3D User Interfaces, IEEE Press, 2006, pp. 167-170.
5. Brain Computer Interfaces Based on the Steady State Visual Evoked Response," IEEE Trans. Rehabilitation Eng., vol. 8, no. 2, 2008, pp. 211-214.
6. L.A. Farewell and E. Donchin, "Taking off the Top of Your Head: Toward a Mental Prothesis Utilizing Event-Related Brain Potentials," Electroencephalography and Clinical Neurophysiology, vol. 70, no. 6, 1988, pp. 510-523.
7. G. Pfurtscheller and C. Neuper, "Motor Imagery Activates Primary Sensorimotor Area in Humans," Neuroscience Letters, vol. 239, nos. 2-3, 1997, pp. 65-68.
8. H. Touyama, M. Aotsuka, and M. Hirose, "A Pilot Study on Virtual Camera Control via Steady-State VEP in Immersing Virtual Environment," Proc. Human-Computer Interaction 2008, ACTA Press, 2008, track 611-065.
9. M. Hirose et al., "Development and Evaluation of the Cabin Immersive Multiscreen Display," Systems and Computers in Japan, vol. 30, no. 1, 1999, pp. 13-22.
10. Y. Wang et al. "Common Spatial Pattern Method for Channel Selection in Motor Imagery Based Brain-Computer Interface," Proc. 27th Ann. Conf. IEEE Eng. in Medicine and Biology Soc., vol. 5, 2005, pp. 5392-5395.
11. J. Fujisawa, H. Touyama, and M. Hirose, "EEG Based Navigation of Immersing Virtual Environments Using Common Spatial Patterns," Proc. 2008 IEEE Int'l Conf. Virtual Reality, IEEE Press, 2008, pp. 251-252.
12. F. Biocca, J. Kim, and Y. Choi, "Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces and Cross-modal Sensory Illusions," Presence, vol. 10, no. 3, 2001, pp. 247-265.
13. L. Lécuyer et al., "Boundary of Illusion: An Experiment of Sensory Integration with a Pseudohaptic System," Proc. 2001 IEEE Int'l Conf. Virtual Reality, IEEE Press, 2001, pp. 115-122.
14. A. Lécuyer et al., "Pseudo-haptic Feedback: Can Isometric Input Devices Simulate Force Feedback?" Proc. IEEE Int'l Conf. Virtual Reality, IEEE Press, 2000, pp. 83-90.
15. A. Lécuyer, J.M. Burkhardt, and L. Etienne, "Feeling Bumps and Holes without a Haptic Interface: The Perception of Pseudo-haptic Textures," Proc. 2004 ACM Conf. Human Factors in Computing Systems, ACM Press, 2004, pp. 239-246.
16. K. van Mensvoort, "What You See Is What You Feel: Exploiting the Dominance of the Visual over the Haptic Domain to Simulate Force-Feedback with Cursor Displacements," Proc. Designing Interactive Systems 2002, ACM Press, 2002, pp. 345-348.
17. A. Pusch, O. Martin, and S. Coquillart, "HEMP-Hand Displacement-Based Pseudo-haptics: A Study of a Force Field Application," Proc. 2008 IEEE Symp. 3D User Interfaces, IEEE Press, 2008, pp. 59-66.
18. J. Martín et al., "Haptic Wrists: An Alternative Design Strategy Based on User Perception," submitted to J. Computing and Information Science in Eng; available from jmamezagaγeit.es.
19. A. Paljic, J.M. Burkhardt, and S. Coquillart, "Evaluation of Pseudo-Haptic Feedback for Simulating Torque: A Comparison between Isometric and Elastic Input Devices," Proc. 12th Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, IEEE CS Press, 2004, pp. 216-223.
20. L. Dominjon et al., "Influence of Control/Display Ratio on the Perception of Mass of Manipulated Objects in Virtual Environments," Proc. 2005 IEEE Int'l Conf. Virtual Reality, IEEE Press, 2005, pp. 19-25.
21. M. Sugimoto and I. Fujishiro, "Enhancement of Virtual Interaction Devices Using Pseudo Force Sensation," Siggraph 2000 Sketches & Applications, ACM Press, 2000, p. 200.
22. R.L. Mandryk, M.E. Rodgers, and K.M. Inkpen, "Sticky Widgets: Pseudo-haptic Widget Enhancements for Multi-monitor Displays," Proc. 2005 ACM Conf. Human Factors in Computing Systems, ACM Press, 2005, pp. 1621-1624.
23. F. Crison et al., "Virtual Technical Trainer: Learning How to Use Milling Machines with Multi-sensory Feedback in Virtual Reality," Proc. IEEE Int'l Conf. Virtual Reality, IEEE Press, 2005, pp. 139-146.
24. D. Wigdor et al., "Perception of Elementary Graphical Elements in Tabletop and Multi-surface Environments," Proc. 2007 ACM Conf. Human Factors in Computing Systems, ACM Press, 2007, pp. 473-482.
25. M.A. Nacenta et al., "Perspective Cursor: Perspective-Based Interaction for Multi-display Environments," Proc. 2006 ACM Conf. Human Factors in Computing Systems, ACM Press, 2006, pp. 289-298.
26. P. Baudisch and R. Rosenholtz, "Halo: A Technique for Visualizing Off-Screen Locations," Proc. 2003 ACM Conf. Human Factors in Computing Systems, ACM Press, 2003, pp. 481-488.
27. M. Nacenta et al., "E-conic: A Perspective-Aware Interface for Multi-display Environments," Proc. ACM Symp. User Interface Software and Technology (UIST 07), ACM Press, 2007, pp. 279-288.
28. N. Govindaraju et al., "Cullide: Interactive Collision Detection between Complex Models in Large Environments Using Graphics Hardware," Proc. Siggraph Workshop Graphics Hardware, ACM Press, 2003, pp. 25-32.
29. Y. Kitamura and F. Kishino, "Consolidated Manipulation of Virtual and Real Objects," Proc. 1997 ACM Symp. Virtual Reality Software and Technology, ACM Press, 1997, pp. 133-138.
30. C. Ware and K. Lowther, "Selection Using a One-Eyed Cursor in a Fish Tank VR Environment," ACM Trans. Computer-Human Interaction, vol. 4, no. 4, 1997, pp. 309-322.
31. I. Poupyrev et al., "Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques," Proc. 1998 ACM Siggraph/Eurographics Workshop Graphics Hardware, ACM Press, 1998, pp. 41-52.
32. C. Wickens and J. Hollands, Engineering Psychology and Human Performance, 3rd ed., Prentice-Hall, 1999.
33. Z. Wartell, L.F. Hodges, and W. Ribarsky, "A Geometric Comparison of Algorithms for Fusion Control in Stereoscopic HTDs," IEEE Trans. Visualization & Computer Graphics, vol. 8, no. 2, 2002, pp. 129-143.
34. J.-Y. Oh and W. Stuerzlinger, "Moving Objects with 2D Input Devices in CAD Systems and Desktop Virtual Environments," Proc. Graphics Interface 2005, ACM Press, 2005, pp. 195-202.
35. G. Smith, T. Salzman, and W. Stuerzlinger, "3D Scene Manipulation with 2D Devices and Constraints," Proc. Graphics Interface 2001, ACM Press, 2001, pp. 135-142.
36. Z. Szalavári and M. Gervautz, "The Personal Interaction Panel-a Two-Handed Interface for Augmented Reality," Computer Graphics Forum vol. 16, no. 3, 1997, pp. 335-346.
37. R. Teather and W. Stuerzlinger, "Assessing the Effects of Orientation and Device on (Constrained) 3D Movement Techniques," Proc. 2008 IEEE Symp. 3D User Interfaces, IEEE Press, 2008, pp. 43-50.
38. A. Simon and S. Scholz, "Multi-viewpoint Images for Multi-user Interaction," Proc. 2005 IEEE Virtual Reality Conf., IEEE Press, 2005, pp. 107-113.
39. M. Agrawala et al., "The Two-User Responsive Workbench: Support for Collaboration through Individual Views of a Shared Space," Proc. Siggraph, ACM Press, 1997, pp. 327-332.
40. K. Riege et al., "The Bent Pick Ray: An Extended Pointing Technique for Multi-user Interaction," Proc. 2006 IEEE Symp. 3D User Interfaces IEEE Press, 2006, pp. 63-66.
41. O. Bimber et al., "The Virtual Showcase," IEEE Computer Graphics and Applications, vol. 21, no. 6, 2001, pp. 48-55.
42. Y. Kitamura et al., "Interactive Stereoscopic Display for Three or More Users," Proc. Siggraph, ACM Press, 2001, pp. 231-239.
43. K. Kiyokawa, H. Takemura, and N. Yokoya, "SeamlessDesign for 3D Object Creation," IEEE MultiMedia, vol. 7, no. 1, 2000, pp. 22-33.
44. R. Ruddle, J. Savage, and D. Jones, "Symmetric and Asymmetric Action Integration during Cooperative Object Manipulation in Virtual Environments," ACM Trans. Computer-Human Interaction, vol. 9, no. 4, 2002, pp. 285-308.
45. K. Kiyokawa et al., "An Occlusion-Capable Optical See-Through Head Mount Display for Supporting Colocated Collaboration," Proc. 2003 IEEE Int'l Symp. Mixed and Augmented Reality, IEEE Press, 2003, pp. 133-141.
46. T. Duval, A. Lécuyer, and S. Thomas, "SkeweR: A 3D Interaction Technique for 2-User Collaborative Manipulation of Objects in Virtual Environments," Proc. 2006 IEEE Symp. 3D User Interfaces, IEEE Press, 2006, pp. 71-74.
47. M. Pinho, D. Bowman, and C. Freitas, "Cooperative Object Manipulation in Immersive Virtual Environments: Framework and Techniques," Proc. 2002 ACM Symp. Virtual Reality Software and Technology, ACM Press, 2002, pp. 171-178.
48. I. Heldal et al., "Immersiveness and Symmetry in Copresent Scenarios," Proc. 2005 IEEE Virtual Reality Conf., IEEE Press, 2005, pp. 171-178.
49. K. Kiyokawa, "A Wide Field-of-View Head Mounted Projective Display Using Hyperbolic Half-Silvered Mirrors," Proc. 2007 IEEE Int'l Symp. Mixed and Augmented Reality, IEEE Press, 2007, pp. 207-210.
50. H. Ishii, M. Kobayashi, and K. Arita, "Iterative Design of Seamless Collaboration Media," Comm. ACM, vol. 37, no. 8, 1994, pp. 83-97.
51. K. Kiyokawa, H. Takemura, and N. Yokoya, "Collaborative Immersive Workspace through a Shared Augmented Environment," Proc. SPIE, vol. 3517, 1998, pp. 2-13.
52. K. Kiyokawa et al., "Communication Behaviors of Colocated Users in Collaborative AR Interfaces," Proc. 2002 IEEE Int'l Symp. Mixed and Augmented Reality, IEEE Press, 2002, pp. 139-148.
53. H. Takemura and F. Kishino, "Cooperative Work Environment Using Virtual Workspace," Proc. 1992 ACM Conf. Computer-Supported Cooperative Work ACM Press, 1992, pp. 226-232.
54. J. Leigh and A.E. Johnson, "Calvin: An Immersive Design Environment Utilizing Heterogeneous Perspectives," Proc. 3rd IEEE Int'l Conf. Multimedia Computing and Systems, IEEE Press, 1996, pp. 20-23.
55. M. Billinghurst, H. Kato, and I. Poupyrev, "The MagicBook-Moving Seamlessly between Reality and Virtuality," IEEE Computer Graphics and Applications, vol. 21, no. 3, 2001, pp. 6-8.
56. R. Grasset, P. Lamb, and M. Billinghurst, "Evaluation of Mixed-Space Collaboration," Proc. 2005 IEEE Int'l Symp. Mixed and Augmented Reality, IEEE Press, 2005, pp. 90-99.
57. S. Yamamoto et al., "Symmetric Model of Remote Collaborative MR Using Tangible Replicas," Proc. 2008 IEEE Virtual Reality Conf., IEEE Press, 2008, pp. 71-74.
58. D. Bowman et al., 3D User Interfaces: Theory and Practice, Addison-Wesley, 2005.
59. F. Brooks, "What's Real about Virtual Reality?" IEEE Computer Graphics and Applications, vol. 19, no. 6, 1999, pp. 16-27.
60. R. McMahan et al., "Separating the Effects of Level of Immersion and 3D Interaction Techniques," Proc. ACM Symp. Virtual Reality Software and Technology, ACM Press, 2006, pp. 108-111.
61. T. Ni, R. McMahan, and D. Bowman, "rapMenu: Remote Menu Selection Using Freehand Gestural Input," Proc. IEEE Symp. 3D User Interfaces, IEEE Press, 2008, pp. 55-58.