A survey of 3D object selection techniques for virtual environments

Computers and Graphics (Pergamon)

Volumn 37, Issue 3, 2013, Pages 121-136

  Argelaguet, Ferran ^a   Andujar, Carlos ^b  

^a INRIA   (France)

^b UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

3D interaction; 3D selection; Virtual pointing; Virtual reality

Indexed keywords

DEPTH PERCEPTION; GESTURE RECOGNITION; RENDERING (COMPUTER GRAPHICS); SURVEYS; USER INTERFACES; VIRTUAL REALITY; VISUAL COMMUNICATION;

3D INTERACTIONS; 3D OBJECT SELECTIONS; 3D SELECTION; COMPUTER GRAPHICS APPLICATIONS; GESTURE RECOGNITION TECHNOLOGIES; INTERACTION TECHNIQUES; POINTING GESTURES; RENDERING PIPELINES;

HUMAN COMPUTER INTERACTION;

EID: 84875479185     PISSN: 00978493     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cag.2012.12.003     Document Type: Article

References (108)

1. C. Andujar, and F. Argelaguet Anisomorphic ray-casting manipulation for interacting with 2D GUIs Comput Graph 31 1 2007 15 25 (Pubitemid 46241411)
2. Andujar C, Argelaguet F. Virtual pads: decoupling motor space and visual space for flexible manipulation of 2D windows within VEs. In: IEEE symposium on 3D user interfaces, 3DUI'07; 2007.
3. C. Andujar, F. Argelaguet, and R. Trueba Hand-based disocclusion for the world-in-miniature metaphor Presence Teleop Virt Environ 19 6 2010 499 512
4. Argelaguet F. Pointing facilitation techniques for 3D object selection on virtual environments. PhD thesis, Universitat Politècnica de Catalunya; 2011.
5. Argelaguet F., Andujar C. Improving 3D selection in immersive environments through expanding targets. In: SG'08: proceedings of the 9th international symposium on smart graphics; 2008. p. 45-57.
6. F. Argelaguet, and C. Andujar Efficient 3D pointing selection in cluttered virtual environments IEEE Comput Graph Appl 29 6 2009 34 43
7. Argelaguet F, Andujar C. Visual feedback techniques for virtual pointing on stereoscopic displays. In: Proceedings of the 16th ACM symposium on virtual reality software and technology, VRST '09. ACM; 2009. p. 163-70.
8. Argelaguet F, Andujar C, Trueba R. Overcoming eye-hand visibility mismatch in 3D pointing selection. InL VRST '08: proceedings of the 2008 ACM symposium on virtual reality software and technology; 2008. p. 43-6.
9. Argelaguet F, Kunert A, Kulik A, Froehlich B. Improving co-located collaboration with show-through techniques. In: IEEE Symposium on 3D user interfaces; 2010. p. 55-92.
10. R. Balakrishnan Beating Fitts' law virtual enhancements for pointing facilitation Int J Hum-Comput Stud 61 6 2004 857 874
11. Bederson BB. Fisheye menus. In: UIST '00: proceedings of the 13th annual ACM symposium on user interface software and technology; 2000. p. 217-25.
12. Boeck JD, Weyer TD, Raymaekers C, Coninx K. Using the non-dominant hand for selection in 3D. In: IEEE symposium on 3D user interfaces (3DUI '06); 2006. p. 53-8. (Pubitemid 44710902)
13. Bolt RA. Put-that-there: voice and gesture at the graphics interface. In: SIGGRAPH '80: proceedings of the seventh annual conference on computer graphics and interactive techniques. ACM, 1980. p. 262-70.
14. Bowman DA, Badillo B, Manek D. Evaluating the need for display-specific and device-specific 3D interaction techniques. In: ICVR'07: proceedings of the 2nd international conference on virtual reality, Springer-Verlag, 2007. p. 195-204.
15. D.A. Bowman, J.L. Gabbard, and D. Hix A survey of usability evaluation in virtual environments classification and comparison of methods Presence Teleop Virt Environ 11 4 2002 404 424
16. Bowman DA, Hodges LF. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. In: I3D '97: proceedings of the 1997 symposium on interactive 3D graphics; 1997. p. 35-ff.
17. D.A. Bowman, L.F. Hodges, and J. Bolter The virtual venue user-computer interaction in information-rich virtual environments Presence Teleop Virt. Environ. 7 5 1998 478 493
18. Bowman DA, Johnson DB, Hodges LF. Testbed evaluation of virtual environment interaction techniques. In: VRST '99: proceedings of the ACM symposium on virtual reality software and technology. ACM, 1999. p. 26-33.
19. D.A. Bowman, E. Kruijff, J.J. LaViola, and I. Poupyrev 3D user interfaces theory and practice 2004 Addison Wesley
20. Bowman DA, Wingrave CA, Campbell J. Using pinch gloves for both natural and abstract interaction techniques in virtual environments. In: HCI international; 2001. p. 629-33.
21. S. Brewster Multimodal feedback for the acquisition of small targets Ergonomics 48 22 2005 1129 1150 (Pubitemid 41601270)
22. M. Burns, and A. Finkelstein Adaptive cutaways for comprehensible rendering of polygonal scenes ACM Trans Graph 27 5 2008 1 7
23. S.K. Card, J.D. Mackinlay, and G.G. Robertson A morphological analysis of the design space of input devices ACM Trans Inf Syst 9 2 1991 99 122
24. J. Cashion, C.A. Wingrave, and J.J. LaViola Dense and dynamic 3D selection for game-based virtual environments IEEE Trans Visualization Comput Graph 18 4 2012 634 642
25. Casiez G, Vogel D, Balakrishnan R, Cockburn A. The impact of control-display gain on user performance in pointing tasks. In: Human-computer interaction, vol. 23; 2009. p. 215-50.
26. Cockburn A, Brock P. Human on-line response to visual and motor target expansion. In: GI '06: proceedings of graphics interface; 2006. p. 81-7. (Pubitemid 44386132)
27. Cournia N, Smith JD, Duchowski AT. Gaze vs hand-based pointing in virtual environments. In: CHI '03: CHI '03 extended abstracts on Human factors in computing systems; 2003. p. 772-3.
28. Dachselt R, Hübner A. A survey and taxonomy of 3D menu techniques. In: EGVE 06: proceedings of the 12th eurographics symposium on virtual environments; 2006. p. 89-99.
29. Dang N-T. A survey and classification of 3D pointing techniques. In: 2007 IEEE international conference on research, innovation and vision for the future. IEEE, March 2007. p. 71-80. (Pubitemid 46950587)
30. de Haan G, Koutek M, Post FH. IntenSelect: using dynamic object rating for assisting 3D object selection; 2005. p. 201-9.
31. Elmqvist N. BalloonProbe: reducing occlusion in 3D using interactive space distortion. In: VRST '05: proceedings of the ACM symposium on virtual reality software and technology; 2005. p. 134-7.
32. N. Elmqvist, and P. Tsigas View-projection animation for 3D occlusion management Comput Graph 31 6 2007 864 876 (Pubitemid 350138121)
33. N. Elmqvist, and P. Tsigas A taxonomy of 3D occlusion management for visualization IEEE Trans. Visualization Comput Graph 14 5 2008 1095 1109
34. P. Fitts The information capacity of the human motor system is controlled by the amplitude of movement J. Exp. Psychol. 6 47 1954 381 391
35. P. Fitts, and J. Peterson Information capacity of discrete motor response J. Exp. Psychol. 2 67 1964 103 112
36. Forsberg A, Herndon K, Zeleznik R. Aperture based selection for immersive virtual environments. In: UIST '96: proceedings of the 9th annual ACM symposium on user interface software and technology; 1996. p. 95-6.
37. S. Frees, and D. Kessler Precise and rapid interaction thought scaled manipulation in immersive virtual environments IEEE Virtual Reality 2005 99 106 (Pubitemid 41731715)
38. S. Frees, G.D. Kessler, and E. Kay PRISM interaction for enhancing control in immersive virtual environments ACM Trans Comput-Hum Interact 14 1 2007
39. Gabbard JL. A taxonomy of usability characteristics for virtual environments. Master's thesis, Department of Computer Science, Virginia Tech; 1997.
40. Grossman T, Balakrishnan R. Pointing at trivariate targets in 3D environments. In: CHI '04: proceedings of the SIGCHI conference on human factors in computing systems. ACM, 2004. p. 447-54.
41. Grossman T, Balakrishnan R. The design and evaluation of selection techniques for 3D volumetric displays. In: UIST '06: proceedings of the 19th annual ACM symposium on user interface software and technology. ACM, 2006. p. 3-12. (Pubitemid 47142419)
42. Grossman T, Wigdor D. Going deeper: a taxonomy of 3D on the tabletop. In: IEEE TABLETOP '07, 2007. p. 137-44.
43. K.P. Herndon, A. van Dam, and M. Gleicher The challenges of 3D interaction a CHI'94 workshop SIGCHI Bull 26 4 1994 36 43
44. Hinckley K, Pausch R, Goble JC, Kassell NF. A survey of design issues in spatial input. In: UIST '94: Proceedings of the 7th ACM symposium on user interface software and technology; 1994. p. 213-22.
45. Hinckley K, Pausch R, Goble JC, Kassell NF. Passive real-world interface props for neurosurgical visualization. In: CHI '94: proceedings of the SIGCHI conference on human factors in computing systems. ACM; 1994. p. 452-8.
46. Jacob RJK, Girouard A, Hirshfield LM, Horn MS, Shaer O, Solovey ET, Zigelbaum J. Reality-based interaction: a framework for post-WIMP interfaces. In: Proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems, CHI '08. ACM, 2008. p. 201-10.
47. R.J. Jagacinski, and D.L. Monk Fitts' law in two dimensions with hand and head movements J Mot Behav 17 1 1985 77 95 (Pubitemid 15074890)
48. König W, Gerken J, Dierdorf S, Reiterer H. Adaptive pointing - design and evaluation of a precision enhancing technique for absolute pointing devices. In: Human-computer interaction, INTERACT 2009, vol. 5726, 2009. p. 658-71.
49. Kopper R, Bacim F, Bowman DA. Rapid and accurate 3D selection by progressive refinement. In: IEEE symposium on 3D user interfaces (3DUI'11); 2011. p. 67-74.
50. R. Kopper, D.A. Bowman, M.G. Silva, and R.P. McMahan A human motor behavior model for distal pointing tasks Int J Hum-Comput Stud 68 October (10) 2010 603 615
51. A. Kulik Building on realism and magic for designing 3D interaction techniques IEEE Comput Graph Appl 29 6 2009 22 33
52. J.J. LaViola Jr. A discussion of cybersickness in virtual environments SIGCHI Bull 32 1 2000 47 56
53. Lee S, Seo J, Kim GJ, Park C-M, Evaluation of pointing techniques for ray casting selection in virtual environments. In: Third international conference on virtual reality and its application in industry, vol. 4756(1); 2003. p. 38-44.
54. J. Liang, and M. Green JDcad a highly interactive 3D modeling system Comput Graph 18 4 1994 499 506
55. Lindeman RW, Sibert JL, Hahn JK. Hand-held windows: towards effective 2D interaction in immersive virtual environments. In: IEEE virtual reality; 1999. p. 205-12.
56. Linderman R, Sibert J, Hahn J. Towards usable VR: an empirical study of user interfaces for immersive virtual environments, In: Proceedings of the SIHCHI conference on human factors in computing systems; 1999. p. 64-71.
57. C.L. MacKenzie, R.G. Marteniuk, C. Dugas, D. Liske, and B. Eickmeier Three-dimensional movement trajectories in Fitts' task implications for control Q J Exp Psychol A Hum Exp Psychol 39 4 1987 629 647
58. I.S. MacKenzie Fitts' law as a research and design tool in human-computer interaction Hum Comput Interact 7 1 1992 91 139
59. MacKenzie IS, Kauppinen T, Silfverberg M. Accuracy measures for evaluating computer pointing devices. In: CHI '01: proceedings of the SIGCHI conference on human factors in computing systems, CHI '01. ACM; 2001. p. 9-16. (Pubitemid 32393333)
60. MacKenzie IS, Ware C. Lag as a determinant of human performance in interactive systems. In: CHI '93: proceedings of the INTERACT '93 and CHI '93 conference on human factors in computing systems. ACM; 1993. p. 488-93.
61. Martinet A, Casiez G, Grisoni G. The design and evaluation of 3D positioning techniques for multi-touch displays. In: IEEE symposium on 3D user interfaces, 3DUI'10; 2010. p. 87-94.
62. D.E. Meyer, R.A. Abrams, S. Kornblum, C.E. Wright, and J.E.K. Smith Optimality in human motor performance ideal control of rapid aimed movements Psychol Rev 95 3 1988 340 370
63. Mine MR. Virtual environments interaction techniques. Technical Report TR94-018, Department of Computer Science, University of North Carolina at Chapel Hill; 1995.
64. Mine MR, Brooks FP Jr., Sequin C. Moving objects in space: exploiting proprioception in virtual-environment interaction. In: SIGGRAPH '97: proceedings of the 24th annual conference on computer graphics and interactive techniques; 1997. p. 19-26.
65. Müller-Tomfelde C, Baranauskas C, Palanque P, Abascal J, Barbosa S. Dwell-based pointing in applications of human computer interaction. In: Baranauskas C, Palanque P, Abascal J, Barbosa SDJ, editors, Human-computer interaction - INTERACT 2007, vol. 4662, Berlin, Heidelberg; 2007. p. 560-73.
66. A. Murata Extending effective target width in Fitt's law to two-dimensional pointing task Int J Hum-Comput Interact 11 1999 137 152
67. J. Octavia, C. Raymaekers, and K. Coninx Adaptation in virtual environments conceptual framework and user models Multimedia Tools Appl 2010 1 22
68. Olwal A, Benko H, Feiner S. SenseShapes: using statistical geometry for object selection in a multimodal augmented reality system. In: ISMAR '03: proceedings of the 2nd IEEE/ACM international symposium on mixed and augmented reality; 2003. p. 300.
69. Olwal A, Feiner S. The flexible pointer: an interaction technique for selection in augmented and virtual reality. In: Conference supplement of UIST '03 (ACM symposium on user interface software and technology); 2003. p. 81-2.
70. Pavlovych A, Stuerzlinger W. The tradeoff between spatial jitter and latency in pointing tasks. In: EICS '09: proceedings of the 1st ACM SIGCHI symposium on engineering interactive computing systems, ACM; 2009. p. 187-196.
71. Peter H, Roland W, Bues BM. ISith - intersection-based spatial interaction for two hands. In: IEEE symposium on 3D user interfaces, 3DUI'06; 2006. p. 59-61.
72. Pfeiffer T. Towards a linguistically motivated model for selection in virtual reality. In: IEEE virtual reality 2012 (VR'12). IEEE; March 2012. p. 89-90.
73. Pierce JS, Forsberg A, Conway MJ, Hong S, Zeleznik R, Mine MR. Image plane interaction techniques in 3D immersive environments. In: I3D '97: proceedings of the 1997 symposium on interactive 3D graphics; 1997. p. 39-ff.
74. Plumert JM, Kearney JK, Cremer JF. Distance perception in real and virtual environments. In: Proceedings of the 1st symposium on applied perception in graphics and visualization - APGV '04, New York. New York, USA: ACM Press; August 2004. p. 27.
75. Poupyrev I, Billinghutst M, Weghorst S, Ichikawa T. The Go-Go interaction technique: non-linear mapping for direct manipulation in VR. In: UIST '96: proceedings of the 9th annual ACM symposium on user interface software and technology; 1996. p. 79-80.
76. I. Poupyrev, and T. Ichikawa Manipulating objects in virtual worlds categorization and empirical evaluation of interaction J Visual Lang Comput 10 1 1999 19 35
77. Poupyrev I, Weghorst S, Billinghurst M, Ichikawa T. A framework and testbed for studying manipulation techniques for immersive VR. In: VRST '97: proceedings of the ACM symposium on virtual reality software and technology, ACM; 1997. p. 21-8.
78. I. Poupyrev, S. Weghorst, M. Billinghutst, and T. Ichikawa Egocentric object manipulation in virtual environments empirical evaluation of interaction techniques Comput Graph Forum 3 17 1998 41 52
79. Sarkar M, Brown MH. Graphical fisheye views of graphs. In: CHI '92: proceedings of the SIGCHI conference on Human factors in computing systems; 1992. p. 83-91.
80. Schmidt G, Baillot Y, Brown DG, Tomlin EB, Swan JEII. Toward disambiguating multiple selections for frustum-based pointing. In: IEEE symposium on 3D user interfaces (3DUI'06); 2006. p. 87-94. (Pubitemid 44710909)
81. R.A. Schmidt, H. Zelaznik, B. Hawkins, J.S. Frank, and J.T. Quinn Jr. Motor-output variability a theory for the accuracy of rapid motor acts Psychol Rev 86 5 1979 415 451
82. Smith BA, Ho J, Ark W, Zhai S. Hand eye coordination patterns in target selection. In: Proceedings of the 2000 symposium on eye tracking research & applications, ETRA '00, ACM; 2000. p. 117-22.
83. Steed A. Selection/towards a general model for selection in virtual environments. In: IEEE symposium on 3D user interfaces (3DUI'06); 2006. p. 103-10. (Pubitemid 44710911)
84. Steed A, Parker C. 3D selection strategies for head tracked and non-head tracked operation of spatially immersive displays. In: Eighth international immersive projection technology workshop; 2004. p. 163-70.
85. Steinicke F, Ropinski T, Hinrichs K. Object selection in virtual environments with an improved virtual pointer metaphor. In: Computer vision and graphics, international conference, ICCVG; 2004. p. 320-6.
86. Stoakley R, Conway MJ, Pausch R. Virtual reality on a WIM: interactive worlds in miniature. In: CHI '95: proceedings of the SIGCHI conference on human factors in computing systems; 1995. p. 265-72.
87. Tanriverdi V, Jacob RJK. Interacting with eye movements in virtual environments. In: CHI '00: proceedings of the SIGCHI conference on human factors in computing systems, ACM; 2000. p. 265-72.
88. Teather RJ, Pavlovych A, Stuerzlinger W, MacKenzie IS. Effects of tracking technology, latency, and spatial jitter on object movement. In: IEEE symposium on 3D user interfaces; 2009. p. 43-50.
89. Teather RJ, Stuerzlinger W. Pointing at 3D targets in a stereo head-tracked virtual environment. In: IEEE symposium on 3D user interfaces (3DUI'11); 2011. p. 87-94.
90. Tyndiuk F, Thomas G, Lespinet-Najib V, Schlick C. Cognitive Comparison of 3D interaction in front of large vs. small displays. In: VRST '05: proceedings of the ACM symposium on virtual reality software and technology; 2005. p. 117-23.
91. Valkov D, Steinicke F, Bruder G, Hinrichs K. 2D touching of 3D stereoscopic objects. In: Proceedings of the 2011 annual conference on human factors in computing systems, CHI '11. ACM; 2011. p. 1353-62.
92. G.P. van Galen, and W.P. de Jong Fitts' law as the outcome of a dynamic noise filtering model of motor control Hum Movement Sci 14 4-5 1995 539 571
93. Vanacken L, Grossman T, Coninx K. Exploring the effects of environment density and target visibility on object selection in 3D virtual environments. In: IEEE symposium on 3D user interfaces, 3DUI '07; 2007. p. 115-22.
94. Vanacken L, Raymaekers C, Coninx K. Evaluating the influence of multimodal feedback on egocentric selection metaphors in virtual environments. Haptic and audio interaction design; 2006. p. 12-23. (Pubitemid 44532712)
95. Vogel, D., Balakrishnan R. Distant freehand pointing and clicking on very large, high resolution displays. In: UIST '05: proceedings of the 18th annual ACM symposium on user interface software and technology. ACM Press; 2005. p. 33-42. (Pubitemid 44531219)
96. Wang Y, MacKenzie C. Effects of orientation disparity between haptic and graphic displays of objects in virtual environments. In: INTERACT '99; 1999. p. 391-8.
97. C. Ware, and R. Balakrishnan Reaching for objects in VR displays lag and frame rate ACM Trans Hum Comput Interact 1 4 1994 331 356
98. C. Ware, and K. Lowther Selection using a one-eyed cursor in a fish tank VR environment ACM Trans Hum Comput Interact 4 4 1997 309 322
99. Watson B, Spaulding V, Walker N, Ribarsky W. Evaluation of the effects of frame time variation on VR task performance. In: Virtual reality annual international symposium. IEEE; 1997. p. 38-44.
100. A. Wiebel, F.M. Vos, D. Foerster, and H.-C. Hege WYSIWYP what you see is what you pick IEEE Trans Visualization Comput Graph 18 December (12) 2012 2236 2244
101. Wingrave, CA, Bowman DA. Baseline factors for raycasting selection. In: Proceedings of virtual reality international; 2005.
102. Wingrave CA, Bowman DA, Ramakrishnan N. Towards preferences in virtual environment interfaces. In: EGVE '02: proceedings of the workshop on virtual environments; 2002. p. 63-72.
103. Wingrave CA, Haciahmetoglu Y, Bowman DA. Overcoming world in miniature limitations by scaling and scrolling. In: IEEE symposium on 3D user interfaces (3DUI'06); 2006. p. 11-6. (Pubitemid 44710896)
104. C.A. Wingrave, and J.J. LaViola Reflecting on the design and implementation issues of virtual environments Presence Teleop Virt Environ 19 2 2010 179 195
105. C.A. Wingrave, J.J. Laviola Jr., and D.A. Bowman A natural, tiered and executable UIDL for 3D user interfaces based on concept-oriented design ACM Trans Comput-Hum Interact 16 4 2009 1 36
106. Wingrave CA, Tintner R, Walker BN, Bowman DA, Hodges LF. Exploring individual differences in raybased selection: strategies and traits. In: IEEE virtual reality; 2005. p. 163-70. (Pubitemid 41731723)
107. Zhai S, Buxton W, Milgram P. The Silk Cursor: investigating transparency for 3D target acquisition. In: CHI '94: proceedings of the SIGCHI conference on human factors in computing systems; 1994. p. 459-64.
108. Zhai S, Milgram P, Buxton W. The influence of muscle groups on performance of multiple degree-of-freedom input. In: Proceedings of the SIGCHI conference on human factors in computing systems: common ground, CHI '96, ACM; 1996. p. 308-15.