3D selection with freehand gesture

Computers and Graphics (Pergamon)

Volumn 37, Issue 3, 2013, Pages 101-120

  Ren, Gang ^a   O'Neill, Eamonn ^a  

^a University of Bath   (United Kingdom)

Author keywords

3D selection; Freehand gesture; Marking menu

Indexed keywords

HAND HELD COMPUTERS; USER INTERFACES;

3D COMPUTER GRAPHICS; 3D SELECTION; DIRECTIONAL EFFECTS; EVALUATION RESULTS; FREEHAND GESTURE; GESTURAL INTERACTION; MARKING MENU; TOUCH BASED INTERACTIONS;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84875146398     PISSN: 00978493     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cag.2012.12.006     Document Type: Article

References (60)

1. Accot J, Zhai S. More than dotting the i's - foundations for crossing-based interfaces. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI '02). New York, NY, USA: ACM; 2002. p. 73-80.
2. Benko H. Beyond flat surface computing: challenges of depth-aware and curved interfaces. In: Proceedings of the 17th ACM international conference on multimedia (MM '09). New York, NY, USA: ACM; 2009. p. 935-44.
3. Benko H, Jota R, Wilson A. Miragetable: freehand interaction on a projected augmented reality tabletop. In: Proceedings of the 2012 ACM annual conference on human factors in computing systems (CHI '12). New York, NY, USA: ACM; 2012. p. 199-208.
4. Benko H, Wilson A. DepthTouch: using depth-sensing camera to enable freehand interactions on and above the interactive surface. Technical report. Microsoft research technical report MSR-TR-2009-23; 2009.
5. Benko H, Wilson AD. Multi-point interactions with immersive omnidirectional visualizations in a dome. In: ACM international conference on interactive tabletops and surfaces (ITS '10). New York, NY, USA: ACM; 2010. p. 19-28.
6. Benko H, Wilson AD, Baudisch P. Precise selection techniques for multi-touch screens. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI '06). New York, NY, USA: ACM; 2006. p. 1263-72. (Pubitemid 44032225)
7. J. Blake Natural user interfaces in.net 2011 Manning Publications Co
8. T. Bockemuhl, N.F. Troje, and V. Durr Inter-joint coupling and joint angle synergies of human catching movements Hum Movement Sci 29 1 2010 73 93
9. Bowman D, Wingrave C. Design and evaluation of menu systems for immersive virtual environments. In: IEEE virtual reality; 2001. p. 149-56. (Pubitemid 32334743)
10. Bragdon A, Ko HS. Gesture select: acquiring remote targets on large displays without pointing. In: Proceedings of the 2011 annual conference on human factors in computing systems (CHI '11). New York, NY, USA: ACM; 2011. p. 187-96.
11. Callahan J, Hopkins D, Weiser M, Shneiderman B. An empirical comparison of pie vs. linear menus. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI '88). New York, NY, USA: ACM; 1988. p. 95-100.
12. S.K. Card, J.D. Mackinlay, and G.G. Robertson A morphological analysis of the design space of input devices ACM Trans Inf Syst 9 2 1991 99 122
13. Chertoff DB, Byers RW, LaViola Jr. JJ. An exploration of menu techniques using a 3D game input device. In: Proceedings of the 4th international conference on foundations of digital games (FDG '09). New York, NY, USA: ACM; 2009. p. 256-62.
14. Clark A, Dünser A, Billinghurst M, Piumsomboon T, Altimira D. Seamless interaction in space. In: Proceedings of the 23rd Australian computer-human interaction conference (OzCHI '11). New York, NY, USA: ACM; 2011. p. 88-97.
15. R. Dachselt, and A. Hübner Three-dimensional menus a survey and taxonomy Comput Graph 31 1 2007 53 65
16. Das K, Borst C. An evaluation of menu properties and pointing techniques in a projection-based vr environment. In: 2010 IEEE symposium on 3D user interfaces; 2010. p. 47-50.
17. Findlater L, Jansen A, Shinohara K, Dixon M, Kamb P, Rakita J, et al. Enhanced area cursors: reducing fine pointing demands for people with motor impairments. In: Proceedings of the 23nd annual ACM symposium on user interface software and technology (UIST '10). New York, NY, USA: ACM; 2010. p. 153-62.
18. Fitzmaurice G, Matejka J, Khan A, Glueck M, Kurtenbach G. Piecursor: merging pointing and command selection for rapid in-place tool switching. In: Proceedings of the 26th annual SIGCHI conference on human factors in computing systems (CHI '08). New York, NY, USA: ACM; 2008. p. 1361-70.
19. Grosjean J, Burkhardt JM, Coquillart S, Richard P. Evaluation of the command and control cube. In: Proceedings of the 4th IEEE international conference on multimodal interfaces; 2002. p. 473-8.
20. Grossman T, Balakrishnan R. Pointing at trivariate targets in 3D environments. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI '04). New York, NY, USA: ACM; 2004. p. 447-54.
21. Grossman T, Balakrishnan R. The design and evaluation of selection techniques for 3D volumetric displays. In: Proceedings of the 19th annual ACM symposium on user interface software and technology (UIST '06). New York, NY, USA: ACM; 2006. p. 3-12. (Pubitemid 47142419)
22. Grossman T, Wigdor D, Balakrishnan R. Multi-finger gestural interaction with 3D volumetric displays. In: Proceedings of the 17th annual ACM symposium on user interface software and technology (UIST '04). New York, NY, USA: ACM; 2004. p. 61-70. (Pubitemid 40787665)
23. Guimbretière F, Nguyen C. Bimanual marking menu for near surface interactions. In: Proceedings of the 2012 ACM annual conference on human factors in computing systems (CHI '12). New York, NY, USA: ACM; 2012. p. 825-8.
24. Guimbretiére F, Winograd T. Flowmenu: combining command, text, and data entry. In: Proceedings of the 13th annual ACM symposium on user interface software and technology (UIST '00). New York, NY, USA: ACM; 2000. p. 213-6. (Pubitemid 32470928)
25. Harrison C, Benko H, Wilson AD. Omnitouch: wearable multitouch interaction everywhere. In: Proceedings of the 24th annual ACM symposium on user interface software and technology (UIST '11). New York, NY, USA: ACM; 2011. p. 441-50.
26. Hinrichs U, Carpendale S. Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI '11). New York, NY, USA: ACM; 2011. p. 3023-32.
27. H. Jo, S. Hwang, H. Park, and J. hee Ryu Aroundplot focus+context interface for off-screen objects in 3D environments Comput Graph 35 4 2011 841 853
28. Jones E, Alexander J, Andreou A, Irani P, Subramanian S. Gestext: accelerometer-based gestural text-entry systems. In: Proceedings of the 28th international conference on human factors in computing systems (CHI '10). New York, NY, USA: ACM; 2010. p. 2173-82.
29. Kolsch M, Beall AC, Turk M. The postural comfort zone for reaching gestures. In: Proceedings of the human factors and ergonomics society annual meeting, vol. 47; 2003. p. 725-8.
30. Kopper R, Bacim F, Bowman D. Rapid and accurate 3D selection by progressive refinement. In: 2011 IEEE symposium on 3D user interfaces; 2011. p. 67-74.
31. Kurtenbach G, Buxton W. The limits of expert performance using hierarchic marking menus. In: Proceedings of the INTERACT '93 and CHI '93 conference on human factors in computing systems (CHI '93). New York, NY, USA: ACM; 1993. p. 482-7.
32. Kurtenbach G, Buxton W. User learning and performance with marking menus. In: Proceedings of the SIGCHI conference on human factors in computing systems: celebrating interdependence (CHI '94). New York, NY, USA: ACM; 1994. p. 258-64.
33. G. Kurtenbach, A.J. Sellen, and W. Buxton An empirical evaluation of some articulatory and cognitive aspects of marking menus Hum Comput Interact 8 1 1993 1 23 (Pubitemid 23713725)
34. G.D. Langolf, D.B. Chaffin, and J.A. Foulke An investigation of Fitts' law using a wide range of movement amplitudes J Motor Behav 8 2 1976 113 128
35. Lepinski GJ, Grossman T, Fitzmaurice G. The design and evaluation of multitouch marking menus. In: Proceedings of the 28th international conference on human factors in computing systems (CHI '10). New York, NY, USA: ACM; 2010. p. 2233-42.
36. J. Liang, and M. Green JDCAD a highly interactive 3D modeling system Comput Graph 18 4 1994 499 506
37. McCrae J, Glueck M, Grossman T, Khan A, Singh K. Exploring the design space of multiscale 3D orientation. In: Proceedings of the international conference on advanced visual interfaces (AVI '10). New York, NY, USA: ACM; 2010. p. 81-8.
38. Ni T, Bowman D, North C. Airstroke: bringing unistroke text entry to freehand gesture interfaces. In: Proceedings of the 2011 annual conference on human factors in computing systems (CHI '11). New York, NY, USA: ACM; 2011. p. 2473-6.
39. T. Ni, D.A. Bowman, C. North, and R.P. McMahan Design and evaluation of freehand menu selection interfaces using tilt and pinch gestures Int J Hum Comput Stud 69 2011 551 562
40. D.A. Norman Natural user interfaces are not natural Interactions 17 3 2010 6 10
41. Primesense. The primesense 3D awareness sensor.
42. Rahman M, Gustafson S, Irani P, Subramanian S. Tilt techniques: investigating the dexterity of wrist-based input. In: Proceedings of the 27th international conference on human factors in computing systems (CHI '09). New York, NY, USA: ACM; 2009. p. 1943-52.
43. Ren G, O'Neill E. 3D marking menu selection with freehand gestures. In: 2012 IEEE symposium on 3D user interfaces; 2012. p. 61-8.
44. Schmidt G, Baillot Y, Brown D, Tomlin E, Swan J. Toward disambiguating multiple selections for frustum-based pointing. In: 2006 IEEE symposium on 3D user interfaces; 2006. p. 87-94. (Pubitemid 44710909)
45. Shoemaker G, Findlater L, Dawson JQ, Booth KS. Mid-air text input techniques for very large wall displays. In: Proceedings of graphics interface 2009 (GI '09). Toronto, ON, Canada: Canadian Information Processing Society; 2009. p. 231-8.
46. Song P, Goh WB, Hutama W, Fu CW, Liu X. A handle bar metaphor for virtual object manipulation with mid-air interaction. In: Proceedings of the 2012 ACM annual conference on human factors in computing systems (CHI '12). New York, NY, USA: ACM; 2012. p. 1297-306.
47. Teather R, Stuerzlinger W. Assessing the effects of orientation and device on (constrained) 3D movement techniques. In: 2008 IEEE symposium on 3D user interfaces; 2008. p. 43-50.
48. Tian F, Xu L, Wang H, Zhang X, Liu Y, Setlur V, et al. Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces. In: Proceedings of the 26th annual SIGCHI conference on human factors in computing systems (CHI '08). New York, NY, USA: ACM; 2008. p. 1371-80.
49. Vanacken L, Grossman T, Coninx K. Exploring the effects of environment density and target visibility on object selection in 3D virtual environments. In: 2007 IEEE symposium on 3D user interfaces; 2007.
50. Vogel D, Balakrishnan R. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In: Proceedings of the 17th annual ACM symposium on user interface software and technology (UIST '04). New York, NY, USA: ACM; 2004. p. 137-46. (Pubitemid 40787675)
51. Vogel D, Balakrishnan R. Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings of the 18th annual ACM symposium on user interface software and technology (UIST '05). New York, NY, USA: ACM; 2005. p. 33-42. (Pubitemid 44531219)
52. Wilson A. Using a depth camera as a touch sensor. In: Proceedings of ACM international conference on interactive tabletops and surfaces. ACM; 2010. p. 69-72.
53. Wilson AD. Robust computer vision-based detection of pinching for one and two-handed gesture input. In: Proceedings of the 19th annual ACM symposium on user interface software and technology (UIST '06). New York, NY, USA: ACM; 2006. p. 255-8. (Pubitemid 47142448)
54. J.O. Wobbrock, and K.Z. Gajos Goal crossing with mice and trackballs for people with motor impairments performance, submovements, and design directions ACM Trans Access Comput 1 1 2008 41 437
55. Wobbrock JO, Myers BA, Kembel JA. Edgewrite: a stylus-based text entry method designed for high accuracy and stability of motion. In: Proceedings of the 16th annual ACM symposium on user interface software and technology (UIST '03). New York, NY, USA: ACM; 2003. p. 61-70. (Pubitemid 40730674)
56. Wyss H, Blach R, Bues M. iSith - intersection-based spatial interaction for two hands. In: 2006 IEEE symposium on 3D user interfaces; 2006. p. 59-61. (Pubitemid 44710903)
57. F. Yang, L. Ding, C. Yang, and X. Yuan An algorithm for simulating human arm movement considering the comfort level Simul Model Pract Theory 13 5 2005 437 449 (Pubitemid 40743851)
58. Yatani K, Partridge K, Bern M, Newman MW. Escape: a target selection technique using visually-cued gestures. In: Proceedings of the 26th annual SIGCHI conference on human factors in computing systems (CHI '08). New York, NY, USA: ACM; 2008. p. 285-94.
59. Zhao S, Agrawala M, Hinckley K. Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI '06). New York, NY, USA: ACM; 2006. p. 1077-86. (Pubitemid 44032202)
60. Zhao S, Balakrishnan R. Simple vs. compound mark hierarchical marking menus. In: Proceedings of the 17th annual ACM symposium on user interface software and technology (UIST '04). New York, NY, USA: ACM; 2004. p. 33-42. (Pubitemid 40787661)