Air pointing: Design and evaluation of spatial target acquisition with and without visual feedback

International Journal of Human Computer Studies

Volumn 69, Issue 6, 2011, Pages 401-414

  Cockburn, A ^a   Quinn, P ^a   Gutwin, C ^b   Ramos, G ^c   Looser, J ^a  

^a UNIVERSITY OF CANTERBURY   (New Zealand)

^b UNIVERSITY OF SASKATCHEWAN   (Canada)

^c MICROSOFT   (United States)

Author keywords

Eyes free interaction; Proprioception; Spatial memory; Target acquisition

Indexed keywords

DESIGN SPACES; EYES-FREE INTERACTION; FUNDAMENTAL CONCEPTS; INPUT DIMENSIONS; INTERACTION QUALITY; NOVEL TECHNIQUES; POTENTIAL BENEFITS; PROPRIOCEPTION; RAYCASTING; SELECTION TIME; SENSING TECHNOLOGY; SPATIAL INTERACTION; SPATIAL MEMORY; SPATIAL REGIONS; TARGET ACQUISITION; VISUAL FEEDBACK;

COMPUTER VISION; MERGERS AND ACQUISITIONS; THREE DIMENSIONAL; VISUAL COMMUNICATION;

DESIGN;

EID: 79952567635     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2011.02.005     Document Type: Article

References (59)

1. J. Andrade, and P. Meudell Short report: is spatial information encoded automatically? Quarterly Journal of Experimental Psychology 46A 1993 365 375
2. Ängeslevä, J.; Oakley, I.; Hughes, S.; OModhrain, S.; 2003. Body mnemonics: portable device interaction design concept. In: Adjunct Proceedings of the UIST 2003: ACM Symposium on User Interface Software and Technology, Vancouver, CanadaACM Press.
3. T. Baudel, and M. Beaudouin-Lafon Charade: remote control of objects using free-hand gestures Communications of the ACM 36 7 1993 28 35
4. Bolt, R.A.; 1980. Put-that-there: voice and gesture at the graphics interface. In: Proceedings of the Seventh Annual Conference on Computer Graphics and Interactive Techniques, Seattle, Washington, United States, pp. 262270.
5. Bowman, D.A.; Johnson, D.B.; Hodges, L.F.; 1999. Testbed evaluation of virtual environment interaction techniques. In: Virtual Reality Software and Technology, ACM Press, London, pp. 2633.
6. D.A. Bowman, E. Kruijff, J.J. LaViola Jr.; and I. Poupyrev 3D User Interfaces: Theory and Practice 2005 Addison-Wesley Boston, MA
7. Brewster, S.; Brown, L.M.; Tactons: structured tactile messages for non-visual information display. In: Proceedings of the Fifth Conference on Australasian user Interface, vol. 28, Dunedin, New Zealand, 2004. Australian Computer Society, Inc.; Conference Paper, 976313. pp. 1523.
8. Brewster, S.; Lumsden, J.; Bell, M.; Hall, M.; Tasker, S.; 2003. Multimodal 'eyes-free' interaction techniques for wearable devices. In: Proceedings of the CHI03: Conference on Human Factors in Computing Systems, Ft. Lauderdale, Florida, ACM, pp. 473480.
9. Brewster, S.; Wright, P.; Edwards, A.; 1993. An evaluation of earcons for use in auditory humancomputer interfaces. In: Proceedings of the INTERCHI93 Conference on Human Factors in Computing Systems, Amsterdam, pp. 222227.
10. Cao, X.; Li, J.; Balakrishnan, R.; 2008. Peephole pointing: modeling acquisition of dynamically revealed targets. In: Proceedings of the CHI08: ACM Conference on Human Factors in Computing Systems, Florence, Italy, ACM Press, pp. 16991708.
11. Cockburn, A.; Gutwin, C.; Alexander, J.; 2006. Faster document navigation with space-filling thumbnails. In: Proceedings of the CHI06 ACM Conference on Human Factors in Computing Systems, Montreal, Canada, ACM Press, pp. 110. (Pubitemid 44032080)
12. Cockburn, A.; Gutwin, C.; Greenberg, S.; 2007. A predictive model of menu performance. In: Proceedings of the CHI07: ACM Conference on Human Factors in Computing Systems, San Jose, CA, ACM Press, pp. 627636. (Pubitemid 47581651)
13. Crossman, E.; Goodeve, P.; 1963/1983. Feedback control of hand-movement and Fitts Law. Paper presented at the meeting of the Experimental Psychological Society, Oxford, July, 1963. Reprinted in Quarterly Journal of Experimental Psychology 35A, 251278.
14. Czerwinski, M.; van Dantzich, M.; Robertson, G.; Hoffman, H.; 1999. The contribution of thumbnail image, mouse-over text and spatial location memory to web page retrieval in 3D. In: Proceedings of the Interact 99, Edinburgh, Scotland, IOS press, pp. 163170.
15. R.D. Easton, and M.J. Sholl Object-array structure, frames of reference, and retrieval of spatial knowledge Journal of Experimental Psychology: Learning, Memory, and Cognition 21 2 1995 483 500
16. D. Egan, and M. Gomez Assaying, isolating, and accommodating individual differences in learning a complex skill R. Dillon, Individual Differences in Cognition 1985 173 217
17. D. Elliot, and T. Lee The role of target information on manual-aiming bias Psychological Research 58 1 1995 2 9
18. D. Elliot, and J. Madalena The influence of premovement visual information on manual aiming Quarterly Journal of Experimental Psychology 39A 3 1987 541 559
19. D. Gagnon Videogames and spatial skills: an exploratory study Educational Communication and Technology 33 4 1985 263 275
20. Grossman, T.; Balakrishnan, R.; 2004. Pointing at trivariate targets in 3D environments. In: Proceedings of the CHI04: ACM Conference on Human Factors in Computing Systems, pp. 447454.
21. Grossman, T.; Balakrishnan, R.; 2006. The design and evaluation of selection techniques for 3D volumetric displays. In: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, Montreux, Switzerland, ACM Press, pp. 312. (Pubitemid 47142419)
22. Harbluk, J.; Noy, Y.; 2002. The Impact of Cognitive Distraction on Driver Visual Behaviour and Vehicle Control. Transport Canada. Ergonomics Division of the Road Safety Directorate and Motor Vehicle Regulation Directorate.
23. S. Hart, and L. Staveland Development of NASA-TLX (Task Load Index): results of empirical and theoretical research P. Hancock, N. Meshkati, Human Mental Workload 1988 139 183
24. Hinckley, K.; Pausch, R.; Goble, J.; Kassell, N.; 1994. A survey of design issues in spatial input. In: Proceedings of the UIST94 Symposium on User Interface Software and Technology, California, pp. 213222.
25. S. Hocherman Proprioceptive guidance and motor planning of reaching movements to unseen targets Experimental Brain Research 95 1993 349 358 (Pubitemid 23288344)
26. M. Krueger VideoPlace and the interface of the future Laurel B.; The Art of Human Computer Interface 1991 Addison Wesley 417 422
27. Kurtenbach, G.; Buxton, W.; 1994. User learning and performance with marking menus. In: Proceedings of the CHI94 Conference on Human Factors in Computing Systems, Boston, April 2428, pp. 258264.
28. G. Kurtenbach, A. Sellen, and W. Buxton An empirical evaluation of some articulatory and cognitive aspects of marking menus HumanComputer Interaction 8 1 1993 1 23 (Pubitemid 23713725)
29. J. Lee, and D. Strayer Preface to the special section on driver distraction Human Factors 46 4 2004 583 586 (Pubitemid 40179356)
30. Li, F.; Dearman, D.; Troung, K.; 2009. Virtual shelves: interactions with orientation aware devices. In: Proceedings of the UIST 2009: The 22nd Annual ACM Symposium on User Interface Software and Technology, Victoria, Canada, ACM Press.
31. Li, K.; Baudisch, P.; Hinckley, K.; 2008. BlindSight: eyes-free access to mobile phones. In: Proceedings of the CHI08: ACM Conference on Human Factors in Computing Systems, Florence, Italy, ACM Press, pp.13891398.
32. W. Medendorp, S. Van Asselt, and C. Gielen Pointing to remembered visual targets after active one-step self-displacements within reaching space Experimental Brain Research 125 1999 50 61
33. Mine, M.R.; Brooks Jr.; F.P.; Sequin, C.H.; 1997. Moving objects in space: exploiting proprioception in virtual-environment interaction. In: Proceedings of the International Conference on Computer Graphics and Interactive Techniques, pp. 1926.
34. Myers, B.; Bhatnagar, R.; Nichols, J.; Peck, C.; Kong, D.; Miller, R.; Long, C.; 2002. Interacting at a distance: measuring the performance of laser pointers and other devices. In: Proceedings of the CHI02: ACM Conference on Human Factors in Computing Systems, Minneapolis, Minnesota, ACM Press, pp. 3340.
35. NASA, 1995. Man-Systems Integration Standards. Revision B. NASA.
36. M. Naveh-Benjamin Coding of spatial location information: an automatic process? Journal of Experimental Psychology: Learning, Memory, and Cognition 13 4 1987 595 605
37. A. Newell, and P.S. Rosenbloom Mechanisms of skill acquisition and the law of practice J. Anderson, Cognitive Skills and their Acquisition 1981 Erlbaum Hillsdale, NJ 1 55
38. Oakley, I.; Park, J.; 2007. Designing eyes-free interaction. In: Proceedings of the Second International Workshop on Haptics and Audio Interaction Design, HAID 2007, Seoul, South Korea, Springer Berlin, Lecture Notes in Computer Science, pp. 121132.
39. Pierce, J.S.; Forsberg, A.S.; Conway, M.J.; Hong, S.; Zeleznik, R.C.; Mine, M.R.; 1997. Image plane interaction techniques in 3D immersive environments. In: Proceedings of the 1997 Symposium on Interactive 3D graphics, Providence, Rhode Island, United States, ACM, pp. 3943.
40. A. Postma, and E. De Haan What was where? Memory for object locations Quarterly Journal of Experimental Psychology 49A 1 1996 178 199
41. I. Poupyrev, S. Weghorst, M. Billinghurst, and T. Ichikawa A framework and testbed for studying manipulation techniques for immersive VR Virtual Reality Software and Technology 1997 21 28
42. I. Poupyrev, S. Weghorst, M. Billinghurst, and T. Ichikawa Egocentric object manipulation in virtual environments: empirical evaluation of interaction techniques Computer Graphics Forum 17 3 1998 41 52
43. C. Prablanc, J.F. Echallier, E. Komilis, and M. Jeannerod Optimal response of eye and hand motor systems in pointing at a visual target Biological Cybernetics 35 1979 113 124
44. A. Sengupta, and B. Das Maximum reach envelope for the seated and standing male and female for industrial workstation design Ergonomics 43 9 2000 1390 1404
45. C. Sherrington On the proprio-ceptive system, especially in its reflex aspect Brain 29 4 1907 483 486
46. J. Soechting, and M. Flanders Sensorimotor representations for pointing to targets in three-dimensional space Journal of Neurophysiology 52 1989 582 594 (Pubitemid 19208085)
47. Steed, A.; 2006. Towards a general model for selection in virtual environments. In: Proceedings of the IEEE Symposium on 3D User Interfaces, Alexandria, Virginia, USA, pp. 103110. (Pubitemid 44710911)
48. J. Thomson Is continuous visual monitoring necessary in visually guided locomotion? Journal of Experimental Psychology: Human Perception and Performance 9 1983 427 443
49. K. Vicente, B. Hayes, and R. Williges Assaying and isolating individual differences in searching a hierarchical file system Human Factors 29 3 1987 349 359 (Pubitemid 17128655)
50. Vogel, D.; Balakrishnan, R.; 2005. Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings of the UIST05: ACM Symposium on User Interface Software and Technology, Seattle, WA, ACM Press, pp. 3342. (Pubitemid 44531219)
51. Wilson, A.; Shafer, S.; 2003. XWand: UI for intelligent spaces. In: Proceedings of the CHI2003 Conference on Human Factors in Computing Systems, Fort Lauderdale, Florida, pp. 545552.
52. C. Wingrave, R. Tintner, B.N. Walker, D.A. Bowman, and L.F. Hodges Exploring Individual Differences in Raybased Selection: Strategies and Traits 2005 IEEE Virtual Reality Bonn, Germany (pp. 163170)
53. C. Wingrave, B. Williamson, P.D. Varcholik, J. Rose, A. Miller, E. Charbonneau, J. Bott, and J.J. LaViola Jr. The wiimote and beyond: spatially convenient devices for 3D user interfaces IEEE Computer Graphics and Applications 30 2 2010 71 85
54. Wobbrock, J.; Cutrell, E.; Harada, S.; MacKenzie, I.; 2008. An error model for pointing based on Fitts law. In: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, Florence, Italy, ACM, pp.16131622.
55. Wobbrock, J.; Myers, B.; Kembel, J.; 2003. EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion. In: Proceedings of the 16th Annual ACM symposium on User Interface Software and Technology, Vancouver, Canada, ACM Press, pp. 6170. (Pubitemid 40730674)
56. R. Woodworth The accuracy of voluntary movement Psychological Review (Monograph Supplement) 3 1899 1 119
57. Yee, K.; 2003. Peephole displays: pen interaction on spatially aware handheld computers. In: Proceedings of the CHI03: ACM Conference on Human Factors in Computing Systems, Fort Lauderdale, Florida, ACM Press, pp. 18.
58. S. Zhai User performance in relation to 3D input device design Computer Graphics 32 4 1998 50 54 (Pubitemid 128467795)
59. Zhao, S.; Dragicevic, P.; Chignell, M.; Balakrishnan, R.; Baudisch, P.; 2007. earPod: eyes-free menu selection using touch input and reactive audio feedback. In: Proceedings of the CHI 07: ACM Conference on Human Factors in Computing Systems, San Jose, California, USA, ACM, pp. 13951404. (Pubitemid 47581731)