Motion marking menus: An eyes-free approach to motion input for handheld devices

International Journal of Human Computer Studies

Volumn 67, Issue 6, 2009, Pages 515-532

  Oakley, Ian ^a   Park, Junseok ^b  

^a UNIVERSITY OF MADEIRA   (Portugal)

^b Electronics and Telecommunications Research Institute (ETRI)   (South Korea)

Author keywords

Evaluation; Eyes free; Gesture; Mobile interface; Motion input

Indexed keywords

HAND HELD COMPUTERS; MOBILE DEVICES; USER INTERFACES;

EVALUATION; EYES FREE; GESTURE; MOBILE INTERFACE; MOTION INPUT;

GESTURE RECOGNITION;

EID: 63449125157     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2009.02.002     Document Type: Article

References (46)

1. Ahlström D., Alexandrowicz R., and Hitz M. Improving menu interaction: a comparison of standard, force enhanced and jumping menus. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '06 (2006), ACM Press, New York
2. Apple iPod, 2007. 〈http://www.apple.com/ipod/ipod.html〉 (accessed July 2007).
3. Barnard L., Yi J.S., Jacko J.A., and Sears A. An empirical comparison of use-in-motion evaluation scenarios for mobile computing devices. International Journal of Human-Computer Studies 64 4 (2005) 487-520
4. Bartlett J.F. Rock'n'Scroll is here to stay. IEEE Computer Graphics and Applications 20 3 (2000) 40-45
5. Baudel T., and Beaudouin-Lafon M. Charade: remote control of objects using free-hand gestures. Communication of the ACM 36 7 (1993) 28-35
6. Benbasat A.Y., and Paradiso J.A. Compact, configurable inertial gesture recognition. Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, CHI'01 (2001), ACM press, New York
7. Brewster S., Lumsden J., Bell M., Hall M., and Tasker S. Multi-modal 'Eyes-free' interaction techniques for wearable devices. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI'03 (2003), ACM Press, New York
8. Bailly G., Lecolinet E., and Nigay L. Flower menus: a new type of marking menu with large menu breadth, within groups and efficient expert mode memorization. Proceedings of the Working Conference on Advanced Visual Interfaces, AVI '08 (2008), ACM Press, New York
9. Callahan J., Hopkins D., Weiser M., and Shneiderman B. An empirical comparison of pie vs. linear menus. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI '88 (1988), ACM Press, New York
10. Clark F., and Horch K. Kinesthesia. In: Boff K., Kaufman L., and Thomas J. (Eds). Handbook of Perception and Human Performance vol. 1 (1986), Wiley, New York 13-1-13-62
11. Cho, S.J., Choi, E., Bang, W.C., Yang, J., Sohn, J., Kim, D.Y., Lee, Y.B., Kim, S., 2006. Two-stage recognition of raw acceleration signals for 3-D gesture-understanding cell phones. In: Proceedings of the Tenth International Workshop on Frontiers in Handwriting Recognition, IWFHR 10.
12. Cho S.J., Murray-Smith R., Choi C., Sung Y., Lee K., and Kim Y.-B. Dynamics of tilt browsing on mobile devices. Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, CHI'07 (2007), ACM Press, New York
13. Fitts P.M. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47 (1954) 381-391
14. Harrison B.L., Fishkin K.P., Gujar A., Mochon C., and Want R. Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI'98 (1998), ACM Press, New York 17-24
15. Hinckley K., Pierce J., Horvitz E., and Sinclair M. Foreground and background interaction with sensor-enhanced mobile devices. ACM Transactions on Computer-Human Interactions Special Issue on Sensor-Based Interaction 12 1 (2005) 31-52 (special issue on sensor-based interaction)
16. Hinckley K., Pierce J., Sinclair M., and Horvitz E. Sensing techniques for mobile interaction. Proceedings of the ACM Conference on User Interface Software Technology, UIST'00 (2000), ACM Press, New York 91-100
17. Hinckley K., Zhao S., Sarin R., Baudisch P., Cutrell E., Shilman M., and Tan D. InkSeine: in situ search for active note taking. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI'07 (2007), ACM Press, New York
18. Holtzblatt, K. (Ed.), 2005. Designing for the mobile device: experiences, challenges and methods. Communications of the ACM, 48(7).
19. Kallio S., Kela J., Mantyjarvi J., and Plomp J. Visualization of hand gestures for pervasive computing environments. Proceedings of the Working Conference on Advanced Visualization Interfaces (2006), ACM Press, New York 480-483
20. Kela J., Koripiaa P., Mantyjarvi J., Kallio S., Savino G., Jozzo L., and Di Marca S. Accelerometer-based gesture control for a design environment. Personal and Ubiquitous Computing 10 5 (2006) 285-299
21. Kurtenbach G., Sellen A., and Buxton B. An empirical evaluation of some articulatory and cognitive aspects of "marking menus". Journal of Human-Computer Interaction 8 1 (1993) 1-23
22. Kurtenbach G., and Buxton W. The limits of expert performance using hierarchic marking menus. Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93) (1993), ACM Press, New York
23. Long Jr. A.C., Landay J.A., and Rowe L.A. Implications for a gesture design tool. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI'99 (1999), ACM Press, New York 40-47
24. Mantyjarvi J., Kela J., Korpipaa P., and Kallio S. Enabling fast and effortless customization in accelerometer based gesture interaction. Proceedings of the third International Conference on Mobile and Ubiquitous Multimedia (2004), ACM Press, New York 25-31
25. Miller G.A. The magic number seven, plus or minus two: some limits on our capacity for processing information. Psychological Review 63 (1956) 81-97
26. Oakley, I., O'Modhrain, S., 2005. Tilt to scroll: evaluating a motion based vibrotactile mobile interface. In: Proceedings of World Haptics'05, IEEE Computer Society, pp. 40-49.
27. Oakley I., Sunwoo J., and Cho I.Y. Pointing with fingers, hands and arms for wearable computing. Proceedings of the ACM CHI 2008 Conference on Human Factors in Computing Systems, CHI'08 (2008), ACM Press, New York
28. Partridge K., Chatterjee S., Sazawal V., Borriello G., and Want R. Tilt-type: accelerometer-supported text entry for very small devices. Proceedings of the ACM Conference of User Interface Software Technology, UIST'02 (2002), ACM Press, New York
29. Pirhonen A., Brewster S.A., and Holguin C. Gestural and audio metaphors as a means of control for mobile devices. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI'02 (2002), ACM Press, New York
30. PocketMotion, 2007. 〈www.pocketmotion.com〉 (accessed July 2007).
31. Poupyrev I., Maruyama S., and Rekimoto J. Ambient touch: designing tactile interfaces for handheld devices. Proceedings of the ACM Conference on User Interface Software Technologies, UIST'02 (2002), ACM Press, New York
32. Rekimoto J. Tilting operations for small screen interfaces. Proceedings of the ACM Conference on User Interface Software Technologies, UIST'96 (1996), ACM Press, New York
33. Schwesig C., Poupyrev I., and Mori E. Gummi: a bendable computer. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI'04 (2004), ACM Press, New York 263-270
34. Schlömer T., Poppinga B., Henze N., and Boll S. Gesture recognition with a Wii controller. Proceedings of the Second international Conference on Tangible and Embedded interaction, TEI'08 (2008), ACM Press, New York
35. St Amant R., Horton T.E., and Ritter F.E. Model-based evaluation of cell phone menu interaction. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI'04 (2004), ACM Press, New York
36. St Amant R., and Horton T.E. Model-based evaluation of expert cell phone menu interaction. ACM Transactions on Computer-Human Interaction 14 1 (2007) 1-24
37. Soukoreff R.W., and Mackenzie I.S. Towards a standard for pointing device evaluation: perspectives on 27 years of Fitts' law research in HCI. International Journal of Human-Computer Studies 61 (2004) 751-789
38. Tactaid VBW32, 2007. 〈www.tactaid.com/skinstimulator.html〉 (accessed July 2007).
39. Tamminen S., Oulasvirta A., Toiskallio K., and Kankainen A. Understanding mobile contexts. Personal and Ubiquitous Computing 8 2 (2004) 135-143
40. Verrillo R.T. Vibrotactile thresholds for hairy skin. Journal of Experimental Psychology 72 1 (1966) 47-50
41. Walker N., and Smelcer J.B. A comparison of selection times from walking and pull-down menus. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI'90 (1990), ACM Press, New York
42. Wigdor D., and Balakrishnan R. TiltText: using tilt for text input to mobile phones. Proceedings of the ACM Conference on User Interface Software Technologies, UIST'03 (2003), ACM Press, New York
43. Zhao S., Agrawala M., Hinckley K., and Baudisch P. Zone and polygon menus: using relative position to increase breadth of multi-stroke marking menus. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI'06 (2006), ACM Press, New York
44. Zhao S., and Balakrishnan R. Simple vs. compound mark hierarchical marking menus. Proceedings of the ACM Conference on User Interface Software Technologies, UIST'04 (2004), ACM Press, New York
45. Zhao S., Dragicevic P., Chignell M., Balakrishnan R., and Baudisch P. earPod: eyes-free menu selection using touch input and reactive audio feedback. Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI'07 (2007), ACM Press, New York 1395-1404
46. Zucco, J.E., Thomas, B.H., Grimmer, K., 2006. Evaluation of four wearable computer pointing devices for drag and drop tasks when stationary and walking. In: Proceedings of the Tenth International Symposium on Wearable Computers. IEEE Computer Society, pp. 29-36.