The word-gesture keyboard: Reimagining keyboard interaction

Communications of the ACM

Volumn 55, Issue 9, 2012, Pages 91-101

  Zhai, Shumin ^a   Kristensson, Per Ola ^b  

^a GOOGLE INC   (United States)

^b UNIVERSITY OF ST ANDREWS   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BASIC CONCEPTS; HUMAN CONTROL; MONTGOMERY; STATISTICAL MODELING; TOUCH-SCREEN KEYBOARDS;

GESTURE RECOGNITION;

BEHAVIORAL RESEARCH;

EID: 84865632963     PISSN: 00010782     EISSN: 15577317     Source Type: Journal    
DOI: 10.1145/2330667.2330689     Document Type: Article

References (51)

1. Accot, J., Zhai, S. More than dotting the i's - foundations for crossingbased interfaces. In Proceedings of CHI 2002: ACM Conference on Human Factors in Computing Systems, CHI Letters 4,1 (2002), ACM, 73-80.
2. Bi, X., Smith, B.A., Zhai, S. Multilingual touchscreen keyboard design and optimization. Hum. Comput. Interact. (2012), To appear (available online at http://www.tandfonline.com).
3. Buxton, W., Human Input to Computer Systems: Theories, Techniques and Technology, book manusript, available at http://www.billbuxton.com/ inputManuscript.html
4. Buxton, W. Chunking and phrasing and the design of human-computer dislogues. In Proceedings of IFIP World Computer Congress (Dublin, Ireland, 1986), 475-480.
5. Buxton, William (2005). Piloting Through the Maze. Interactions Magazine. 12(6), November + December, 10
6. Card, S., Moran, T., Newell, A. The Psychology of Human-Computer Interaction, Lawrence, Erlbaum Associates, Hillsdale, NJ, 1983.
7. Cao, X., Zhai, S. Modeling human performance of pen stroke gestures. In Proceedings the ACM CHI conference on Human factors in computing systems (2007), ACM, 1495-1504.
8. Chen, S.F., Goodman, J. An empirical study of smoothing techniques for language modeling. In Proceedings of the 34th Annual Meeting on Association for Computational Linguistics (1996), Association for Computational Linguistics, Santa Cruz, CA, 310-318.
9. Cooper, W.E., ed. Cognitive Aspects of Skilled Typewriting, Springer-Verlag, New York, 1983.
10. David, P.A. Clio and the economics of QWERTY. Am. Econ. Rev. 75 (1985) 332-337.
11. Fitts, P.M. The information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psychol. 47, 6 (1954) 381-391.
12. Getschow, C.O., Rosen, M.J., Goodenough-Trepagnier, C. A systematic approach to design a minimum distance alphabetical keyboard. In Proceedings of RESNA (Rehabilitation Engineering Society of North America) 9th Annual Conference (Minneapolis, MN, 1986), 396-398.
13. Goldberg, D., Richardson, C. Touching-typing with a stylus. In Proceedings of INTERCHI, ACM Conference on Human Factors in Computing Systems (Amsterdam, The Netherlands, 1993), ACM, 80-87.
14. Goodman, J., Venolia, G., Steury, K., Parker, C. Language modeling for soft keyboards. In Proceedings of International Conference on Intelligent User Interfaces (IUI'02) (2002), ACM, 194-195.
15. Kristensson, P.O., Zhai, S. Command strokes with and without preview: Using pen gestures on keyboard for command selection. In Proceedings of ACM CHI Conference on Human Factors in Computing Systems (San Jose, CA, 2007), ACM, 1137-1146.
16. Kristensson, P.O. Design and evaluation of a shorthand-aided soft keyboard. Master's thesis, Linköping University, Sweden (2002), p. 96.
17. Kristensson, P.O. Discrete and continuous shape writing for text entry and control. PhD Thesis, Linköping University, Sweden (2007).
18. Kristensson, P.O. Five challenges for intelligent text entry methods, In AI Magazine (2009), 30(4) 85-94.
19. Kristensson, P.O., Vertanen, K. Asynchronous multimodal text entry using speech and gesture keyboards. In Proceedings of 12th Annual Conference of the International Speech Communication Association (2011), ISCA, 581-584.
20. Kristensson, P.O., Vertanen, K. Performance comparisons of phrase sets and presentation styles for text entry evaluations. In Proceedings of the 17th ACM International Conference on Intelligent User Interfaces (2012), ACM, 29-32.
21. Kristensson, P.O., Zhai, S. SHARK2: A large vocabulary shorthand writing system for pen-based computers. In Proceedings of ACM Symposium on User Interface Software and Technology (UIST 2004) (2004), 43-52.
22. Kristensson, P.O., Zhai, S. Relaxing stylus typing precision by geometric pattern matching. In Proceedings of ACM International Conference on Intelligent User Interfaces (2005), ACM, 151-158.
23. Kristensson, P.O., Zhai, S. Learning shape writing by game playing. In Proceedings of CHI '07 extended abstracts on Human factors in computing systems (San Jose, CA, USA , 2007), ACM. 1971-1976.
24. Kurtenbach, G., Buxton, W. Issues in combining marking and direct manipulation techniques. In Proceedings of ACM symposium on User Interface Software and Technology (1991), 137-144.
25. Lewis, J.R., Kennedy, P.J., LaLomia, M.J. Improved Typing-Key Layouts for Single-Finger or Stylus Input, IBM Technical Report TR 54.692, 1992.
26. Liebowitz, S.J., Margolis, S.E. The Fable of the Keys. J. Law Econ. 33, 1 (1990), 1-25.
27. MacKenzie, I.S., ed. Special issue on text entry for mobile devices. Hum. Comput. Interact. 17 (2002).
28. MacKenzie, I.S., Soukoreff, R.W. Text entry for mobile computing: Models and methods, theory and practice. Hum. Comput. Interact. 17, 1 (2002).
29. MacKenzie, I.S., Zhang, S.X. The design and evaluation of a high-performance soft keyboard. In Proceedings of CHI'99: ACM Conference on Human Factors in Computing Systems (1999), 25-31.
30. Melin, O.W. Stenografiens historia. P.A. Norstedt & Söner, Stockholm, Sweden, 1927/1929.
31. Miller, G.A. The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol. Rev. 63 (1956), 81-97.
32. Montgomery, E.B. Bringing manual input into the 20th century, Computer (1982), 15(3) 11-18.
33. Rick, J. Performance optimizations of virtual keyboards for stroke-based text entry on a touch-based tabletop. In Proceedings of 23nd Annual ACM Symposium on User Interface Software and Technology (2010), ACM, 77-86.
34. Schmidt, R.A., Lee, T.D. Motor Control & Learning: A Behavioral Emphasis, 5th edn, Human Kinetics, 2011.
35. Schneider, W., Shiffrin, R.M. Controlled and automatic human information processing: I. Detection, search, and attention. Psychol. Rev. 84, 1 (1977), 1-66.
36. Shannon, C.E. A mathematical theory of communication. Bell System Technical J. 27 (1948), 379-423, 623-656.
37. ShapeWriterInc. Press Release: ShapeWriter Publishes Award Winning Software On Multiple Mobile and PC Platforms, 2008 [retrieved from www.reuters.com on 14 May 2012].
38. Shiffrin, R.M., Schneider, W. Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. Psychol. Rev. 84, 2 (1977), 127-190.
39. Tulving, E. Introduction to memory. In The New Cognitive Neurosciences, M.S. Gazzaniga, ed. MIT Press, Cambridge, MA, 2000, 727-732.
40. Venolia, D., Neiberg, F. T-cube: a fast, self-disclosing pen-based alphabet. In Proceedings of ACM CHI Conference on Human Factors in Computing Systems (1994), 265-270.
41. Willingham, D.B. A neuropsychological theory of motor skill learning. Psychol. Rev. 105 (1998), 558-584.
42. Wulf, G., Shea, C.H. Principles derived from the study of simple skills do not generalize to complex skill learning. Psychnonomics Bull. Rev. 9, 2 (2003), 185-211.
43. Yaeger, L., Webb, B., Lyon, R. Combining neural networks and context-driven search for on-line, printed handwriting recognition in the Newton. AI Magazine 19, 1 (1998).
44. Yamada, H. A historical study of typewriters and typing methods: from the position of planning Japanese parallels. J. Inform. Process. 2, 4 (1980) 175-202.
45. Zhai, S. On the ease and efficiency of human-computer interfaces. In Proceedings of ACM ETRA 2008: ACM Eye Tracking Research & Applications Symposium (2008), 9-10.
46. Zhai, S., Kristensson, P.O. Shorthand writing on stylus keyboard. In Proceedings of ACM CHI Conference on Human Factors in Computing Systems, CHI Letters 5(1) (Fort Lauderdale, FL, 2003), ACM, 97-104.
47. Zhai, S., Kristensson, P.O. Introduction to shape writing, IBM Research Report RJ10393 (also as a Chapter 7 of Text Entry Systems: Mobility, Accessibility, Universality MacKenzie, I. S., Tanaka-Ishii, K., eds Morgan Kaufmann Publishers, 2006, 139-158).
48. Zhai, S., Hunter, M., Smith., B. A. The Metropolis keyboard - an exploration of quantitative techniques for virtual keyboard design. In Proceedings of the 13th annual ACM symposium on User Interface Software and Technology (UIST) (2000), 119-128.
49. Zhai, S., Hunter, M., Smith, B.A. Performance optimization of virtual keyboards. Hum. Comput. Interact. 17(2-3) (2002), 89-129.
50. Zhai, S., Kristensson, P.O., Smith, B.A. In Search of effective text input interfaces for off the desktop computing. Interacting with Computers 17, 3 (2005), 229-250.
51. Zhai, S., Kristensson, P.O., Gong, P., Greiner, M., Peng, S.A., Liu, L.M., Dunnigan, A. Shapewriter on the iphone: from the laboratory to the real world. In Extended Abstracts of ACM CHI Conference on Human Factors in Computing Systems (Design Practice) (2009), ACM, 2667-2670.