Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes

UIST: Proceedings of the Annual ACM Symposium on User Interface Softaware and Technology

Volumn , Issue , 2007, Pages 159-168

  Wobbrock, Jacob O ^a   Wilson, Andrew D ^b   Li, Yang ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Dynamic time warping; Gesture recognition; Marks; Rapid prototyping; Recognition rates; Rubine; Statistical classifiers; Strokes; Symbols; Unistrokes; User interfaces

Indexed keywords

DYNAMIC TIME WARPING; MARKS; RECOGNITION RATES; STATISTICAL CLASSIFIERS; STROKES; UNISTROKES;

DIGITAL LIBRARIES; IMAGE CLASSIFICATION; PATTERN MATCHING; RAPID PROTOTYPING; USER INTERFACES;

GESTURE RECOGNITION;

EID: 41149132768     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1294211.1294238     Document Type: Conference Paper

References (32)

1. Anderson, D., Bailey, C. and Skubic, M. (2004) Hidden Markov Model symbol recognition for sketch-based interfaces. AAAI Fall Symposium. Menlo Park, CA: AAAI Press, 15-21.
2. Cao, X. and Balakrishnan, R. (2003) VisionWand: Interaction techniques for large displays using a passive wand tracked in 3D. Proc. UIST'03. New York: ACM Press, 173-182.
3. Cao, X. and Balakrishnan, R. (2005) Evaluation of an on-line adaptive gesture interface with command prediction. Proc. Graphics Interface '05. Waterloo, Ontario: CHCCS, 187-194.
4. Cho, M.G. (2006) A new gesture recognition algorithm and segmentation method of Korean scripts for gesture-allowed ink editor. Information Sciences 176 (9), 1290-1303.
5. Guimbretière, F., Stone, M. and Winograd, T. (2001) Fluid interaction with high-resolution wall-size displays. Proc. UIST '01. New York: ACM Press, 21-30.
6. Henry, T.R., Hudson, S.E. and Newell, G.L. (1990) Integrating gesture and snapping into a user interface toolkit. Proc. UIST '90. New York: ACM Press, 112-122.
7. Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P. and Smith, M. (2004) Stitching: Pen gestures that span multiple displays. Proc. AVI '04. New York: ACM Press, 23-31.
8. Hong, J.I. and Landay, J.A. (2000) SATIN: A toolkit for informal ink-based applications. Proc. UIST'00. New York: ACM Press, 63-72.
9. Kara, L.B. and Stahovich, T.F. (2004) An image-based trainable symbol recognizer for sketch-based interfaces. AAAI Fall Symposium. Menlo Park, CA: AAAI Press, 99-105.
10. Karlson, A.K., Bederson, B.B. and SanGiovanni, J. (2005) AppLens and LaunchTile: Two designs for one-handed thumb use on small devices. Proc. CHI '05. New York: ACM Press, 201-210.
11. Kristensson, P. and Zhai, S. (2004) SHARK2: A large vocabulary shorthand writing system for pen-based computers. Proc. UIST '04. New York: ACM Press, 43-52.
12. Landay, J. and Myers, B.A. (1993) Extending an existing user interface toolkit to support gesture recognition. Adjunct Proc. CHI '93. New York: ACM Press, 91-92.
13. Lin, J., Newman, M.W., Hong, J.I. and Landay, J.A. (2000) DENIM: Finding a tighter fit between tools and practice for web site design. Proc. CHI '00. New York: ACM Press, 510-517.
14. Long, A.C., Landay, J.A. and Rowe, L.A. (1999) Implications for a gesture design tool. Proc. CHI '99. New York: ACM Press, 40-47.
15. Mitchell, T.M. (1997) Machine Learning. New York: McGraw-Hill.
16. Morris, M.R., Huang, A., Paepcke, A. and Winograd, T. (2006) Cooperative gestures: Multi-user gestural interactions for co-located groupware. Proc. CHI '06. New York: ACM Press, 1201-1210.
17. Myers, B.A., McDaniel, R.G., Miller, R.C., Ferrency, A.S., Faulring, A., Kyle, B.D., Mickish, A., Klimovitski, A. and Doane, P. (1997) The Amulet environment: New models for effective user interface software development. IEEE Trans. Software Engineering 23 (6), 347-365.
18. Myers, C.S. and Rabiner, L.R. (1981) A comparative study of several dynamic time-warping algorithms for connected word recognition. The Bell System Technical J. 60(1), 1389-1409.
19. Notowidigdo, M. and Miller, R.C. (2004) Off-line sketch interpretation. AAAI Fall Symposium. Menlo Park, CA: AAAI Press, 120-126.
20. Pittman, J.A. (1991) Recognizing handwritten text. Proc. CHI '91. New York: ACM Press, 271-275.
21. Plamondon, R. and Srihari, S.N. (2000) On-line and off-line handwriting recognition: A comprehensive survey. IEEE Trans. Pattern Analysis & Machine Int. 22 (1), 63-84.
22. Press, W.H., Teukolsky, S.A., Vetterling, W.T. and Flannery, B.P. (1992) Numerical Recipes in C. Cambridge Univ. Press.
23. Rubine, D. (1991) Specifying gestures by example. Proc. SIGGRAPH '91. New York: ACM Press, 329-337.
24. rd Wkshp. on Mining Temporal and Sequential Data, ACM KDD '04. Seattle, Washington (August 22-25, 2004).
25. Sezgin, T.M. and Davis, R. (2005) HMM-based efficient sketch recognition. Proc. IUI '05. New York: ACM Press, 281-283.
26. Stojmenović, M., Nayak, A. and Zunic, J. (2006) Measuring linearity of a finite set of points. Proc. CIS '06. Los Alamitos, CA: IEEE Press, 1-6.
27. Swigart, S. (2005) Easily write custom gesture recognizers for your Tablet PC applications. Tablet PC Technical Articles.
28. Tappert, C.C. (1982) Cursive script recognition by elastic matching. IBM J. of Research & Development 26 (6), 765-771.
29. Tappert, C.C., Suen, C.Y. and Wakahara, T. (1990) The state of the art in online handwriting recognition. IEEE Trans. Pattern Analysis & Machine Int. 12 (8), 787-808.
30. Vermunt, J.K. (1997) Log-linear Models for Event Histories. Thousand Oaks, CA: Sage Publications.
31. Wilson, A.D. and Shafer, S. (2003) XWand: UI for intelligent spaces. Proc. CHI '03. New York: ACM Press, 545-552.
32. Zhai, S. and Kristensson, P. (2003) Shorthand writing on stylus keyboard. Proc. CHI '03. New York: ACM Press, 97-104.