Proton++: A customizable declarative multitouch framework

UIST'12 - Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology

Volumn , Issue , 2012, Pages 477-486

  Kin, Kenrick ^a,b   Hartmann, Björn ^a   DeRose, Tony ^b   Agrawala, Maneesh ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Pixar Animation Studios ^*  (United States)

Author keywords

Custom attributes; Gesture tablature; Proton++; Regular expressions; Touch events symbols

Indexed keywords

CONFLICT DETECTION; CUSTOM ATTRIBUTES; CUSTOMIZABLE; GESTURE TABLATURE; MENU ITEMS; MULTI-TOUCH; MULTI-TOUCH GESTURES; MULTIPLE USER; ORIENTATION ATTRIBUTE; REGULAR EXPRESSIONS; TIME INTERVAL; USER ID; USER STUDY;

PATTERN MATCHING; STATIC ANALYSIS; TOUCH SCREENS; USER INTERFACES;

PROTONS;

EID: 84869015896     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (41)

1. Appert, C., and Zhai, S. Using strokes as command shortcuts: cognitive benefits and toolkit support. Proc. CHI 2009 (2009), 2289-2298.
2. Apple. iOS. http://developer.apple.com/technologies/ios.
3. Benko, H., Wilson, A. D., and Baudisch, P. Precise selection techniques for multi-touch screens. Proc. CHI 2006 (2006), 1263-1272.
4. Bevilacqua, F., Zamborlin, B., Sypniewski, A., Schnell, N., Guédy, F., and Rasamimanana, N. Continuous realtime gesture following and recognition. In Gesture in Embodied Communication and Human-Computer Interaction, vol. 5934 of Lecture Notes in Computer Science. 2010, 73-84.
5. Cao, X., Wilson, A. D., Balakrishnan, R., Hinckley, K., and Hudson, S. ShapeTouch: Leveraging contact shape on interactive surfaces. Proc. TABLETOP 2008 (2008), 129-136.
6. Dang, C. T., and André, E. Usage and recognition of finger orientation for multi-touch tabletop interaction. Proc. INTERACT 2011 (2011), 409-426.
7. Echtler, F., Huber, M., and Klinker, G. Hand tracking for enhanced gesture recognition on interactive multi-touch surfaces, 2007. Technical Report, Technische Universität München - Institut für Informatik.
8. Esenther, A., and Wittenburg, K. Multi-user multi-touch games on DiamondTouch with the DTFlash toolkit. In Intelligent Technologies for Interactive Entertainment, vol. 3814. 2005, 315-319.
9. Freeman, D., Benko, H., Morris, M. R., and Wigdor, D. ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures. Proc. ITS 2009 (2009), 165-172.
10. Gibbon, D., Gut, U., Hell, B., Looks, K., Thies, A., and Trippel, T. A computational model of arm gestures in conversation. Proc. Eurospeech 2003 (2003), 813-816.
11. Guiard, Y. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior 19, 4 (1987), 486-517.
12. Han, J. Low-cost multi-touch sensing through frustrated total internal reflection. Proc. UIST 2005 (2005), 115-118.
13. Kammer, D., Wojdziak, J., Keck, M., and Taranko, S. Towards a formalization of multi-touch gestures. Proc. ITS 2010 (2010), 49-58.
14. Khandkar, S. H., and Maurer, F. A domain specific language to define gestures for multi-touch applications. 10th Workshop on Domain-Specific Modeling (2010).
15. Kin, K., Hartmann, B., and Agrawala, M. Two-handed marking menus for multitouch devices. TOCHI 18 (August 2011), 16:1-16:23.
16. Kin, K., Hartmann, B., DeRose, T., and Agrawala, M. Proton: Multitouch gestures as regular expressions. Proc. CHI 2012 (2012).
17. Kurtenbach, G. P. The design and evaluation of marking menus. PhD thesis, University of Toronto, Toronto, Ont., Canada, 1993.
18. Lepinski, G. J., Grossman, T., and Fitzmaurice, G. The design and evaluation of multitouch marking menus. Proc. CHI 2010 (2010), 2233-2242.
19. Lu, H., and Li, Y. Gesture Coder: A tool for programming multi-touch gestures by demonstration. Proc. CHI 2012 (2012).
20. MERL. DiamondTouch. http://merl.com/projects/DiamondTouch.
21. Microsoft. Surface. http://www.microsoft.com/surface.
22. Morris, M. R., Huang, A., Paepcke, A., and Winograd, T. Cooperative gestures: multi-user gestural interactions for co-located groupware. Proc. CHI 2006 (2006), 1201-1210.
23. Moscovich, T. Contact area interaction with sliding widgets. Proc. UIST 2009 (2009), 13-22.
24. Newman, W. M. A system for interactive graphical programming. Proc. AFIPS 1968 (Spring) (1968), 47-54.
25. Olsen, Jr., D. R., and Dempsey, E. P. Syngraph: A graphical user interface generator. Proc. SIGGRAPH 1983 (1983), 43-50.
26. Ramos, G., Boulos, M., and Balakrishnan, R. Pressure widgets. Proc. CHI 2004 (2004), 487-494.
27. Rekimoto, J. SmartSkin: An infrastructure for freehand manipulation on interactive surfaces. Proc. CHI 2002 (2002), 113-120.
28. Rosenberg, I., and Perlin, K. The UnMousePad: an interpolating multi-touch force-sensing input pad. Proc. SIGGRAPH (2009), 65:1-65:9.
29. Rubine, D. Specifying gestures by example. Proc. SIGGRAPH 1991 (1991), 329-337.
30. Scholliers, C., Hoste, L., Signer, B., and De Meuter, W. Midas: a declarative multi-touch interaction framework. Proc. TEI 2011 (2011), 49-56.
31. Shneiderman, B. Direct manipulation: A step beyond programming languages. In Computer, vol. 16(8). August 1983, 57-69.
32. Swigart, S. Easily write custom gesture recognizers for your tablet PC applications, November 2005. Microsoft Technical Report.
33. Wang, F., Cao, X., Ren, X., and Irani, P. Detecting and leveraging finger orientation for interaction with direct-touch surfaces. Proc. UIST 2009 (2009), 23-32.
34. Westerman, W. Hand tracking, finger identification, and chordic manipulation on a multi-touch surface. PhD thesis, University of Delaware, 1999.
35. Wigdor, D., Benko, H., Pella, J., Lombardo, J., and Williams, S. Rock & rails: extending multi-touch interactions with shape gestures to enable precise spatial manipulations. Proc. CHI 2011 (2011), 1581-1590.
36. Wilson, A. D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., and Kirk, D. Bringing physics to the surface. Proc. UIST 2008 (2008), 67-76.
37. Wobbrock, J., Morris, M., and Wilson, A. User-defined gestures for surface computing. Proc. CHI 2009 (2009), 1083-1092.
38. Wobbrock, J. O., Wilson, A. D., and Li, Y. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. Proc. UIST 2007 (2007), 159-168.
39. Worth, C. D. xstroke. http: //pandora.east.isi.edu/xstroke/usenix-2003.
40. Wu, M., and Balakrishnan, R. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. Proc. UIST 2003 (2003), 193-202.
41. Xbox. Kinect. http://www.xbox.com/kinect.