Towards a formalization of multi-touch gestures

ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010

Volumn , Issue , 2010, Pages 49-58

  Kammer, Dietrich ^a   Wojdziak, Jan ^a   Keck, Mandy ^a   Groh, Rainer ^a   Taranko, Severin ^b  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

^b Queo Media GmbH   (Germany)

Author keywords

Formalization; Gestures; Interaction; Multi touch; Standardization

Indexed keywords

FORMALIZATION; GESTURAL INTERACTION; GESTURES; INPUT DEVICES; INTERACTION; MULTI-TOUCH; MULTI-TOUCH GESTURES; TEST ENVIRONMENT;

INTERACTIVE DEVICES;

STANDARDIZATION;

EID: 79952480694     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1936652.1936662     Document Type: Conference Paper

References (38)

1. Appert, C. and Zhai, S. Using strokes as command shortcuts: cognitive benefits and toolkit support. In Proceedings of the 27th international Conference on Human Factors in Computing Systems (Boston, MA, USA, April 04 - 09, 2009). CHI '09. ACM, New York, NY, 2289-2298.
2. Bau, O. & Mackay, W. E. OctoPocus: A Dynamic Guide for Learning Gesture-Based Command Sets. UIST 2008, October 19-22, 2008, Monterey, California, USA.
3. Bimber, O., Encarnacao, L. M., Stork, A. A multi-layered architecture for sketch-based interaction within virtual environments, Computers & Graphics, Volume 24, Issue 6, December 2000, Pages 851-867, ISSN 0097-8493. (Pubitemid 32034354)
4. Buxton, W. Lexical and Pragmatic Considerations of Input Structures. Computer Graphics, 17 (1), 1983, 31-37. (Pubitemid 13486334)
5. Cassell, J. A Framework For Gesture Generation and Interpretation. Computer Vision in Human-Machine Interaction. pp. 191-215. Cambridge University Press. 1998.
6. Codeplex. Multi-Touch Vista. Website. Last Update: 11/20/09, Last Checked: 5/5/2010, Available Online: http://www.codeplex.com/MultiTouchVista.
7. Davies, J., van Harmelen, F., Fensel, D. Towards the Semantic Web: Ontology-driven Knowledge Management. John Wiley & Sons Inc., New York, NY, USA, 2002.
8. De Nardi, A., Gesture Recognition mAnagement Framework for Interactive Tabletop Interfaces. Diploma thesis at University of Pisa. December 2008. Available at: http://grafitiproject.wordpress.com/
9. Dietz, P. and Leigh, D. DiamondTouch: A Multi-User Touch Technology. UIST 2001, 219-226.
10. Echtler, F., and Klinker, G. A multitouch software architecture. In Proceedings of the 5th Nordic Conference on Human-Computer interaction: Building Bridges (Lund, Sweden, October 20 - 22, 2008). NordiCHI '08, vol. 358. ACM, New York, NY, 463-466.
11. Eco, U. A Theory of Semiotics. Indiana University Press, USA, 1979.
12. Fraunhofer-Institute for Industrial Engineering IAO. Multi Touch for Java. Website. Retrieved: 2010-10-15. Available at: http://www.mt4j.org/
13. Freeman, D., Benko, H., Morris, M. R., and Wigdor, D. ShadowGuides: Visualizations for In-Situ Learning of Multi-Touch and Whole-Hand Gestures. In Proceedings of ACM Interactive Tabletops and Surfaces (ITS '09). pp. 165-172, 2009.
14. George, R. & Blake, J. Objects, Containers, Gestures, and Manipulations: Universal Foundational Metaphors of Natural User Interfaces. CHI 2010, April 10-15, 2010, Atlanta, Georgia, USA.
15. Gibbon, D., Gut, U., Hell, B., Looks, K., Thies, A., Trippel, T. A Computational Model of Arm Gestures in Conversation. Proceedings of Eurospeech, 2003, 813-816.
16. Görg, M. T., Cebulla, M., Garzon, S. R., A Framework for Abstract Representation and Recognition of Gestures in Multi-touch Applications, International Conference on Advances in Computer-Human Interaction, pp. 143-147, 2010 Third International Conference on Advances in Computer-Human Interactions, 2010.
17. Hammond, T. and Davis, R. 2007. LADDER, a sketching language for user interface developers. In ACM SIGGRAPH 2007 Courses (San Diego, California, August 05 - 09, 2007). SIGGRAPH '07. ACM, New York, NY, 35.
18. Kaindl, G. Towards a flexible software framework for multi-touch application design. Engineering Patterns for Multi-Touch Interfaces 2010. A workshop of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems. June 20, 2010.
19. Kaltenbrunner, M. TUIO 2.0 Protocol Specification (Draft). January 18th, 2010. Website. Retrieved: 2010-05-282010-04-30. Available at: http://www.tuio.org/?tuio20
20. Kammer, D., Freitag, G., Keck, M., Wacker, M. Taxonomy and Overview of Multi-touch Frameworks: Architecture, Scope, and Features. Engineering Patterns for Multi-Touch Interfaces 2010. A workshop of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems. June 20, 2010.
21. Karam, M., Schraefel, M. C. A taxonomy of Gestures in Human Computer Interaction. ACM Transactions on Computer-Human Interactions (submitted), 2005.
22. Kopp, S., Krenn, B., Marsella, S., Marshall, A. N., Pelachaud C., Pirker, H., Thórisson, K. R., Vilhjálmsson, H. Towards a Common Framework for Multimodal Generation: The Behavior Markup Language. J. Gratch et al. (Eds.): IVA 2006, LNAI 4133, 2006, pp. 205 - 217, Springer-Verlag Berlin Heidelberg. (Pubitemid 44532615)
23. Lao, S., Heng, X., Zhang, G., Ling, Y., and Wang, P. A gestural interaction design model for multi-touch displays. In Proceedings of the 2009 British Computer Society Conference on Human-Computer interaction (Cambridge, United Kingdom, September 01 - 05, 2009). British Computer Society, Swinton, UK, 440-446.
24. Lopez, V., Uren, V., Sabou, M., Motta, E. Cross Ontology Query Answering on the Semantic Web: An Initial Evaluation. K-CAP 2009, September 1-4, 2009, Redondo Beach, California, USA.
25. Meyer, A. S. Gesture Recognition. Website. Retrieved: 2010-10-15. Available at: http://wiki.nuigroup.com/ Gesture Recognition, Nov. 2009.
26. Microsoft®.NET Framework Developer Center. Website. Retrieved: 2010-10-15. Available at: http://msdn.microsoft.com/en-us/netframework/
27. Microsoft® Developer Center. Microsoft® Surface SDK. Website. Retrieved: 2010-10-15. Available at: http://msdn.microsoft.com/en-us/library/ ee804845.aspx
28. Microsoft® Developer Center. Windows Touch. Webseite. Retrieved: 2010-10-15. Available at: http://msdn.microsoft.com/en-us/library/dd562197.aspx
29. Morris, M. R., Huang, A., Paepcke, A., Winograd, T. Cooperative Gestures: Multi-user Gestural Interactions for Co-located Groupware. Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, 2006, pp. 1201-1210, ACM Press. (Pubitemid 44032217)
30. Nespoulous, J.-L., Perron, P., Lecours, A. R. Biological Foundations of Gestures: Motor and Semiotic Aspects. Lawrence Erlbaum Associates, Hillsdale, MJ, 1986.
31. Posner, R. & Debus, S. (Hrsg.). 30 Jahre Zeitschrift für Semiotik 1979 - 2008. Stauffenburg Verlag.
32. Ramanahally, P., Gilbert, S., Niedzielski, T., Velázquez, D., and Anagnost, C. Sparsh UI: A Multi-Touch Framework for Collaboration and Modular Gesture Recognition. Proceedings of the World Conference on Innovative VR. 2009.
33. Sezgin, T. M., Stahovich, T., and Davis, R. Sketch based interfaces: early processing for sketch understanding. In Proceedings of the 2001 Workshop on Perceptive User interfaces (Orlando, Florida, November 15 - 16, 2001). PUI '01, vol. 15. ACM, New York, NY, 1-8.
34. Walther-Franks, B., Schwarten, L., Teichert, J., Krause, M., Herrlich, M., User Detection for a Multi-touch Table via Proximity Sensors, IEEE Tabletops and Interactive Surfaces 2008.
35. Wang, F., Cao, X., Ren, X., Irani, P., Detecting and Leveraging Finger Orientation for Interaction with Direct-Touch Surfaces. UIST'09, October 4-7, 2009, Victoria, British Columbia, Canada.
36. Wigdor, D., Williams, S., Cronin, M., Levy, R., White, K., Mazeev, M., Benko, H. Ripples: Utilizing Per-Contact Visualizations to Improve User Interaction with Touch Displays. UIST 2009, October 4-7, Victoria, British Columbia, Canada.
37. Wobbrock, J. O., Morris, M. R., Wilson, A. D. User-Defined Gestures for Surface Computing. Proceedings of CHI 2009, 1083-1092. April 4-9, Boston Massachusetts, USA.
38. Yee, W., Potential Limitations of Multi-touch Gesture Vocabulary: Differentiation, Adoption, Fatigue. Human-Computer Interaction. Novel Interaction Methods and Techniques, Lecture Notes in Computer Science, 2009, Springer Berlin / Heidelberg, pp. 291-300.