Semiotic analysis of multi-touch interface design: The MuTable case study

International Journal of Human Computer Studies

Volumn 70, Issue 10, 2012, Pages 714-728

  Derboven, Jan ^a   De Roeck, Dries ^b   Verstraete, Mathijs ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b Hogeschool Antwerpen   (Belgium)

Author keywords

Evaluation; Multi touch; Semiotics; Tabletops; User studies

Indexed keywords

EVALUATION; EVALUATION METHOD; INTERFACE DESIGNS; INTERFACE LANGUAGES; MULTI-TOUCH; SEMIOTIC ANALYSIS; TABLETOP APPLICATIONS; TABLETOPS; USER STUDY; USER TESTS;

RESEARCH; SEMIOTICS;

USER INTERFACES;

EID: 84865227650     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2012.05.005     Document Type: Article

References (48)

1. P.B. Andersen A Theory of Computer Semiotics 1990 Cambridge University Press Cambridge
2. P.B. Andersen What Semiotics can and cannot do for HCI Knowledge-Based Systems 14 8 2001 419 424 (Pubitemid 33089204)
3. Apple Inc., 2011. iOS Human Interface Guidelines. User Experience. Available from: 〈http://developer.apple.com/library/ios/documentation/ userexperience/conceptual/mobilehig/MobileHIG.pdf〉 (accessed 20.07.11).
4. T. Apted, J. Kay, and A. Quigley Tabletop sharing of digital photographs for the elderly R. Grinter, T. Rodden, P. Aoki, E. Cutrell, R. Jeffries, G. Olson, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI '06 2006 ACM New York, NY 781 790 (Pubitemid 44032167)
5. Bardzell, J., Bardzell, S. 2008. Interaction criticism: a proposal and framework for a new discipline of hci. In: CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, New York, NY, USA, pp. 24632472.
6. D. Benyon The new HCI? Navigation of information space Knowledge-Based Systems 14 8 2001 425 430 (Pubitemid 33089205)
7. Blackwell, A., 2006. The reification of metaphor as a design tool. In: ACM Transactions on Computer-Human Interaction 13:4. pp. 490530. (Pubitemid 46045661)
8. Brandl, P., Forlines, C., Wigdor, D., Haller, M., Shen, C., 2008. Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces. In: Proceedings of the Working Conference on Advanced Visual Interfaces. AVI08, New York, NY, USA, 2008, pp. 154161.
9. D. Chandler Semiotics. The basics 2002 Routledge London, UK
10. Derboven, J., De Roeck, D., Verstraete, M.,Geerts, D., Schneider-Barnes, J. Luyten,K., 2010. Comparing user interaction with low and high fidelity prototypes of tabletop surfaces. In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI '10), ACM, New York, NY. 148157.
11. C.S. De Souza The semiotic engineering of user interface languages International Journal of Man-Machine Studies 39 5 1993 753 773
12. C.S. De Souza Semiotic approaches to user interface design Knowledge-Based Systems 14 8 2001 415 418 (Pubitemid 33089203)
13. C.S. De Souza The Semiotic Engineering of Human-Computer Interaction (Acting with Technology) 2005 The MIT Press London, UK
14. C.S. De Souza, and C.F. Leito Semiotic Engineering Methods for Scientific Research in HCI 2009 Morgan & Claypool San Francisco, CA
15. De Souza, C.S.,Leito, C.F., Prates, R.O., da Silva, E.J., 2006. The semiotic inspection method In: Proceedings of VII Brazilian Symposium on Human Factors in Computing Systems, IHC '06, 323, ACM, New York, NY. 148157. (Pubitemid 351528632)
16. Hinrichs, U., Carpendale, S., 2011. Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits. In : Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '11. 30233032.
17. H. Kahler Methods & tools. Constructive interaction and collaborative work: introducing a method for testing collaborative systems Interactions 7 3 2000 27 34
18. J. Kjeldskov, and J. Paay Indexicality: understanding mobile human-computer interaction in context ACM Transactions on Computer-Human Interaction 17 4 2010 28
19. Kristensson, P.O., Arnell, O., Bjrk, A., Dahlbck, N., Pennerup, J., Prytz, E., Wikman, J., Astrm, N., 2008. InfoTouch: an explorative multi-touch visualization interface for tagged photo collections. In: Proceedings of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges. NordiCHI '08, ACM, New York, NY. 491494.
20. Mazalek, A., Winegarden, C., Al-Haddad, T., Robinson, S. J., Wu, C., 2009. Architales: physical/digital co-design of an interactive story table. In: Proceedings of the 3rd International Conference on Tangible and Embedded interaction, TEI '09 ACM, New York, NY. 241248.
21. Maximo, A., Saba, M.P., Velho, L., 2009. CollecTable: a natural interface for music collections. In: SIGGRAPH '09: Posters (SIGGRAPH '09). ACM, New York, NY.
22. Merriam-Webster Dictionary, 2011. Metonymy. 〈www.merriam-webster. com/dictionary/metonymy〉 (accessed 19.07.11).
23. Nacenta M.A., Baudish P., Benko H., Wilson A., 2009. Separability of spatial manipulations in multi-touch interfaces. In: Proceedings of the Graphics Interface 2009 (GI '09). 175182.
24. D.A. Norman Natural user interfaces are not natural Interactions 17 3 2010 6 10
25. D.A. Norman, and J. Nielsen Gestural interfaces: a step backward in usability Interactions 17 5 2010 46 49
26. S. O'Neill Interactive Media: The Semiotics of Embodied Interaction 2008 Springer London, UK
27. Pavlus, J., 2010. Synthesizer 76 iPad App Shows Delights and Pitfalls of "Skeuomorphic" UI's. 〈fastcodesign.com〉 (accessed 19.07.11).
28. Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., Saarikko, P., 2008. It's Mine, Don't Touch! Interactions at a large multi-touch display in a city centre. In: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, CHI '08. ACM, New York, NY. 12851294.
29. D. Pinelle, and C. Gutwin Evaluating teamwork support in tabletop groupware applications using collaboration usability analysis Personal and Ubiquitous Computing 12 3 2008 237 254 (Pubitemid 351176346)
30. Piper, A.M., Hollan, J.D., 2009. Tabletop displays for small group study: affordances of paper and digital materials. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, CHI '09. ACM, Boston, MA. 12271236.
31. Piper, A.M., O'Brien, E., Morris, M.R., Winograd, T., 2006. SIDES: a cooperative tabletop computer game for social skills development. In: Proceedings of the 2006 20th Anniversary Conference on Computer Supported Cooperative Work (CSCW '06), ACM, New York, NY. 110. (Pubitemid 47112386)
32. Prates, R.O., Barbosa, S.D., de Souza, C.S., 2000a. A case study for evaluating interface design through communicability. In: Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, ACM, New York, NY. 308316.
33. R.O. Prates, C.S. de Souza, and S.D. Barbosa Methods and tools: a method for evaluating the communicability of user interfaces Interactions 7 1 2000 31 38
34. R.O Prates, C.S. Souza, and P.S. Assis Categorizing communicability evaluation breakdowns in groupware applications. CHI-SA2001 2001 Pretoria RSA
35. D. Saffer Designing Gestural Interfaces: Touch Screens and Interactive Devices 2008 O'Reilly Media Sebastopol, CA
36. J. Schneider, J. Derboven, K. Luyten, C. Vleugels, S. Bannier, D. De Roeck, and M. Verstraete Multi-user multi-touch setups for collaborative learning in an educational setting Lecture Notes in Computer Science 6240 2010 181 188
37. T. Shrimpton-Smith, B. Zaman, and D. Geerts Coupling the users: the benefits of paired user testing for iDTV International Journal of Human-Computer Interaction 24 2 2008 197 213
38. Spindler, M., Stellmach, S., Dachselt, R., 2009. PaperLens: advanced magic lens interaction above the tabletop. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09), ACM, New York, NY. 6976.
39. Tuddenham, P., Robinson, P., 2009. Territorial coordination and workspace awareness in remote tabletop collaboration. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, CHI '09 ACM, Boston, MA. 21392148.
40. Vanacken, D., Demeure, A., Luyten, K., Coninx, K., 2008. Ghosts in the interface: meta-user visualizations as guides for multi-touch interaction. In: Proceedings of the IEEE Tabletops and Interactive Surfaces 2008, Amsterdam, NL. 8790.
41. Vinh, K., 2011. Unnecessary Explanations. 〈subtraction.com〉 Feb 01, 2011 (accessed 25.07.11).
42. Virgin Digital Publishing, 2011. Project Magazine. Available from: 〈http://itunes.apple.com/us/app/project/id404942717?mt=8〉 (accessed 28.07.11).
43. Weiss, M., Wagner, J., Jansen, Y., Jennings, R., Khoshabeh, R., Hollan, J.D., Borchers, J., 2009. SLAP widgets: bridging the gap between virtual and physical controls on tabletops. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems (CHI '09), ACM, New York, NY. 481490.
44. Westerman, 2008. How People Really Use the iPhone. Create with Context Research Report. Available from: 〈www.createwithcontext.com/how-people- really-use-the-iphone.html〉 (accessed 15.01.12).
45. D. Wigdor, and D. Wixon Brave NUI World 2011 Morgan Kauffman Burlington, MA
46. Wigdor, D., Williams, S., Cronin, M., Levy, R., White, K., Mazeev, M., Benko, H., 2009. Ripples: utilizing per-contact visualizations to improve user interaction with touch displays. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (UIST '09), ACM, New York, NY. 312.
47. Wixon, D., 2008.The challenge of emotional innovation. UX Week. Available from: 〈http://vimeo.com/2893051〉 (accessed 19.07.11).
48. Wobbrock, J.O., Morris, M.R., Wilson, A.D., 2009. User-defined gestures for surface computing. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, CHI '09 ACM, New York, NY. 10831092.