Exploring the design space of gestural interaction with active tokens through user-defined gestures

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2014, Pages 4107-4116

  Valdes, Consuelo ^a   Eastman, Diana ^a   Grote, Casey ^a   Thatte, Shantanu ^c   Shaer, Orit ^a   Mazalek, Ali ^b   Ullmer, Brygg ^c   Konkel, Miriam K ^c  

^a WELLESLEY COLLEGE   (United States)

^b Georgia Institute of Technology   (United States)

^c LOUISIANA STATE UNIVERSITY   (United States)

Author keywords

Cross device interaction; Gestures; Multi display environments; Physical tokens; Queries; Tabletop

Indexed keywords

DESIGN; HUMAN ENGINEERING; USER INTERFACES;

CROSS-DEVICE INTERACTIONS; GESTURES; MULTI-DISPLAY ENVIRONMENTS; PHYSICAL TOKENS; QUERIES; TABLETOP;

HUMAN COMPUTER INTERACTION;

EID: 84900394522     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2556288.2557373     Document Type: Conference Paper

References (60)

1. (n. d. ). Retrieved from Sifteo: Https://www. sifteo. com/
2. Anthony, L., Brown, Q., Nias, J., Tate, B., & Mohan, S. (2012). Interaction and recognition challenges in interpreting children's touch and gesture input on mobile devices. In Proc. of the ITS, ACM
3. Antle, A. N., & Wise, A. F. (2013). Getting down to details: Using theories of cognition and learning to inform tangible user interface design. Interacting with Computers, 25(1)
4. Antle, A. N., Droumeva, M., & Ha, D. (2009). Hands on what?: Comparing children's mouse-based and tangiblebased interaction. In Proc. of IDC, ACM
5. Block, F., Horn, M. S., Phillips, B. C., Diamond, J., Evans, E. M., & Shen, C. (2012). The DeepTree Exhibit: Visualizing the tree of life to facilitate informal learning. Visualization and Computer Graphics, IEEE, 18(12)
6. Camarata, K., Do, E. Y. L., Johnson, B. R., & Gross, M. D. (2002). Navigational blocks: Navigating information space with tangible media. In Proc. of IUI, ACM
7. Coelho, M., Zigelbaum, J., & Kopin, J. (2011). Six-forty by four-eighty: The post-industrial design of computational materials. In Proc. of TEI. ACM
8. Djajadiningrat, T., Overbeeke, K., & Wensveen, S. (2002). But how, Donald, tell us how?: On the creation of meaning in interaction design through feedforward and inherent feedback. In Proc. of DIS, ACM
9. Drucker, S., Fisher, D., Sadana, R., Herron, J., & Schraefel, M. C. (2013). TouchVix: A Case Study Comparing Two Interfaces for Data Analytics on Tablets. In Proc. of CHI, ACM
10. Epps, J., Lichman, S., & Wu, M. (2006). A study of hand shape use in tabletop gesture interaction. In Proc. of CHI extended abstracts, ACM
11. Findlater, L., Lee, B., & Wobbrock, J. (2012). Beyond QWERTY: Augmenting touch screen keyboards with multitouch gestures for non-alphanumeric input. In Proc. of CHI, ACM
12. Good, M. D., Whiteside, J. A., Wixon, D. R., & Jones, S. J. (1984). Building a user-derived interface. Communications of the ACM, 27(10), 1032-1043
13. Guiard, Y. (1987). Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of motor behavior, 19, 486-517
14. Hinckley, K., Pausch, R., Proffitt, D., Patten, J., & Kassell, N. (1997). Cooperative bimanual action. In Proc. of CHI, ACM
15. Horn, M. S., Tobiasz, M., & Shen, C. (2009). Visualizing biodiversity with voronoi treemaps. In Voronoi Diagrams, IEEE
16. Hornecker, E., Marshall, P., Dalton, N. S., & Rogers, Y. (2008). Collaboration and interference: Awareness with mice or touch input. In Proc. of CSCW, ACM
17. Isenberg, P., Isenberg, T., Hesselmann, T., Lee, B., Von Zadow, U., & Tang, A. (2013). Data visualization on interactive surfaces: A research agenda. Computer Graphics and Applications, IEEE, 33(2), 16-24
18. Jacob, R. J., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T., & Zigelbaum, J. (2008). Realitybased interaction: A framework for post-WIMP interfaces. In Proc. of CHI, ACM
19. Jetter, H. C., Gerken, J., Zöllner, M., Reiterer, H., & Milic-Frayling, N. (2011). Materializing the query with facetstreams: A hybrid surface for collaborative search on tabletops. In Proc. of CHI, ACM
20. Jetter, H.-C., Reiterer, H., and Geyer, F. (2013). Blended Interaction: Understanding natural human-computer interaction in post-WIMP interactive spaces. Personal and Ubiquitous Computing
21. Klum, S., Isenberg, P., Langner, R., Fekete, J. D., & Dachselt, R. (2012). Stackables: Combining tangibles for faceted browsing. In Proc. of AVI. ACM
22. Lahey, B., Girouard, A., Burleson, W., Vertegaal, R., and Canada, K. L. (2011). PaperPhone: Understanding the Use of Bend Gestures in Mobile Devices with Flexible Electronic Paper Displays. In Proc. of CHI, ACM
23. Marshall, P., Hornecker, E., Morris, R., Sheep Dalton, N., & Rogers, Y. (2008). When the fingers do the talking: A study of group participation with varying constraints to a tabletop interface. In Proc. of ITS, IEEE
24. Merrill, D., Kalanithi, J., & Maes, P. (2007). Siftables: Towards sensor network user interfaces. In Proc. of TEI, ACM
25. Micire, M., Desai, M., Courtemanche, A., Tsui, K. M., & Yanco, H. A. (2009). Analysis of natural gestures for controlling robot teams on multi-touch tabletop surfaces. In Proc. of ITS, ACM
26. Microsoft. (n. d. ). Microsoft PixelSense. Retrieved from Microsoft PixelSense: Http://www. microsoft. com/enus/pixelsense/default. aspx
27. Microsoft Surface. (n. d. ). Retrieved from www. microsoft. com/surface
28. Morris, M. R. (2012). Web on the wall: Insights from a multimodal interaction elicitation study. In Proc. of ITS, ACM
29. Morris, M. R., Brush, A. B., & Meyers, B. R. (2007). Reading revisited: Evaluating the usability of digital display surfaces for active reading tasks. In Proc. of ITS,2007, IEEE
30. Morris, M. R., Fisher, D., & Wigdor, D. (2010). Search on surfaces: Exploring the potential of interactive tabletops for collaborative search tasks. Information processing & management, 46(6), 703-717
31. Nature Specials: Big Data. (2013). Retrieved from Nature: Http://www. nature. com/news/specials/bigdata/index. html
32. Nielsen, M., Störring, M., Moeslund, T. B., & Granum, E. (2004). A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In Gesture-Based Communication in HCI. Springer Berlin Heidelberg
33. Norman, D. A. (1999). Affordance, conventions, and design. Interactions, 6(3)
34. Patten, J., & Ishii, H. (2000). A comparison of spatial organization strategies in graphical and tangible user interfaces. In Proc. of DARE, ACM
35. Pyryeskin, D., Hancock, M., & Hoey, J. (2012). Comparing elicited gestures to designer-created gestures for selection above a multi-touch surface. In Proc. of ITS, ACM
36. Rekimoto, J., Ullmer, B., & Oba, H. (2001). DataTiles: A modular platform for mixed physical and graphical interactions. In Proc. of CHI, ACM
37. Russell, D. M., Stefik, M. J., Pirolli, P., & Card, S. K. (1993). The cost structure of sensemaking. In Proc. of CHI, ACM
38. Sacco, G. M., & Tzitzikas, Y. (2009). Dynamic taxonomies and faceted search (Vol. 25). Springer
39. Schkolne, S., Ishii, H., Schroder, P. (2004). Immersive design of DNA molecules with a tangible interface. Visualization, IEEE, pp. 227-234
40. Seyed, T., Burns, C., Costa Sousa, M., Maurer, F., & Tang, A. (2012). Eliciting usable gestures for multi-display environments. In Proc. of ITS, ACM
41. Shaer, O., & Hornecker, E. (2010). Tangible user interfaces: Past, present, and future directions. Foundations and Trends in HCI, 3(1-2)
42. Shaer, O., Leland, N., Calvillo-Gamez, E. H., & Jacob, R. J. (2004). The TAC paradigm: Specifying tangible user interfaces. Personal and Ubiquitous Computing, 8(5)
43. Shaer, O., Mazalek, A., Ullmer, B., & Konkel, M. (2013). From Big Data to Insights: Opportunities and Challenges for TEI in Genomics. In Proc. of TEI. ACM
44. Shaer, O., Strait, M., Valdes, C., Feng, T., Lintz, M., & Wang, H. (2011). Enhancing genomic learning through tabletop interaction. In Proc. of CHI, ACM
45. Shaer, O., Strait, M., Valdes, C., Wang, H., Feng, T., Lintz, M.,. & Liu, S. (2012). The design, development, and deployment of a tabletop interface for collaborative exploration of genomic data. International Journal of Human-Computer Studies, 70(10), 746-764
46. Thudt, A., Hinrichs, U., & Carpendale, S. (2012). The bohemian bookshelf: Supporting serendipitous book discoveries through information visualization. In Proc. of CHI, ACM
47. Ullmer, B., Dell, C., Gill, C., Toole, C., Wiley, C., Dever, Z.,. Parker, R. (2011). Casier: Structures for Composing Tangibles and Complementary Interactors for User Across Diverse Systems. In Proc of TEI, ACM
48. Ullmer, B., Dever, Z., Sankaran, R., Toole, C., Freeman, C., Cassady, B.,. Parker. (2009). Cartouche: Conventions for tangibles bridging diverse interactive systems. In Proc of TEI, ACM
49. Ullmer, B., Ishii, H., & Jacob, R. J. (2005). Token+ constraint systems for tangible interaction with digital information. ACM TOCHI, 12(1), 81-118
50. Ullmer, B., Ishii, H., & Jacob, R. J. (2003). Tangible query interfaces: Physically constrained tokens for manipulating database queries. In Proc. of Interact
51. Valdes, C., Ferreirae, M., Feng, T., Wang, H., Tempel, K., Liu, S., & Shaer, O. (2012). A collaborative environment for engaging novices in scientific inquiry. In Proc. of ITS, ACM
52. van den Hoven, E., Mazalek, A. (2011). Grasping gestures: Gesturing with physical artifacts. AI EDAM 25(3)
53. Vermeulen, J., Luyten, K., van den Hoven, E., and Coninx, C. (2013). Crossing the bridge over Norman's gulf of execution: Revealing feedforward's true identity. In Proc. Of CHI, ACM
54. Vogel, D., & Baudisch, P. (2007). Shift: A technique for operating pen-based interfaces using touch. In Proc of CHI, ACM
55. Voida, S., Tobiasz, M., Stromer, J., Isenberg, P., & Carpendale, S. (2009). Getting practical with interactive tabletop displays: Designing for dense data, fat fingers, diverse interactions, and face-to-face collaboration. In Proc. of the ITS, ACM
56. Weiser, M. (1999). The computer for the 21 st century. ACM SIGMOBILE, 3(3), 3-11
57. Wobbrock, J. O., Morris, M. R., & Wilson, A. D. (2009). User-defined gestures for surface computing. In Proc. of CHI, ACM
58. Wu, M., Shen, C., Ryall, K., Forlines, C., & Balakrishnan, R. (2006). Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces. In Proc. of HIHCS
59. Xu, W., Chang, K., Francisco, N., Valdes, C., Kincaid, R., & Shaer, O. (2013). From wet lab bench to tangible virtual experiment: SynFlo. In Proc. of TEI. ACM
60. Zigelbaum, J., Horn, M. S., Shaer, O., & Jacob, R. J. (2007). The tangible video editor: Collaborative video editing with active tokens. In Proc. of TEI, ACM.