Reality-Based interaction: A framework for post-WIMP interfaces

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2008, Pages 201-210

  Jacob, Robert J K ^a   Shaer, Orit ^a   Girouard, Audrey ^a   Hirshfield, Leanne M ^a   Horn, Michael S ^a   Solovey, Erin Treacy ^a   Zigelbaum, Jamie ^a,b  

^a Tufts University   (United States)

^b MIT MEDIA LAB   (United States)

Author keywords

Context aware; Interaction styles; Multimodal; Next generation; Post WIMP interfaces; Reality Based Interaction; Tangible interfaces; Ubiquitous computing; Virtual reality

Indexed keywords

INTERACTIVE COMPUTER SYSTEMS; UBIQUITOUS COMPUTING; VIRTUAL REALITY;

CONTEXT-AWARE; INTERACTION STYLES; MULTI-MODAL; NEXT-GENERATION; POST-WIMP INTERFACES; REALITY-BASED INTERACTION; TANGIBLE INTERFACES;

HUMAN COMPUTER INTERACTION;

EID: 57649149068     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1357054.1357089     Document Type: Conference Paper

References (56)

1. Abowd, G.D. and Dix, A.J., Integrating Status and Event Phenomena in Formal Specifications of Interactive Systems. in Proc. SIGSOFT 1994, (1994), Addison-Wesley/ACM Press.
2. Agarawala, A. and Balakrishnan, R. Keepin' it real: pushing the desktop metaphor with physics, piles and the pen Proc. CHI2006, ACM Press, 2006.
3. Ängeslevä, J., Oakley, I., Hughes, S. and O'Modhrain, S., Body Mnemonics Portable device interaction design concept, in UIST, (2003).
4. Apted, T., Kay, J. and Quigley, A. Tabletop sharing of digital photographs for the elderly Proc. of SIGCHI, ACM Press, 2006.
5. Bae, S.-H., Kobayash, T., Kijima, R. and Kim, W.-S., Tangible NURBS-curve manipulation techniques using graspable handles on a large display. in Proc. UIST 2004, (2004), ACM Press, 81-90.
6. Beaudouin-Lafon, M. Instrumental Interaction: An Interaction Model for Designing Post-WIMP User Interfaces Proc. CHI 2000, Addison-Wesley/ACM Press, 2000, 446-453.
7. Beeharee, A. and Steed, A. Exploiting real world knowledge in ubiquitous applications. Personal and Ubiquitous Computing, 11. 429-437.
8. Bellotti, V., Back, M., Edwards, W.K., Grinter, R.E., Henderson, A. and Lopes, C. Making Sense of Sensing Systems: Five Questions for Designers and Researchers Proc. CHI 2002, ACM Press, 2002, 415-422.
9. Benford, S., Schnadelbach, H., Koleva, B., Anastasi, R., Greenhalgh, C., Rodden, T., Green, J., Ghali, A., Pridmore, T., Gaver, B., Boucher, A., Walker, B., Pennington, S., Schmidt, A., Gellersen, H. and Steed, A. Expected, sensed, and desired: A framework for designing sensing-based interaction. ACM Transactions Computer-Human Interaction, 12 (1). 3-30.
10. Bowman, D.A., Kruijff, E., LaViola, J.J. and Poupyrev, I. 3D User Interfaces: Theory and Practice. Addison-Wesley/Pearson Education, 2004.
11. Buur, J., Jensen, M.V. and Djajadiningrat, T., Please touch tangible UIs: Hands-only scenarios and video action walls: novel methods for tangible user interaction design, in Proc. DIS'04, (2004).
12. Buxton, B. http://www.billbuxton.com/multitouchOverview.html, 2007.
13. Christou, G. Towards a new method for the evaluation of reality based interaction CHI '07 extended abstracts, ACM, San Jose, CA, USA, 2007.
14. Coutrix, C. and Nigay, L. Mixed reality: a model of mixed interaction. Proceedings of the working conference on Advanced visual interfaces.
15. Dickie, C., Vertegaal, R., Sohn, C. and Cheng, D. eyeLook: using attention to facilitate mobile media consumption Proc. UIST 2005, ACM Press, 2005.
16. Dourish, P. Where The Action Is: The Foundations of Embodied Interaction, MIT Press, Cambridge, Mass., 2001.
17. Dubois, E. and Gray, P. A Design-Oriented Information-Flow Refinement of the ASUR Interaction Model. Proceedings of EHCI 2007.
18. Fishkin, K.P. A Taxonomy for and Analysis of Tangible Interfaces. Personal and Ubiquitous Computing, 8 (5). 347-358.
19. Fishkin, K.P., Moran, T.P. and Harrison, B.L. Embodied User Interfaces: Toward Invisible User Interfaces Proc. of EHCI'98, 1998.
20. Forlines, C. and Shen, C., Touch: DTLens: multi-user tabletop spatial data exploration. in Proc. UIST 2005, (2005).
21. Hayes, P.J. The second naive physics manifesto Cognitive Science Technical Report URCS-10, University of Rochester, 1983.
22. Hornecker, E. and Buur, J., Getting a Grip on Tangible Interaction: A Framework on Physical Space and Social Interaction. in Proc. of CHI 2006, (2006), ACM, 437-446.
23. Hurtienne, J. and Israel, J.H. Image schemas and their metaphorical extensions: intuitive patterns for tangible interaction Proc. TEI 2007, ACM Press, 2007.
24. Hutchins, E.L., Hollan, J.D. and Norman, D.A. Direct Manipulation Interfaces. Draper, D.A.N.a.S.W. ed. User Centered System Design: New Perspectives on Human-computer Interaction, Lawrence Erlbaum, Hillsdale, N.J., 1986, 87-124.
25. Jackson, R.L. and Fagan, E., Collaboration and learning within immersive virtual reality. in Proc. Collaborative Virtual Environments, (2000), ACM Press, 83-92.
26. Jacob, R.J.K., Girouard, A., Hirshfield, L.M., Horn, M.S., Shaer, O., Solovey, E.T. and Zigelbaum, J., Reality-Based Interaction: Unifying the New Generation of Interaction Styles (Work in Progress paper), in CHI 2007, (2007), 2465-2470.
27. Jacob, R.J.K., Girouard, A., Horn, M., Miller, L., Shaer, O., Treacy, E. and Zigelbaum, J. What Is the Next Generation of Human-Computer Interaction? interactions, 2007.
28. Kalanithi, J. Connectibles: Tangible Social Networking, MS Thesis, MIT Media Lab, Cambridge, 2007, 132pp.
29. Klemmer, S.R., Hartmann, B. and Takayama, L., How bodies matter: five themes for interaction design. in Proc. DIS 2006, (2006), ACM Press, 140-149.
30. MacLean, A., Young, R.M., Bellotti, V.M.E. and Moran, T.P. Questions, Options, and Criteria: Elements of Design Space Analysis. Human-Computer Interaction, 6. 201-250.
31. Maeda, J. The Laws of Simplicity (Simplicity: Design, Technology, Business, Life). The MIT Press, 2006.
32. Merrill, D. and Maes, P., Augmenting Looking, Pointing and Reaching Gestures to Enhance the Searching and Browsing of Physical Objects. in Proc. Pervasive'07, (2007).
33. Milgram, P. and Kishino, F., Augmented reality: A class of displays on the reality-virtuality continuum. in SPIE, (1994), 282-292.
34. Mohler, B.J., Thompson, W.B., Creem-Regehr, S.H., Willemsen, P., Herbert L. Pick, Jr. and Rieser, J.J. Calibration of locomotion resulting from visual motion in a treadmill-based virtual environment. ACM Trans. Appl. Percept., 4 (1). 4.
35. Nielsen, J. Noncommand User Interfaces Comm. ACM, 1993, 83-99.
36. Poupyrev, I., Newton-Dunn, H. and Bau, O. D20: interaction with multifaceted display devices CHI '06 extended abstracts, ACM Press, 2006.
37. Rohrer, T. Metaphors We Compute By: Bringing Magic into Interface Design, Center for the Cognitive Science of Metaphor, Philosophy Department, University of Oregon, 1995.
38. Second Life. http://secondlife.com/.
39. Shneiderman, B. Direct Manipulation. A Step Beyond Programming Languages. IEEE Transactions on Computers, 16 (8). 57.
40. Shneiderman, B. Leonardo's Laptop: Human Needs and the New Computing Technologies, MIT Press, Cambridge, Mass., 2002.
41. Shneiderman, B. Why Not Make Interfaces Better Than 3D Reality? IEEE Computer Graphics and Applications, 2003, 12-15.
42. Slater, M., Usoh, M. and Steed, A. Taking steps: the influence of a walking technique on presence in virtual reality. ACM Trans. Comput.-Hum. Interact., 2 (3). 201-219.
43. Smith, J.D., Vertegaal, R. and Sohn, C., ViewPointer: lightweight calibration-free eye tracking for ubiquitous handsfree deixis. in Proc. UIST 2005, (2005).
44. Streitz, N.A., Tandler, P., Muller-Tomfelde, C. and Konomi, S. Roomware: Toward the Next Generation of Human-Computer Interaction Based on an Integrated Design of Real and Virtual Worlds. Carroll, J.M. ed. Human-Computer Interaction in the New Millenium, Addison-Wesley/ACM Press, Reading, Mass., 2001.
45. Tanriverdi, V. A Virtual Reality Interface Design (VRID) Model and Methodology, Tufts University, 2001.
46. Tanriverdi, V. and Jacob, R.J.K., Interacting with Eye Movements in Virtual Environments. in Proc. CHI 2000, (2000), Addison-Wesley/ACM Press, 265-272.
47. Ullmer, B. and Ishii, H. Emerging Frameworks for Tangible User Interfaces. Carroll, J.M. ed. Human-Computer Interaction in the New Millenium, Addison-Wesley/ACM Press, Reading, Mass., 2001.
48. Ullmer, B., Ishii, H. and Jacob, R.J.K. Token+Constraint Systems for Tangible Interaction with Digital Information ACM TOCHI, 2005, 81-118.
49. Underkoffler, J. and Ishii, H. Urp: A Luminous-Tangible Workbench for Urban Planning and Design Proc. CHI'99, Addison-Wesley/ACM Press, 1999, 386-393.
50. Usoh, M., Arthur, K., Whitton, M.C., Bastos, R., Steed, A., Slater, M. and Brooks, F.P. Walking > walking-inplace > flying, in virtual environments Proc. SIGGRAPH'99, Addison-Wesley/ACM Press, 1999, 359-364.
51. Van Dam, A. Post-WIMP user interfaces. Commun. ACM, 40 (2). 63-67.
52. Vinson, N.G. Design guidelines for landmarks to support navigation in virtual environments Proc CHI, ACM Press, 1999, 278-285.
53. Vogel, D. and Balakrishnan, R., Distant freehand pointing and clicking on very large, high resolution displays. in Proc. UIST 2005, (2005).
54. Warren, J. A Wii Workout: When Videogames Hurt Wall Street Journal Online, 2006.
55. Weiser, M. The Computer for the Twenty-first Century Scientific American, 1991, 94-104.
56. Zigelbaum, J., Horn, M., Shaer, O. and Jacob, R., The tangible video editor: collaborative video editing with active tokens. in Proc. TEI '07, (2007), ACM, 43-46.