Emerging frameworks for tangible user interfaces

IBM Systems Journal

Volumn 39, Issue 3-4, 2000, Pages 915-930

  Ullmer, B ^a,b   Ishii, H ^a  

^a MIT MEDIA LAB   (United States)

^b IBM   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

TANGIBLE USER INTERFACES;

HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER SYSTEMS; MATHEMATICAL MODELS;

USER INTERFACES;

EID: 0034516438     PISSN: 00188670     EISSN: None     Source Type: Journal    
DOI: 10.1147/sj.393.0915     Document Type: Article

References (105)

1. G. Fitzmaurice, H. Ishii, and W. Buxton, "Bricks: Laying the Foundations for Graspable User Interfaces," Proceedings ofCHI'95 (1995), pp. 442-449.
2. G. Fitzmaurice, Graspable User Interfaces, Ph.D. thesis, University of Toronto, Toronto (1996).
3. H. Ishii and B. Ullmer, "Tangible Bits: Towards Seamless Interfaces Between People, Bits, and Atoms," Proceedings ofCHI'97 (1997), pp. 234-241.
4. J. Underkoffler and H. Ishii, "Urp: A Luminous-Tangible Workbench for Urban Planning and Design," Proceedings ofCHI'99 (1999), pp. 386-393.
5. J. Underkoffler, B. Ullmer, and H. Ishii, "Emancipated Pixels: Real-World Graphics in the Luminous Room," Computer Graphics Proceedings (SIGGRAPH 99) ( 1999), pp. 385392.
6. S. Burbeck, Applications Programming in Smalltalk-80: How to Use Afodel-View-Controller (1987), See http:// st-www.cs.uiuc.edu/users/smarch/st-docs/mvc.html.
7. J. Coutaz, "PAC, an Object Oriented Model for Dialog Design," Proceedings of Interact'87 (1987), pp. 431-436.
8. The "tangibles" term was used in this context ca. 1994 at Interval Research Corp., associated with the development of the Logjam video logging and ToonTown audio conferencing systems.9'10
9. J. Cohen, M. Withgott, and P. Piernot, "Logjam: A Tangible Multi-Person Interface for Video Logging," Proceedings of CHI'99 (1999).
10. A. Singer, D. Hindus, L. Stifelman, and S. White, "Tangible Progress: Less Is More in Somewire Audio Spaces," Proceedings of CHI'99 (1999).
11. K. MacLean, S. Snibbe, and G. Levin, "Tagged Handles: Merging Discrete and Continuous Manual Control," Proceedings ofCHI'OO (2000), pp. 225-232.
12. D. Reznick, E. Moshkovich, and J. Canny, "Building a Universal Part Manipulator," Distributed Manipulation, Bohringer and Choset, Editors, Kluwer Academic Press, Dordrecht, the Netherlands (1999).
13. B. Ullmer, H. Ishii, and D. Glas, "mediaBlocks: Physical Containers, Transports, and Controls for Online Media," Computer Graphics Proceedings (SIGGRAPH98) (1998), pp. 379-386.
14. B. Ullmer and H. Ishii, "mediaBlocks: Tangible Interfaces for Online Media," CHI'99 Extended Abstracts (video demonstration) (1999), pp. 31-32.
15. B. Ullmer and H. Ishii, "The metaDESK: Models and Pro-totypes for Tangible User Interfaces," Proceedings ofUIST'97 (1997), pp. 223-232.
16. S. Houde and G. Salomon, "Working Towards Rich and Flexible File Representations," Proceedings of INTERCHI'93, Adjunct Proceedings (1993), pp. 9-10.
17. J. Johnson, T. Roberts, W. Verplank, et al., "The Xerox Star: A Retrospective," Computer 22, No. 9, 11-29 (September 1989).
18. M. Familant and M. Detweiler, "Iconic Reference: Evolving Perspectives and an Organising Framework," International Journal of Man-Machine Studies 39,705-728 (1993).
19. M. Got\)tl,Beyond Input Devices: A New Conceptual Framework for the Design of Physical-Digital Objects, M.S. thesis, MIT Media Laboratory, Cambridge, MA (1998).
20. S. McCloud, Understanding Comics: Tlie Invisible Art, Rutgers University Press, London (1993).
21. G. Crampton-Smith, "The Hand That Rocks the Cradle," I.D., 60-65 (May/June 1995).
22. L. Holmquist, J. Redström, and P. Ljungstrand, "TokenBased Access to Digital Information," Proceedings of HUC'99 (1999), pp. 234-245.
23. B. Ullmer, Models and Mechanisms for Tangible User Interfaces, M.S. thesis, MIT Media Laboratory, Cambridge, MA (June 1997).
24. E. Arias, H. Eden, and G. Fisher, "Enhancing Communication, Facilitating Shared Understanding, and Creating Better Artifacts by Integrating Physical and Computational Media for Design," Proceedings ofDIS'97 (1997), pp. 1-12.
25. K. Schäfer, V. Brauer, and W. Bruns, "A New Approach to Human-Computer Interaction-Synchronous Modelling in Real and Virtual Spaces," Proceedings ofDIS'97 (1997), pp. 335-344.
26. J. Underkoffler and H. Ishii, "Illuminating Light: An Optical Design Tool with a Luminous-Tangible Interface," Proceedings ofCHI'98 (1998), pp. 542-549.
27. H. Shwe, Smarter Play for Smart Toys: Ttie Benefits of Technology-Enhanced Play (1999), at http://www.zowie.com/ about/smart.html.
28. M. Fjeld, M. Bichsel, and M. Rauterberg, "BUILD-IT: An Intuitive Design Tool Based on Direct Object Manipulation," Gesture and Sign Language in Human-Computer Interaction, Lecture Notes in Artificial Intelligence, Vol. 1371, Wachsmut and Fröhlich, Editors, Springer-Verlag, Berlin (1998), pp. 297-308.
29. I. Siio, "InfoBinder: A Pointing Device for a Virtual Desktop System," Proceedings of the IHCI'95 (1995).
30. K. Hinckley, R. Pausch, J. Goble, and N. Kassel, "Passive Real-World Interface Props for Neurosurgical Visualization," Proceedings ofCHl'94 (1994), pp. 452-458.
31. D. Small, Rethinking the Book, Ph.D. thesis, MITMedia Laboratory, Cambridge, MA (1999).
32. P. Wellner, "Interacting with Paper on the DigitalDesk," Communications of the ACM 36, No. 7, 86-96 (July 1993).
33. R. Aish, "Three-Dimensional Input for CAAD Systems," Computer-Aided Design 11, No. 2, 66-70 (March 1979).
34. R. Aish and P. Noakes, "Architecture Without NumbersCAAD Based on a 3D Modelling System," Computer-Aidcd Design 16, No. 6, 321-328 (November 1984).
35. J. Frazer, "Three-Dimensional Data Input Devices," Computers/Graphics in the Building Process, Washington (1982).
36. J. Frazer, An Evolutionary Architecture, Architectural Association, London (1994).
37. G. Anagnostou, D. Dewey, and A. Patera, "Geometry-De-fining Processors for Engineering Design and Analysis," Tlie Visitai Computer 5, 304-315 (1989).
38. M. Gorbet, M. Orth, and H. Ishii, "Triangles: Tangible Interface for Manipulation and Exploration of Digital Information Topography," Proceedings ofCHI'98 (1998), pp. 4956.
39. K. Kramer, Maveable Objects, Mobile Code, M.S. thesis, MIT Media Laboratory, Cambridge, MA (1998).
40. M. Resnick, F. Berg, et al., "Digital Manipulative: New Toys to Think With," Proceedings ofCHI'98 (1998), 281-287.
41. K. Kramer and N. Minar, Slackables: Manipulable Distributed Displays (1997), See http://el.www.media.mit.edu/ projects/stackablesJ.
42. K. Heaton, R. Poor, and A. Wheeler, "Nami," Conference Abstracts and Applications of 'SIGGRAPH 99, Emerging Technologies (1999), p. 214.
43. D. Anderson, J. Frankel, J. Marks, et al., "Building Virtual Structures with Physical Blocks" (Demo Description), Proceedings of UIST'99 (1999), pp. 71-72.
44. T. McNerney, Tangible Programming Bricks: An Approach to Making Programming Accessible to Everyone, M.S. thesis, MIT Media Laboratory, Cambridge, MA (2000).
45. R. Perlman, "Using Computer Technology to Provide a Creative Learning Environment for Preschool Children," MIT Logo Memo #24, Cambridge, MA (1976).
46. H. Suzuki and H. Kato, "AlgoBlock: A Tangible Programming Language, a Tool for Collaborative Learning," Proceedings of the Fourth European Logo Conference, Athens, Greece (August 1993), pp. 297-303.
47. R. Abiams,Adi-entures in Tangible Computing: Tlie Work of Interaction DesignerDurrell Bishop, in Context, M.A. thesis, Royal College of Art, London (1999).
48. L. Nelson, S. Ichimura, E. Pedersen, and L. Adams, "Palette: A Paper Interface for Giving Presentations," Proceedings ofCHI'99 (1999), pp. 354-361.
49. H. Ishii, R. Fletcher, et al., "musicBottles," Abstracts and Applications of SIGGRAPH 99, Emerging Technologies (1999), p. 174.
50. N. Jeremijenko, "Voice Boxes: Memesis,"Ars Electronica '96 Festival Catalog, Springer, New York (1996), p. 403.
51. R. Borovoy, Genuine Object-Oriented Programming, M.S. thesis, MIT Media Laboratory, Cambridge, MA (1995).
52. M. Umaschi, "Soft Toys with Computer Hearts: Building Personal Storytelling Environments," CHI'97 ExtendedAbstracts (1997), pp. 20-21.
53. J. Glos and J. Cassell, "Rosebud: Technological Toys for Storytelling," CHI'97 Extended Abstracts (1997), pp. 359360.
54. N. Streitz, J. Geiler, et al., "i-LAND: An Interactive Landscape for Creativity and Innovation," Proceedings ofCHI'99 (1999), pp. 120-127.
55. M. Resnick, "Behavior Construction Kits," Communications of the ACM 36, No. 7, 64-71 (July 1993).
56. P. Frei, V. Su, B. Mikhak, and H. Ishii, "curlybot: Designing a New Class of Computational Toys," Proceedings of CHl'OO (2000), pp. 129-136.
57. A. Dunne and F. Raby, Fields and Thresholds, Presentation at the Doors of Perception 2 (November 1994), See http:// www.mediamatic.nl/doors/Doors2/Doors2Fry.html.
58. M. Weiser and J. S. Brown, Tlie Coming Age of Calm Technology (October 5,1996), See http:/Avww.ubiq.com/hypertext/ weiser/acmfuture2endnote.htm.
59. C. Wisneski, H. Ishii, A. Dahley, M. Gorbet, S. Brave, B. Ullmer, and P. Yarin, "Ambient Displays: Turning Architectual Space into an Interface Between People and Dig-
60. ital Information,"Proceedings of Co Build'9S (1998), pp. 22-32.
61. E. Pedersen and T. Sokoler, "AROMA: Abstract Representation of Presence Supporting Mutual Awareness," Proceedings ofCHl'97 (1997), pp. 51-58.
62. A. Dahley, C. Wisneski, and H. Ishii, "Water Lamp and Pinwheels: Ambient Projection of Digital Information into Architectural Space," Proceedings of CHI'93 Companion (1998), pp. 269-270.
63. H. Kuzuoka and S. Greenberg, "Mediating Awareness and Communication Through Digital But Physical Surrogates," Proceedings of CHI'99 Companion (1999), pp. 11-12.
64. C. Wisneski, The Design of Personal Ambient Displays, M.S. thesis, MIT Media Laboratory, Cambridge, MA (1999).
65. J. Heiner, S. Hudson, and K. Tanaka, "The Information Percolator: Ambient Information Display in a Decorative Object," Proceedings of UIST'99 (1999), pp. 141-148.
66. S. Brave, H. Ishii, and A. Dahley, "Tangible Interfaces for Remote Collaboration and Communication," Proceedings ofCSCW '98 (1998), pp. 169-178.
67. W. Mackay and D. Pagani, "Video Mosaic: Laying Out Time in a Physical Space," Proceedings of Multimédia'94 (1994), pp. 165-172.
68. T. Arai, K. Machii, and S. Kuzunuki, "Retrieving Electronic Documents with Real-World Objects on the InteractiveDESK," Proceedings of VIST'95 (1995), pp. 37-38.
69. L. Stifelman, "Augmenting Real-World Objects: A PaperBased Audio Notebook," Proceedings ofCHI'96 Companion (1996), pp. 199-200.
70. H. Ishii, C. Wisneski, J. Orbanes, B. Chun, and J. Paradiso, "PingPongPIus: Design of an Athletic-Tangible Interface for Computer-Supported Cooperative Play," Proceedings of CHI'99 (1999), pp. 394-401.
71. P. Yarin and H. Ishii, "TouchCounters: Designing Interactive Electronic Labels for Physical Containers," Proceedings of CHI'99 (1999), pp. 362-368.
72. R. Want, K. Fishkin, A. Gujar, and B. Harrison, "Bridging Physical and Virtual Worlds with Electronic Tags," Proceedings of CHI'99 (1999), pp. 370-377.
73. J. Rekimoto and M. Saitoh, "Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments," Proceedings of CHI'99 (1999), pp. 378-385.
74. B. Ullmer, Cognitive Roles of Physical Artifacts in Non-Athletic Games, unpublished manuscript (2000).
75. M. Csikszentmihalyi and E. Rochberg-Halton, The Meaning of Things: Domestic Symbols and the Self, Cambridge University Press, Cambridge, UK (1981).
76. J. Gonzalez, "Autotopographies," Prosthetic Territories: Politics and Hypertechnologies, Westview Press, Boulder, CO, pp. 133-150.
77. J. Zhang, "The Nature of External Representations in Problem Solving," Cognitive Science 21, No. 2,179-217 (1997).
78. J. Zhang and D. Norman, "Representations in Distributed Cognitive Tasks," Cognitive Science 18, 87-122 (1994).
79. J. Gibson, The Ecological Approach to Visual Perception, Erlbaum Associates, New York (1979).
80. D. Norman, Things Tliat Make Us Smart, Addison-Wesley Publishing Co., Reading, MA (1993).
81. E. Hutchins, Cognition in the Wild, MIT Press, Cambridge, MA (1995).
82. M. Scaife and Y. Rogers, "External Cognition: How Do Graphical Representations Work?" International JoumaloJ Human-Computer Studies 45, No. 2, 185-213 (1996).
83. N. Eilan, R. McCarthy, and B. Brewer, Spatial Representation, Blackwell, Oxford, UK (1993).
84. D. Kirsh, "The Intelligent Use of Space," Artificial Intelligence (1995).
85. Y. Guiard, "Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model," Tlie Journal of Motor Behavior 19, No. 4, 486-517 (1987).
86. K. Hinckley et al., "Two-Handed Virtual Manipulation," ACM TOCHI'9S (1998).
87. M. Krampen, "Objects," Encyclopedic Dictionary of Semiotics, Vol. 1, T. Sebeok, Editor, Mouton de Gruyter, New York (1986), pp. 635-639.
88. J. McCarthy, An Introduction to Theoretical Kinematics, MIT Press, Cambridge, MA (1990).
89. Semantic Visions in Design, S. Vihma, Editor, UIAH, Helsinki (1990).
90. B. Shneiderman, "Direct Manipulation: A Step Beyond Programming Languages," Computer 16, 57-69 (1983).
91. D. Fröhlich, "Direct Manipulation and Other Lessons," Handbook of Human-Computer Interaction, 2e, Ch. 21, Elsevier, Amsterdam (1997).
92. D. Gentner and J. Nielsen, "The Anti-Mac Interface," Communications of the ACM 39, No. 8, 70-82 (August 1996).
93. R. Baeza-Yates, Visual Programming (1998), formerly at http:// www-lsi.upc.es/~rbaeza/semAp/vp.html. (Visited August 19, 1998.)
94. J. Larkin and H. Simon, "Why a Diagram Is (Sometimes) Worth Ten Thousand Words," Cognitive Science 11,65-99 (1987).
95. M. Petre, "Why Looking Isn't Always Seeing: Readership Skills and Graphical Programming," Communications of the ACM 38, 33-44 (June 1995).
96. S. Feiner, B. Maclntyre, and D. Seligmann, "KnowledgeBased Augmented Reality," Communications of the ACM 36, No. 7, 52-62 (July 1993).
97. R. Azuma, "A Survey of Augmented Reality," Presence 6, No. 4, 355-385 (August 1997).
98. W. Mackay, "Augmented Reality: Linking Real and Virtual Worlds," (published keynote address), Proceedings of ACM AVI'9S (\WS).
99. P. Milgram and F. Kishino, "A Taxonomy of MLxed Reality Displays," IEICE Transactions on Information Systems, E77D(12) (December 1994).
100. T. Starner, S. Mann, B. Rhodes, J. Levine, J. Healey, D. Kirsch, R. Picard, and A. Pentland, "Augmented Reality Through Wearable Computing," Presence 6, No. 4 (Winter 1997).
101. M. Weiser, "The Computer for the 21st Century," Scientific American 265, No. 3,'94-104 (1991).
102. J. R. Cooperstock, K. Tanikoshi, G. Beirne, T. Narine, and W. Buxton, "Evaluation of a Reactive Environment," Proceedings ofCHI'95 (1995), pp. 170-177.
103. K. Fishkin, T. Moran, and B. Harrison, "Embodied User Interfaces: Towards Invisible User Interfaces," Proceedings ofEHCI'9S (1998).
104. F. Halasz, "Reflections on Notecards: Seven Issues for the Next Generation of Hypermedia Systems," Communications of the ACM 31, No. 7, 836-852 (July 1988).
105. F. Halasz, " 'Seven Issues' Revisited," keynote address. Hypertext'91 Conference (1991), See http:/Avww.parc.xerox.com/ spl/projects/halasz-keynote/ and http://www.csdl.tamu.edu/ -leggett/halasz.html (video).