Toolkit support for integrating physical and digital interactions

Human-Computer Interaction

Volumn 24, Issue 3, 2009, Pages 315-366

  Klemmer, Scott R ^a   Landay, James A ^b  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAR-CODES; DIGITAL INFORMATION; DIGITAL INTERACTIONS; ELECTRONIC TAGS; HIGH-LEVEL ABSTRACTION; IN-FIELD; LABORATORY STUDIES; LIBRARY SUPPORT; LITERATURE REVIEWS; PHYSICAL INTERFACE; PHYSICAL OBJECTS; TECHNICAL EXPERTISE; TOOLKIT SUPPORT; USER INTERFACE DEVELOPMENT;

ABSTRACTING; COMPUTER VISION; DIGITAL LIBRARIES; PAPER; USER INTERFACES;

SURFACE CHEMISTRY;

EID: 68149162627     PISSN: 07370024     EISSN: None     Source Type: Journal    
DOI: 10.1080/07370020902990428     Document Type: Article

References (81)

1. Back, M., Cohen, J., Gold, R., Harrison, S., & Minneman, S. (2001). Listen reader: An electronically augmented paper-based book. CHI Letters, 3(1), 23-29.
2. Ballagas, R., Ringel, M., Stone, M., & Borchers, J. (2003). iStuff: A physical user interface toolkit for ubiquitous computing environments. CHI Letters, 5(1), 537-544.
3. Ballagas, R., Szybalski, A., & Fox, A. (2004). The patch panel: Enabling control-flow interoperability in ubicomp environments. Proceedings of Percom 2004: IEEE International Conference on Pervasive Computing and Communications. Los Alamitos, CA: IEEE Computer Society.
4. Beck, K. (2000). extreme programming eXplained: Mbrace change. Reading, MA: Addison- Wesley.
5. Beckmann, C., & Dey, A. K. (2003). SiteView: Tangibly programming active environments with predictive visualization. Proceedings of Fifth International Conference on Ubiquitous Computing. New York: Springer.
6. Bradski, G. (2001). Open source computer vision library. Retrieved from http://www. intel.com/research/mrl/research/opencv
7. Brooks, F. P. (1987). Essence and accidents of software engineering. IEEE Computer, 20(4), 10-19.
8. Burnett, M., Sheretov, A., Ren, B., & Rothermel, G. (2002). Testing homogeneous spreadsheet grids with the "What you see is what you test" methodology. IEEE Transactions on Software Engineering, 28 6), 576-594.
9. Canny, J. F. (1986). A computational approach to edge detection. Transactions on Pattern Analysis and Machine Intelligence, 8 6), 679-698.
10. Carter, S., Mankoff, J., Klemmer, S. R., & Matthews, T. (2008). Exiting the cleanroom: On ecological validity and ubiquitous computing. Human-Computer Interaction, 23(1), 47-99.
11. Chang, S.-K. (Ed.). (1990). Principles of visual programming systems. Englewood Cliffs, NJ: Prentice Hall.
12. Clarke, S. (2001). Evaluating a new programming language. Proceedings of Workshop of the Psychology of Programming Interest Group. Poole, UK: Bournemouth University.
13. Clarke, S. (2004). Measuring API usability. Dr. Dobbs Journal, 29, S6-S9.
14. De Guzman, E., & Hsieh, G. (2003). Function composition in physical chaining applications. Berkeley, CA: UC Berkeley.
15. De Guzman, E. S., Ramírez, A., & Klemmer, S. R. (2003). Object ClassifierViews: Support for visual programming of image classifiers. Berkeley, CA: UC Berkeley.
16. Détienne, F. (2001). Software design - Cognitive aspects (F. Bott, Trans.). London: Springer Verlag.
17. Dey, A. K., Salber, D., & Abowd, G. D. (2001). A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human-Computer Interaction, 16(2-4), 97-166.
18. Fails, J. A., & Olsen, D. R. (2003). A design tool for camera-based interaction. CHI Letters, 5(1), 449-456.
19. Fishkin, K. P. (2004). A taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous Computing, 8(5), 347-358.
20. Fitzmaurice, G.W., Ishii, H., & Buxton,W. (1995). Bricks: Laying the foundations for graspable user interfaces. Proceedings of CHI: Human Factors in Computing Systems. New York: Addison-Wesley.
21. Forsyth, D. A., & Ponce, J. (2003). Computer vision: A modern approach. Upper Saddle River, NJ: Prentice Hall.
22. Freeman, W. T., Miyake, Y., Tanaka, K.-i., Anderson, D. B., Beardsley, P. A., et al. (1998). Computer vision for interactive computer graphics. IEEE Computer Graphics and Applications, 18(3), 42-53.
23. Gamma, E., Helm, R., Johnson, R., & Vlissides, J. (1995). Design patterns: Elements of reusable object-oriented software. New York: Addison-Wesley.
24. Goldberg, A. (1977). Smalltalk in the classroom (No. SSL 77-2). Palo Alto, CA: Xerox Palo Alto Research Center.
25. Gorbet, M., Orth, M., & Ishii, H. (1998). Triangles: Tangible interface for manipulation and exploration of digital information topography. Proceedings of CHI: ACM Conference on Human Factors in Computing Systems. New York: ACM Press.
26. Grasso, A., Karsenty, A., & Susani, M. (2000). Augmenting paper for community information sharing. Proceedings of DARE 2000: Designing Augmented Reality Environments. New York: ACM Press.
27. Green, T. R. G., & Petre, M. (1996). Usability analysis of visual programming environments. Journal of Visual Languages and Computing 7(2), 131-174.
28. Greenberg, S., & Fitchett, C. (2001). Phidgets: Easy development of physical interfaces through physical widgets. CHI Letters, 3 2), 209-218.
29. Heiner, J. M., Hudson, S. E., & Tanaka, K. (1999). Linking and messaging from real paper in the paper PDA. CHI Letters, 1(1), 179-186.
30. Holmquist, L. E., Redström, J., & Ljungstrand, P. (1999). Token-based access to digital information. Proceedings of Handheld and Ubiquitous Computing. First International Symposium, HUC'99. New York: Springer.
31. Hong, J. I., & Landay, J. A. (2000). SATIN: A toolkit for informal ink-based applications. CHI Letters, 2(2), 63-72.
32. Horn, B. K. P. (1986). Binary images: Topological properties. In Robot vision (pp. 65-89). Cambridge, MA: MIT Press.
33. Ishii, H., & Ullmer, B. (1997). Tangible bits: Towards seamless interfaces between people, bits and atoms. Proceedings of CHI: Human Factors in Computing Systems. New York: ACM Press.
34. Jacob, R., Ishii, H., Pangaro, G., & Patten, J. (2002). A tangible interface for organizing information using a grid. CHI Letters, 4(1), 339-346.
35. Johnson,W., Jellinek, H., Jr., L. K., Rao, R., & Card, S. (1993). Bridging the paper and electronic worlds: The paper user interface. Proceedings of INTERCHI: Human Factors in Computing Systems. New York: ACM Press.
36. Jones, S. P., Blackwell, A., & Burnett, M. (2003). A User-centred approach to functions in Excel. Proceedings of SIGPLAN International Conference on Functional Programming. New York: ACM Press.
37. Kato, H., Billinghurst, M., & Poupyrev, I. (2000). ARToolKit. Retrieved from http://www.hitl.washington.edu/artoolkit/
38. Kelley, J. F. (1984). An iterative design methodology for user-friendly natural language office information applications. ACM Transactions on Office Information Systems, 2(1), 26-41.
39. Klemmer, S. R., Everitt, K., & Landay, J. A. (2008). Integrating physical and digital interactions on walls for fluid design collaboration. Human-Computer Interaction, 23(2), 138-213.
40. Klemmer, S. R., Graham, J.,Wolff, G. J., & Landay, J. A. (2003). Books with voices: Paper transcripts as a tangible interface to oral histories. CHI Letters, 5(1), 89-96.
41. Klemmer, S. R., Li, J., Lin, J., & Landay, J. A. (2004). Papier-Mĉché: Toolkit support for tangible input. CHI Letters 6(1), 399-406.
42. Klemmer, S. R., Sinha, A. K., Chen, J., Landay, J. A., Aboobaker, N., & Wang, A. (2000). SUEDE: A Wizard of Oz prototyping tool for speech user interfaces. CHI Letters, 2(2), 1-10.
43. Krasner, G. E., & Pope, S. T. (1988). A description of the model-view-controller user interface paradigm in the Smalltalk-80 system. Object Oriented Programming, 1(3), 26-49.
44. Landay, J. A., & Myers, B. A. (1993). Extending an existing user interface toolkit to support gesture recognition. Proceedings of Adjunct Proceedings of INTERCHI '93: Human Factors in Computing Systems. New York: ACM Press.
45. Lange, B. M., Jones, M. A., & Meyers, J. L. (1998). Insight lab: An immersive team environment linking paper, displays, and data. Proceedings of CHI: Human Factors in Computing Systems. New York: ACM Press.
46. Lederer, S., & Heer, J. (2004). All together now: Visualizing local and remote actors of localized activity. Proceedings of Extended Abstracts of CHI: Conference on Human Factors in Computing Systems. New York: ACM Press.
47. Liblit, B., Aiken, A., Zheng, A. X., & Jordan, M. I. (2003). Bug isolation via remote program sampling. Proceedings of PLDI: SIGPLAN 2003 Conference on Programming Language Design and Implementation. New York: Association for Computer Machinery.
48. MacIntyre, B., Gandy, M., Dow, S., & Bolter, J. D. (2004). DART: A toolkit for rapid design exploration of augmented reality experiences. CHI Letters, 6(2), 197-206.
49. Mackay,W. E., Fayard, A.-L., Frobert, L., & Medini, L. (1998). Reinventing the familiar: Exploring an augmented reality design space for air traffic control. Proceedings of CHI: Human Factors in Computing Systems. New York: ACM Press.
50. Mackay, W. E., & Pagani, D. (1994). Video mosaic: Laying out time in a physical space. Proceedings of Multimedia, 2, 165-172.
51. Mankoff, J., Hudson, S. E., & Abowd, G. D. (2000). Providing integrated toolkitlevel support for ambiguity in recognition-based interfaces. CHI Letters, 2(1), 368-375.
52. Matthews, T., Dey, A. K., Mankoff, J., Carter, S., & Rattenbury, T. (2004). A toolkit for managing user attention in peripheral displays. CHI Letters, 6(2), 247-256.
53. McGee, D. R., Cohen, P. R., Wesson, R. M., & Horman, S. (2002). Comparing paper and tangible, multimodal tools. CHI Letters, 4 1), 407-414.
54. McGrath, J. E. (1994). Methodology matters: Doing research in the behavioral and social sciences. In R. M. Baecker,W. Buxton, J. Grudin, & S. Greenberg (Eds.), Readings in human-computer interaction: Toward the year 2000, 2nd edition. San Francisco: Morgan Kaufmann.
55. Moran, T. P., Saund, E., van Melle, W., Gujar, A., Fishkin, K. P., & Harrison, B. L. (1999). Design and technology for Collaborage: Collaborative collages of information on physical walls. CHI Letters 1(1), 197-206.
56. Myers, B. A. (1990). A new model for handling input. ACM Transactions on Information Systems, 8(3), 289-320.
57. Myers, B., Hudson, S. E., & Pausch, R. (2000). Past, present, and future of user interface software tools. ACM Transactions on Computer-Human Interaction, 7(1), 3-28.
58. Myers, B. A., McDaniel, R. G., Miller, R. C., Ferrency, A. S., Faulring, A., et al. (1997). The amulet environment: New models for effective user interface software development. IEEE Transactions on Software Engineering, 23(6), 347-365.
59. Myers, B. A., & Rosson, M. B. (1992). Survey on user interface programming. Proceedings of CHI: Human Factors in Computing Systems. New York: ACM Press.
60. Nelson, L., Ichimura, S., Pedersen, E. R., & Adams, L. (1999). Palette: A paper interface for giving presentations. Proceedings of CHI: Human Factors in Computing Systems. New York: ACM Press.
61. Norman, D. A. (1983). Some observations on mental models. In D. Gentner & A. L. Stevens (Eds.), Human-computer interaction in the new millennium (pp. 7-14). Hillsdale, NJ: Erlbaum.
62. Norman, D. (1990). The design of everyday things. New York: Doubleday.
63. Pane, J. (2002). A Programming System for Children that is Designed for Usability. Unpublished doctoral dissertation, CarnegieMellon University, Pittsburgh, Pennsylvania.
64. Poynor, R. (1995). The hand that rocks the cradle. I.D., 42, 60-65.
65. Rekimoto, J., & Ayatsuka, Y. (2000). CyberCode: Designing augmented reality environments with visual tags. Proceedings of Designing Augmented Reality Environments (DARE 2000). New York: ACM Press.
66. Rekimoto, J., & Saitoh, M. (1999). Augmented surfaces: A spatially continuous work space for hybrid computing environments. Proceedings of CHI: Human Factors in Computing Systems. New York: ACM Press.
67. Rekimoto, J., Ullmer, B., & Oba, H. (2001). DataTiles: A modular platform for mixed physical and graphical interactions. CHI Letters 3(1), 269-276.
68. Rodden, K., & Blackwell, A. (2002). Class libraries: A challenge for programming usability research. Proceedings ofWorkshop of the Psychology of Programming Interest Group Isleworth, UK: Brunel University College.
69. Sellen, A. J., & Harper, R. (2001). The myth of the paperless office. Cambridge, MA:MIT Press.
70. Shaer, O., Leland, N., Calvillo-Gamez, E. H., & Jacob, R. J. K. (2004). The TAC paradigm: Specifying tangible user interfaces. Personal and Ubiquitous Computing, 8(5), 359-369.
71. Shneiderman, B. (1986). Empirical studies of programmers: The territory, paths, and destinations. Proceedings of First Workshop on Empirical Studies of Programmers. Norwood, NJ: Ablex.
72. Stifelman, L., Arons, B., & Schmandt, C. (2001). The audio notebook: Paper and pen interaction with structured speech. CHI Letters, 3(1), 182-189.
73. Szekely, P. (1996). Retrospective and challenges for model-based interface development. Proceedings of EurographicsWorkshop on Design, Specification and Verification of Interactive Systems. New York: ACM Press.
74. Ullmer, B., & Ishii, H. (1997). The metaDESK: Models and prototypes for tangible user interfaces. Proceedings of UIST: User Interface Software and Technology. New York: ACM Press.
75. Ullmer, B., & Ishii, H. (2001). Emerging frameworks for tangible user interfaces. In J. M. Carroll (Ed.), Human-computer interaction in the new millennium (pp. 579-601). New York: Addison-Wesley.
76. Ullmer, B., Ishii, H., & Glas, D. (1998). mediaBlocks: Physical containers, transports, and controls for online media. Proceedings of SIGGRAPH 98: 25th International Conference on Computer Graphics and Interactive Technique. New York: ACM Press.
77. Underkoffler, J., & Ishii, H. (1999). Urp: A luminous-tangible workbench for urban planning and design. Proceedings of CHI: ACM Conference on Human Factors in Computing Systems. New York: ACM Press.
78. Underkoffler, J., Ullmer, B., & Ishii, H. (1999). Emancipated pixels: Real-world graphics in the luminous room. Proceedings of SIGGRAPH: Computer Graphics and Interactive Techniques. New York: ACM Press.
79. University of Virginia. (1995). Alice: Rapid prototyping for virtual reality. IEEE Computer Graphics and Applications, 15(3), 8-11.
80. Want, R., Fishkin, K. P., Gujar, A., & Harrison, B. L. (1999). Bridging physical and virtual worlds with electronic tags. Proceedings of CHI: Human Factors in Computing Systems. New York: ACM Press.
81. Wellner, P. (1993). Interacting with paper on the Digital Desk. Communications of the ACM, 36, 87-96.