Beyond flat surface computing: Challenges of depth-aware and curved interfaces

MM'09 - Proceedings of the 2009 ACM Multimedia Conference, with Co-located Workshops and Symposiums

Volumn , Issue , 2009, Pages 935-944

  Benko, Hrvoje ^a  

^a MICROSOFT RESEARCH   (United States)

Author keywords

Curved interfaces; Depth sensing cameras; Gestures; Interactive surfaces; Multi touch interactions; Spherical displays; Surface computing

Indexed keywords

CURVED INTERFACE; CURVED INTERFACES; INTERACTIVE SURFACES; MULTI-TOUCH; SURFACE COMPUTING;

APPROXIMATION THEORY; CAMERAS; COMPUTER SUPPORTED COOPERATIVE WORK; DISPLAY DEVICES; METHOD OF MOMENTS; MULTIMEDIA SYSTEMS; RESEARCH; TECHNICAL PRESENTATIONS; THREE DIMENSIONAL; UBIQUITOUS COMPUTING; USER INTERFACES;

SURFACE CHEMISTRY;

EID: 72449170018     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1631272.1631462     Document Type: Conference Paper

References (39)

1. Benko, H., Ishak, E.W., Feiner, S. (2005). Cross-Dimensional Gestural Interaction Techniques for Hybrid Immersive Environments. In Proceedings of IEEE Conference on Virtual Reality (VR). p. 209-116.
2. Benko, H., Wilson, A., and Balakrishnan, R. (2008). Sphere: Multi-Touch Interactions on a Spherical Display. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST). p. 77-86.
3. Benko, H., Wilson, A. (2009). DepthTouch: Using Depth-Sensing Camera to Enable Freehand Interactions On and Above the Interactive Surface. Microsoft Research Technical Report MSR-TR-2009-23. March, 2009.
4. Bowman, D.A., Kruijff, E., LaViola, J.J., and Poupyrev, I. (2004). 3D User Interfaces: Theory and Practice. Addison-Wesley, Boston.
5. Butz, A., Höllerer, T., Feiner, S., MacIntyre, B., and Beshers, C. (1999). Enveloping users and Computers in a Collaborative 3D Augmented Reality. In Proceedings International Workshop on Augmented Reality (IWAR). p. 35-44.
6. Cassinelli, A. and Ishikawa, M. (2005). Khronos projector. In ACM SIGGRAPH 2005 Emerging Technologies. p. 10.
7. Companje, R., van Dijk, N., Hogenbirk, H. and Mast, D. (2007). Globe4D, Time-Traveling with an Interactive Four-Dimensional Globe. In Proceedings of ACM Conference on Multimedia (MULTIMEDIA). p. 959-960.
8. Chen, Y., Au, J., Kazlas, P., Ritenour, A., Gates, H. and McCreary, M. (2003). Flexible Active-Matrix Electronic Ink Display. Nature. 423. p. 136.
9. Cruz-Neira,C., Sandin, D.J., DeFanti, T.A., Kenyon, R.V., and Hart, J.C. (1992). The CAVE: Audio Visual Experience Automatic Virtual Environment. Communications of the ACM. 35, 6. (June 1992). p. 65-72.
10. Cutler, L.D., Fröhlich, B., and Hanrahan, P. (1997). Two-handed Direct Manipulation on the Responsive Workbench. In Proceedings of the ACM Symposium on Interactive 3D Graphics (I3D). p. 107-114.
11. Dietz, P. and Leigh, D. (2001). DiamondTouch: A Multi-User Touch Technology. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST). p. 219-226.
12. Fitzmaurice, G., Khan, A., Buxton, W., Kurtenbach, G., and Balakrishnan, R. (2003). Sentient data access via a diverse society of devices. ACM Queue. p. 53-62.
13. Grossman, T. and Wigdor, D. (2007). Going Deeper: a Taxonomy of 3D on the Tabletop. In Proceedings of the IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP). p.137-144,
14. Grossman, T., Wigdor, D. and Balakrishnan, R. (2004). Multi-Finger Gestural Interaction with 3D Volumetric Displays. In Proceedings of ACM Symposium on User Interface Software and Technology (UIST). p. 61-70.
15. Han, J. (2005). Low-cost multi-touch sensing through frustrated total internal reflection. In Proceedings of ACM Symposium on User Interface Software and Technology (UIST). p. 115-118.
16. Holman, D. and Vertegaal, R. (2008). Organic user interfaces: designing computers in any way, shape, or form. Communications of the ACM 51, 6 (Jun. 2008), p. 48-55.
17. Hua, H., Brown, L. D., Gao, C., and Ahuja, N. (2003). A New Collaborative Infrastructure: SCAPE. In Proceedings of IEEE Virtual Reality (VR). p. 171-179.
18. Iddan, G. J. and Yahav, G. (2001). 3D Imaging in the Studio. SPIE, vol. 4298. p. 48.
19. Izadi, S., Hodges, S., Taylor, S., Rosenfeld, D., Villar, N., Butler, A., and Westhues, J. (2008). Going beyond the display: a surface technology with an electronically switchable diffuser. In Proceedings of ACM Symposium on User interface Software and Technology (UIST). p. 269-278.
20. Kettner, S., Madden, C. and Ziegler, R. (2004). Direct Rotational Interaction with a Spherical Projection. In Proceedings of Creativity & Cognition Symposium on Interaction: Systems, Practice and Theory.
21. Krueger, M. W., Gionfriddo, T., and Hinrichsen, K. (1985). VIDEOPLACE - an artificial reality. SIGCHI Bulletin 16(4) (Apr. 1985). p. 35-40.
22. Kruger, R., Carpendale, S., Scott, S. and Greenberg, S. (2003). How People Use Orientation on Tables: Comprehension, Coordination and Communication. In Proceedings of ACM Conference on Supporting Group Work (SIGGROUP). p. 369-378.
23. Matsushita, N. and Rekimoto, J. (1997). HoloWall: Designing a Finger, Hand, Body, and Object Sensitive Wall. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST). p. 209-210.
24. Pinhanez, C. S. (2001) The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces. In Proceedings of the International Conference on Ubiquitous Computing (UBICOMP). p. 315-331.
25. Piper, B., Ratti, C., and Ishii, H. (2002) Illuminating Clay: A 3-D Tangible Interface for Landscape Analysis. In Proceedings of Conference on Human Factors in Computing Systems (CHI). p. 355-362.
26. Poupyrev, I., Newton-Dunn, H., Bau, O. (2006). D20: Interaction with Multifaceted Display Devices. In Proceedings of Conference on Human Factors in Computing Systems (CHI). Extended Abstracts. p. 1241-1246.
27. Rekimoto, J. and Saitoh, M. (1999). Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In Proceedings of ACM Conference on Human Factors in Computing Systems (CHI). p. 378-385.
28. Rekimoto, J. (2002). SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces. In Proceedings of ACM Conference on Human Factors in Computing Systems (CHI). p. 113-120.
29. Shen, C., Vernier, F., Forlines, C. and Ringel, M. (2004). DiamondSpin: An Extensible Toolkit for Around-the-Table Interaction. In Proceedings of ACM Conference on Human Factors in Computing Systems (CHI). p. 167-174.
30. Starner, T., Leibe, B., Minnen, D., Westeyn, T., Hurst, A., and Weeks, J. (2003). The Perceptive Workbench: Computer-Vision-Based Gesture Tracking, Object Tracking, and 3D Reconstruction for Augmented Desks," Machine Vision and Applications, vol. 14, p. 51-71.
31. Taylor, B. T. and Bove, V. M. (2009). Graspables: grasp-recognition as a user interface. In Proceedings of Conference on Human Factors in Computing Systems (CHI). p. 917-926.
32. st century. Scientific American. 265, 3. December 11, 1991. p. 94-104.
33. Wellner, P. (1993). Interacting with paper on the DigitalDesk. Communications of the ACM. 36, 7 (Jul. 1993). p. 87-96.
34. Wilson, A. (2004). TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction. In Proceedings of the Conference on Multimodal Interfaces (ICMI). p. 69-76.
35. Wilson, A. (2005). PlayAnywhere: A Compact Tabletop Computer Vision System. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST). p. 83-92.
36. Wilson, A. (2006) Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST). p. 255-258.
37. Wilson, A. (2007) Depth-Sensing Video Cameras for 3D Tangible Tabletop Interaction. In Proceedings of the IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP). p. 201-204.
38. Wilson, A. D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., and Kirk, D. 2008. Bringing physics to the surface. In Proceedings of ACM Symposium on User interface Software and Technology (UIST). p. 67-76.
39. Wu, M. and Balakrishnan, R. (2003). Multi-Finger and Whole Hand Gestural Interaction Techniques for Multi-User Tabletop Displays. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST). p. 193-202.