ShadowPuppets: Supporting collocated interaction with mobile projector phones using hand shadows

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2011, Pages 2707-2716

  Cowan, Lisa G ^a   Li, Kevin A ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b AT AND T LABS RESEARCH   (United States)

Author keywords

Gesture; Interaction technique; Mobile projector phone; Projector camera system; Shadow

Indexed keywords

HUMAN COMPUTER INTERACTION;

COLLOCATED INTERACTIONS; GESTURE; INTERACTION TECHNIQUES; LARGE DISPLAYS; MOBILE PROJECTOR PHONE; MOBILE PROJECTORS; PICO-PROJECTORS; PROJECTOR PHONES; PROJECTOR-CAMERA SYSTEM; SHADOW;

TELEPHONE SETS;

EID: 79958150945     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1978942.1979340     Document Type: Conference Paper

References (33)

1. Beardsley, P., Forlines, C., Raskar, R., and VanBaar, J. Handheld Projectors for Mixing Physical and Digital Textures. In Proc. CVPR 2005, 112.
2. Boring, S., Baur, D., Butz, A., Gustafson, S., and Baudisch, P. Touch projector: mobile interaction through video. In Proc. CHI 2010, 2287-2296.
3. Cao, X. and Balakrishnan, R., Interacting with Dynamically Defined Information Spaces using a Handheld Projector and a Pen. In Proc. UIST 2006, 225-234.
4. Cao, X., Forlines, C., and Balakrishnan, R. Multi-user interaction using handheld projectors. In Proc. UIST 2007, 43-52.
5. Cheng, K. and Takatsuka, M. Initial evaluation of a bare-hand interaction technique for large displays using a webcam. In Proc. EICS 2009. 291-296.
6. Cowan, L., Weibel, N., Griswold, W. G., Pina, L., Hollan, J. D. Projector Phone Use: Practices and Social Implications. In Journal of Personal and Ubiquitous Computing, theme issue on Personal Mobile Projection, 2011.
7. Echtler, F., Huber, M., and Klinker, G. Shadow tracking on multi-touch tables. In Proc. AVI 2008, 388-391.
8. Everitt, K. M., Klemmer, S. R., Lee, R., and Landay, J. A. Two worlds apart: bridging the gap between physical and virtual media for distributed design collaboration. In Proc. CHI 2003, 553-560.
9. Freeman, D., Benko, H., Morris, M. R., and Wigdor, D. Sha-dowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures. In Proc. ITS 2009, 165-172.
10. Greaves, A. and Rukzio, E. Evaluation of picture browsing using a projector phone. In Proc. MobileHCI 2008, 351-354.
11. Gustafson, S., Bierwirth, D., Baudisch, P., Imaginary Interfaces: Spatial Interaction with Empty Hands and Without Visual Feedback. In Proc. UIST 2010.
12. Harrison, C., Tan, D., and Morris, D. Skinput: appropriating the body as an input surface. In Proc. CHI 2010, 453-462.
13. Hilliges, O., Izadi, S., Wilson, A. D., Hodges, S., Garcia-Mendoza, A., and Butz, A. Interactions in the air: adding further depth to interactive tabletops. In Proc. UIST 2009, 139-148.
14. Horprasert, T., Harwood D., Davis, L. S. A statistical approach for real-time robust background subtraction and shadow detection. In Proc. ICCV 1999 Workshops.
15. Ishii, H., Kobayashi, M., and Arita, K. Iterative design of seamless collaboration media. Commun. ACM 37, 8 (Aug. 1994), 83-97.
16. Kale, A., Kwan, K., Jaynes, C., Epipolar Constrained User Pushbutton Selection in Projected Interfaces, In Proc. CVPR 2004 Workshops.
17. Kane, S. K., Avrahami, D., Wobbrock, J. O., Harrison, B., Rea, A. D., Philipose, M., and LaMarca, A. Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In Proc. UIST 2009, 129-138.
18. Manresa, C., Varona, J., Mas, R. and Perales, F. (2005) Hand tracking and gesture recognition for human-computer interaction. Electronic Letters on Computer Vision and Image Analysis, 5 (3), 96-104.
19. Mistry, P., Maes, P. and Chang, L., WUW - Wear Ur World - A Wearable Gestural Interface. In Proc. CHI 2009.
20. Norman, D. A., Human-centered Design Considered Harmful. Interactions 12, 4 (Jul./Aug. 2005) 14-19.
21. Pinelle, D., Nacenta, M., Gutwin, C., and Stach, T. The effects of co-present embodiments on awareness and collaboration in tabletop groupware. In Proc. GI 2008.
22. Pinhanez, C. S. The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces, In Proc. Ubicomp 2001, 315-331.
23. Rapp, S., Michelitsch, G., Osen, M., Williams, J., Barbisch, M., Bohan, R., Valsan, Z., and Emele, M. (2004). Spotlight navigation: Interaction with a handheld projection device. In Proc. Pervasive 2004, Video Paper.
24. Segen, J. and Kumar, S. Shadow gestures: 3D hand pose estimation using a single camera, In Proc. CVPR 1999, 479-485.
25. Shoemaker, G., Tang, A., and Booth, K. S. Shadow reaching: a new perspective on interaction for large displays. In Proc. UIST 2007, 53-56.
26. Snibbe, S. S. and Raffle, H. S. Social immersive media: pursuing best practices for multi-user interactive camera/projector exhibits. In Proc. CHI 2009, 1447-1456.
27. Song, H., Grossman, T., Fitzmaurice, G., Guimbretiere, F., Khan, A., Attar, R., Kurtenbach, G. PenLight: Combining a Mobile Projector and a Digital Pen for Dynamic Visual Overlay. In Proc. CHI 2009. 143-152.
28. Song, H., Guimbretiere, F., Grossman, T., and Fitzmaurice, G. MouseLight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector. In Proc. CHI 2010, 2451-2460.
29. Sugimoto, M., Miyahara, K., Inoue, H., and Tsunesada, Y. Ho-taru: Intuitive Manipulation Techniques for Projected Displays of Mobile Devices. Proc. INTERACT 2005, 57-68.
30. Tang, A., Neustaedter, C., Greenberg, S.: Videoarms: embodiments in mixed presence groupware. In Proc. BCS-HCI, 2006.
31. Tang, J. C. and Minneman, S. VideoWhiteboard: video shadows to support remote collaboration. In Proc. CHI 1991, 315-322.
32. Wilson, A. D. Robust computer vision-based detection of pinching for one and two-handed gesture input. In Proc. UIST 2006, 255-258.
33. Wobbrock, J. O., Morris, M. R., and Wilson, A. D. User-defined gestures for surface computing. In Proc. CHI 2009, 1083-1092.