RoomAlive: Magical experiences enabled by scalable, adaptive projector-camera units

UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology

Volumn , Issue , 2014, Pages 637-644

  Jones, Brett ^a,b   Sodhi, Rajinder ^a,b   Murdock, Michael ^a,c   Mehra, Ravish ^a,d   Benko, Hrvoje ^a   Wilson, Andrew D ^a   Ofek, Eyal ^a   MacIntyre, Blair ^a,e   Raghuvanshi, Nikunj ^a   Shapira, Lior ^a  

^a MICROSOFT RESEARCH   (United States)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^d UNIVERSITY OF NORTH CAROLINA   (United States)

^e GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Projection mapping; Projector camera system; Spatial augmented reality

Indexed keywords

AUGMENTED REALITY; CAMERAS; MAPPING;

BASIC BUILDING BLOCK; DESIGN CHALLENGES; DISTRIBUTED FRAMEWORK; GAMING EXPERIENCES; INTERACTIVE PROJECTION; PHYSICAL ENVIRONMENTS; PROJECTOR-CAMERA SYSTEM; SPATIAL AUGMENTED REALITIES;

USER INTERFACES;

EID: 84911993685     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2642918.2647383     Document Type: Conference Paper

References (45)

1. Aliaga, D., Yeung, Y., and Law, A. Fast high-resolution appearance editing using superimposed projections. ACM TOG, (2012).
2. Batlle, J., Mouaddib, E., and Salvi, J. Recent progress in coded structured light as a technique to solve correspondence problem: A survey. Pattern Recognition 31, 7 (1998), 963-982.
3. Behringer, R. Placing Artificial Objects in Real Scenes. Proc. of IWAR, (1998).
4. Benko, H., Jota, R., and Wilson, A. MirageTable: freehand interaction on a projected augmented reality tabletop. ACM CHI, (2012).
5. Bimber, O. and Raskar, R. Spatial augmented reality: Merging real and virtual worlds. AK Peters Ltd, 2005.
6. Bimber, O. PlayReal: SAR Games. http://140.78.90.140/medien/ar/research.php. 2008.
7. Brown, M., Majumder, A., and Yang, R. Camera-based calibration techniques for seamless multiprojector displays. IEEE Visualization and Computer Graphics, (2005).
8. Brox, T., Papenberg, N., and Weickert, J. High Accuracy Optical Flow Estimation Based on a Theory for Warping. IEEE ECCV, (2004).
9. Butler, A., Izadi, S., Hilliges, O., Molyneaux, D., Hodges, S., and Kim, D. Shake ' n ' Sense: Reducing Interference for Overlapping Structured Light Depth Cameras. ACM CHI, (2012), 1933-1936.
10. Cruz-Neira, C., Sandin, D., and DeFanti, T. Surround-screen projection-based virtual reality: the design and implementation of the CAVE. ACM SIGGRAPH, (1993).
11. Fischler, M.A. and Bolles, R.C. Random sample consensus. Communications of the ACM 24, 6 (1981), 381-395.
12. Fuchs, H. and Frahm, J.-M. Scanning and tracking dynamic objects with commodity depth cameras. IEEE ISMAR, (2013).
13. Hancock, M., Nacenta, M., Gutwin, C., and Carpendale, S. The effects of changing projection geometry on the interpretation of 3D orientation on tabletops. Proc. of ITS, (2009).
14. Harrison, C., Benko, H., Wilson, A.D., and Way, O.M. OmniTouch: Wearable multitouch interaction everywhere. ACM UIST, (2011).
15. Hilliges, O., Kim, D., Izadi, S., Weiss, M., and Wilson, A. HoloDesk: direct 3d interactions with a situated see-through display. ACM CHI, (2012).
16. Hou, J., Nam, Y., Peng, W., and Lee, K.M. Effects of screen size, viewing angle, and players' immersion tendencies on game experience. Computers in Human Behavior 28, 2 (2012), 617-623.
17. Illingworth, J. and Kittler, J. A survey of the hough transform. Computer Vision, Graphics, and Image Processing 44, 1 (1988), 87-116.
18. Jones, B.R., Benko, H., Ofek, E., and Wilson, A.D. IllumiRoom: peripheral projected illusions for interactive experiences. ACM CHI, (2013).
19. Jones, B.R., Sodhi, R., Campbell, R.H., Garnett, G., and Bailey, B.P. Build your world and play in it: Interacting with surface particles on complex objects. IEEE ISMAR, (2010).
20. Kainz, B., Hauswiesner, S., Reitmayr, G., et al. OmniKinect: Real-Time Dense Volumetric Data Acquisition and Applications. IEEE VR, (2012).
21. Lee, J.C., Dietz, P.H., Maynes-Aminzade, D., Raskar, R., and Hudson, S.E. Automatic projector calibration with embedded light sensors. ACM UIST, (2004).
22. Mine, M., Rose, D., Yang, B., Jeroen van Baar, and Grundhöfer, A. Projection-Based Augmented Reality in Disney Theme Parks. IEEE Computer 45, 7 (2012), 32-40.
23. Nathan Silberman, Lior Shapira, Ran Gal, P.K. A Contour Completion Model for Augmenting Surface Reconstructions. ECCV, (2014).
24. Newcombe, R.A., Davison, A.J., Izadi, S., et al. KinectFusion: Real-time dense surface mapping and tracking. IEEE ISMAR, (2011).
25. Ng, A., Lepinski, J., Wigdor, D., Sanders, S., and Dietz, P. Designing for Low-Latency Direct-Touch Input. ACM UIST, (2012).
26. OculusVR. http://www.oculusvr.com. 2014.
27. Pinhanez, C. The Everywhere Displays Projector: A Device to create ubiquitous graphical interfaces. Proc. UbiComp, (2001), 315-331.
28. ProCams. http://www.procams.org. 2007.
29. Projection Mapping Central. Projection Mapping Central. http://projection-mapping.org, 2014.
30. R. Sekular, R.B. Perception 2nd Edition. (1990).
31. Raskar, R., van Baar, J., Beardsley, P., Willwacher, T., Rao, S., and Forlines, C. iLamps: geometrically aware and self-configuring projectors. ACM TOG 223, (2003).
32. Raskar, R. and Beardsley, P. A self-correcting projector. IEEE CVPR, (2001).
33. Raskar, R., Brown, M.S., Welch, G., Towles, H., Scales, B., and Fuchs, H. Multi-projector displays using camera-based registration. IEEE Visualization, (1999).
34. Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., and Fuchs, H. The office of the future: A unified approach to image-based modeling and spatially immersive displays. ACM SIGGRAPH, (1998).
35. Raskar, R., Welch, G., and Fuchs, H. Spatially augmented reality. IWAR, (1998).
36. Raskar, R., Welch, G., Low, K.L., and Bandyopadhyay, D. Shader lamps: Animating real objects with image-based illumination. Proc. Eurographics, (2001).
37. Sajadi, B., Member, S., and Majumder, A. Auto-Calibration of Multi-Projector CAVE-like Immersive Environments. ACM TOG 17, 1 (2011), 1-13.
38. Schulze, J.P., Acevedo, D., Mangan, J., Prudhomme, A., Nguyen, P., and Weber, P. Democratizing rendering for multiple viewers in surround VR systems. IEEE 3DUI, (2012).
39. Smith, G., Othenin-girard, A., Whitehead, J., and Wardrip-fruin, N. PCG-Based Game Design: Creating Endless Web. In Proc. of Foundations of Digital Games, (2012).
40. Straka, M., Hauswiesner, S., Ruther, M., and Bischof, H. Rapid Skin: Estimating the 3D Human Pose and Shape in Real-Time. IEEE 3DIMPVT, (2012).
41. Willis, K.D.D., Poupyrev, I., Hudson, S.E., and Mahler, M. SideBySide: Ad-hoc Multi-user Interaction with Handheld Projectors. ACM CHI, (2011).
42. Wilson, A., Benko, H., Izadi, S., and Hilliges, O. Steerable augmented reality with the beamatron. ACM UIST, (2012).
43. Wilson, A.D. and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. ACM UIST, (2010), 273-282.
44. Wilson, A.D. PlayAnywhere: a compact interactive tabletop projection-vision system. ACM UIST, (2005).
45. Xiao, R. and Hudson, S.E. WorldKit: Rapid and Easy Creation of Ad-hoc Interactive Applications on Everyday Surfaces. ACM CHI, (2013).