Interactive 3D modeling of indoor environments with a consumer depth camera

UbiComp'11 - Proceedings of the 2011 ACM Conference on Ubiquitous Computing

Volumn , Issue , 2011, Pages 75-84

  Du, Hao ^a   Henry, Peter ^a   Ren, Xiaofeng ^b   Cheng, Marvin ^a   Goldman, Dan B ^c   Seitz, Steven M ^a   Fox, Dieter ^a,b  

^a University of Washington   (United States)

^b INTEL CORPORATION   (United States)

^c ADOBE RESEARCH   (United States)

Author keywords

3d mapping; depth camera; localization; user interaction

Indexed keywords

3-D MAPPING; 3-D MODELING; 3D LOCALIZATION; 3D MODELS; 3D REGISTRATION; CONTEXTUAL INFORMATION; DEPTH CAMERA; HUMAN ERRORS; INDOOR ENVIRONMENT; INDOOR SPACE; INTERACTIVE VISUALIZATIONS; LOCALIZATION; MOBILE SYSTEMS; ON-THE-FLY; ONLINE FEEDBACK; PERSONAL SPACES; PROTOTYPE SYSTEM; TECHNICAL CHALLENGES; USER INTERACTION; VISION BASED; VISUAL MODEL;

CAMERAS; ERRORS; HUMAN COMPUTER INTERACTION; LAPTOP COMPUTERS; THREE DIMENSIONAL COMPUTER GRAPHICS; UBIQUITOUS COMPUTING; USER INTERFACES; VISUALIZATION;

THREE DIMENSIONAL;

EID: 80054072711     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2030112.2030123     Document Type: Conference Paper

References (33)

1. S. Agarwal, N. Snavely, I. Simon, S. Seitz, and R. Szeliski. Building Rome in a Day. In Computer Vision and Pattern Recognition (CVPR), pages 72-79, 2010.
2. M. Azizyan, I. Constandache, and R. Roy Choudhury. Surroundsense: Mobile Phone Localization via Ambience Fingerprinting. In International Conference on Mobile Computing and Networking, pages 261-272. ACM, 2009.
3. P. Bahl and V. Padmanabhan. RADAR: An In-building RF-based User Location and Tracking System. In INFOCOM 2000, volume 2, pages 775-784. IEEE, 2000.
4. L. Clemente, A. Davison, I. Reid, J. Neira, and J. Tardós. Mapping Large Loops with a Single Hand-Held Camera. In Robotics Science and Systems (RSS), 2007.
5. A. Davison, I. Reid, N. Molton, and O. Stasse. MonoSLAM: Real-time Single Camera SLAM. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), pages 1052-1067, 2007. (Pubitemid 46667415)
6. P. Debevec, C. J. Taylor, and J. Malik. Modeling and Rendering Architecture from Photographs: A Hybrid Geometryand Image-based Approach. In SIGGRAPH, 1996.
7. D. Fox, W. Burgard, F. Dellaert, and S. Thrun. Monte Carlo Localization: Efficient Position Estimation for Mobile Robots. In AAAI, pages 343-349, 1999.
8. Y. Furukawa, B. Curless, S. Seitz, and R. Szeliski. Manhattan-world Stereo. In Computer Vision and Pattern Recognition (CVPR). IEEE, 2009.
9. Y. Furukawa, B. Curless, S. M. Seitz, and R. Szeliski. Reconstructing Building Interiors from Images. In Intl. Conference on Computer Vision (ICCV), 2009.
10. Y. Furukawa and J. Ponce. Accurate, Dense, and Robust Multi-view Stereopsis. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2009.
11. R. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, 2003.
12. P. Henry, M. Krainin, E. Herbst, X. Ren, and D. Fox. RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments. In Intl. Symposium on Experimental Robotics (ISER), 2010.
13. J. Hightower and G. Borriello. Location Systems for Ubiquitous Computing. Computer, 34(8):57-66, 2001. (Pubitemid 32742945)
14. B. K. P. Horn. Closed-form Solution of Absolute Orientation using Unit Quaternions. J. Opt. Soc. Am. A, 4(4):629-642, 1987.
15. G. Klein and D. W. Murray. Parallel Tracking and Mapping for Small AR Workspaces. In Intl. Symposium on Mixed and Augmented Reality, 2007.
16. K. Konolige, J. Bowman, J. D. Chen, P. Mihelich, M. Calonder, V. Lepetit, and P. Fua. View-Based Maps. Intl. Journal of Robotics Research (IJRR), 29(10), 2010.
17. A. LaMarca, Y. Chawathe, S. Consolvo, J. Hightower, I. Smith, J. Scott, T. Sohn, J. Howard, J. Hughes, F. Potter, J. Tabert, P. Powledge, G. Borriello, and B. Schilit. Place Lab: Device Positioning using Radio Beacons in the Wild. Pervasive Computing, pages 116-133, 2005.
18. A. LaMarca, J. Hightower, I. Smith, and S. Consolvo. Self-mapping in 802.11 Location Systems. Ubiquitous Computing (UbiComp), pages 87-104, 2005.
19. Microsoft Kinect. http://www.xbox.com/en-US/kinect, 2010.
20. R. A. Newcombe and A. J. Davison. Live Dense Reconstruction with a Single Moving Camera. In Computer Vision and Pattern Recognition (CVPR), 2010.
21. D. Nistér, O. Naroditsky, and J. Bergen. Visual Odometry. In Computer Vision and Pattern Recognition (CVPR). IEEE, 2004.
22. V. Otsason, A. Varshavsky, A. LaMarca, and E. De Lara. Accurate GSM Indoor Localization. Ubiquitous Computing (UbiComp), pages 141-158, 2005.
23. S. Patel, K. Truong, and G. Abowd. Powerline Positioning: A Practical Sub-room-level Indoor Location System for Domestic Use. Ubiquitous Computing (UbiComp), pages 441-458, 2006.
24. M. Pollefeys, D. Nister, J.-M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S.-J. Kim, P. Merrell, C. Salmi, S. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewenius, R. Yang, G. Welch, and H. Towles. Detailed Real-Time Urban 3D Reconstruction From Video. Intl. Journal on Computer Vision (IJCV), 72(2):143-67, 2008. (Pubitemid 351406110)
25. PrimeSense. http://www.primesense.com/.
26. S. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski. A Comparison and Evaluation of Multi-view Stereo Reconstruction Algorithms. In Computer Vision and Pattern Recognition (CVPR), volume 1, pages 519-528, 2006.
27. S. Sinha, D. Steedly, R. Szeliski, M. Agrawala, and M. Pollefeys. Interactive 3D architectural modeling from unordered photo collections. ACM Transactions on Graphics (TOG), 27(5):1-10, 2008.
28. N. Snavely, S. M. Seitz, and R. Szeliski. Photo Tourism: Exploring Photo Collections in 3D. In SIGGRAPH, 2006.
29. P. Sturm and S. Maybank. A Method for Interactive 3D Reconstruction of Piecewise Planar Objects from Single Images. In British Machine Vision Conference (BMVC), pages 265-274, 1999.
30. S. Thrun, W. Burgard, and D. Fox. Probabilistic Robotics. The MIT Press, 2005.
31. B. Triggs, P. McLauchlan, R. Hartley, and A. Fitzgibbon. Bundle Adjustment: A Modern Synthesis. Vision Algorithms: Theory and Practice, pages 153-177, 2000.
32. O. Woodman and R. Harle. Pedestrian Localisation for Indoor Environments. In Ubiquitous Computing (UbiComp), pages 114-123. ACM, 2008.
33. C. Wu. SiftGPU: A GPU implementation of scale invariant feature transform (SIFT). http://cs.unc.edu/~ccwu/siftgpu, 2007.