Combining monoSLAM with object recognition for scene augmentation using a wearable camera

Image and Vision Computing

Volumn 28, Issue 11, 2010, Pages 1548-1556

  Castle, R O ^a   Klein, G ^a   Murray, D W ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Augmented reality; Object recognition; Simultaneous localization and mapping; Wearable vision

Indexed keywords

AUGMENTED REALITY; CAMERAS; GESTURE RECOGNITION; MAPPING; MATHEMATICAL TECHNIQUES; OBJECT RECOGNITION; VIRTUAL REALITY;

2D IMAGES; 3-D ENVIRONMENTS; 3-D MEASUREMENT; AUGMENTED REALITY APPLICATIONS; SIMULTANEOUS LOCALIZATION AND MAPPING; VISUAL COMPUTING; WEARABLE CAMERAS; WEARABLE VISION;

THREE DIMENSIONAL;

EID: 77955430087     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2010.03.009     Document Type: Article

References (42)

1. P. Bunnun, W. Mayol-Cuevos, OutlinAR: an assisted interactive model building system with reduced computation effort, in: Proc. 7th IEEE/ACM Int. Symp. on Mixed and Augmented Reality, 2008, pp. 61-64.
2. A. van den Hengel, A. Dick, T. Thormählen, B. Ward, and P.H.S. Torr VideoTrace: rapid interactive scene modelling from video ACM Transactions on Graphics 26 3 2007 (Article 86)
3. D.G. Lowe Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2 2004 91 110
4. A.J. Davison, I.D. Reid, N. Molton, and O. Stasse MonoSLAM: real-time single camera SLAM IEEE Transactions on Pattern Analysis and Machine Intelligence 29 6 2007 1052 1067
5. D. Ashbrook, and T. Starner Using GPS to learn significant locations and predict movement across multiple users Personal and Ubiquitous Computing 7 5 2003 275 286
6. R. Hariharan, K. Toyama, Project lachesis: parsing and modeling location histories, in: Proc. 3rd Int. Conf. on Geographic Information Science, 2004, pp. 106-124.
7. L. Liao, D. Fox, and H. Kautz Extracting places and activities from GPS traces using hierarchical conditional random fields International Journal of Robotics Research 26 1 2007 119 134
8. A. Pentland Looking at people: sensing for ubiquitous and wearable computing IEEE Transactions on Pattern Analysis and Machine Intelligence 22 1 2000 107 119 (Pubitemid 32132957)
9. M. Kourogi, T. Kurata, K. Sakaue, A panorama-based method of personal positioning and orientation and its real-time applications for wearable computers, in: Proc. 5th IEEE Int. Symp. on Wearable Computing, 2001, pp. 107-114.
10. E. Foxlin, Generalized architecture for simultaneous localization, auto-calibration and map-building, in: Proc. IEEE/RSJ Conf. on Intelligent Robots and Systems, 2002, pp. 527-533.
11. M. Pollefeys, L. Van Gool, M. Vergauwen, F. Verbiest, K. Cornelis, J. Tops, and R. Koch Visual modeling with a hand-held camera International Journal of Computer Vision 59 3 2004 207 232
12. A.W. Fitzgibbon, A. Zisserman, Automatic camera recovery for closed or open image sequences, in: Proc. 5th European Conf. on Computer Vision, LNCS, vol. 1406, Springer, 1998, pp. 311-326.
13. D. Nistér, Automatic Dense Reconstruction from Uncalibrated Video Sequences, PhD thesis, Royal Institute of Technology KTH, Stockholm, Sweden (March 2001).
14. R.C. Smith, and P. Cheeseman On the representation and estimation of spatial uncertainty International Journal of Robotics Research 5 4 1986 56 68
15. J.J. Leonard, H.F. Durrant-Whyte, and I.J. Cox Dynamic map building for an autonomous mobile robot International Journal of Robotics Research 11 8 1992 286 298
16. S. Thrun, W. Burgard, and D. Fox Probabilistic Robotics 2005 MIT Press Cambridge MA
17. D. Nistér, O. Naroditsky, J. Bergen, Visual odometry for ground vehicle applications, Journal of Field Robotics 23 (1).
18. E. Mouragnon, F. Dekeyser, P. Sayd, M. Lhuillier, M. Dhôme, Real time localization and 3d reconstruction, in: Proc. 24th IEEE Conf. on Computer Vision and Pattern Recognition, 2006, pp. 363-370.
19. G. Klein, D.W. Murray, Parallel tracking and mapping for small AR workspaces, in: Proc. 6th IEEE/ACM Int. Symp. on Mixed and Augmented Reality, 2007, pp. 225-234.
20. A.J. Davison, Real-time simultaneous localisation and mapping with a single camera, in: Proc. 9th IEEE Int. Conf. on Computer Vision, 2003, pp. 1403-1410.
21. R.C. Smith, M. Self, and P. Cheeseman Estimating uncertain spatial relationships in robotics I. Cox, G. Wilfong, Autonomous Robot Vehicles 1990 Springer-Verlag New York 167 193
22. J.J. Leonard, and H.F. Durrant-Whyte Directed Sonar Sensing for Mobile Robot Navigation 1992 Kluwer Academic Boston, MA
23. A.J. Davison, D.W. Murray, Mobile robot localisation using active vision, in: Proc. 5th European Conf. on Computer Vision, LNCS, vol. 1407, Springer, Berlin, Heidelberg, 1998, pp. 809-825.
24. J.G.H. Knight, A.J. Davison, I.D. Reid, Towards constant time SLAM using postponement, in: Proc. IEEE/RSJ Conf. on Intelligent Robots and Systems, 2001, pp. I:406-412.
25. J.J. Leonard, P.M. Newman, Consistent, convergent and constant-time SLAM, in: Int. Joint Conf. on Artificial Intelligence, 2003, vol. 18, Morgan Kaufmann, 2003, pp. 1143-1150.
26. S. Thrun, Y. Liu, D. Koller, A.Y. Ng, Z. Ghahramani, and H. Durrant-Whyte Simultaneous localization and mapping with sparse extended information filters International Journal of Robotics Research 23 7-8 2004 693 716
27. W.W. Mayol, A.J. Davison, B.J. Tordoff, D.W. Murray, Applying active vision and SLAM to wearables, in: P. Dario, R. Chatila (Eds.), Robotics Research: The 11th International Symposium, Springer Tracts in Advanced Robotics, vol. 15, Springer, siena Italy, 2005, pp. 325-334 (October 19-21, 2003).
28. A. Rottmann, O. Martínez-Mozos, C. Stachniss, W. Burgard, Semantic place classification of indoor environments with mobile robots using boosting, in: Proc. AAAI-05: the 20th National Conf. on Artificial Intelligence, 2005, pp. 1306-1311.
29. H.I. Posner, D. Schröter, P.M. Newman, Using scene similarity for place labeling, in: Proc. 10th Int. Symp. on Experimental Robotics, 2006, pp. 85-98.
30. S. Thrun, C. Martin, Y. Liu, D. Hähnel, R. Emery-Montemerlo, D. Chakrabarti, and W. Burgard A real-time expectation maximization algorithm for acquiring multi-planar maps of indoor environments with mobile robots IEEE Transactions on Robotics and Automation 20 3 2004 433 443
31. I. Gordon, D.G. Lowe, What and where: 3D object recognition with accurate pose, in: J. Ponce, M. Hébert, C. Schmid, A. Zisserman (Eds.), Toward Category-Level Object Recognition (Proc Sicily Workshop), Springer-Verlag, 2006, pp. 67-82.
32. J. Shi, C. Tomasi, Good features to track, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 1994, pp. 593-600.
33. J.M.M. Montiel, J. Civera, A.J. Davison, Unified inverse depth parametrization for monocular SLAM, in: Proc. Robotics: Science and Systems, 2006.
34. Y. Bar-Shalom, and T.E. Fortmann Tracking and Data Association Mathematics in Science and Engineering, vol. 179 1988 Academic Press Inc. San Diego, California
35. J.J. Leonard, and R. Rikoski Incorporation of delayed decision making into stochastic mapping D. Rus, S. Singh, Experimental Robotics VII Lecture Notes in Control and Information Sciences vol. 271 2001 Springer-Verlag 533 542
36. W.W. Mayol, B.J. Tordoff, and D.W. Murray Wearable visual robots Personal and Ubiquitous Computing 6 2002 37 48
37. B. Williams, G. Klein, I.D. Reid, Real-time SLAM relocalisation, in: Proc. 11th IEEE Int. Conf. on Computer Vision, 2007, pp. 1-8.
38. J. Civera, A.J. Davison, J.M.M. Montiel, Dimensionles monocular SLAM, in: Proc. 3rd Iberian Conf. on Pattern Recognition and Image Analysis, Girona, Spain, June 6-8, 2007, pp. 412-419.
39. T.A. Vidal-Calleja, A.J. Davison, J. Andrade-Cetto, D.W. Murray, Active control for single camera SLAM, in: Proc. 2006 IEEE Int. Conf. on Robotics and Automation, 2006, pp. 1930-1936.
40. G. Reitmayr, E. Eade, T. Drummond, Semi-automatic annotations in unknown environments, in: Proc. 6th IEEE/ACM Int. Symp. on Mixed and Augmented Reality, 2007, pp. 67-70.
41. R.O. Castle, Simultaneous Recognition, Localization and Mapping for Wearable Visual Robots, DPhil thesis, University of Oxford, Department of Engineering Science, 2009.
42. R.O. Castle, D.W. Murray, Object recognition and localization while tracking and mapping, in: Proc. 8th IEEE/ACM Int. Symp. on Mixed and Augmented Reality, 2009, pp. 179-180.