Keyframe-based recognition and localization during video-rate parallel tracking and mapping

Image and Vision Computing

Volumn 29, Issue 8, 2011, Pages 524-532

  Castle, R O ^a   Murray, D W ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Augmented reality; Object recognition; Structure from motion; Wearable vision

Indexed keywords

AUGMENTED REALITY; COMMAND AND CONTROL SYSTEMS; CONFORMAL MAPPING; MILITARY APPLICATIONS; OBJECT RECOGNITION; THREE DIMENSIONAL; VIRTUAL REALITY;

BUNDLE ADJUSTMENTS; COMMAND AND CONTROL; IMAGE FEATURES; KEY FRAMES; MAPPING ALGORITHMS; REALISTIC APPLICATIONS; SIFT FEATURE; SITUATIONAL AWARENESS; STRUCTURE FROM MOTION; VIDEO RATES; WEARABLE VISION;

FEATURE EXTRACTION;

EID: 80051669135     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2011.05.002     Document Type: Article

References (45)

1. C. Harris, and C. Stennett RAPiD - a video rate object tracker Proc 1st British Machine Vision Conference 1990 73 78
2. D. Lowe Fitting parameterized three-dimensional models to images IEEE Transactions on Pattern Analysis and Machine Intelligence 13 5 1991 441 450 (Pubitemid 21676525)
3. D. Gennery Visual tracking of known three-dimensional objects International Journal of Computer Vision 7 3 1992 243 270 (Pubitemid 23621964)
4. T. Drummond, and R. Cipolla Real-time visual tracking of complex structures IEEE Transactions on Pattern Analysis and Machine Intelligence 24 7 2002 932 946 (Pubitemid 34835468)
5. A.W. Fitzgibbon, and A. Zisserman Automatic camera recovery for closed or open image sequences Proc 5th European Conf on Computer Vision Vol. 1 1998 311 326 (Pubitemid 128093090)
6. D. Nistér, Automatic dense reconstruction from uncalibrated video sequences, Ph.D. thesis, Royal Institute of Technology KTH, Stockholm, Sweden (March 2001).
7. M. Pollefeys, L.V. Gool, M. Vergauwen, F. Verbiest, K. Cornelis, J. Tops, and R. Koch Visual modeling with a hand-held camera International Journal of Computer Vision 59 3 2004 207 232
8. W. Triggs, P. McLauchlan, R. Hartley, and A. Fitzgibbon Bundle adjustment - a modern synthesis B. Triggs, A. Zisserman, R. Szeliski, Vision Algorithms: Theory and Practice Vol. 1883 of Lecture Notes in Computer Science 2000 Springer-Verlag 298 372
9. A.J. Davison Real-time simultaneous localisation and mapping with a single camera Proc 9th IEEE Int Conf on Computer Vision II 2003 1403 1410
10. A.J. Davison, I.D. Reid, N.D. Molton, and O. Stasse MonoSLAM: real-time single camera SLAM IEEE Transactions on Pattern Analysis and Machine Intelligence 26 6 2007 1052 1067 (Pubitemid 46667415)
11. D. Nistér, O. Naroditsky, and J. Bergen Visual odometry for ground vehicle applications Journal of Field Robotics 23 1 2006 3 20
12. E. Mouragnon, M. Lhuillier, M. Dhome, F. Dekeyser, and P. Sayd Real time localisation and 3d reconstruction Proc 24th IEEE Conf on Computer Vision and Pattern Recognition I 2006 363 370
13. D. Lowe Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2 2004 91 110
14. R. Fergus, P. Perona, and A. Zisserman Object class recognition by unsupervised scale-invariant learning Proc 21st IEEE Conf on Computer Vision and Pattern Recognition Vol. 2 2003 264 271
15. A. Opelt, A. Pinz, and A. Zisserman Learning an alphabet of shape and appearance for multi-class object detection International Journal of Computer Vision 80 1 2008 16 44
16. G. Klein, and D.W. Murray Parallel tracking and mapping for small AR workspaces Proc 6th IEEE/ACM Int Symp on Mixed and Augmented Reality 2007
17. C. McGlone, E. Mikhail, and J. Bethel Manual of Photogrammetry 5th Edition 2004 American Society of Photogrammetry and Remote Sensing Bethesda, MD
18. R.O. Castle, and D.W. Murray Object recognition and localization while tracking and mapping Proc 8th IEEE/ACM Int Symp on Mixed and Augmented Reality 2009 179 180
19. A.J. Davison, W.W. Mayol, and D.W. Murray Real-time localisation and mapping with wearable active vision Proc 2nd IEEE/ACM Int Symp on Mixed and Augmented Reality 2003 18 27
20. W.W. Mayol, A.J. Davison, B.J. Tordoff, and D.W. Murray Applying active vision and SLAM to wearables P. Dario, R. Chatila, International Symposium on Robotics Research, Siena, Italy, October 19-21, 2003 Vol. 15 2003 Springer 325 334
21. I. Gordon, and D.G. Lowe What and where: 3D object recognition with accurate pose J. Ponce, M. Hebert, C. Schmid, A. Zisserman, Toward Category-Level Object Recognition, Springer-Verlag 2006 67 82
22. R.O. Castle, G. Klein, and D.W. Murray Combining monoSLAM with object recognition for scene augmentation using a wearable camera Image and Vision Computing 28 12 2010 1548 1556
23. M. Bosse, P. Newman, J. Leonard, and S. Teller Simultaneous localization and map building in large-scale cyclic environments using the atlas framework International Journal of Robotics Research 23 12 2004 1113 1139
24. E. Eade, and T. Drummond Unified loop closing and recovery for real time monocular SLAM Proc 18th British Machine Vision Conference 2008
25. S.A. Holmes, G. Sibley, G. Klein, and D.W. Murray Using a relative representation in parallel tracking and mapping Proc 2009 IEEE Int Conf on Robotics and Automation 2009
26. C. Mei, G. Sibley, M. Cummins, P. Newman, I. Reid, RSLAM: a system for large-scale mapping in constant time using stereo, International Journal of Computer Vision Online first. doi:10.1007/s11263-010-0361-7.
27. R.O. Castle, G. Klein, and D.W. Murray Video-rate localization in multiple maps for wearable augmented reality Proc 12th IEEE Int Symp on Wearable Computers 2008
28. E. Rosten, and T. Drummond Machine learning for high-speed corner detection Proc 9th European Conf on Computer Vision 2006
29. E. Rosten, R. Porter, and T. Drummond Faster and better: a machine learning approach to corner detection IEEE Transactions on Pattern Analysis and Machine Intelligence 32 1 2010 105 119
30. J.E. Dennis Nonlinear Least-Squares 1977 Academic Press London 269 312
31. Z.Y. Zhang Parameter estimation techniques - a tutorial with application to conic fitting Image and Vision Computing 15 1 1997 59 76
32. S.A. Holmes, Challenges in real-time slam: curbing complexity, cultivating consistency, D.Phil. thesis, Department of Engineering Science, University of Oxford (2010).
33. D.W. Marquardt An algorithm for the least-squares estimation of non-linear parameters Journal of the Society Industrial Application Math 11 2 1963 431 441
34. J.W. Tukey Exploratory Data Analysis 1977 Addison-Wesley Reading MA
35. D. Nistér An efficient solution to the five-point relative pose problem IEEE Transactions on Pattern Analysis and Machine Intelligence 26 6 2004 756 777
36. J.S. Beis, and D.G. Lowe Shape indexing using approximate nearest-neighbour search in high-dimensional spaces Proc 1997 IEEE Computer Society Conf on Computer Vision and Pattern Recognition 1997 1000 1006
37. R. Hartley, and A. Zisserman Multiple View Geometry in Computer Vision 2nd Edition 2004 Cambridge University Press
38. B.K.P. Horn, H.M. Hilden, and S. Negahdaripour Closed form solution of absolute orientation using orthonormal matrices Journal of the Optical Society of America. A 5 7 1988 1127 1135
39. O. Faugeras, and M. Hébert A 3d recognition and positioning algorithm using geometric matching between primitive surfaces Proc. 8th. Int. Joint Conf. on Artificial Intelligence, IJCAI-83 1983 996 1002 (Pubitemid 14514057)
40. M.A. Fischler, and R.C. Bolles Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography Communication ACM 24 6 1981 381 395
41. C.A. Collins, Convent Thoughts, Western Art Collection, Ashmolean Museum, Oxford (Painted 1850-51).
42. S.N. Sinha, J. Frahm, M. Pollefeys, and Y. Genc Feature tracking and matching in video using programmable graphics hardware Machine Vision and Applications 22 1 2011 207 217 10.1007/s00138-007-0105-z
43. D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg Pose tracking from natural features on mobile phones Proc 7th IEEE/ACM Int Symp on Mixed and Augmented Reality 2008
44. M.J. Choi, J.J. Lim, A. Torralba, and A.S. Willsky Exploiting hierarchical context on a large database of object categories Proc 28th IEEE Conf on Computer Vision and Pattern Recognition 2010
45. H. Strasdat, J.M.M. Montiel, and A.J. Davison Real-time monocular SLAM: why filter? Proc 2010 IEEE Int Conf on Robotics and Automation 2010