Correcting scale drift by object recognition in single-camera SLAM

IEEE Transactions on Cybernetics

Volumn 43, Issue 6, 2013, Pages 1767-1780

  Botterill, Tom ^a   Mills, Steven ^b   Green, Richard ^a  

^a UNIVERSITY OF CANTERBURY   (New Zealand)

^b UNIVERSITY OF OTAGO   (New Zealand)

Author keywords

Object recognition; robot vision systems; simultaneous localization and mapping

Indexed keywords

ACCUMULATED ERRORS; MEASUREMENTS OF; OBJECT CLASS; OUTDOOR ENVIRONMENT; ROBOT VISION SYSTEMS; SIMULTANEOUS LOCALIZATION AND MAPPING; SINGLE CAMERAS; UNKNOWN ENVIRONMENTS;

CAMERAS; COMPUTER VISION; ERRORS; MATHEMATICAL TECHNIQUES; ROBOTICS;

OBJECT RECOGNITION;

ALGORITHM; ARTICLE; ARTIFACT; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; METHODOLOGY; PHOTOGRAPHY; ROBOTICS;

ALGORITHMS; ARTIFACTS; ARTIFICIAL INTELLIGENCE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; ROBOTICS;

EID: 84890109115     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2012.2230164     Document Type: Article

References (75)

1. R. Smith, M. Self, and P. Cheeseman, Autonomous Robot Vehicles. Amsterdam, The Netherlands: Springer-Verlag, 1990, ch. Estimating Uncertain Spatial Relationships in Robotics, pp. 435-461.
2. L. A. Clemente, A. J. Davison, I. Reid, J. Neira, and J. D. Tardos, "Mapping large loops with a single hand-held camera," in Proc. Robot.: Sci. Syst., 2007, pp. 1-8.
3. T. Lemaire and S. Lacroix, "SLAM with panoramic vision," J. Field Robot., vol. 24, no. 1/2, pp. 91-111, Jan./Feb. 2007. (Pubitemid 46469846)
4. E. Eade and T. Drummond, "Unified loop closing and recovery for real time monocular SLAM," in Proc. Brit. Mach. Vis. Conf., 2008, pp. 1-10.
5. H. Strasdat, J. M. M. Montiel, and A. J. Davison, "Scale drift-aware large scale monocular SLAM," in Proc. Robot.: Sci. Syst. Conf., 2010, pp. 1-8.
6. A. Davison, "Real-time simultaneous localisation and mapping with a single camera," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2003, pp. 1403-1410.
7. E. Eade and T. Drummond, "Scalable monocular SLAM," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Los Alamitos, CA, 2006, pp. 469-476. (Pubitemid 44931365)
8. H. Durrant-Whyte and T. Bailey, "Simultaneous localisation and mapping (SLAM): Part I," IEEE Robot. Autom. Mag., vol. 13, no. 2, pp. 1-9, Jun. 2006.
9. T. Botterill, R. Green, and S. Mills, "A bag-of-words speedometer for single camera SLAM," in Proc. Image Vis. Comput. New Zealand, Wellington, NZ, Nov. 2009, pp. 91-96.
10. C. Hide, T. Botterill, and M. Andreotti, "Vision-aided IMU for handheld pedestrian navigation," in Proc. Inst. Navigat. GNSS Conf., Portland, OR, 2010, pp. 534-541.
11. G. Nützi, S. Weiss, D. Scaramuzza, and R. Siegwart, "Fusion of IMU and vision for absolute scale estimation in monocular slam," J. Intell. Robot. Syst., vol. 61, no. 1, pp. 287-299, Jan. 2011.
12. F. Endres, J. Hess, N. Engelhard, J. Sturm, D. Cremers, and W. Burgard, "An evaluation of the RGB-D SLAM system," in Proc. IEEE Int. Conf. Robot. Autom., St. Paul, MN, May 2012, pp. 1691-1696.
13. M. Achtelik, M. Achtelik, S. Weiss, and R. Siegwart, "Onboard IMU and monocular vision based control for MAVs in unknown in- and outdoor environments," in Proc. IEEE Int. Conf. Robot. Autom., 2011, pp. 3056-3063.
14. K. Č. Pucihar and P. Coulton, "Estimating scale using depth from focus for mobile augmented reality," in Proc. 3rd ACM SIGCHI Symp. Eng. Interactive Comput. Syst., 2011, pp. 253-258.
15. D. Scaramuzza, F. Fraundorfer, M. Pollefeys, and R. Siegwart, "Absolute scale in structure from motion from a single vehicle mounted camera by exploiting nonholonomic constraints," in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 1413-1419.
16. B. Kitt, J. Rehder, A. Chambers, M. Schönbein, H. Lategahn, and S. Singh, "Monocular visual odometry using a planar road model to solve scale ambiguity," in Proc. Eur. Conf. Mob. Robots, 2011, pp. 1-6.
17. D. Gutiérrez-Gómez, L. Puig, and J. Guerrero, "Full Scaled 3D Visual Odometry from a Single Wearable Omnidirectional Camera," Univ. of Zaragoza, Aragon, Spain, Tech. Rep., 2012.
18. T. Botterill, S. Mills, and R. Green, "Bag-of-words-driven, single camera simultaneous localization and mapping," J. Field Robot., vol. 28, no. 2, pp. 204-226, Mar./Apr. 2011.
19. S. Vasudevan, S. Gächter, V. Nguyen, and R. Siegwart, "Cognitive maps for mobile robots - An object based approach," Robot. Auton. Syst., vol. 55, no. 5, pp. 359-371, May 2007. (Pubitemid 46601830)
20. P. Jensfelt, S. Ekvall, D. Kragic, and D. Aarno, "Integrating SLAM and object detection for service robot tasks," in Proc. IROS Workshop Mob. Manipulators: Basic Tech., New Trends Appl., Edmonton, Canada, 2005, pp. 1-11.
21. J. Stückler, N. Biresev, and S. Behnke, "Semantic mapping using objectclass segmentation of RGB-D images," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2012, pp. 1-6.
22. L. Kunze, M. Beetz, M. Saito, H. Azuma, K. Okada, and M. Inaba, "Searching objects in large-scale indoor environments: A decision-theoretic approach," in Proc. IEEE Int. Conf. Robot. Autom., 2012, pp. 4385-4390.
23. R. Anati, D. Scaramuzza, K. Derpanis, and K. Daniilidis, "Robot localization using soft object detection," in Proc. IEEE Int. Conf. Robot. Autom., May 2012, pp. 4992-4999.
24. S. Ahn, M. Choi, J. Choi, and W. K. Chung, "Data association using visual object recognition for EKF-SLAM in home environment," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Oct. 2006, pp. 2588-2594. (Pubitemid 46928287)
25. R. Castle, D. J. Gawley, G. Klein, and D. Murray, "Video-rate recognition and localization for wearable cameras," in Proc. Brit. Mach. Vis. Conf., 2007, pp. 1100-1109.
26. R. Castle, G. Klein, and D. Murray, "Combining monoSLAM with object recognition for scene augmentation using a wearable camera," Image Vis. Comput., vol. 28, no. 11, pp. 1548-1556, Nov. 2010.
27. R. Castle and D. Murray, "Keyframe-based recognition and localization during video-rate parallel tracking and mapping," Image Vis. Comput., vol. 29, no. 8, pp. 524-532, Jul. 2011.
28. J. Civera, D. Gálvez-López, L. Riazuelo, J. Tardós, and J. Montiel, "Towards semantic SLAM using a monocular camera," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2011, pp. 1277-1284.
29. S. Bao, M. Bagra, and S. Savarese, "Semantic structure from motion with object and point interactions," in Proc. IEEE ICCV Workshop, 2011, pp. 982-989.
30. M. Decrouez, R. Dupont, F. Gaspard, F. Devernay, and J. Crowley, "Modélisation explicite des objets et de l'environnement en combinant les approches topologique et métrique pour la localisation," in Proc. Congrès des Jeunes Chercheurs en Vision par Ordinateur, 2011, pp. 1-8.
31. C. Hsiao and C. Wang, "Achieving undelayed initialization in monocular slam with generalized objects using velocity estimate-based classification," in Proc. IEEE Int. Conf. Robot. Autom., 2011, pp. 4060-4066.
32. A. Angeli and A. Davison, "Live feature clustering in video using appearance and 3D geometry," in Proc. Brit. Mach. Vis. Conf., 2010, pp. 41-51.
33. D. G. Lowe, "Object recognition from local scale-invariant features," in Proc. IEEE Int. Conf. Comput. Vis., 1999, pp. 1150-1157.
34. H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool, "Speeded-Up Robust Features (SURF)," Comput. Vis. Image Understand., vol. 110, no. 3, pp. 346-359, Jun. 2008.
35. Y. Yu, G. Mann, and R. Gosine, "An object-based visual attention model for robotic applications," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 5, pp. 1398-1412, Oct. 2010.
36. J. Uijlings, A. Smeulders, and R. Scha, "Real-time bag of words, approximately," in Proc. Conf. Image Video Retrieval, 2009, pp. 1-8.
37. F.-F. Li and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2005, pp. 524-531.
38. A. Ramanan and M. Niranjan, "A review of codebook models in patchbased visual object recognition," J. Signal Process. Syst., vol. 68, no. 3, pp. 333-352, Sep. 2012.
39. A. Ramisa, S. Vasudevan, D. Scaramuzza, R. L. de Mántaras, and R. Siegwart, "A tale of two object recognition methods for mobile robots," in Proc. Int. Conf. Comput. Vis. Syst., Santorini, Greece, 2008, vol. 5008, pp. 353-362. (Pubitemid 351775979)
40. I. Jebari, S. Bazeille, E. Battesti, H. Tekaya, M. Klein, A. Tapus, D. Filliat, C. Meyer, S. Ieng, R. Benosman, E. Cizeron, J.-C. Mamanna, and B. Pothier, "Multi-sensor semantic mapping and exploration of indoor environments," in Proc. IEEE Conf. TePRA, 2011, pp. 151-156.
41. J. Sivic and A. Zisserman, "Video google: A text retrieval approach to object matching in videos," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2003, pp. 1470-1477.
42. D. Nistér and H. Stewénius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2006, pp. 2161-2168. (Pubitemid 44931581)
43. M. Cummins and P. Newman, "Accelerated appearance-only SLAM," in Proc. IEEE Int. Conf. Robot. Autom., May 2008, pp. 1828-1833.
44. P. Newman, G. Sibley, M. Smith, M. Cummins, A. Harrison, C. Mei, I. Posner, R. Shade, D. Schroeter, L. Murphy, W. Churchill, D. Cole, and I. Reid, "Navigating, recognizing and describing urban spaces with vision and lasers," Int. J. Robot. Res., vol. 28, no. 11/12, pp. 1406-1433, Nov./Dec. 2009.
45. K. Konolige, J. Bowman, J. D. Chen, P. Mihelich, M. Calonder, V. Lepetit, and P. Fua, "View-based maps," in Proc. Robot.: Sci. Syst., Seattle, Washington, Jun. 2009, pp. 1-8.
46. G. Sibley, C.Mei, I. Reid, and P. Newman, "Vast-scale outdoor navigation using adaptive relative bundle adjustment," Int. J. Robot. Res., vol. 29, no. 8, pp. 958-980, Jul. 2010.
47. J.Wang, H. Zha, and R. Cipolla, "Coarse-to-fine vision-based localization by indexing scale-invariant features," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 36, no. 2, pp. 413-422, Apr. 2006.
48. G. Csurka, C. R. Dance, L. Fan, J. Willamowski, and C. Bray, "Visual categorization with bags of keypoints," in Proc. ECCV Int.Workshop Stat. Learn. Comput. Vis., 2004, pp. 1-22.
49. J. Dvorsky, P. Praks, and V. Snasel, "Latent semantic indexing for image retrieval systems," in Proc. SIAM Linear Algebra, 2003, pp. 1-8.
50. J. Sivic, B. C. Russell, A. A. Efros, A. Zisserman, and W. T. Freeman, "Discovering object categories in image collections," in Proc. Int. Conf. Comput. Vis., 2005, pp. 1-8.
51. J. Sivic, B. Russell, A. Zisserman, W. Freeman, and A. Efros, "Unsupervised discovery of visual object class hierarchies," in Proc. IEEE CVPR, 2008, pp. 1-8.
52. S. Zhang, J. Huang, H. Li, and D. Metaxas, "Automatic image annotation and retrieval using group sparsity," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 3, pp. 838-849, 2012.
53. M. Brown and D. Lowe, "Unsupervised 3D object recognition and reconstruction in unordered datasets," in Proc. Int. Workshop 3-D Digital Imaging Modeling, 2005, pp. 56-63.
54. T. Serre, L. Wolf, S. Bileschi, M. Riesenhuber, and T. Poggio, "Robust object recognition with cortex-like mechanisms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 3, pp. 411-426, Mar. 2007. (Pubitemid 46336417)
55. K. Grauman and T. Darrell, "The pyramid match kernel: Efficient learning with sets of features," J. Mach. Learn. Res., vol. 8, pp. 725-760, Apr. 2007. (Pubitemid 46677049)
56. F. Rothganger, S. Lazebnik, C. Schmid, and J. Ponce, "3D object modeling and recognition using local affine-invariant image descriptors and multi-view spatial constraints," Int. J. Comput. Vis., vol. 66, no. 3, pp. 231-259, Mar. 2006.
57. R. Hoover, A. Maciejewski, and R. Roberts, "Fast eigenspace decomposition of images of objects with variation in illumination and pose," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 2, pp. 318-329, Apr. 2011.
58. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, "The PASCAL Visual Object Classes (VOC) challenge," Int. J. Comput. Vis., vol. 88, no. 3, pp. 303-338, Jun. 2010.
59. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2005, pp. 886-893. (Pubitemid 43897286)
60. Y. Huang, K. Huang, D. Tao, T. Tan, and X. Li, "Enhanced biologically inspired model for object recognition," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 6, pp. 1668-1680, Dec. 2011.
61. K. Lai, L. Bo, X. Ren, and D. Fox, "Detection-based object labeling in 3D scenes," inProc. IEEEInt. Conf.Robot.Autom.,May 2012, pp. 1330-1337.
62. T. Botterill, "Visual Navigation for Mobile Robots Using the Bag-of- Words Algorithm," Ph.D. dissertation, Univ. of Canterbury, Christchurch, New Zealand, 2010.
63. A. Angeli, D. Filliat, S. Doncieux, and J.-A. Meyer, "Fast and incremental method for loop-closure detection using bags of visual words," IEEE Trans. Robot., vol. 24, no. 5, pp. 1027-1037, Oct. 2008.
64. T. Botterill, S. Mills, and R. Green, "Speeded-up bag-of-words algorithm for robot localisation through scene recognition," in Proc. Image Vis. Comput. New Zealand, Nov. 2008, pp. 1-6.
65. E. Rosten and T. Drummond, "Machine learning for high-speed corner detection," in Proc. Eur. Conf. Comput. Vis., 2006, pp. 430-443. (Pubitemid 44029797)
66. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, Jun. 1981.
67. T. Botterill, S. Mills, and R. Green, "Fast RANSAC hypothesis generation for essential matrix estimation," in Proc. Int. Conf. DICTA, 2011, pp. 1-6.
68. G. Grisetti, S. Grzonka, C. Stachniss, P. Pfaff, and W. Burgard, "Efficient estimation of accurate maximum likelihood maps in 3D," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2007, pp. 3472-3478.
69. R. Kummerle, G. Grisetti, H. Strasdat, K. Konolige, and W. Burgard, "G2o: A general framework for graph optimization," in Proc. IEEE Int. Conf. Robot. Autom., 2011, pp. 3607-3613.
70. M. Kaess, H. Johannsson, R. Roberts, V. Ila, J. Leonard, and F. Dellaert, "iSAM2: Incremental smoothing and mapping with fluid relinearization and incremental variable reordering," in Proc. IEEE Int. Conf. Robot. Autom., 2011, pp. 3281-3288.
71. I. Esteban, L. Dorst, and J. Dijk, "Closed form solution for the scale ambiguity problem in monocular visual odometry," in Proc. Intell. Robot. Appl., 2010, vol. 6424, pp. 665-679.
72. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 2003.
73. M. Cummins and P. Newman, "FAB-MAP: Probabilistic localization and mapping in the space of appearance," Int. J. Robot. Res., vol. 27, no. 6, pp. 647-665, Jun. 2008.
74. E. Limpert, W. A. Stahel, and M. Abbt, "Log-normal distributions across the sciences: Keys and clues," BioScience, vol. 51, no. 5, pp. 341-352, May 2001. (Pubitemid 32550418)
75. S. Weerahandi, Exact Statistical Methods for Data Analysis. NewYork: Springer-Verlag, 1995.