Real-time RGB-D camera relocalization via randomized ferns for keyframe encoding

IEEE Transactions on Visualization and Computer Graphics

Volumn 21, Issue 5, 2015, Pages 571-583

  Glocker, Ben ^a   Shotton, Jamie ^b   Criminisi, Antonio ^b   Izadi, Shahram ^b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b MICROSOFT RESEARCH   (United Kingdom)

Author keywords

camera relocalization; dense tracking and mapping; marker free augmented reality; tracking recovery

Indexed keywords

AUGMENTED REALITY; CAMERAS; HAMMING DISTANCE; MAPPING; RECOVERY; TRACKING (POSITION);

AUTOMATIC DISCOVERY; COMPACT REPRESENTATION; MARKER-FREE; RE-LOCALIZATION; REINITIALIZATION; SIMULTANEOUS LOCALIZATION AND TRACKING; TRACKING ALGORITHM; TRACKING FAILURE;

ENCODING (SYMBOLS);

EID: 84926064093     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2014.2360403     Document Type: Article

References (50)

1. A. J. Davison, "Real-time simultaneous localisation and mapping with a single camera," in Proc. IEEE Int. Conf. Comput. Vis., 2003, pp. 1403-1410.
2. A. J. Davison, I. D. Reid, N. D. Molton, and O. Stasse, "MonoSLAM: Real-time single camera SLAM," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 1052-1067, Apr. 2007.
3. G. Klein and D. Murray, "Parallel tracking and mapping for small AR workspaces," in Proc. IEEE Int. Symp. Mixed Augmented Reality, 2007, pp. 225-234.
4. R. Newcombe, S. Lovegrove, and A. Davison, "DTAM: Dense tracking and mapping in real-time," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 2320-2327.
5. V. Pradeep, C. Rhemann, S. Izadi, C. Zach, M. Bleyer, and S. Bathiche, "MonoFusion: Real-time 3D reconstruction of small scenes with a single web camera," in Proc. IEEE Int. Symp. Mixed Augmented Reality, 2013, pp. 83-88.
6. R. Newcombe, A. Davison, S. Izadi, P. Kohli, O. Hilliges, J. Shotton, D. Molyneaux, S. Hodges, D. Kim, and A. Fitzgibbon, "KinectFusion: Real-time dense surface mapping and tracking," in Proc. IEEE Int. Symp. Mixed Augmented Reality, 2011, pp. 127-136.
7. S. Lieberknecht, A. Huber, S. Ilic, and S. Benhimane, "RGB-D camera-based parallel tracking and meshing," in Proc. IEEE Int. Symp. Mixed Augmented Reality, 2011, pp. 147-155.
8. R. F. Salas-Moreno, R. A. Newcombe, H. Strasdat, P. H. Kelly, and A. J. Davison, "SLAM++: Simultaneous localisation and mapping at the level of objects," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 1352-1359.
9. Y. M. Kim, N. J. Mitra, D.-M. Yan, and L. Guibas, "Acquiring 3D indoor environments with variability and repetition," ACM Trans. Graph., vol. 31, no. 6, p. 138, 2012.
10. T. Whelan, M. Kaess, M. Fallon, H. Johannsson, J. Leonard, and J. McDonald, "Kintinuous: Spatially Extended KinectFusion," in Proc. RGBD Workshop, 2012.
11. H. Roth and M. Vona, "Moving volume kinectfusion," in Proc. Brit. Mach. Vis. Conf., 2012.
12. J. Chen, D. Bautembach, and S. Izadi, "Scalable real-time volumetric surface reconstruction," ACM Trans. Graph., vol. 32, no. 4, p. 113, 2013.
13. W. Tan, H. Liu, Z. Dong, G. Zhang, and H. Bao, "Robust monocular SLAM in dynamic environments," in Proc. IEEE Int. Symp. Mixed Augmented Reality, 2013, pp. 209-218.
14. M. Dou, H. Fuchs, and J.-M. Frahm, "Scanning and tracking dynamic objects with commodity depth cameras," in Proc. IEEE Int. Symp. Mixed Augmented Reality, 2013, pp. 99-106.
15. M. Keller, D. Lefloch, M. Lambers, S. Izadi, T. Weyrich, and A. Kolb, "Real-time 3D reconstruction in dynamic scenes using point-based fusion," in Proc. IEEE Int. Conf. 3D Vis., 2013, pp. 1-8.
16. P. Tanskanen, K. Kolev, L. Meier, F. Camposeco, O. Saurer, and M. Pollefeys, "Live Metric 3D Reconstruction on Mobile Phones," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 65-72.
17. V. A. Prisacariu, O. Kahler, D. W. Murray, and I. D. Reid, "Simultaneous 3D tracking and reconstruction on a mobile phone," in Proc. IEEE Int. Symp. Mixed Augmented Reality, 2013, pp. 89-98.
18. J. Ventura, C. Arth, G. Reitmayr, and D. Schmalstieg, "Global Localization from Monocular SLAM on a Mobile Phone," IEEE Trans. Visualization Comput. Graph., vol. 20, no. 4, pp. 531-539, Apr. 2014.
19. J. Platonov, H. Heibel, P. Meier, and B. Grollmann, "A mobile markerless AR system for maintenance and repair," in Proc. IEEE Int. Symp. Mixed Augmented Reality, 2006, pp. 105-108.
20. S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison et al., "KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera," in Proc. 24th Annu ACM Symp User Interface Softw. Technol., 2011, pp. 559-568.
21. R. Salas-Moreno, B. Glocker, P. Kelly, and A. Davison, "Dense Planar SLAM," in Proc. IEEE Int. Symp. Mixed Augmented Reality, 2014.
22. M. Tatzgern, R. Grasset, D. Kalkofen, and D. Schmalstieg, "Transitional Augmented Reality Navigation for Live Captured Scenes," in Proc. IEEE Virtual Reality, 2014, pp. 21-26.
23. F. Steinbrucker, J. Sturm, and D. Cremers, "Real-time visual odometry from dense RGB-D images," in Proc. IEEE Int. Conf. Comput. Vis. Workshops, 2011, pp. 719-722.
24. T. Whelan, H. Johannsson, M. Kaess, J. J. Leonard, and J. McDonald, "Robust Tracking for Real-Time Dense RGB-D Mapping with Kintinuous," MIT-CSAIL, Tech. Rep. 031, 2012.
25. P. Henry, M. Krainin, E. Herbst, X. Ren, and D. Fox, "RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments," Int. J. Robot. Res., vol. 31, no. 5, pp. 647-663, 2012.
26. B. Glocker, S. Izadi, J. Shotton, and A. Criminisi, "Real-Time RGBD Camera Relocalization," in Proc. IEEE Int. Symp. Mixed Augmented Reality, 2013.
27. A. Guzman-Rivera, P. Kohli, B. Glocker, J. Shotton, T. Sharp, A. Fitzgibbon, and S. Izadi, "Multi-Output Learning for Camera Relocalization," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 1114-1121.
28. J. Shotton, B. Glocker, C. Zach, S. Izadi, A. Criminisi, and A. Fitzgibbon, "Scene Coordinate Regression Forests for Camera Relocalization in RGB-D Images," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 2930-2937.
29. G. Reitmayr and T. W. Drummond, "Going out: robust modelbased tracking for outdoor augmented reality," in Proc. IEEE Int. Symp. Mixed Augmented Reality, 2006, pp. 109-118.
30. M. Cummins and P. Newman, "Appearance-only SLAM at large scale with FAB-MAP 2.0," Int. J. Robot. Res., vol. 30, no. 9, pp. 1100-1123, 2011.
31. K. Ni, A. Kannan, A. Criminisi, and J. Winn, "Epitomic location recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
32. E. Eade and T. Drummond, "Unified loop closing and recovery for real time monocular SLAM," in Proc. Brit. Mach. Vis. Conf., 2008.
33. J. Martinez-Carranza, A. Calway, and W. Mayol-Cuevas, "Enhancing 6D visual relocalisation with depth cameras," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., 2013, pp. 899-906.
34. B. Williams, G. Klein, and I. Reid, "Automatic Relocalization and Loop Closing for Real-Time Monocular SLAM," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 9, pp. 1699-1712, Sep. 2011.
35. M. Fischler and R. Bolles, "Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
36. A. P. Gee and W. Mayol-Cuevas, "6D Relocalisation for RGBD Cameras Using Synthetic View Regression," in Brit. Mach. Vis. Conf., 2012.
37. G. Klein and D. Murray, "Improving the agility of keyframe-based SLAM," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 802-815.
38. C. Pirchheim, D. Schmalstieg, and G. Reitmayr, "Handling pure camera rotation in keyframe-based SLAM," in Proc. IEEE Int. Symp. Mixed Augmented Reality, 2013, pp. 229-238.
39. E. Rosten, R. Porter, and T. Drummond, "Faster and better: A machine learning approach to corner detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 105-119, Jan. 2010.
40. M. Calonder, V. Lepetit, C. Strecha, and P. Fua, "BRIEF: Binary robust independent elementary features," in Eur. Conf. Comput. Vis., 2010, pp. 778-792.
41. N. Sunderhauf and P. Protzel, "BRIEF-Gist -Closing the Loop by Simple Means," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., 2011, pp. 1234-1241.
42. S. A. Winder and M. Brown, "Learning local image descriptors," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8.
43. D. Nister and H. Stewenius, "Scalable recognition with a vocabulary tree," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 2, 2006, pp. 2161-2168.
44. M. Ozuysal, M. Calonder, V. Lepetit, and P. Fua, "Fast keypoint recognition using random ferns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 3, pp. 448-461, Jan. 2010.
45. V. Lepetit and P. Fua, "Keypoint recognition using randomized trees," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1465-1479, Jul. 2006.
46. E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, "ORB: an efficient alternative to SIFT or SURF," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 2564-2571.
47. M. Feuerstein, T. Mussack, S. M. Heining, and N. Navab, "Intraoperative Laparoscope Augmentation for Port Placement and Resection Planning in Minimally Invasive Liver Resection," IEEE Trans. Med. Imaging, vol. 27, no. 3, pp. 355-369, Mar. 2008.
48. B. Schwald and B. De Laval, "An augmented reality system for training and assistance to maintenance in the industrial context," J. WSCG, vol. 11, no. 1, 2003.
49. N. Gelfand, N. J. Mitra, L. J. Guibas, and H. Pottmann, "Robust Global Registration," in Proc. Eur. Symp. Geometry Process., 2005.
50. M. J. Milford and G. F. Wyeth, "SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights," in Proc. IEEE Int. Conf. Robot. Autom., 2012, pp. 1643-1649.