Monocular camera/IMU/GNSS integration for ground vehicle navigation in challenging GNSS environments

Sensors

Volumn 12, Issue 3, 2012, Pages 3162-3185

  Chu, Tianxing ^a   Guo, Ningyan ^b   Backén, Staffan ^c   Akos, Dennis ^c  

^a PEKING UNIVERSITY   (China)

^b BEIHANG UNIVERSITY   (China)

^c UCB 450   (United States)

Author keywords

Computer vision; Extended kalman filter; GNSS; Sensor integration; Strapdown mechanization; Tightly coupled integration

Indexed keywords

EID: 84858952576     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s120303162     Document Type: Article

References (43)

1. Chu, T.; Akos, D. Assisted GNSS-Performance Results of Multiplexed Measurements, Limited Bandwidth, and a Vectorized Implementation. In Proceedings of the 2011 International Technical Meeting of the Institute of Navigation, San Diego, CA, USA, 24-26 January 2011; pp. 1007-1018.
2. Park, M.; Gao, Y. Error and performance analysis of MEMS-based inertial sensors with a low-cost GPS receiver. Sensors 2008, 9, 2240-2261.
3. Godha, S.; Cannon, M.E. GPS/MEMS INS integrated system for navigation in urban areas. GPS Solut. 2007, 11, 193-203.
4. Bijker, J.; Steyn, W. Kalman filter configurations for a low-cost loosely integrated inertial navigation system on an airship. Control Eng. Pract. 2008, 16, 1509-1518.
5. Durrant-Whyte, H.; Bailey, T. Simultaneous localisation and mapping (SLAM): Part I the essential algorithms. Robot. Autom. Mag. 2006, 13, 99-110.
6. Soloviev, A.; Venable, D. Integration of GPS and Vision Measurements for Navigation in GPS-Challenged Environments. In Proceedings of IEEE/ION PLANS 2010, Indian Wells, CA, USA, 4-6 May 2010; pp. 826-833.
7. Corke, P.; Lobo, J.; Dias, J. An introduction to inertial and visual sensing. Int. J. Robot. Res. 2007, 26, 519-535.
8. Chu, C.; Lie, F.; Lemay, L.; Gebre-Egziabher, D. Performance Comparison of Tight and Loose INS-Camera Integration. In Proceedings of the 24rd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS 2011), Portland, OR, USA, 19-23 September 2011; pp. 3516-3526.
9. Schlaile, C.; Meister, O.; Frietsch, N. Using natural features for vision based navigation of an indoor-VTOL MAV. Aero. Sci. Technol. 2009, 13, 349-357.
10. Soloviev, A.; Touma, J.; Klausutis, T.; Miller, M.; Rutkowski, A.; Fontaine, K. Integrated Multi-Aperture Sensor and Navigation Fusion. In Proceedings of the 22nd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS 2009), Savannah, GA, USA, 22-25 September 2009; pp. 759-766.
11. Hide, C.; Moore, T.; Botterill, T. Low cost vision aided IMU for pedestrian navigation. J. Glob. Position. Syst. 2011, 10, 3-10.
12. Huang, B.; Du, S.; Gao, Y. An Integrated MEMS IMU/Camera System for Pedestrian Navigation in GPS-Denied Environment. In Proceedings of the 24rd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS 2011), Portland, OR, USA, 19-23 September 2011; pp. 2373-2380.
13. Blanco, J.L.; Moreno, F.A.; Gonzalez, J. A collection of outdoor robotic datasets with centimeter-accuracy ground truth. Auton. Robot. 2009, 27, 327-351.
14. Randeniya, D.I.B.; Sarkar, S.; Gunaratne, M. Vision-IMU integration using a slow-frame-rate monocular vision system in an actual roadway setting. IEEE Trans. Intell. Transp. 2010, 11, 256-266.
15. Hol, J.D. Pose estimation and calibration algorithms for vision and inertial sensors. M.S. Thesis, Linköping University, Linköping, Sweden, May 2008; pp. 46-47.
16. Gleason, S.; Gebre-Egziabher, D. GNSS Applications and Methods; Artech House: Norwood, MA, USA, 2009.
17. Kong, X. Inertial navigation system algorithm for low cost IMU. Ph.D. Thesis, The University of Sydney, Sydney, NSW, Australia, 2000; pp. 12-22.
18. Groves, P.D. Principles of GNSS, Inertial, and Multi-Sensor Integrated Navigation Systems; Artech House: Norwood, MA, USA, 2008.
19. Shin, E. Estimation techniques for low-cost inertial navigation. Ph.D. Thesis, University of Calgary, Calgary, AB, Canada, May 2005; pp. 46-56.
20. Benson, D.O. A comparison of two approaches to pure-inertial and Doppler-inertial error analysis. IEEE Trans. Aero. Electron. Syst. 1975, 11, 447-455.
21. Zhang, Z. Flexible Camera Calibration by Viewing a Plane from Unknown Orientations. In Proceedings of the 7th IEEE International Conference on Computer Vision, Kerkyra, Greece, 20-27 September 1999; pp. 666-673.
22. Clarke, T.A.; Fryer, J.G. The development of camera calibration methods and models. Photogramm. Rec. 1998, 16, 51-66.
23. Heikkilä, J.; Silvén, O. A Four-Step Camera Calibration Procedure with Implicit Image Correction. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'97), San Juan, Puerto Rico, 17-19 June 1997; pp. 1106-1112.
24. Lowe, D.G. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 2004, 60, 91-110.
25. Ke, Y.; Sukthankar, R. PCA-SIFT: A More Distinctive Representation for Local Image Descriptors. In Proceedings of Conference on Computer Vision and Pattern Recognition, Washington, DC, USA, 2004; Volume I, pp. 511-517.
26. Bay, H.; Ess, A.; Tuytelaars, T.; van Gool, L. Speeded-up robust features (SURF). J. Comput. Vis. Image Underst. 2004, 110, 346-359.
27. Lingua, A.; Marenchino, D.; Nex, F. Performance analysis of the SIFT operator for automatic feature extraction and matching in photogrammetric applications. Sensors 2009, 9, 3745-3766.
28. Fischler, M.A.; Bolles, R.C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 1981, 24, 381-395.
29. Zhao, L.; Huang, S.; Yan, L.; Wang, J.; Hu, G; Dissanayake, G. Large-Scale Monocular SLAM by Local Bundle Adjustment and Map Joining. In Proceedings of the 11th International Conference on Control, Automation, Robotics & Vision (ICARCV), Singapore, 5-8 December 2010; pp. 431-436.
30. Hartley, R.; Zisserman, A. Multiple View Geometry in Computer Vision, 2nd ed.; Cambridge University Press: Cambridge, UK, 2003.
31. Van Graas, F.; Soloviev, A. Precise velocity estimation using a stand-alone GPS receiver. J. Inst. Navigat. 2004, 51, 283-292.
32. Jülg, T. Evaluation of Multipath Error and Signal Propagation in a Complex Scenario for GPS Multipath Identification. In Proceedings of the 4th IEEE International Symposium on Spread Spectrum Techniques and Applications, Mainz, Germany, 22-25 September 1996; pp. 872-876.
33. Comp, C.J.; Axelrad, P. Adaptive SNR-based carrier phase multipath mitigation technique. IEEE Trans. Aero. Electron. Syst. 1998, 34, 264-276.
34. Lee, H.K.; Lee, J.G.; Jee, G.I. GPS multipath detection based on sequence of successive-time double-differences. IEEE Signal Proc. Let. 2004, 11, 316-319.
35. Armesto, L.; Tornero, J.; Vincze, M. Fast ego-motion estimation with multi-rate fusion of inertial and vision. Int. J. Robot. Res. 2007, 26, 577-589.
36. Duong, T.; Chiang, K. Non-Linear, Non-Gaussian Estimation for INS/GPS Integration. In Proceedings of the 24rd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS 2011), Portland, GA, USA, 19-23 September 2011; pp. 946-953.
37. Sensor Performance for Xsens MTi. Available online: http://www.xsens.com/en/general/mti (accessed on 4 January 2012).
38. Lobo, J.; Dias, J. Relative pose calibration between visual and inertial sensors. Int. J. Robot. Res. 2007, 26, 561-575.
39. Hol, J.D.; Schön, T.B.; Luinge, H.; Slycke, P.J.; Gustafsson, F. Robust real-time tracking by fusing measurements from inertial and vision sensors. J. RT. Image Process. 2007, 2, 149-160.
40. Cook, G.L. Critical GPS-GLONASS Interoperability Issues. In Proceedings of the 1997 National Technical Meeting of The Institute of Navigation, Santa Monica, CA, USA, 14-16 January 1997; pp. 183-193.
41. Global Navigation Satellite System-GLONASS; Interface Control Document (Edition 5.1); Russian Institute of Space Device Engineering: Moscow, Russia, 2008.
42. You, W.; Jiang, F. Data synchronization technology of INS/GPS integrated navigation system. J. Chin. Inert. Technol. 2003, 11, 20-22.
43. Chu, T.; Akos, D. Assisted GNSS-Traditional and Vectorized: Implementation and Performance Results. In Proceedings of the 23rd International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS 2010), Portland, OR, USA, 21-24 September 2010; pp. 1605-1614.