Accurate global localization using visual odometry and digital maps on urban environments

IEEE Transactions on Intelligent Transportation Systems

Volumn 13, Issue 4, 2012, Pages 1535-1545

  Alonso, Ignacio Parra ^a   Llorca, David Fernández ^a   Gavilan, Miguel ^a   Pardo, Sergio Álvarez ^a   Garcia Garrido, Miguel Ángel ^a   Vlacic, Ljubo ^b   Sotelo, Miguel Ángel ^a  

^a UNIVERSITY OF ALCALÁ   (Spain)

^b GRIFFITH UNIVERSITY   (Australia)

Author keywords

Digital maps; geographical information systems; intelligent transportation systems (ITSs); intelligent vehicles; visual odometry

Indexed keywords

CUMULATIVE ERRORS; DIGITAL MAP; DIGITAL ROAD MAP; DRIVER-ASSISTANCE SYSTEMS; DYNAMIC RANGE; GEOGRAPHICAL INFORMATION SYSTEM; GLOBAL LOCALIZATION; GPS POSITIONING; INTELLIGENT TRANSPORTATION SYSTEMS; KEY ELEMENTS; MAP-MATCHING ALGORITHM; MOTION INFORMATION; MOTION TRAJECTORIES; PRIOR KNOWLEDGE; RESEARCH AND DEVELOPMENT; SEQUENCE OF IMAGES; URBAN ENVIRONMENTS; VISION BASED; VISION BASED ALGORITHMS; VISUAL INFORMATION; VISUAL ODOMETRY;

ALGORITHMS; ERRORS; ESTIMATION; GEOGRAPHIC INFORMATION SYSTEMS; IMAGE MATCHING; INTELLIGENT SYSTEMS; INTELLIGENT VEHICLE HIGHWAY SYSTEMS; MAPS; STEREO VISION; URBAN PLANNING; VEHICLES;

GLOBAL POSITIONING SYSTEM;

EID: 84870535441     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2012.2193569     Document Type: Article

References (54)

1. J. Ibanez-Guzman, S. Lefevre, A. Mokkadem, and S. Rodhaim, "Vehicle to vehicle communications applied to road intersection safety, field results, " in Proc. 13th Int. IEEE Conf. Intell. Transp. Syst., Madeira Island, Portugal, 2010, pp. 192-197.
2. C. Wu, Y. Meng, L. Zhi-lin, C. Yong-qi, and J. Chao, "Tight integration of digital map and in-vehicle positioning unit for car navigation in urban areas, " J. Natural Sci., vol. 8, no. 2, pp. 551-556, 2003.
3. M. Agrawal and K. Konolige, "Real-time localization in outdoor environments using stereo vision and inexpensive GPS, " in Proc. 18th ICPR, Aug. 2006, pp. 1063-1068. (Pubitemid 46553304)
4. A. Shashua, Y. Gdalyahu, and G. Hayun, "Pedestrian detection for driving assistance systems: Single-frame classification and system level performance, " in Proc. IEEE IV Symp., Parma, Italy, 2004, pp. 1-6.
5. S. Lovegrove, A. J. Davison, and J. Ibañez-Guzmán, "Accurate visual odometry from a rear parking camera, " in Proc. IEEE IV Symp., Jun. 2011, pp. 788-793.
6. N. Nourani-Vatani, J. Roberts, and M. Srinivasan, "Imu aided 3D visual odometry for car-like vehicles, " in Proc. IEEE Aust. Conf. Robot. Autom., Dec. 2008, pp. 1-8.
7. D. Fernandez Llorca, M. A. Sotelo, I. Parra, M. Ocaña, and L. M. Bergasa, "Error analysis in a stereo vision-based pedestrian detection sensor for collision avoidance applications, " Sensors, vol. 10, no. 4, pp. 3741-3758, Apr. 2010.
8. A. Ishii, A. Sakai, M. Mitsuhashi, and Y. Kuroda, "Correcting angle of visual odometry system by fusing monocular and stereo methods in untextured dynamic environment, " in Proc. 10th Int. Symp. Commun. Inf. Technol., Oct. 2010, pp. 950-955.
9. D. Scaramuzza and R. Siegwart, "Appearance-guided monocular omnidirectional visual odometry for outdoor ground vehicles, " IEEE Trans. Robot., vol. 24, no. 5, pp. 1015-1026, Oct. 2008.
10. B. Matei and P. Meer, "Optimal rigid motion estimation and performance evaluation with bootstrap, " in Proc. CVPR, 1999, pp. 339-345.
11. J. M. M. Montiel, J. Civera, and A. Davison, "Unified inverse depth parametrization for monocular SLAM, " in Proc. Robot.: Sci. Syst., Aug. 2006, pp. 932-945.
12. S. D. Blostein and T. S. Huang, "Error analysis in stereo determination of 3D point positions, " IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-9, no. 6, pp. 752-765, Nov. 1987.
13. F. Solina, "Errors in stereo due to quantization, " Dept. Comput. Inf. Sci., Univ. Pennsylvania, Philadelphia, PA, Tech. Rep. MS-CIS-85-34, Sep. 1985.
14. C. Yuan and G. Medioni, "3D reconstruction of background and objects moving on ground plane viewed from a moving camera, " in Proc. IEEE CVPR, 2006, pp. 2261-2268. (Pubitemid 44931593)
15. H. S. Park, T. Shiratori, I. Matthews, and Y. Sheikh, "3D reconstruction of a moving point from a series of 2D projections, " in Proc. ECCV: Part III, 2010, pp. 158-171.
16. K. Konolige, M. Agrawal, and J. Solà, "Large scale visual odometry for rough terrain, " in Proc. ISRR, 2007, pp. 201-202.
17. D. Nistér, O. Narodistsky, and J. Beren, "Visual odometry, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2004, pp. 652-659.
18. D. Nistér, O. Narodistsky, and J. Bergen, "Visual odometry for ground vehicle applications, " J. Field Robot., vol. 23, no. 1, pp. 3-20, Jan. 2006.
19. M. Sotelo, R. García, I. Parra, D. Llorca, M. Gavilán, S. Álvarez, and J. Naranjo, "Visual odometry for road vehicles-Fesibility analysis, " J. Zheijiang Univ., vol. 8, no. 12, pp. 2017-2020, Nov. 2007. (Pubitemid 350223080)
20. R. García, M. A. Sotelo, I. Parra, and D. F. Llorca, "3D visual odometry for road vehicles, " J. Intell. Robot. Syst., vol. 51, no. 1, pp. 113-134, 2008. (Pubitemid 350276028)
21. I. Parra, M. A. Sotelo, D. F. Llorca, and M. Ocaña, "Robust visual odometry for vehicle localization in urban environments, " ROBOTICA, vol. 28, no. 3, pp. 441-452, May 2010.
22. H. Moravec, "Obstacle avoidance and navigation in the real world by a seeing robot rover, " Ph. D. dissertation, Stanford Univ., Stanford, CA, Sep. 1980.
23. M. Maomone, Y. Cheng, and L. Matthies, "Two years of visual odometry on the mars exploration rovers: Field reports, " J. Field Robot., vol. 24, no. 3, pp. 169-186, Mar. 2007. (Pubitemid 46647283)
24. D. Nistér, "An efficient solution to the five-point relative pose problem, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2003, vol. 2, pp. 195-202.
25. E. Mouragnon, M. Lhuillier, M. Dhome, F. Dekeyser, and P. Sayd, "Real time localization and 3D reconstruction, " in Proc. CVPR, 2006, pp. 363-370. (Pubitemid 44931352)
26. D. Nistér, "A minimal solution to the generalised 3-point pose problem, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2004, vol. 1, pp. 560-567.
27. Z. Zhang and O. Faugueras, "Estimation of displacements from two 3D frames obtained from stereo, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 12, pp. 1141-1156, Dec. 1992. (Pubitemid 23594865)
28. A. Hagnelius, "Visual odometry, " M. S thesis, Umea Univ., Umea, Sweden, 2005.
29. D. A. Forsyth and J. Ponce, "Computer Vision. A modern Approach, " in Pearson Education International. Englewood Cliffs, NJ: Prentice-Hall, 2003.
30. C. Harris and M. Stephens, "A combined corner and edge detector, " in Proc. 4th Alvey Vis. Conf., 1988, pp. 147-151.
31. B. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision, " in Proc. Int. Joint Conf. Artif. Intell., Apr. 1981, pp. 674-679. (Pubitemid 14478744)
32. M. Agrawal, K. Konolige, and M. R. Blas, "Censure: Center surround extremas for realtime feature detection and matching, " Comput. Vis. ECCV, vol. 5305, pp. 102-115, Oct. 2008.
33. D. G. Lowe, "Distinctive image features from scale-invariant keypoints, " Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
34. P. Lothe, S. Bourgeois, F. Dekeyser, E. Royer, and M. Dhome, "Towards geographical referencing of monocular slam reconstruction using 3D city models: Application to real-time accurate vision-based localization, " in Proc. CVPR, 2009, pp. 2882-2889.
35. A. Napier, G. Sibley, and P. Newman, "Real-time bounded-error pose estimation for road vehicles using vision, " in Proc. 13th Int. IEEE Conf. Intell. Transp. Syst., Madeira Island, Portugal, 2010, pp. 1141-1146.
36. A. C. Aitken, "On least squares and linear combinations of observations, " Proc. Roy. Soc. Edinburgh, vol. 55, pp. 42-48, 1935.
37. G. P. Stein, O. Mano, and A. Shashua, "A robust method for computing vehicle ego-motion, " in Proc. IEEE IV Symp., 2000, pp. 362-368. (Pubitemid 32135693)
38. J. S. Greenfeld, "Matching GPS observations to locations on a digital map, " in Proc. 81st Annu. Meeting Transp. Res. Board, Jan. 2002, p. 376.
39. M. A. Quddus, W. Y. Ochieng, and R. B. Noland, "Current map-matching algorithms for transport applications: State-of-the-art and future research directions, " Transp. Res. Part C: Emerging Technol., vol. 15, no. 5, pp. 312-328, Oct. 2007. (Pubitemid 47364527)
40. W. Ochieng, M. Quddus, and R. Noland, "Map-matching in complex urban road networks, " Brazilian J. Cartogr., vol. 55, no. 2, pp. 1-18, 2004.
41. D. Bernstein and A. Kornhauser, "An introduction to map matching for personal navigation assistants, " New Jersey TIDE Center, Newark, NJ, Tech. Rep., 2002.
42. Steve Coast, Openstreetmaps, 2010. [Online]. Available: http://wiki. openstreetmap. org
43. S. H. Laurila and T. A. Stansell, Electronic Surveying and Navigation. New York: Wiley, 1976.
44. M. Wolschon, Travelling Salesman, 2010. [Online]. Available: http://wiki. openstreetmap. org/wiki/Travelling-salesman
45. L. Clemente, A. Davison, I. Reid, J. Neira, and J. Tardós, "Mapping large loops with a single hand-held camera, " in Proc. Robot.: Sci. Syst. Conf., Jun. 2007, pp. 1-8.
46. S. Avidan and A. Shashua, "Trajectory triangulation: 3D reconstruction of moving points from a monocular image sequence, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 4, pp. 348-357, Apr. 2000. [Online]. Available: http://dx. doi. org/10. 1109/34. 845377.
47. M. Han and T. Kanade, "Reconstruction of a scene with multiple linearly moving objects, " in Proc. IEEE Conf. CVPR, Jun. 2000, pp. 542-549.
48. A. P. Dani, Z. Kan, N. R. Fischer, and W. E. Dixon, "Structure and motion estimation of a moving object using a moving camera, " in Proc. Amer. Control Conf., 2010, pp. 6962-6967.
49. A. P. Dani, Z. Kan, N. R. Fischer, and W. E. Dixon, "Structure estimation of a moving object using a moving camera: an unknown input observer approach, " in Proc. 50th IEEE Conf. Decision Control, 2011, pp. 5005-5010.
50. I. Parra, D. F. Llorca, M. Sotelo, L. M. Bergasa, P. Revenga, J. Nuevo, M. Ocaña, and M. A. García, "Combination of feature extraction methods for SVM pedestrian detection, " IEEE Trans. Intell. Transp. Syst., vol. 8, no. 2, pp. 292-307, Jun. 2007. (Pubitemid 46873210)
51. D. Fernandez Llorca, M. Sotelo, I. Parra, J. Naranjo, M. Gavilán, and S. Álvarez, "An experimental study on pitch compensation in pedestrianportection systems for collision avoidance and mitigation, " IEEE Trans. Intell. Transp. Syst., vol. 10, no. 3, pp. 469-474, Sep. 2009.
52. F. J. Rodríguez, M. Mazo, and M. A. Sotelo, "Automation of an industrial fork lift truck, guided by artificial vision in open environments, " Auton. Robots, vol. 5, no. 2, pp. 215-231, May 1998. [Online]. Available: http://dx. doi. org/10. 1023/A:1008826306614. (Pubitemid 128514285)
53. Á. Sotelo, F. J. Rodríguez, and L. Magdalena, "Virtuous: Vision-based road transportation for unmanned operation on urban-like scenarios, " IEEE Trans. Intell. Transp. Syst., vol. 5, no. 2, pp. 69-83, Jun. 2004.
54. S. Álvarez, M. A. Sotelo, M. Ocaña, D. F. Llorca, I. Parra, and L. M. Bergasa, "Perception advances in outdoor vehicle detection for automatic cruise control, " ROBOTICA, vol. 28, no. 5, pp. 765-779, Sep. 2009.