3D LIDAR-camera extrinsic calibration using an arbitrary trihedron

Sensors (Switzerland)

Volumn 13, Issue 2, 2013, Pages 1902-1918

  Gong, Xiaojin ^a   Lin, Ying ^a   Liu, Jilin ^a  

^a ZHEJIANG UNIVERSITY   (China)

Author keywords

3D LIDAR camera system; Extrinsic calibration; Sensor fusion

Indexed keywords

3D LIDAR-CAMERA SYSTEM; CALIBRATION PARAMETERS; EXTRINSIC CALIBRATION; GEOMETRIC CONSTRAINT; NONLINEAR LEAST SQUARES; RELATIVE TRANSFORMATION; SENSOR FUSION; STRUCTURED ENVIRONMENT;

CAMERAS; ITERATIVE METHODS; MATHEMATICAL TRANSFORMATIONS; OPTICAL RADAR; SENSORS; THREE DIMENSIONAL COMPUTER GRAPHICS;

CALIBRATION;

EID: 84875159017     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s130201902     Document Type: Article

References (30)

1. Ess, A.; Leibe, B.; Schindler, K.; Van, G.L. Moving Obstacle Detection in Highly Dynamic Scenes. In Proceeding of IEEE International Conference Robotics and Automation, Kobe, Japan, 12-17 May 2009.
2. Geiger, A.; Lenz, P.; Urtasun, R. Are We Ready for Autonomous Driving? The KITTI Vision Benchmark Suite. In Proceeding of 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA, 16-21 June 2012.
3. Wulf, O.; Arras, K.; Christensen, H.; Wagner, B. 2D Mapping of Cluttered Indoor Environments by Means of 3D Perception. In Proceeding of IEEE International Conference on Robotics and Automation, Barcelona, Spain, 18-22 April 2004; Volume 4, pp. 4204-4209.
4. Pandey, G.; McBride, J.R.; Eustice, R. Ford campus vision and lidar data set. Int. J. Robot. Res. 2011, 30, 1543-1552.
5. Zhao, G.; Xiao, X.; Yuan, J. Fusion of Velodyne and Camera Data for Scene Parsing. In Proceeding of 15th International Conference on Information Fusion (FUSION), Seattle, WA, USA, 6-9 July 2009.
6. Wasielewski, S.; Strauss, O. Calibration of a Multi-Sensor System Laser Rangefinder/Camera. In Proceedings of the Intelligent Vehicles Symposium, Detroit, MI, USA, 25-26 September 1995; pp. 472-477.
7. Naroditsky, O.; Iv, E.P.; Daniilidis, K. Automatic Alignment of a Camera with a Line Scan Lidar System. In Proceedings of IEEE International Conference Robotics and Automation, Shanghai, China, 9-13 May 2011.
8. Zhang, Q.; Pless, R. Extrinsic Calibration of a Camera and Laser Range Finder (Improve Camera Calibration). In Proceedings of IEEE International Conference on Intelligent Robots and Systems, Sendai, Japan, 28-30 September 2004; pp. 2301-2306.
9. Mei, C.; Rives, P. Calibration between a Central Catadioptric Camera and a Laser Range Finder for Robotic Applications. In Proceedings of IEEE International Conference on Robotics and Automation, Orlando, FL, USA, 15-19 May 2006; pp. 532-537.
10. Zhang, Z. A flexible new technique for camera calibration. IEEE Tran. Pattern Anal. Mach. Intell. 2000, 22, 1330-1334.
11. Madsen, K.; Nielsen, H.; Tingleff, O. Methods for Non-Linear Least Squares Problems. In Informatics and Mathematical Modelling; Technical University of Denmark: Lyngby, Denmark, 2004.
12. Unnikrishnan, R.; Hebert, M. Fast Extrinsic Calibration of a Laser Rangefinder to a Camera; Carnegie Mellon University, Rotbotics Institute: Pittsburgh, PA, USA, 2005.
13. Pandey, G.; McBride, J.; Savarese, S.; Eustice, R. Extrinsic Calibration of a 3D Laser Scanner and an Omnidirectional Camera. In Proceedings of 7th IFAC Symposium on Intelligent Autonomous Vehicles, Lecce, Italy, 6-8 September 2010.
14. Rodriguez, F.S.; Fremont, V.; Bonnifait, P. Extrinsic Calibration between a Multi-Layer Lidar and a Camera. In Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Seoul, Korea, 20-22 August 2008; pp. 214-219.
15. Klimentjew, D.; Hendrich, N.; Zhang, J. Mulit Sensor Fusion of Camera and 3D Laser Range Finder for Object Recognition. In Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Salt Lake City, UT, USA, 5-7 September 2010; pp. 236-241.
16. Aliakbarpour, H.; Nuez, P.; Prado, J.; Khoshhal, K.; Dias, J. An Efficient Algorithm for Extrinsic Calibration between a 3D Laser Range Finder and a Stereo Camera for Surveillance. In Proceedings of International Conference on Advanced Robotics, Munich, Germany, 22-26 June 2009; pp. 1-6.
17. Pandey, G.; McBride, J.R.; Savarese, S.; Eustice, R.M. Automatic Targetless Extrinsic Calibration of a 3D Lidar and Camera by Maximizing Mutual Information. In Proceedings of the AAAI National Conference on Artifical Intelligence, Toronto, Canada, 22-26 July 2012.
18. Stamos, I.; Liu, L.; Chen, C.; Wolberg, G.; Yu, G.; Zokai, S. Integrating automated range registration with multiview geometry for the photorealistic modeling of large-scale scenes. Int. J. Comput. Vis. 2008, 78, 237-260.
19. Mirzaei, F.M.; Kottas, D.G.; Roumeliotis, S.I. 3D lidar-camera intrinsic and extrinsic calibration: Observability analysis and analytical least squares-based initialization. Int. J. Robot. Res. 2012, in press.
20. Geiger, A.; Moosmann, F.; Car, O.; Schuster, B. A Toolbox for Automatic Calibration of Range and Camera Sensors Using a Single Shot. In Proceedings of International Conference on Robotics and Automation (ICRA), St. Paul, MN, USA, 14-18 May 2012.
21. Scaramuzza, D.; Harati, A.; Siegwart, R. Extrinsic Self Calibration of a Camera and a 3D Laser Range Finder from Natural Scenes. In Proceedings of IEEE International Conference on Intelligent Robots and Systems, San Diego, CA, USA, 29 October-2 November 2007; pp. 4164-4169.
22. Li, G.; Liu, Y.; Dong, L.; Cai, X.; Zhou, D. An Algorithm for Extrinsic Parameters Calibration of a Camera and a Laser Range Finder Using Line Features. In Proceedings of IEEE International Conference on Intelligent Robots and Systems, San Diego, CA, USA, 29 October-2 November 2007; pp. 3854-3859.
23. Mirisola, L.G.B.; Lobo, J.; Dias, J. 3D Map Registration using Vision/Laser and Inertial Sensing. In Proceedings of European Conference on Mobile Robots (EMCR), Freiburg, Germany, 19-21 September 2007.
24. Nnez, P.; Jr, P.D.; Rocha, R.; Dias, J. Data Fusion Calibration for a 3D Laser Range Finder and a Camera Using Inertial Data. In Proceedings of European Conference on Mobile Robots (ECMR), Dubrovnik, Croatia, 23-25 September 2009; pp. 31-36.
25. Grey, P. Ladybug3 Getting Started Manual, 2012. Available online: http://www.ptgrey.com/(accessed on 25 Jannuary 2013).
26. Velodyne. Velodyne HDL-64E, 2012. Available online: http://velodynelidar.com/lidar (accessed on 25 Jannuary 2013).
27. Ly, S.; Demonceaux, C.; Vasseur, P. Translation Estimation for Single Viewpoint Cameras Using Lines. In Proceedings of International Conference on Robotics and Automation (ICRA), Anchorage, AK, USA, 3-8 May 2010; pp. 1928-1933.
28. Hartley, R.I.; Zisserman, A. Multiple View Geometry in Computer Vision, 2nd ed.; Cambridge University Press: Cambridge, UK, 2004.
29. Lowe, D.G. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 2004, 60, 91-110.
30. Kinoshita, K. 3D Accuracy Improvement from an Image-Evaluation and Viewpoint Dependency. In Proceedings of Australia-Japan Advanced Workshop on Computer Vision, Adelaide, Australia, 9-11 September 2003.