Design of a multi-sensor cooperation travel environment perception system for autonomous vehicle

Sensors (Switzerland)

Volumn 12, Issue 9, 2012, Pages 12386-12404

  Chen, Long ^a   Li, Qingquan ^a   Li, Ming ^a   Zhang, Liang ^a   Mao, Qingzhou ^a  

^a WUHAN UNIVERSITY   (China)

Author keywords

Autonomous vehicle; Multi sensor cooperation; Road and lane detection; Traffic sign detection; Travel environment perception system

Indexed keywords

AUTONOMOUS VEHICLES; ENVIRONMENT PERCEPTIONS; LANE DETECTION; MULTI SENSOR; TRAFFIC SIGN DETECTION;

CURBS; INTELLIGENT VEHICLE HIGHWAY SYSTEMS; SENSORS;

TRAFFIC SIGNS;

EID: 84867007027     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s120912386     Document Type: Article

References (51)

1. Batavia, P.; Pomerleau, D.; Thorpe, C. Predicting Lane Position for Roadway Departure Prevention. In Proceedings of the IEEE Intelligent Vehicles Symposium, Berlin, Germany, October 1998.
2. Batavia, P. Driver Adaptive Warning Systems; Technical Report CMU-RI-TR-98-07; Carnegie Mellon University: Pittsburgh, PA, USA, March 1998.
3. Bertozzi, M.; Broggi, A.; Cellario, M.; Fascioli, A.; Lombardi, P.; Porta, M. Artificial Vision in Road Vehicles. Proc. IEEE 2002, 90, 1258-1271.
4. Chen, M.; Jochem, T.; Pomerleau, D. AURORA: A Vision-based Roadway Departure Warning System. In Proceedings of the 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems 95, Human Robot Interaction and Cooperative Robots, Pittsburgh, PA, USA, August 1995; Volume 1, 243-248.
5. Pomerleau, D.; Thorpe, C.; Emery, L. Performance Specification Development for Roadway Departure Collision Avoidance Systems. In Proceedings of the 4th World Congress on Intelligent Transport Systems, Berlin, Germany, October 1997.
6. Bertozzi, M.; Broggi, A. Vision-Based Vehicle Guidance. Computer 1997, 30, 49-55.
7. Bertozzi, M.; Broggi, A. GOLD: A Parallel Real-time Stereo Vision System for Generic Obstacle and lane detection. IEEE Trans. Imag. Proc. 1998, 7, 62-81.
8. Kluge, K.; Lakshmanan, S. A Deformable-Template Approach to Lane Detection. In Proceedings of the Intelligent Vehicles '95 Symposium, Detroit, MI, USA, 25-26 September 1995; pp. 54-59.
9. Broggi, A. Robust Real-time Lane and Road Detection in Critical Shadow Conditions. In Proceedings of International Symposium on Computer Vision, Coral Gables, FL, USA, November 1995; pp. 353-358.
10. Paetzold, F.; Franke, U.; von Seelen, W. Lane Recognition in Urban Environment Using Optimal Control Theory. In Proceedings of the Intelligent Vehicles Symposium, Dearborn, MI, USA, October 2000; pp. 221-226.
11. Wang, Y.; Shen, D.; Teoh, E. Lane Detection Using Spline Model. Pattern Recognit. Lett. 2000, 21, 677-689.
12. Kang, D.; Choi, J.; Kweon, I. Finding and Tracking Road Lanes Using Line-snakes. In Proceedings of the Intelligent Vehicles Symposium, Tokyo, Japan, September 1996; pp. 189-194.
13. Wang, Y.; Teoh, E.; Shen, D. Lane detection and tracking using B-Snake. Image Vis. Comput. 2004, 22, 269-280.
14. Lieb, D.; Lookingbill, A.; Thrun, S. Adaptive Road Following Using Self-supervised Learning and Reverse Optical Flow. In Proceedings of Robotics: Science and Systems, Cambridge, MI, USA, June 2005.
15. Wang, J.; Ji, Z.; Su, Y. Unstructured road detection using hybrid features. In Proceedings of the International Conference on Machine Learning and Cybernetics, Baoding, China, July 2009, Volume 1,pp. 482-486.
16. Foedisch, M.; Takeuchi, A. Adaptive Road Detection Through Continuous Environment Learning. In Proceedings of the 33rd Applied Imagery Pattern Recognition Workshop, Washington, DC, USA, October 2004; pp. 16-21.
17. Zhou, S.; Iagnemma, K. Self-supervised Learning Method for Unstructured Road Detection Using Fuzzy Support Vector Machines. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, October 2010.
18. Chen, L.; Li, Q.; Mao, Q.; Zou, Q. Block-constraint Line Scanning Method for Lane Detection. In Proceedings of the Intelligent Vehicles Symposium, San Diego, CA, USA, June 2010; pp. 89-94.
19. Wijesoma, W.; Kodagoda, K.; Balasuriya, A. Road-boundary Detection and Tracking Using Ladar Sensing. IEEE Trans. Robot. Autom. 2004, 20, 456-464.
20. Chen, S.; Li, Y.; Kwok, N. Active Vision in Robotic Systems: A Survey of Recent Developments. Int. J. Robot. Res. 2011, 30, 1343-1377.
21. Gavrila, D.; Philomin, V. Real-Time Object Detection for Smart Vehicles. In Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece, September 1999; Volume 1, pp. 87-93.
22. Gavrila, D.; Franke, U.; Wohler, C.; Gorzig, S. Real Time Vision for Intelligent Vehicles. IEEE Instrum. Meas. Mag. 2001, 4, 22-27.
23. Barnes, N.; Zelinsky, A. Real-time Radial Symmetry for Speed Sign Detection. In Proceedings of the Intelligent Vehicles Symposium, Parma, Italy, June 2004; pp. 566-571.
24. Andrey, V.; Jo, K. Automatic Detection and Recognition of Traffic Signs Using Geometric Structure Analysis. In Proceedings of the International Joint Conference on SICE-ICASE, Busan, Korea, October 2006; pp. 1451-1456.
25. Liu, H.; Ran, B. Vision-based Stop Sign Detection and Recognition System for Intelligent Vehicles. Transp. Res. Rec. 2001, 1748, 161-166.
26. de la Escalera, A.; Armingol, J.; Mata, M. Traffic Sign Recognition and Analysis for Intelligent Vehicles. Image Vis. Comput. 2003, 21, 247-258.
27. Kehtarnavaz, N.; Ahmad, A. Traffic Sign Recognition in Noisy Outdoor Scenes. In Proceedings of the Intelligent Vehicles 95 Symposium, Detroit, MI, USA, September 1995; pp. 460-465.
28. Siogkas, G.; Dermatas, E. Detection, Tracking and Classification of Road Signs in Adverse Conditions. In Proceedings of the 2006 IEEE Mediterranean Electrotechnical Conference, Malaga, Spain, May 2006; pp. 537-540
29. de la Escalera, A.; Armingol, J.; Pastor, J.; Rodriguez, F. Visual Sign Information Extraction and Identification by Deformable Models for Intelligent Vehicles. Intell. Transp. Sys. 2004, 5, 57-68.
30. Fleyeh, H. Color Detection and Segmentation for Road and Traffic Signs. In Proceedings of the Conference on Cybernetics and Intelligent Systems, Singapore, December 2004; Volume 2, pp. 809-814.
31. Soetedjo, A.; Yamada, K. Fast and Robust Traffic Sign Detection. In Proceedings of 2005 IEEE International Conference on Systems, Man and Cybernetics, Waikoloa, HI, USA, October 2005; Volume 2, pp. 1341-1346.
32. Piccioli, G.; De Micheli, E.; Parodi, P.; Campani, M. Robust Method for Road Sign Detection and Recognition. Imag Vis. Comput. 1996, 14, 209-223.
33. Wu, W.; Chen, X.; Yang, J. Detection of Text on Road Signs From Video. IEEE Trans. Intell. Transp. 2005, 6, 378-390.
34. Li, L.; Ma, G.; Ding, S. Identification of Degraded Traffic Sign Symbols Using Multi-Class Support Vector Machines. In Proceedings of the International Conference on Mechatronics and Automation, Harbin, China, August 2007; pp. 2467-2471.
35. Bahlmann, C.; Zhu, Y.; Ramesh, V.; Pellkofer, M.; Koehler, T. A System for Traffic Sign Detection, Tracking, and Recognition Using Color, Shape, and Motion Information. In Proceedings of the Intelligent Vehicles Symposium, Las Vegas, NV, USA, June 2005; pp. 255-260.
36. Keller, C.; Sprunk, C.; Bahlmann, C.; Giebel, J.; Baratoff, G. Real-Time Recognition of US Speed Signs. In Proceedings of the Intelligent Vehicles Symposium, Eindhoven, the Netherlands, June 2008; pp. 518-523.
37. Ishak, K.; Sani, M.; Tahir, N. A Speed Limit Sign Recognition System Using Artificial Neural Network. In Prceedings of the Conference on Research and Development, Selangor, Malaysia, June 2006; pp. 127-131.
38. Nguwi, Y.; Kouzani, A. Automatic Road Sign Recognition Using Neural Networks. In Proceedings of the 2006 International Joint Conference on Neural Networks, Vancouver, BC, Canada, 2006; pp. 3955-3962.
39. Ach, R.; Luth, N.; Schinner, T.; Techmer, A.; Walther, S. Classification of Traffic Signs in Real-Time on a Multi-Core Processor. In Proceedings of the Intelligent Vehicles Symposium, Eindhoven, the Netherlands, June 2008; pp. 313-318.
40. Maldonado-Bascon, S.; Lafuente-Arroyo, S.; Siegmann, P.; Gomez-Moreno, H.; Acevedo-Rodriguez, F. Traffic Sign Recognition System for Inventory Purposes. In Proceedings of the Intelligent Vehicles Symposium, Eindhoven, the Netherlands, June 2008; pp. 590-595.
41. Kouzani, A. Road-Sign Identification Using Ensemble Learning. In Proceedings of the Intelligent Vehicles Symposium, Xi'an, China, June 2007; pp. 438-443.
42. Viola, P.; Jones, M. Robust Real-time Object Detection. Int. J. Comput. Vis. 2001, 57, 137-154.
43. Urmson, C.; Anhalt, J.; Bagnell, D.; Baker, C.; Bittner, R.; Clark, M.; Dolan, J.; Duggins, D.; Galatali, T.; Geyer, C. et al. Autonomous Driving in Urban Environments: Boss and the Urban Challenge. J. Field Robot. 2008, 25, 425-466.
44. Thrun, S.; Montemerlo, M.; Dahlkamp, H.; Stavens, D.; Aron, A.; Diebel, J.; Fong, P.; Gale, J.; Halpenny, M.; Hoffmann, G. et al. Stanley: The Robot that Won the DARPA Grand Challenge. J. Robot. Sys. 2007, pp. 1-43.
45. Bradski, G.; Kaehler, A. Learning OpenCV: Computer vision with the OpenCV library; O'Reilly Media, 2008.
46. Zhang, Z. Flexible Camera Calibration by Viewing a Plane from Unknown Orientations. In Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece, September 1999; Volume 1, pp. 666-673.
47. Viola, P.; Jones, M. Robust Real-Time Face Detection. Int. J. Comput. Vis. 2004, 57, 137-154.
48. Bay, H.; Tuytelaars, T.; Van Gool, L. SURf: Speeded Up Robust Ffeatures. In Proceedings of the 9th European Conference on Computer Vision, Graz, Austria, May 2006; pp. 404-417.
49. Fasel, B.; Van Gool, L. Interactive Museum Guide: Accurate Retrieval of Object Descriptions. In Proceedings of the 4th International Conference on Adaptive Multimedia Retrieval: User, Context, and Feedback, Geneva, Switzerland, July 2006; pp. 179-191.
50. Arya, S.; Mount, D.; Netanyahu, N.; Silverman, R.; Wu, A. An Optimal Algorithm for Approximate Nearest Neighbor Searching Fixed Dimensions. J. ACM (JACM) 1998, 45, 891-923.
51. Chen, L.; Li, Q.; Li, M.; Mao, Q. Traffic Sign Detection and Recognition for Intelligent Vehicle. In Proceedings of the Intelligent Vehicles Symposium, Baden-Banden, Germany, June 2011; pp. 908-913.