A vision-based driver nighttime assistance and surveillance system based on intelligent image sensing techniques and a heterogamous dual-core embedded system architecture

Sensors

Volumn 12, Issue 3, 2012, Pages 2373-2399

  Chen, Yen Lin ^a   Chiang, Hsin Han ^b   Chiang, Chuan Yen ^c   Liu, Chuan Ming ^a   Yuan, Shyan Ming ^c   Wang, Jenq Haur ^a  

^a NATIONAL TAIPEI UNIVERSITY OF TECHNOLOGY   (Taiwan)

^b FU JEN CATHOLIC UNIVERSITY   (Taiwan)

^c NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

Author keywords

CCD sensors; Computer vision techniques; Driver assistance systems; Embedded systems; Heterogeneous multi core systems; Nighttime driving

Indexed keywords

EID: 84858994625     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s120302373     Document Type: Article

References (39)

1. Masaki, I. Vision-Based Vehicle Guidance; Springer-Verlag: New York, NY, USA, 1992.
2. Broggi, A.; Bertozzi, M.; Fascioli, A.; Conte, G. Automatic Vehicle Guidance: The Experience of the ARGO Autonomous Vehicle; World Scientific: Singapore, 1999.
3. Wu, B.-F.; Lin, C.-T.; Chen, Y.-L. Dynamic calibration and occlusion handling algorithms for lane tracking. IEEE Trans. Ind. Electron. 2009, 56, 1757-1773.
4. Broggi, A.; Bertozzi, M.; Fascioli, A.; Bianco, C.G.L.; Piazzi, A. Visual perception of obstacles and vehicles for platooning. IEEE Trans. Intell. Transport. Syst. 2000, 1, 164-176.
5. Jang, J.A.; Kim, H.S.; Cho, H.B. Smart roadside system for driver assistance and safety warnings: Framework and applications. Sensors 2011, 11, 7420-7436.
6. Kurihata, H.; Takahashi, T.; Ide, I.; Mekada, Y.; Murase, H.; Tamatsu, Y.; Miyahara, T. Detection of raindrops on a windowshield from an in-vehicle video camera. Int. J. Innov. Comp. Inf. Control 2007, 3, 1583-1591.
7. Musleh, B.; García, F.; Otamendi, J.; Armingol, J.M.; De la Escalera, A. Identifying and tracking pedestrians based on sensor fusion and motion stability predictions. Sensors 2010, 10, 8028-8053.
8. Deguchi, D.; Doman, K.; Ide, I.; Murase, H. Improvement of a traffic sign detector by retrospective gathering of training samples from in-vehicle camera image sequences. In Proceedings of the 10th Asian Conference Computer Vision, Queenstown, New Zealand, 8-12 November 2010; pp. 204-213.
9. Nedevschi, S.; Danescu, R.; Frentiu, D.; Marita, T.; Oniga, F.; Pocol, C.; Schmidt, R.; Graf, T. High accuracy stereo vision for far distance obstacle detection. Proc. IEEE Intell. Veh. Symp. 2004, doi: 10.1109/IVS.2004.1336397.
10. Betke, M.; Haritaoglu, E.; Davis, L.S. Real-time multiple vehicle detection and tracking from a moving vehicle. Mach. Vision Appl. 2000, 12, 69-83.
11. Beymer, D.; McLauchlan, P.; Coifman, B.; Malik, J. A real-time computer vision system for measuring traffic parameters. In Proceedings of 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 17-19 June 1997; pp. 495-510.
12. Huang, K.; Wang, L.; Tan, T.; Maybank, S. A real-time object detecting and tracking system for outdoor night surveillance. Pattern Recognit. 2008, 41, 432-444.
13. Stam, J.S.; Pierce, M.W.; Ockerse, H.C. Image Processing System to Control Vehicle Headlamps or Other Vehicle Equipment. U.S. Patent 6,868,322, 15 March 2005.
14. Eichner, M.L.; Breckon, T.P. Real-time video analysis for vehicle lights detection using temporal information. In Proceedings of the 4th European Conference on Visual Media Production, London, UK, 27-28 November 2007; p. 1.
15. O'Malley, R.; Jones, E.; Glavin, M. Rear-lamp vehicle detection and tracking in low-exposure color video for night conditions. IEEE Trans. Intell. Transp. Syst. 2010, 11, 453-462.
16. Hsiao, P.-Y.; Yeh, C.-W.; Huang, S.-S.; Fu, L.-C. A portable vision-based real-time lane departure warning system: Day and night. IEEE Trans. Veh. Technol. 2009, 58, 2089-2094.
17. Hsiao, P.-Y.; Cheng, H.-C.; Huang, S.-S.; Fu, L.-C. CMOS image sensor with a built-in lane detector. Sensors 2009, 9, 1722-1737.
18. Young, C.-P.; Chang, B.-R.; Tsai, H.-F.; Fang, R.-Y.; Lin, J.-J. Vehicle collision avoidance system using embedded hybrid intelligent prediction based on vision/GPS sensing. Int. J. Innov. Comp. Inf. Control 2009, 5, 4453-4468.
19. Antonini, M.; Barlaud, M.; Mathieu, P.; Daubechies, I. Image coding using wavelet transform. IEEE Trans. Image Proc. 1992, 1, 205-220.
20. Li, S.; Li, W. Shape-adaptive discrete wavelet transforms for arbitrarily shaped visual object coding. IEEE Trans. Circuits Syst. Video Technol. 2000, 10, 725-743.
21. Shapiro, J.M. Embedded image coding using zerotrees of wavelets coefficients. IEEE Trans. Sig. Process. 1993, 41, 3445-3462.
22. Said, A.; Pearlman, W.A. A new, fast, and efficient image codec based on set partitioning in hierarchical trees. IEEE Trans. Circuits Syst. Video Technol. 1996, 6, 243-250.
23. Taubman, D. High performance image scalable image compression with EBCOT. IEEE Trans. Image Process. 2000, 9, 1158-1170.
24. Huang, H.-Y.; Wu, B.-F.; Chen, Y.-L.; Hsieh, C.-M. A new fast approach of single-pass perceptual embedded zero-tree coding. ICIC Express Lett. 2011, 5, 2523-2530.
25. ISO/IEC 15444-1: Information Technology-JPEG2000 Image Coding System; ISO/IEC: Geneva, Switzerland, 2000.
26. Christopoulos, C.; Skodras, A.; Ebrahimi, T. The JPEG2000 still image coding system: An overview. IEEE Trans. Consumer Electron. 2000, 46, 1103-1127.
27. Koenen, R. Overview of the MPEG-4 Version 1 Standard; ISO/IEC JTC1/SC29/WG11 N1909; ISO/IEC: Geneva, Switzerland, 1997.
28. Sikora, T. The MPEG-4 video standard verification model. IEEE Trans. Circuits Syst. Video Technol. 1997, 7, 19-31.
29. Wu, B.F.; Chen, Y.L.; Chiu, C.C. A discriminant analysis based recursive automatic thresholding approach for image segmentation. IEICE Trans. Inf. Syst. 2005, E88-D, 1716-1723.
30. Chen, Y.L.; Wu, B.F. A multi-plane segmentation approach for text extraction from complex document images. Pattern Recognit. 2009, 42, 1419-1444.
31. Rueda, L. An efficient algorithm for optimal multilevel thresholding of irregularly sampled histograms. In Structural, Syntactic, Statistical Pattern Recognition; Springer-Verlag: Berlin, Germany, 2008; pp. 602-611.
32. Rojas, D.; Rueda, L.; Urrutia, H.; Ngom, A. Efficient optimal multi-level thresholding for biofilm image segmentation. In Pattern Recognition in Bioinformatics; Springer-Verlag: Berlin, Germany, 2009, pp. 307-318.
33. Chen, Y.-L.; Liang, W.-Y.; Chiang, C.-Y.; Hsieh, T.-J.; Lee, D.-C.; Yuan, S.-M.; Chang, Y.-L. Vision-based finger detection, tracking, and event identification techniques for multi-touch sensing and displaying systems. Sensors 2011, 11, 6868-6892.
34. Suzuki, K.; Horiba, I.; Sugie, N. Linear-time connected-component labeling based on sequential local operations. Comput. Vis. Image Underst. 2003, 89, 1-23.
35. Stein, G.P.; Mano. O.; Shashua, A. Vision-based ACC with a single camera: Bounds on range and range rate accuracy. Proc. IEEE Intell. Veh. Symp. 2003, 120-125.
36. The TI OMAP3530 Dual-Core Embedded Platform. Available online: http://www.ti.com/product/omap3530 (accessed on 9 January 2012).
37. Linux Digital Video Software Development Kits (DVSDK). Available online: http://www.ti.com/tool/linuxdvsdk-dv (accessed on 9 January 2012).
38. Codec Engine GenCodecPkg Wizard FAQ. Available online: http://processors.wiki.ti.com/index.php/Codec_Engine_GenCodecPkg_Wizard_FAQ (accessed on 9 January 2012).
39. Sneath, P.; Sokal, R. Numerical Taxonomy. The Principle and Practice of Numerical Classification; W.H. Freeman: New York, NY, USA, 1973.