Learning Framework for Robust Obstacle Detection, Recognition, and Tracking

IEEE Transactions on Intelligent Transportation Systems

Volumn 18, Issue 6, 2017, Pages 1633-1646

  Nguyen, Vinh Dinh ^a   Van Nguyen, Hau ^a   Tran, Dinh Thi ^a   Lee, Sang Jun ^a   Jeon, Jae Wook ^a  

^a Sungkyunkwan University   (South Korea)

Author keywords

Deep learning; unsupervised learning; vehicle and pedestrian detection

Indexed keywords

AUTOMOBILE DRIVERS; OBJECT DETECTION; OBSTACLE DETECTORS; PATTERN RECOGNITION SYSTEMS; REAL TIME SYSTEMS; STEREO VISION; VEHICLES;

DEPTH INFORMATION; DRIVER ASSISTANCE SYSTEM; DRIVING CONDITIONS; LEARNING FRAMEWORKS; OBSTACLE DETECTION; PEDESTRIAN DETECTION; PEDESTRIAN RECOGNITION; REAL TIME REQUIREMENT;

PEDESTRIAN SAFETY;

EID: 84992027340     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2016.2614818     Document Type: Article

References (38)

1. S. Sivaraman and M. M. Trivedi, "Looking at vehicles on the road: A survey of vision-based vehicle detection, tracking, and behavior analysis, " IEEE Trans. Intell. Transp. Sys., vol. 14, no. 4, pp. 1773-1795, Dec. 2013.
2. V. D. Nguyen, T. T. Nguyen, D. D. Nguyen, S. J. Lee, and J. W. Jeon, "A fast evolutionary algorithm for real-time vehicle detection, " IEEE Trans. Veh. Tech., vol. 62, no. 6, pp. 2453-2468, Jul. 2013.
3. G. Toulminet, M. Bertozzi, S. Mousset, A. Bensrhair, and A. Broggi, "Vehicle detection by means of stereo vision-based obstacles features extraction and monocular pattern analysis, " IEEE Trans. Image Process., vol. 15, no. 8, pp. 2364-2375, Aug. 2006.
4. F. Erbs, A. Barth, and U. Franke, "Moving vehicle detection by optimal segmentation of the dynamic stixel world, " in Proc. IEEE Intell. Veh. Symp., Jun. 2011, pp. 951-956.
5. C. D. Pantilie and S. Nedevschi, "Real-time obstacle detection in complex scenarios using dense stereo vision and optical flow, " in Proc. 13th Int. IEEE Conf. Intell. Transp. Syst. (ITSC), Sep. 2010, pp. 439-444.
6. B. Southall, M. Bansal, and J. Eledath, "Real-time vehicle detection for highway driving, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recogn., Jun. 2009, pp. 541-548.
7. C.-C. Chiu, M.-L. Chung, and W.-C. Chen, "Real-time front vehicle detection algorithm for an asynchronous binocular system, " J. Inf. Sci. Eng., vol. 26, pp. 735-752, May 2010.
8. M. Nishigaki and Y. Aloimonos, "Moving obstacle detection using cameras for driver assistance system, " in Proc. IEEE Intell. Veh. Symp., Jun. 2010, pp. 805-812.
9. M. Enzweiler and D. M. Gavrila, "A mixed generative-discriminative framework for pedestrian classification, " in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
10. S. Sivaraman and M. M. Trivedi, "A general active-learning framework for on-road vehicle recognition and tracking, " IEEE Trans. Intell. Transp. Syst., vol. 11, no. 2, pp. 267-276, Jun. 2010.
11. C. Caraffi, T. Vojí?r, J. Trefný, and J. Šochman, "A system for real-time detection and tracking of vehicles from a single car-mounted camera, " in Proc. 15th Int. IEEE Conf. Intell. Transp. Syst. (ITSC), Sep. 2012, pp. 975-982.
12. C. Leistner, P. M. Roth, H. Grabner, H. Bischof, A. Starzacher, and B. Rinner, "Visual on-line learning in distributed camera networks, " in Proc. IEEE Int. Conf. Distrib. Smart Camera, Sep. 2008, pp. 1-10.
13. S. Richard, H. Brody, B. Bharath, D. M. Christopher, and Y. Andrew Ng, "Convolutional-recursive deep learning for 3d object classification, " in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 665-673.
14. Q. V. Le, J. Ngiam, Z. Chen, D. Chia, P. W. Koh, and A. Y. Ng, "Tiled Convolutional Neural Networks, " Adv. Neural Inf. Process. Syst., NIPS, vol. 23, pp. 1279-1287, Jan. 2010.
15. Q. V. Le, "Building high-level features using large scale unsupervised learning, " in Proc. Int. Conf. Mach. Learn., May 2013, pp. 8595-8598.
16. Q. Yao, X. Liao, and H. Jin, "A map-reduce method for training autoencoders on xeon phi, " in Proc. IEEE Int. Conf. Comput. Inf. Technol. Ubiquitous Comput. Commun., Oct. 2015, pp. 1330-1337.
17. V. D. Nguyen, D. D. Nguyen, S. J. Lee, and J. W. Jeon, "Local density encoding for robust stereo matching, " IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 12, pp. 2049-2062, Dec. 2014.
18. A. Bensrhair, M. Bertozzi, A. Broggi, A. Fascioli, S. Mousset, and G. Toulminet, "Stereo vision-based feature extraction for vehicle detection, " in Proc. IEEE Intell. Vehicle Symp., Jun. 2002, pp. 465-470.
19. C. G. Keller, M. Enzweiler, M. Rohrbach, D. F. Llorca, C. Schnorr, and D. M. Gavrila, "The benefits of dense stereo for pedestrian detection, " IEEE Trans. Intell. Transp. Syst., vol. 12, no. 2, pp. 1096-1106, Dec. 2011.
20. R. Labayrade, D. Aubert, and J. P. Tarel, "Real time obstacle detection in stereovision on non flat road geometry through 'v-disparity' representation, " IEEE Intell. Vehicle Symp., vol. 2. Jun. 2002, pp. 646-652.
21. M. Zhang, P. Liu, X. Zhao, X. Zhao, and Y. Zhang, "An obstacle detection algorithm based on U-V disparity map analysis, " in Proc. IEEE Int. Conf. ICITIS, Dec. 2010, pp. 763-776.
22. Z. Hu, F. Lamosa, and K. Uchimura, "A complete U-V-disparity study for stereovision based 3D driving environment analysis, " in Proc. Int. Conf. DIM, Jun. 2005, pp. 204-211.
23. S. Meister, B. Jähne, and D. Kondermann, "Outdoor stereo camera system for the generation of real-world benchmark data sets, " Opt. Eng., vol. 51, no. 2, p. 021107, Mar. 2012.
24. R. Klette et al., "Performance of correspondence algorithms in visionbased driver assistance using an online image sequence database, " IEEE Trans. Veh. Technol., vol. 60, no. 5, pp. 2012-2026, Jun. 2011.
25. T. Ahonen, A. Hadid, and M. Pietikäinen, "Face description with local binary patterns: Application to face recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
26. Z. Guo, L. Zhang, and D. Zhang, "A completed modeling of local binary pattern operator for texture classification, " IEEE Trans. Image Process., vol. 19, no. 6, pp. 1657-1663, Jun. 2010.
27. X. Tan and B. Triggs, "Enhanced local texture feature sets for face recognition under difficult lighting conditions, " in Analysis and Modeling of Faces and Gestures, vol. 4778. Berlin, Germany: Springer, 2007, pp. 168-182.
28. S. Murala, R. P. Maheshwari, and R. Balasubramanian, "Local tetra patterns: A new feature descriptor for content-based image retrieval, " IEEE Trans. Image Process., vol. 21, no. 5, pp. 2874-2886, May 2012.
29. A. Coates, A. Y. Ng, and H. Lee, "An analysis of single-layer networks in unsupervised feature learning, " Proc. J. Mach. Learn. Res. Track, AISTATS, Jan. 2011, pp. 215-223.
30. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, "Greedy layerwise training of deep networks, " in Adv. Neural Inf. Process. Syst., 2007, pp. 153-160.
31. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks, " Science, vol. 313, no. 5786, pp. 504-507, Jul. 2006.
32. R. Danescu, F. Oniga, S. Nedevschi, and M.-M. Meinecke, "Tracking multiple objects using particle filters and digital elevation maps, " in Proc. IEEE Intell. Veh. Symp., Jun. 2009, p. 88-93.
33. R. Danescu, F. Oniga, and S. Nedevschi, "Modeling and tracking the driving environment with a particle-based occupancy grid, " IEEE Trans. Intell. Transp. Syst., vol. 12, no. 4, p. 1131-1342, Dec. 2011.
34. K. Zhang, L. Zhang, and M. H. Yang, "Real-time compressive tracking, " in Proc. Eur. Conf. Comput. Vis., Oct. 2012, pp. 864-877.
35. M. Enzweiler and D. M. Gavrila, "Monocular pedestrian detection: Survey and experiments, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 12, pp. 2179-2195, Dec. 2009.
36. A. Geiger, P. Lenz, and R. Urtasun, "Are we ready for autonomous driving? The KITTI vision benchmark suite, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recogn, Jun. 2012, pp. 3354-3361.
37. S. Babenko, M. H. Yang, and S. Belongie, "Robust object tracking with online multiple instance learning, " in Proc. PAMI, 2011, pp. 1632-1649.
38. K. L. Priddy and P. E. Keller, Artificial Neural Networks: An Introduction. Bellingham, WA, USA: SPIE, 2005, pp. 16-17.