Identifying and tracking pedestrians based on sensor fusion and motion stability predictions

Sensors

Volumn 10, Issue 9, 2010, Pages 8028-8053

  Musleh, Basam ^a   García, Fernando ^a   Otamendi, Javier ^b   Armingol, José ^a   de la Escalera, Arturo ^a  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

^b UNIVERSIDAD REY JUAN CARLOS   (Spain)

Author keywords

Advanced driver assistance systems; Confidence intervals; Laser technology; Pedestrian detection; Sensor fusion; Stereo vision

Indexed keywords

CONFIDENCE INTERVAL; DENSE DISPARITY MAPS; INTELLIGENT ALGORITHMS; LASER TECHNOLOGIES; PEDESTRIAN DETECTION; REAL TIME ALGORITHMS; SENSOR FUSION; STATISTICAL VALIDATION;

ADVANCED DRIVER ASSISTANCE SYSTEMS; COMPUTER VISION; INTELLIGENT SYSTEMS; STEREO VISION;

SENSORS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CAR DRIVING; HUMAN; IMAGE PROCESSING; METHODOLOGY; REPRODUCIBILITY; WALKING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; AUTOMOBILE DRIVING; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; WALKING;

EID: 77958040204     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s100908028     Document Type: Article

References (39)

1. Gandhi, T.; Trivedi, M.M. Pedestrian protection systems: Issues, survey, and challenges. IEEE Trans. Intell. Transp. Syst. 2007, 8, 413-430.
2. Broggi, A.; Cerri, P.; Ghidoni, S.; Grisleri, P.; Ho Gi, J. Localization and analysis of critical areas in urban scenarios. In Proceedings of the IEEE Intelligent Vehicles Symposium, Eindhoven, The Netherlands, June 2008; pp. 1074-1079.
3. Broggi, A.; Cappalunga, A.; Caraffi, C.; Cattani, S.; Ghidoni, S.; Grisleri, P.; Porta, P.-P.; Posterli, M.; Zani, P.; Beck, J. The passive sensing suite of the TerraMax autonomous vehicle. In Proceedings of the IEEE Intelligent Vehicles Symposium, Eindhoven, the Netherlands, June 2008; pp. 769-774.
4. Hwang, P.; Cho, S.E.; Ryu, K.J.; Park, S.; Kim, E. Multi-classifier based LIDAR and camera fusion. In Proceedings of the IEEE Intl. Conf. on Intelligent Transportation Systems, Seattle, WA, USA, September 2007; pp. 467-472.
5. Mahlisch, M.; Schweiger, R.; Ritter, W.; Dietmayer, K. Sensorfusion using spatio-temporal aligned video and lidar for improved vehicle detection. In Proceedings of the IEEE Intelligent Vehicles Symposium, Tokyo, Japan, June 2006; pp. 424-429.
6. Labayrade, R.; Royere, C.; Gruyer, D.; Aubert, D. Cooperative fusion for multi-obstacles detection with use of stereovision and laser scanner. Auton. Robots 2005, 19, 117-140.
7. Kaempchen, N.; Buehler, M.; Dietmayer, K. Feature-level fusion for free-form object tracking using laserscanner and video. In Proceedings of the IEEE Intelligent Vehicles Symposium, Las Vegas, NV, USA, June 2005; pp. 453-458.
8. Premebida, C., Monteiro, G., Nunes, U., Peixoto, P. A lidar and vision-based approach for pedestrian and vehicle detection and tracking. In Proceedings of the IEEE Intl. Conf. on Intelligent Transportation Systems, Seattle, WA, USA, September 2007; pp. 1044-1049.
9. Premebida, C.; Ludwig, O.; Nunes, U. LIDAR and vision-based pedestrian detection system. J. Field Robotic. 2009, 26, 696-711.
10. Floudas, N.; Polychronopoulos, A.; Aycard, O.; Burlet, J.; Ahrholdt, M. High level sensor data fusion approaches for object recognition road environment. In Proceedings of the IEEE Intelligent Vehicles Symposium, Istanbul, Turkey, June 2007; pp. 136-141.
11. Kaempchen, N.; Dietmayer, K. Fusion of laser scanner and video for advanced driver assistance systems. In Proceedings of the 11th World Congress on Intelligent Transportation Systems, Nagoya, Japan, October 2004; pp. 1-8.
12. Spinello, L.; Siegwart, R. Human detection using multimodal and multidimensional features. In Proceedings of the IEEE International Conference on Robotics and Automation, Pasadena, CA, USA, May 2008; pp. 3264-3269.
13. Aycard, O.; Spalanzani, A.; Burlet, J.; Fulgenzi, C.; Dung, V.; Raulo, D.; Yguel, M. Grid based fusion & tracking. In Proceedings of the IEEE Intelligent Transportation Systems Conference, Toronto, Canada, September 2006; pp. 450-455.
14. Mahlisch, M.; Hering, R.; Ritter, W.; Dietmayer, K. Heterogeneous fusion of Video, LIDAR and ESP data for automotive ACC vehicle tracking. In Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Heidelberg, Germany, September 2006; pp. 139-144.
15. Leonard, J.J.; Durrant-Whyte, H.F. Mobile robot location by tracking geometric beacons. IEEE Trans. Robotic. Autom. 1991, 7, 376-382.
16. Hogg, R.V.; Craig, A.; McKean, J.W. Introduction to Mathematical Statistics, 6th ed.; Prentice Hall: Bergen County, NJ, USA, 2004.
17. McCulloch, C.E.; Boudreau, M.D.; Via, S. Confidence regions for evolutionary trajectories. Biometrics 1996, 52, 184-192.
18. Garcia, F., Cerri, P.; Broggi, A.; Armingol, J.M.; de la Escalera, A. Vehicle detection based on laser radar. Lect. N. Comput. Sci. 2009, 5717, 391-397.
19. Fusiello, A.; Trucco, E.; Verri, A. A compact algorithm for rectification of stereo pairs. Mach. Vision Appl. 2000, 12, 16-22.
20. Fusiello, A; Irsara, L.; Quasi-Euclidean uncalibrated epipolar rectification. In Proceedings of the 19th International Conference on Pattern Recognition, Tampa, FL, USA, December 2008; pp. 1-4.
21. Hartley, R.I. Theory and practice of projective rectification. Int. J. Comput. Vision 1999, 2, 115-127.
22. Soquet, N.; Perrollaz, R.; Labayrade, R.; Auber, D.; Free space estimation for autonomous navigation. In Proceedings of the 5th International Conference on Computer Vision System, Bielefeld, Germany, March 2007; pp. 1-6.
23. NVIDIA CUDA, Programming guide, 2.3.1 version, NVIDIA Co. Available online: http://developer.download.nvidia.com/compute/cuda/1_0/NVIDIA_CUDA_Progra mming_Guide_1.0.pdf (accessed on August 26, 2010).
24. Stam, J.; Gallup, D.; Frahm, J.M. CUDA stereo imaging. Draft. 2008. Available online: openvidia.sourceforge.net (accessed on August 26, 2010).
25. Scharstein, D.; Szeliski, R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vision 2002, 47, 7-42.
26. Brown, M.Z.; Burschka, D.; Hager, G.D. Advances in computational stereo. IEEE Trans. Pattern Anal. Mach. Intell. 2003, 25, 993-1008.
27. Gong, M.; Yang, L.; Wang, L.; Gong, M.A. Performance study on different cost aggregation approaches used in real-time stereo matching. Int. J. Comput. Vision 2007, 75, 283-296.
28. Yang, Q.; Wang, L.; Yang, R.; Wang, S.; Liao, M.; Nistér, D. Real-time global stereo matching using hierarchical belief propagation. In Proceedings of the British Machine Vision Conference Edinburgh, UK, September 2006; pp. 989-995.
29. Hirschmüller, P.; Innocent, R.; Garibaldi, J. Real time correlation based stereo vision with reduced border errors, Int. J. Comput. Vision 2002, 47, 229-246.
30. Broggi, A.; Caraffi, C.; Fedriga, R.I.; Grisleri, P.; Obstacle detection with stereo vision for off-road vehicle navigation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA, June 2005; pp. 65-71.
31. Labayrade, R., Aubert, D.; Tarel, J.P.; Real time obstacles detection in stereovision on non flat road geometry through V-disparity representation. In Proceedings of the Intelligent Vehicle Symposium, Versailles, France, June 2002; pp. 646-651
32. Hu, Z.; Uchimura, K. U-V disparity: An efficient algorithm for stereo vision based scene analysis. In Proceedings of the IEEE Intelligent Vehicles Symposium, Las Vegas, NV, USA, June 2005; pp. 48-54.
33. Soquet, N.; Aubert, D.; Hautiere, N.; Road segmentation supervised by an extended V-disparity algorithm for autonomous navigation. In Proceedings of the IEEE Intelligent Vehicles Symposium, Istanbul, Turkey, June 2007; pp. 160-165.
34. Lee, C.H.; Lim, Y.C.; Kong, S.; Lee, J.H.; Obstacle localization with a binarized v-disparity map using local maximum frequency values in stereo vision. In Proceedings of the International Conference on Signals, Circuits and System, Monastir, Tunisia, November 2008; pp. 1-4.
35. Sidak, Z. Rectangular confidence regions for the means of multivariate normal distributions. J. Am. Stat. Assoc. 1967, 62, 626-633.
36. Draper, N.R.; Guttman, I. Confidence intervals versus regions. Statistician 1995, 44, 399-403.
37. Goldberg, K.M.; Iglewizcz, B. Bivariate extensions of the boxplot. Technometrics 1992, 34, 307-320.
38. Leibe, B.; Cornelis, N.; Cornelis, K.; van Gool, L. Dynamic 3D scene analysis from a moving vehicle. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA, June 2007; pp. 1-8.
39. Bolder, B.; Dunn, M.; Gienger, M.; Janssen, H.; Sugiura, H.; Goerick, C. Visually guided whole body interaction. In Proceedings of the IEEE International Conference on Robotics and Automation, Rome, Italy, April 2007, pp. 3054-3061.