The benefits of dense stereo for pedestrian detection

IEEE Transactions on Intelligent Transportation Systems

Volumn 12, Issue 4, 2011, Pages 1096-1106

  Keller, Christoph G ^a   Enzweiler, Markus ^b   Rohrbach, Marcus ^c   Llorca, David Fernández ^d   Schnörr, Christoph ^a   Gavrila, Dariu M ^b,e  

^a UNIVERSITY OF HEIDELBERG   (Germany)

^b DAIMLER AG   (Germany)

^c MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^d UNIVERSITY OF ALCALÁ   (Spain)

^e UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Active safety; computer vision; intelligent vehicles; pedestrian detection

Indexed keywords

ACTIVE SAFETY; CAMERA PARAMETER; DETECTION RATES; DISCRIMINATIVE CLASSIFIERS; DYNAMIC ESTIMATION; FALSE ALARMS; FEATURE SPACE; GRADIENT ORIENTATIONS; IMAGE DATA; INTENSITY IMAGES; LINEAR SUPPORT VECTOR MACHINES; PEDESTRIAN DETECTION; PEDESTRIAN DETECTION SYSTEM; PERFORMANCE IMPROVEMENTS; REGIONS OF INTEREST; ROAD PROFILE; SCENE CONSTRAINTS; SPATIAL FEATURES; SPEED BUMPS; URBAN ENVIRONMENTS;

COMPUTER VISION; FEATURE EXTRACTION; INTELLIGENT VEHICLE HIGHWAY SYSTEMS; STEREO VISION; VECTOR SPACES;

PEDESTRIAN SAFETY;

EID: 82455209062     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2011.2143410     Document Type: Article

References (51)

1. I. P. Alonso, D. F. Llorca, M. A. Sotelo, L. M. Bergasa, P. Revenga de Toro, J. Nuevo,M. Ocana, andM. A. G. Garrido, "Combination of feature extraction methods for SVM pedestrian detection," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 2, pp. 292-307, Jun. 2007.
2. S. Bauer, U. Brunsmann, and S. Schlotterbeck-Macht, "FPGA implementation of a HOG-based pedestrian recognition system," in Proc. MPCWorkshop, 2009, pp. 49-58.
3. A. Broggi, A. Fascioli, I. Fedriga, A. Tibaldi, and M. Del Rose, "Stereobased preprocessing for human shape localization in unstructured environments," in Proc. IEEE Intell. Vehicles Symp., 2003, pp. 410-415.
4. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Conf. CVPR, 2005, pp. 886-893.
5. N. Dalal, B. Triggs, and C. Schmid, "Human detection using oriented histograms of flow and appearance," in Proc. ECCV, 2006, pp. 428-441.
6. P. Dollar, C. Wojek, B. Schiele, and P. Perona, "Pedestrian detection: A benchmark," in Proc. IEEE Conf. CVPR, 2009, pp. 304-311.
7. R. P. W. Duin and D. M. J. Tax, "Experiments with classifier combining rules," in Proc. 1st Int. Workshop Multiple Classifier Syst., 2000, pp. 16-29.
8. M. Enzweiler, A. Eigenstetter, B. Schiele, and D. M. Gavrila, "Multi-cue pedestrian classification with partial occlusion handling," in Proc. IEEE Conf. CVPR, 2010, pp. 990-997.
9. M. Enzweiler and D. M. Gavrila, "Monocular pedestrian detection: Survey and experiments," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 12, pp. 2179-2195, Dec. 2009.
10. M. Enzweiler, P. Kanter, and D. M. Gavrila, "Monocular pedestrian recognition using motion parallax," in Proc. IEEE Intell. Vehicles Symp., 2008, pp. 792-797.
11. A. Ess, B. Leibe, and L. van Gool, "Depth and appearance for mobile scene analysis," in Proc. ICCV, 2007, pp. 1-8.
12. D. Fernandez, I. Parra, M. A. Sotelo, P. Revenga, S. Alvarez, and M. Gavilan, "3D candidate selection method for pedestrian detection on non-planar roads," in Proc. IEEE Intell. Vehicles Symp., 2007, pp. 1162-1167.
13. U. Franke, S. K. Gehrig, H. Badino, and C. Rabe, "Towards optimal stereo analysis of image sequences," in Proc. Robot Vis., 2008, pp. 43-58.
14. T. Gandhi and M. M. Trivedi, "Pedestrian protection systems: Issues, survey, and challenges," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 3, pp. 413-430, Sep. 2007.
15. D. M. Gavrila and S. Munder, "Multi-cue pedestrian detection and tracking from a moving vehicle," Int. J. Comput. Vis., vol. 73, no. 1, pp. 41-59, Jun. 2007.
16. D. Geronimo, A. M. Lopez, A. D. Sappa, and T. Graf, "Survey on pedestrian detection for advanced driver assistance systems," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 7, pp. 1239-1258, Jul. 2010.
17. D. Geronimo, A. D. Sappa, D. Ponsa, and A. M. Lopez, "2D-3D based on-board pedestrian detection system," Comput. Vis. Image Understand., vol. 114, no. 5, pp. 583-595, May 2010.
18. G. Grubb, A. Zelinsky, L. Nilsson, and M. Rilbe, "3D vision sensing for improved pedestrian safety," in Proc. IEEE Intell. Vehicles Symp., Jun. 2004, pp. 19-24.
19. M. Hiromoto and R.Miyamoto, "Hardware architecture for high-accuracy real-time pedestrian detection with CoHOG features," in Proc. 5th IEEE Workshop Embedded Comput. Vis., 2009, pp. 894-899.
20. H. Hirschmüller, "Stereo processing by semiglobal matching and mutual information," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 328-341, Feb. 2008.
21. M. Hussein, F. Porikli, and L. Davis, "A comprehensive evaluation framework and a comparative study for human detectors," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 3, pp. 417-427, Sep. 2009.
22. C. Keller,M. Enzweiler, and D. M. Gavrila, "A new benchmark for stereobased pedestrian detection," in Proc. IEEE Intell. Vehicles Symp., Baden- Baden, Germany, 2011.
23. C. G. Keller, D. F. Llorca, and D. M. Gavrila, "Dense stereo-based ROI generation for pedestrian detection," in Proc. DAGM Symp. Pattern Recog., 2009, pp. 81-90.
24. R. Labayrade, D. Aubert, and J. P. Tarel, "Real time obstacle detection in stereovision on non flat road geometry through "v- disparity" representation," in Proc. IEEE Intell. Vehicles Symp., 2002, pp. 646-651.
25. B. Leibe, N. Cornelis, K. Cornelis, and L. Van Gool, "Dynamic 3D scene analysis from a moving vehicle," in Proc. IEEE Conf. CVPR, 2007, pp. 1-8.
26. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
27. K. Mikolajczyk, C. Schmid, and A. Zisserman, "Human detection based on a probabilistic assembly of robust part detectors," in Proc. ECCV, 2004, pp. 69-81.
28. A. Mohan, C. Papageorgiou, and T. Poggio, "Example-based object detection in images by components," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 4, pp. 349-361, Apr. 2001.
29. S. Munder and D. M. Gavrila, "An experimental study on pedestrian classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 11, pp. 1863-1868, Nov. 2006.
30. S. Munder, C. Schnörr, and D. M. Gavrila, "Pedestrian detection and tracking using a mixture of view-based shape-texture models," IEEE Trans. Intell. Transp. Syst., vol. 9, no. 2, pp. 333-343, Jun. 2008.
31. S. Nedevschi, S. Bota, and C. Tomiuc, "Stereo-based pedestrian detection for collision-avoidance applications," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 3, pp. 380-391, Sep. 2009.
32. S. Nedevschi, R. Danescu, D. Frentiu, T. Marita, F. Oniga, C. Pocol, T. Graf, and R. Schmidt, "High accuracy stereovision approach for obstacle detection on non-planar roads," in Proc. IEEE INES, 2004, pp. 211-216.
33. L. Oliveira, U. Nunes, and P. Peixoto, "On exploration of classifier ensemble synergism in pedestrian detection," IEEE Trans. Intell. Transp. Syst., vol. 11, no. 1, pp. 16-27, Mar. 2010.
34. F. Oniga, S. Nedevschi, M. M. Meinecke, and T. B. To, "Road surface and obstacle detection based on elevation maps from dense stereo," in Proc. IEEE Intell. Transp. Syst. Conf., 2007, pp. 859-865.
35. C. Papageorgiou and T. Poggio, "A trainable system for object detection," Int. J. Comput. Vis., vol. 38, no. 1, pp. 15-33, Jun. 2000.
36. J. C. Platt, "Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods," in Advances in Large Margin Classifiers. Cambridge, MA: MIT Press, 1999, pp. 61-74.
37. M. Rohrbach, M. Enzweiler, and D. M. Gavrila, "High-level fusion of depth and intensity for pedestrian classification," in Proc. DAGM Symp. Pattern Recog., 2009, pp. 101-110.
38. W. R. Schwartz, A. Kembhavi, D. Harwood, and L. S. Davis, "Human detection using partial least squares analysis," in Proc. ICCV, 2009, pp. 24-31.
39. N. Suganuma and N. Fujiwara, "An obstacle extraction method using virtual disparity image," in Proc. IEEE Intell. Vehicles Symp., 2007, pp. 456-461.
40. O. Tuzel, F. Porikli, and P. Meer, "Human detection via classification on Riemannian manifolds," in Proc. IEEE Conf. CVPR, 2007, pp. 1-8.
41. W. Van der Mark and D. M. Gavrila, "Real-time dense stereo for intelligent vehicles," IEEE Trans. Pattern Anal. Mach. Intell., vol. 7, no. 1, pp. 38-50, Mar. 2006.
42. P. Viola, M. Jones, and D. Snow, "Detecting pedestrians using patterns of motion and appearance," Int. J. Comput. Vis., vol. 63, no. 2, pp. 153-161, Jul. 2005.
43. X. Wang, T. X. Han, and S. Yan, "A HOG-LBP human detector with partial occlusion handling," in Proc. ICCV, 2009, pp. 32-39.
44. A. Wedel, H. Badino, C. Rabe, H. Loose, U. Franke, and D. Cremers, "B-spline modeling of road surfaces with an application to free-space estimation," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 4, pp. 572-583, Dec. 2009.
45. C. Wöhler and J. K. Anlauf, "A time delay neural network algorithm for estimating image-pattern shape and motion," Image Vis. Comput., vol. 17, no. 3/4, pp. 281-294, Mar. 1999.
46. C. Wojek, S. Walk, and B. Schiele, "Multi-cue onboard pedestrian detection," in Proc. IEEE Conf. CVPR, 2009, pp. 794-801.
47. B. Wu and R. Nevatia, "Detection and tracking of multiple, partially occluded humans by Bayesian combination of edgelet based part detectors," Int. J. Comput. Vis., vol. 75, no. 2, pp. 247-266, Nov. 2007.
48. B. Wu and R. Nevatia, "Optimizing discrimination-efficiency tradeoff in integrating heterogeneous local features for object detection," in Proc. IEEE Conf. CVPR, 2008, pp. 1-8.
49. L. Zhang, B. Wu, and R. Nevatia, "Detection and tracking of multiple humans with extensive pose articulation," in Proc. ICCV, 2007, pp. 1-8.
50. L. Zhao and C. Thorpe, "Stereo and neural network-based pedestrian detection," IEEE Trans. Intell. Transp. Syst., vol. 1, no. 3, pp. 148-154, Sep. 2000.
51. Q. Zhu, M. Yeh, K. Chen, and S. Avidan, "Fast human detection using a cascade of histograms of oriented gradients," in Proc. IEEE Conf. CVPR, 2006, pp. 1491-1498.