Automatic detection and tracking of pedestrians from a moving stereo rig

ISPRS Journal of Photogrammetry and Remote Sensing

Volumn 65, Issue 6, 2010, Pages 523-537

  Schindler, Konrad ^a   Ess, Andreas ^a   Leibe, Bastian ^b   Van Gool, Luc ^a,c  

^a ETH ZURICH   (Switzerland)

^b RWTH AACHEN UNIVERSITY   (Germany)

^c UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Detection; Tracking; Urban Scene; Vision

Indexed keywords

3D COORDINATES; 3D RECONSTRUCTION; AUTOMATIC DETECTION; DETECTION; DETECTION AND TRACKING; ENVIRONMENT MODELS; IMAGE-BASED; PEDESTRIAN DETECTION; STEREO RIGS; STEREO SYSTEM; STEREOSEQUENCE; TRACKING; URBAN SCENES; URBAN TRAFFIC;

THREE DIMENSIONAL;

DETECTION METHOD; ENVIRONMENTAL MODELING; PEDESTRIAN; STEREO IMAGE; TRACKING; URBAN TRANSPORT; VISION;

EID: 78149499308     PISSN: 09242716     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.isprsjprs.2010.06.006     Document Type: Article

References (56)

1. Andriluka, M., Roth, S., Schiele, B., 2008. People-tracking-by-detection and people-detection-by-tracking. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (on CD-ROM).
2. Avidan, S., 2005. Ensemble tracking. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition, vol. 2. pp. 494-501.
3. Bajracharya M., Moghaddam B., Howard A., Brennan S., Matthies L.H. A fast stereo-based system for detecting and tracking pedestrians from a moving vehicle. International Journal of Robotics Research 2009, 28(11-12):1466-1485.
4. Bay H., Ess A., Tuytelaars T., Van Gool L. Speeded-up robust features (SURF). Computer Vision and Image Understanding 2008, 110(3):346-359.
5. Bibby, C., Reid, I., 2008. Robust real-time visual tracking using pixel-wise posteriors. In: Proceedings 10th European Conference on Computer Vision, vol. 2. pp. 831-844.
6. Bishop C.M. Pattern Recognition and Machine Learning 2006, Springer.
7. Boros E., Hammer P.L. Pseudo-Boolean optimization. Discrete Applied Mathematics 2002, 123(1-3):155-225.
8. Cornelis, N., Van Gool, L., 2005. Real-time connectivity constrained depth map computation using programmable graphics hardware. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition, vol. 1. pp. 1009-1104.
9. Cornelis, N., Van Gool, L., 2008. Fast scale invariant feature detection and matching on programmable graphics hardware. In: Proceedings Workshop on Computer Vision on GPUs (on CD-ROM).
10. Dalal, N., Triggs, B., 2005. Histograms of oriented gradients for human detection. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition, vol. 1. pp. 886-893.
11. Davison, A.J., 2003. Real-time simultaneous localization and mapping with a single camera. In: Proceedings 9th International Conference on Computer Vision. pp. 1403-1410.
12. Dollar, P., Wojek, C., Schiele, B., Perona, P., 2009. Pedestrian detection: a benchmark. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (on CD-ROM).
13. Enzweiler M., Gavrila D.M. Monocular pedestrian detection: survey and experiments. IEEE Transactions on Pattern Analysis and Machine Intelligence 2009, 31(12):2179-2195.
14. Ess, A., Leibe, B., Schindler, K., Van Gool, L., 2008. A mobile vision system for robust multi-person tracking. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (on CD-ROM).
15. Ess, A., Leibe, B., Schindler, K., Van Gool, L., 2009a. Moving obstacle detection in highly dynamic scenes. In: Proceedings International Conference on Robotics and Automation. pp. 56-63.
16. Ess A., Leibe B., Schindler K., Van Gool L. Robust multi-person tracking from a mobile platform. IEEE Transactions on Pattern Analysis and Machine Intelligence 2009, 31(10):1831-1846.
17. Ess, A., Leibe, B., Van Gool, L., 2007. Depth and appearance for mobile scene analysis. In: Proceedings 11th International Conference on Computer Vision. pp. 1-8.
18. Felzenszwalb, P., McAllester, D., Ramanan, D., 2008. A discriminatively trained, multiscale, deformable part model. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (on CD-ROM).
19. Förstner, W., Gülch, E., 1987. A fast operator for detection and precise location of distinct points, corners and centres of circular features. In: Proceedings ISPRS Intercommission Workshop on Fast Processing of Photogrammetric Data. pp. 281-305.
20. Gavrila D.M., Munder S. Multi-cue pedestrian detection and tracking from a moving vehicle. International Journal of Computer Vision 2007, 73(1):41-59.
21. Gelb A. Applied Optimal Estimation 1996, MIT Press.
22. Havlena, M., Ess, A., Moreau, W., Torii, A., Jancosek, M., Pajdla, T., Van Gool, L., 2009. AWEAR 2.0 system: omni-directional audio-visual data acquisition and processing. In: Proceedings 1st Workshop on Egocentric Vision (on CD-ROM).
23. Helbing D., Molnár P. Social force model for pedestrian dynamics. Physics Review E 1995, 51(5):4282-4286.
24. Hoiem D., Efros A.A., Hebert M. Putting objects in perspective. Proceedings IEEE Conference on Computer Vision and Pattern Recognition 2006, vol. 2:2137-2144.
25. Isard M., Blake A. CONDENSATION-conditional density propagation for visual tracking. International Journal of Computer Vision 1998, 29(1):5-28.
26. Leibe B., Schindler K., Cornelis N., Van Gool L. Coupled detection and tracking from static cameras and moving vehicles. IEEE Transactions on Pattern Analysis and Machine Intelligence 2008, 30(10):1683-1698.
27. Leibe B., Seemann E., Schiele B. Pedestrian detection in crowded scenes. Proceedings IEEE Conference on Computer Vision and Pattern Recognition 2005, vol. 1:878-885.
28. Li, Y., Huang, C., Nevatia, R., 2009. Learning to associate: HybridBoosted multi-target tracker for crowded scene. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (on CD-ROM).
29. Lin, Z., Davis, L.S., 2008. A pose-invariant descriptor for human detection and segmentation. In: Proceedings 10th European Conference on Computer Vision, vol. 4. pp. 423-436.
30. Mei, C., Sibley, G., Cummins, M., Newman, P., Reid, I., 2009. A constant-time efficient stereo SLAM system. In: Proceedings British Machine Vision Conference (on CD-ROM).
31. Murphy, K.P., Weiss, Y., Jordan, M.I., 1999. Loopy belief propagation for approximate inference: an empirical study. In: Proceedings Uncertainty in Artifical Intelligence. pp. 467-475.
32. Nistér D., Naroditsky O., Bergen J.R. Visual odometry. Proceedings IEEE Conference on Computer Vision and Pattern Recognition 2004, vol. 1:652-659.
33. Nummiaro K., Koller-Meier E., Van Gool L. An adaptive color-based particle filter. Image and Vision Computing 2003, 21(1):99-110.
34. Okuma, K., Taleghani, A., de Freitas, N., Little, J., Lowe, D., 2004. A boosted particle filter: multitarget detection and tracking. In: Proceedings 8th European Conference on Computer Vision, vol. 1. pp. 28-39.
35. Papageorgiou C., Poggio T. A trainable system for object detection. International Journal of Computer Vision 2000, 38(1):15-33.
36. Pearl J. Probabilistic Reasoning in Intelligent Systems 1988, Morgan Kaufmann Publishers Inc.
37. Pellegrini, S., Ess, A., Schindler, K., Van Gool, L., 2009. You'll never walk alone: modeling social behavior for multi-target tracking. In: Proceedings 12th International Conference on Computer Vision. pp. 261-268.
38. Rother, C., Kolmogorov, V., Lempitsky, V.S., Szummer, M., 2007. Optimizing binary MRFs via extended roof duality. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (on CD-ROM).
39. Rousseeuw P.J., Leroy A.M. Robust Regression and Outlier Detection 1987, John Wiley and Sons.
40. Sabzmeydani, P., Mori, G., 2007. Detecting pedestrians by learning shapelet features. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (on CD-ROM).
41. Schadschneider, A., 2001. Cellular automaton approach to pedestrian dynamics-theory. In: Proceedings Pedestrian and Evacuation Dynamics. pp. 75-86.
42. Scharstein D., Szeliski R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 2002, 47(1-3):7-42.
43. Schindler, K., James, U., Wang, H., 2006. Perspective n-view multibody structure-and-motion through model selection. In: Proceedings 9th European Conference on Computer Vision, vol. 1. pp. 606-619.
44. Shashua, A., Gdalyahu, Y., Hayun, G., 2004. Pedestrian detection for driving assistance systems: single-frame classification and system level performance. In: Proceedings Intelligent Vehicle Symposium. pp. 1-6.
45. Stauffer, C., Grimson, W.E.L., 1999. Adaptive background mixture models for real-time tracking. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition. pp. 2246-2252.
46. Toyama, K., Krumm, J., Brumitt, B., Meyers, B., 1999. Wallflower: principles and practice of background maintenance. In: Proceedings 7th International Conference on Computer Vision. pp. 255-261.
47. Viola, P., Jones, M., Snow, D., 2003. Detecting pedestrians using patterns of motion and appearance. In: Proceedings 9th International Conference on Computer Vision. pp. 734-741.
48. Walk, S., Majer, N., Schindler, K., Schiele, B., 2010. New features and insights for pedestrian detetion. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (on CD-ROM).
49. Wang, X., Han, T.X., Yan, S., 2009. A HOG-LBP human detector with partial occlusion handling. In: Proceedings 12th International Conference on Computer Vision. pp. 32-39.
50. Wedel, A., Rabe, C., Vaudrey, T., Brox, T., Franke, U., Cremers, D., 2008. Efficient dense scene flow from sparse or dense stereo data. In: Proceedings 10th European Conference on Computer Vision, vol. 1. pp. 739-751.
51. Wojek, C., Dorkó, G., Schulz, A., Schiele, B., 2008. Sliding-windows for rapid object class localization: a parallel technique. In: Pattern Recognition-Proceedings 30th DAGM Symposium. pp. 71-81.
52. Wojek, C., Walk, S., Schiele, B., 2009. Multi-cue onboard pedestrian detection. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (on CD-ROM).
53. Wu B., Nevatia R. Detection and tracking of multiple, partially occluded humans by Bayesian combination of edgelet part detectors. International Journal of Computer Vision 2007, 75(2):247-266.
54. Zach, C., Frahm, J.-M., Niethammer, M., 2009. Continuous maximal flows and Wulff shapes: application to MRFs. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (on CD-ROM).
55. Zhang, L., Li, Y., Nevatia, R., 2008. Global data association for multi-object tracking using network flows. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition (on CD-ROM).
56. Zhu Q., Yeh M.-C., Cheng K.-T., Avidan S. Fast human detection using a cascade of histograms of oriented gradients. Proceedings IEEE Conference on Computer Vision and Pattern Recognition 2006, vol. 2:1491-1498.