Single-pedestrian detection aided by two-pedestrian detection

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 9, 2015, Pages 1875-1889

  Ouyang, Wanli ^a   Zeng, Xingyu ^a   Wang, Xiaogang ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

contextual information; discriminative model; human detection; object detection; Part based model; pedestrian detection

Indexed keywords

OBJECT RECOGNITION; STATISTICAL TESTS;

CONTEXTUAL INFORMATION; DISCRIMINATIVE MODELS; HUMAN DETECTION; PART-BASED MODELS; PEDESTRIAN DETECTION;

OBJECT DETECTION;

AUTOMATED PATTERN RECOGNITION; CLASSIFICATION; HUMAN; IMAGE PROCESSING; PEDESTRIAN; PROCEDURES;

HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PEDESTRIANS;

EID: 84939219300     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2377734     Document Type: Article

References (99)

1. M. Andriluka, S. Roth, and B. Schiele. "Pictorial structures revisited: People detection, and articulated pose estimation". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 1014-1021
2. A. Bar-Hillel, D. Levi, E. Krupka, and C. Goldberg. "Part-based feature synthesis for human detection". in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 127-142
3. O. Barinova, V. Lempitsky, and P. Kohli. "On detection of multiple object instances using hough transforms". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 2233-2240
4. R. Benenson, M. Mathias, R. Timofte, and L. V. Gool. "Pedestrian detection at 100 frames per second". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 2903-2910
5. R. Benenson, M. Mathias, T. Tuytelaars, and L. Van Gool. "Seeking the strongest rigid detector". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 3666-3673
6. M. Bergtholdt, J. H. Kappes, S. Schmidt, and C. Schnorr. "A study of parts-based object class detection using complete graphs". Int. J. Comput. Vis., vo. 87, nos. 1/2, pp. 93-117, 2010
7. L. Bourdev, S. Maji, T. Brox, and J. Malik. "Detecting people using mutually consistent poselet activations". in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 168-181
8. L. Bourdev, and J. Malik. "Poselets: Body part detectors trained using 3D human pose annotations". in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 1365-1372
9. G. Chen, Y. Ding, J. Xiao, and T. X. Han. "Detection evolution with multi-order contextual co-occurrence". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 1798-1805
10. N. Dalal, and B. Triggs. "Histograms of oriented gradients for human detection". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, pp. 886-893
11. N. Dalal, B. Triggs, and C. Schmid. "Human detection using oriented histograms of flow, and appearance". in Proc. 9th Eur. Conf. Comput. Vis., 2006, pp. 428-441
12. T. Dean, M. A. Ruzon, M. Segal, J. Shlens, S. Vijayanarasimhan, and J. Yagnik. "Fast, accurate detection of 100, 000 object classes on a single machine". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 1814-1821
13. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. "Imagenet: A large-scale hierarchical image database". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 248-255
14. C. Desai, and D. Ramanan. "Detecting actions, poses, and objects with relational phraselets". in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 158-172
15. C. Desai, D. Ramanan, and C. Fowlkes. "Discriminative models for multi-class object layout". in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 229-236
16. Y. Ding, and J. Xiao. "Contextual boost for pedestrian detection". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 2895-2902
17. S. K. Divvala, D. Hoiem, J. H. Hays, A. A. Efros, and M. Hebert. "An empirical study of context in object detection". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 1271-1278
18. P. Dollár, R. Appel, S. Belongie, and P. Perona. "Fast feature pyramids for object detection". IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 8, pp. 1532-1545, Aug. 2014
19. P. Dollár, R. Appel, and W. Kienzle. "Crosstalk cascades for frame-rate pedestrian detection". in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 645-659
20. P. Dollár, S. Belongie, and P. Perona. "The fastest pedestrian detector in the west". in Proc. British Mach. Vis. Conf., 2010, pp. 1-11
21. P. Dollár, Z. Tu, P. Perona, and S. Belongie. "Integral channel features". in Proc. British Mach. Vis. Conf., 2009, pp. 91.1-91.11
22. P. Dollár, C. Wojek, B. Schiele, and P. Perona. "Pedestrian detection: An evaluation of the state of the art". IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 743-761, Apr. 2012
23. M. Enzweiler, A. Eigenstetter, B. Schiele, and D. M. Gavrila. "Multi-cue pedestrian classification with partial occlusion handling". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 990-997
24. M. Enzweiler, and D. Gavrila. "A mixed generative-discriminative framework for pedestrian classification". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8
25. M. Enzweiler, and D. Gavrila. "Integrated pedestrian classification, and orientation estimation". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 982-989
26. M. Enzweiler, and D. M. Gavrila. "Monocular pedestrian detection: Survey, and experiments". IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 12, pp. 2179-2195, Dec. 2009
27. M. Enzweiler, and D. M. Gavrila. "A multilevel mixture-of-experts framework for pedestrian classification". IEEE Trans. Image Process., vol. 20, no. 10, pp. 2967-2979, Oct. 2011
28. A. Ess, B. Leibe, and L. V. Gool. "Depth, and appearance for mobile scene analysis". in Proc. 11th IEEE Int. Conf. Comput. Vis., 2007, pp. 1-8
29. M. Everingham, L. V. Gool, C. K. I. Williams, J. Winn, and A. Zisserman. "The pascal visual object classes (VOC) challenge". Int. J. Comput. Vis., vol. 88, no. 2, pp. 303-338, 2010
30. P. Felzenszwalb, R. B. Grishick, D. McAllister, and D. Ramanan. "Object detection with discriminatively trained part based models". IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, pp. 1627-1645, Sep. 2010
31. P. F. Felzenszwalb, and D. P. Huttenlocher. "Pictorial structures for object recognition". Int. J. Comput. Vis., vol. 61, pp. 55-79, 2005
32. C. Galleguillos, B. McFee, S. Belongie, and G. Lanckriet. "Multiclass object localization by combining local contextual interactions". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 113-120
33. D. Gavrila. "Multi-feature hierarchical template matching using distance transforms". in Proc. 14th IEEE Int. Conf. Pattern Recognit., 1998, pp. 439-444
34. A. Geiger, P. Lenz, and R. Urtasun. "Are we ready for autonomous driving? the kitti vision benchmark suite". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 3354-3361
35. D. Geronimo, A. M. Lopez, A. D. Sappa, and T. Graf. "Survey on pedestrian detection for advanced driver assistance systems". IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 7, pp. 1239-1258, Jul. 2010
36. R. Girshick, P. Felzenszwalb, and D. McAllester. "Object detection with grammar models". in Proc. Adv. Neural Inf. Process. Syst., 2011, pp. 442-450
37. A. Hare, Handbook of Small Group Research. New York, NY, USA: Macmillan, 1962
38. D. Hoiem, A. Efros, and M. Hebert. "Putting objects in perspective". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 2137-2144
39. S. V. Lab [Online]. Available: http://image-net.org/challenges/LSVRC/2011/index, 2014
40. C. Lampert, M. Blaschko, and T. Hofmann. "Beyond sliding windows: object localization by efficient subwindow search". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8
41. B. Leibe, A. Leonardis, and B. Schiele. "Combined object categorization, and segmentation with an implicit shape model". in Proc. 10th Eur. Conf. Comput. Vis. Workshop Stat. Learn. Comp. Vis, 2004, pp. 17-32
42. B. Leibe, A. Leonardis, and B. Schiele. "Robust object detection with interleaved categorization, and segmentation". Int. J. Comput. Vis., vol. 77, nos. 1/3, pp. 259-289, 2008
43. B. Leibe, E. Seemann, and B. Schiele. "Pedestrian detection in crowded scenes". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, pp. 878-885
44. C. Li, D. Parikh, and T. Chen. "Extracting adaptive contextual cues from unlabeled regions". in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 511-518
45. H. Li, X. Huang, J. Huang, and S. Zhang. "Feature matching with affine-function transformation models". IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 12, pp. 2407-2422, Dec. 2014
46. Z. Lin, and L. Davis. "A pose-invariant descriptor for human detection, and segmentation". in Proc. 10th Eur. Conf. Comput. Vis., 2008, pp. 423-436
47. Z. Lin, L. S. Davis, D. Doermann, and D. DeMenthon. "Hierarchical part-template matching for human detection, and segmentation". in Proc. IEEE Int. Conf. Comput. Vis., 2007, pp. 1-8
48. P. Luo, Y. Tian, X. Wang, and X. Tang. "Switchable deep network for pedestrian detection". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 899-906
49. S. Maji, A. C. Berg, and J. Malik. "Classification using intersection kernel support vector machines is efficient". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8
50. K. Mikolajczyk, B. Leibe, and B. Schiele. "Multiple object class detection with a generative model". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, pp. 26-36
51. M. Moussaid, N. Perozo, S. Garnier, D. Helbing, and G. Theraulaz. "The walking behaviour of pedestrian social groups, and its impact on crowd dynamics". PLoS One, vol. 5, no. 4, p. e10047, 2010
52. S. Munder, and D. M. Gavrila. "An experimental study on pedestrian classification". IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 11, pp. 1863-1868, Nov. 2006
53. A. Ng, M. Jordan, and Y. Weiss. "On spectral clustering: Analysis, and an algorithm". in Proc. Adv. Neural Inf. Process. Syst., 2002, pp. 849-856
54. M. Norouzi, M. Ranjbar, and G. Mori. "Stacks of convolutional restricted boltzmann machines for shift-invariant feature learning". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 2735-2742
55. A. Oliva, and A. Torralba. "The role of context in object recognition". Trends Cogn. Sci., vol. 11, no. 12, pp. 520-527, 2007
56. W. Ouyang, X. Chu, and X. Wang. "Multi-source deep learning for human pose estimation". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 2337-2344
57. W. Ouyang, P. Luo, X. Zeng, S. Qiu, Y. Tian, H. Li, S. Yang, Z. Wang, Y. Xiong, C. Qian, Z. Zhu, R. Wang, C.-C. Loy, X. Wang, and X. Tang. "Deepid-net: Multi-stage, and deformable deep convolutional neural networks for object detection". arXiv preprint arXiv: 1409.3505, 2014
58. W. Ouyang, and X. Wang. "A discriminative deep model for pedestrian detection with occlusion handling". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 3258-3265
59. W. Ouyang, and X. Wang. "Joint deep learning for pedestrian detection". in Proc. 9th IEEE Int. Conf. Comput. Vis., 2013, pp. 2056-2063
60. W. Ouyang, X. Zeng, and X. Wang. "Modeling mutual visibility relationship in pedestrian detection". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 3222-3229
61. C. Papageorgiou, and T. Poggio. "A trainable system for object detection". Int. J. Comput. Vis., vol. 38, no. 1, pp. 15-33, 2000
62. D. Park, D. Ramanan, and C. Fowlkes. "Multiresolution models for object detection". in Proc. 10th Eur. Conf. Comput. Vis., 2010, pp. 241-254
63. D. Park, C. L. Zitnick, D. Ramanan, and P. Dollár. "Exploring weak stabilization for motion feature extraction". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 2882-2889
64. M. Pedersoli, A. Vedaldi, and J. Gonzalez. "A coarse-to-fine approach for fast deformable object detection". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 1353-1360
65. B. Pepikj, M. Stark, P. Gehler, and B. Schiele. "Occlusion patterns for object class detection". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 3286-3293
66. F. Porikli. "Integral histogram: A fast way to extract histograms in cartesian spaces". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2005, pp. 829-836
67. P. Sabzmeydani, and G. Mori. "Detecting pedestrians by learning shapelet features". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8
68. M. A. Sadeghi, and A. Farhadi. "Recognition using visual phrases". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 1745-1752
69. W. Schwartz, A. Kembhavi, D. Harwood, and L. Davis. "Human detection using partial least squares analysis". in Proc. 12th IEEE Int. Conf. Comput. Vis., 2009, pp. 24-31
70. P. Sermanet, K. Kavukcuoglu, S. Chintala, and Y. Lecun. "Pedestrian detection with unsupervised, and multi-stage feature learning". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 3626-3633
71. V. D. Shet, J. Neumann, V. Ramesh, and L. S. Davis. "Bilatticebased logical reasoning for human detection". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2007, pp. 1-8
72. Z. Song, Q. Chen, Z. Huang, Y. Hua, and S. Yan. "Contextualizing object detection, and classification". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 1585-1592
73. M. Sun, and S. Savarese. "Articulated part-based model for joint object detection, and pose estimation". in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 723-730
74. S. Tang, M. Andriluka, A. Milan, K. Schindler, S. Roth, and B. Schiele. "Learning people detectors for tracking in crowded scenes". Proc. 9th IEEE Int. Conf. Comput. Vis., 2013, pp. 1049-1056
75. S. Tang, M. Andriluka, and B. Schiele. "Detection, and tracking of occluded people". in Proc. British Mach. Vis. Conf., Surrey, U.K., 2012, pp. 9.1-9.11
76. O. Tuzel, F. Porikli, and P. Meer. "Pedestrian detection via classification on riemannian manifolds". IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 10, pp. 1713-1727, Oct. 2008
77. A. Vedaldi, V. Gulshan, M. Varma, and A. Zisserman. "Multiple kernels for object detection". in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 606-613
78. P. Viola, and M. Jones. "Robust real-time face detection". Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, 2004
79. P. Viola, M. J. Jones, and D. Snow. "Detecting pedestrians using patterns of motion, and appearance". Int. J. Comput. Vis., vol. 63, no. 2, pp. 153-161, 2005
80. S. Walk, N. Majer, K. Schindler, and B. Schiele. "New features, and insights for pedestrian detection". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 1030-1037
81. M. Wang, W. Li, and X. Wang. "Transferring a generic pedestrian detector towards specific scenes". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 3274-3281
82. M. Wang, and X. Wang. "Automatic adaptation of a generic pedestrian detector to a specific traffic scene". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 3401-3408
83. X. Wang, X. Han, and S. Yan. "An hog-lbp human detector with partial occlusion handling". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 32-39
84. Y. Wang, D. Tran, and Z. Liao. "Learning hierarchical poselets for human parsing". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 1705-1712
85. C. Wojek, and B. Schiele. "A performance evaluation of single, and multi-feature people detection". in Proc. 30th DAGM Symp. Pattern Recognit., 2008, pp. 82-91
86. C. Wojek, S. Walk, and B. Schiele. "Multi-cue onboard pedestrian detection". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 794-801
87. B. Wu, and R. Nevatia. "Detection of multiple, partially occluded humans in a single image by Bayesian combination of edgelet part detectors". in Proc. IEEE Int. Conf. Comput. Vis., 2005, pp. 90-97
88. B. Wu, and R. Nevatia. "Detection, and tracking of multiple, partially occluded humans by Bayesian combination of edgelet based part detectors". Int. J. Comput. Vis., vol. 75, no. 2, pp. 247-266, 2007
89. B. Wu, and R. Nevatia. "Detection, and segmentation of multiple, partially occluded objects by grouping, merging, assigning part detection responses". Int. J. Comput. Vis., vol. 82, no. 2, pp. 185-204, 2009
90. J. Yan, Z. Lei, L. Wen, and S. Z. Li. "The fastest deformable part model for object detection". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 2497-2504
91. J. Yan, Z. Lei, D. Yi, and S. Z. Li. "Multi-pedestrian detection in crowded scenes: A global view". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 3124-3129
92. J. Yan, X. Zhang, Z. Lei, S. Liao, and S. Z. Li. "Robust multi-resolution pedestrian detection in traffic scenes". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 3033-3040
93. Y. Yang, S. Baker, A. Kannan, and D. Ramanan. "Recognizing proxemics in personal photos". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 3522-3529
94. Y. Yang, and D. Ramanan. "Articulated pose estimation with flexible mixtures-of-parts". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 1385-1392
95. B. Yao, and L. Fei-Fei. "Modeling mutual context of object, and human pose in human-object interaction activities". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 17-24
96. X. Zeng, W. Ouyang, M. Wang, and X. Wang. "Deep learning of scene-specific classifier for pedestrian detection". in Proc. 10th Eur. Conf. Comput. Vis., 2014, pp. 472-487
97. X. Zeng, W. Ouyang, and X. Wang. "Multi-stage contextual deep learning for pedestrian detection". in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 121-128
98. L. Zhu, Y. Chen, A. Yuille, and W. Freeman. "Latent hierarchical structural learning for object detection". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2010, pp. 1062-1069
99. Q. Zhu, M.-C. Yeh, K.-T. Cheng, and S. Avidan. "Fast human detection using a cascade of histograms of oriented gradients". in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, pp. 1491-1498