Fast feature pyramids for object detection

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 8, 2014, Pages 1532-1545

  Dollar, Piotr ^a   Appel, Ron ^b   Belongie, Serge ^c   Perona, Pietro ^b  

^a MICROSOFT RESEARCH   (United States)

^b California Institute of Technology   (United States)

^c Cornell NYC Tech Cornell Computer Science Department ^*  (United States)

Author keywords

image pyramids; natural image statistics; object detection; pedestrian detection; real time systems; Visual features

Indexed keywords

APPROXIMATION THEORY; DISCRETE COSINE TRANSFORMS; EXTRAPOLATION; REAL TIME SYSTEMS;

IMAGE PYRAMIDS; NATURAL IMAGE STATISTICS; OBJECT DETECTION; PEDESTRIAN DETECTION; VISUAL FEATURE;

OBJECT RECOGNITION;

EID: 84903622275     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2300479     Document Type: Article

References (77)

1. D. Hubel and T. Wiesel, "Receptive Fields and Functional Architecture of Monkey Striate Cortex," J. Physiology, vol. 195, pp. 215-243, 1968.
2. C. Malsburg, "Self-Organization of Orientation Sensitive Cells in the Striate Cortex," Biological Cybernetics, vol. 14, no. 2, pp. 85-100, 1973.
3. L. Maffei and A. Fiorentini, "The Visual Cortex as a Spatial Frequency Analyser," Vision Research, vol. 13, no. 7, pp. 1255-1267, 1973.
4. P. Burt and E. Adelson, "The Laplacian Pyramid as a Compact Image Code," IEEE Trans. Comm., vol. 31, no. 4, pp. 532-540, Apr. 1983. (Pubitemid 13521088)
5. J. Daugman, "Uncertainty Relation for Resolution in Space, Spatial Frequency, and Orientation Optimized by Two-Dimensional Visual Cortical Filters," J. Optical Soc. Am. A: Optics, Image Science, and Vision, vol. 2, pp. 1160-1169, 1985.
6. J. Koenderink and A. Van Doorn, "Representation of Local Geometry in the Visual System," Biological Cybernetics, vol. 55, no. 6, pp. 367-375, 1987. (Pubitemid 17030735)
7. D.J. Field, "Relations between the Statistics of Natural Images and the Response Properties of Cortical Cells," J. Optical Soc. Am. A: Optics, Image Science, and Vision, vol. 4, pp. 2379-2394, 1987.
8. S. Mallat, "A Theory for Multiresolution Signal Decomposition: The Wavelet Representation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 647-693, July 1989.
9. P. Vaidyanathan, "Multirate Digital Filters, Filter Banks, Polyphase Networks, and Applications: A Tutorial," Proc. IEEE, vol. 78, no. 1, pp. 56-93, Jan. 1990. (Pubitemid 20702049)
10. M. Vetterli, "A Theory of Multirate Filter Banks," IEEE Trans. Acoustics, Speech and Signal Processing, vol. 35, no. 3, pp. 356-372, Mar. 1987.
11. E. Simoncelli and E. Adelson, "Noise Removal via Bayesian Wavelet Coring," Proc. Int'l Conf. Image Processing (ICIP), vol. 1, 1996.
12. W.T. Freeman and E.H. Adelson, "The Design and Use of Steerable Filters," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 9, pp. 891-906, Sept. 1991.
13. J. Malik and P. Perona, "Preattentive Texture Discrimination with Early Vision Mechanisms," J. Optical Soc. Am. A, vol. 7, pp. 923-932, May 1990.
14. D. Jones and J. Malik, "Computational Framework for Determining Stereo Correspondence from a Set of Linear Spatial Filters," Image and Vision Computing, vol. 10, no. 10, pp. 699-708, 1992.
15. E. Adelson and J. Bergen, "Spatiotemporal Energy Models for the Perception of Motion," J. Optical Soc. Am. A, vol. 2, no. 2, pp. 284-299, 1985. (Pubitemid 15466457)
16. Y. Weiss and E. Adelson, "A Unified Mixture Framework for Motion Segmentation: Incorporating Spatial Coherence and Estimating the Number of Models," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 1996.
17. L. Itti, C. Koch, and E. Niebur, "A Model of Saliency-Based Visual Attention for Rapid Scene Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
18. P. Perona and J. Malik, "Detecting and Localizing Edges Composed of Steps, Peaks and Roofs," Proc. Third IEEE Int'l Conf. Computer Vision (ICCV), 1990.
19. M. Lades, J. Vorbruggen, J. Buhmann, J. Lange, C. von der Malsburg, R. Wurtz, and W. Konen, "Distortion Invariant Object Recognition in the Dynamic Link Architecture," IEEE Trans. Computers, vol. 42, no. 3, pp. 300-311, Mar. 1993.
20. D.G. Lowe, "Object Recognition from Local Scale-Invariant Features," Proc. Seventh IEEE Int'l Conf. Computer Vision (ICCV), 1999.
21. N. Dalal and B. Triggs, "Histograms of Oriented Gradients for Human Detection," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2005.
22. R. De Valois, D. Albrecht, and L. Thorell, "Spatial Frequency Selectivity of Cells in Macaque Visual Cortex," Vision Research, vol. 22, no. 5, pp. 545-559, 1982. (Pubitemid 12155596)
23. Y. LeCun, P. Haffner, L. Bottou, and Y. Bengio, "Gradient-Based Learning Applied to Document Recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
24. M. Riesenhuber and T. Poggio, "Hierarchical Models of Object Recognition in Cortex," Nature Neuroscience, vol. 2, pp. 1019-1025, 1999. (Pubitemid 30599567)
25. D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.
26. A. Krizhevsky, I. Sutskever, and G. Hinton, "Imagenet Classification with Deep Convolutional Neural Networks," Proc. Advances in Neural Information Processing Systems (NIPS), 2012.
27. P. Viola and M. Jones, "Rapid Object Detection Using a Boosted Cascade of Simple Features," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2001.
28. P. Viola, M. Jones, and D. Snow, "Detecting Pedestrians Using Patterns of Motion and Appearance," Int'l J. Computer Vision, vol. 63, no. 2, pp. 153-161, 2005. (Pubitemid 40536820)
29. P. Dollár, Z. Tu, P. Perona, and S. Belongie, "Integral Channel Features," Proc. British Machine Vision Conf. (BMVC), 2009.
30. R. Benenson, M. Mathias, R. Timofte, and L. Van Gool, "Pedestrian Detection at 100 Frames per Second," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2012.
31. P. Dollár, C. Wojek, B. Schiele, and P. Perona, "Pedestrian Detection: An Evaluation of the State of the Art,"IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 4, pp. 743-761, 2012.
32. www.vision.caltech.edu/Image-Datasets/CaltechPedestrians/, 2014.
33. D.L. Ruderman and W. Bialek, "Statistics of Natural Images: Scaling in the Woods," Physical Rev. Letters, vol. 73, no. 6, pp. 814-817, Aug. 1994. (Pubitemid 24976330)
34. E. Switkes, M. Mayer, and J. Sloan, "Spatial Frequency Analysis of the Visual Environment: Anisotropy and the Carpentered Environment Hypothesis," Vision Research, vol. 18, no. 10, pp. 1393-1399, 1978. (Pubitemid 9044254)
35. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan, "Object Detection with Discriminatively Trained Part Based Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 9, pp. 1627-1645, Sept. 2010.
36. C. Wojek, S. Walk, and B. Schiele, "Multi-Cue Onboard Pedestrian Detection," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2009.
37. A. Ess, B. Leibe, and L. Van Gool, "Depth and Appearance for Mobile Scene Analysis," Proc. IEEE 11th Int'l Conf. Computer Vision (ICCV), 2007.
38. M. Everingham, L. Van Gool, C.K.I. Williams, J. Winn, and A. Zisserman, "The PASCAL Visual Object Classes (VOC) Challenge," Int'l J. Computer Vision, vol. 88, no. 2, pp. 303-338, June 2010.
39. P. Dollár, S. Belongie, and P. Perona, "The Fastest Pedestrian Detector in the West," Proc. British Machine Vision Conf. (BMVC), 2010.
40. P. Dollár, R. Appel, and W. Kienzle, "Crosstalk Cascades for Frame-Rate Pedestrian Detection," Proc. 12th European Conf. Computer Vision (ECCV), 2012.
41. T. Lindeberg, "Scale-Space for Discrete Signals," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 3, pp. 234-254, Mar. 1990. (Pubitemid 20677933)
42. J.L. Crowley, O. Riff, and J.H. Piater, "Fast Computation of Characteristic Scale Using a Half-Octave Pyramid," Proc. Fourth Int'l Conf. Scale-Space Theories in Computer Vision, 2002.
43. R.S. Eaton, M.R. Stevens, J.C. McBride, G.T. Foil, and M.S. Snorrason, "A Systems View of Scale Space," Proc. IEEE Int'l Conf. Computer Vision Systems (ICVS), 2006.
44. P. Felzenszwalb, R. Girshick, and D. McAllester, "Cascade Object Detection with Deformable Part Models," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2010.
45. M. Pedersoli, A. Vedaldi, and J. Gonzalez, "A Coarse-to-Fine Approach for Fast Deformable Object Detection," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2011.
46. C.H. Lampert, M.B. Blaschko, and T. Hofmann, "Efficient Subwindow Search: A Branch and Bound Framework for Object Localization," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 12, pp. 2129-2142, Dec. 2009.
47. L. Bourdev and J. Brandt, "Robust Object Detection via Soft Cascade," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2005.
48. C. Zhang and P. Viola, "Multiple-Instance Pruning for Learning Efficient Cascade Detectors," Proc. Advances in Neural Information Processing Systems (NIPS), 2007.
49. J. Sochman and J. Matas, "Waldboost-Learning for Time Constrained Sequential Detection," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2005.
50. H. Masnadi-Shirazi and N. Vasconcelos, "High Detection-Rate Cascades for Real-Time Object Detection," Proc. IEEE 11th Int'l Conf. Computer Vision (ICCV), 2007.
51. F. Fleuret and D. Geman, "Coarse-To-Fine Face Detection," Int'l J. Computer Vision, vol. 41, no. 1/2, pp. 85-107, 2001. (Pubitemid 32512207)
52. P. Felzenszwalb and D. Huttenlocher, "Efficient Matching of Pictorial Structures," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2000.
53. C. Papageorgiou and T. Poggio, "A Trainable System for Object Detection," Int'l J. Computer Vision, vol. 38, no. 1, pp. 15-33, 2000.
54. M. Weber, M. Welling, and P. Perona, "Unsupervised Learning of Models for Recognition," Proc. European Conf. Computer Vision (ECCV), 2000.
55. S. Agarwal and D. Roth, "Learning a Sparse Representation for Object Detection," Proc. European Conf. Computer Vision (ECCV), 2002.
56. R. Fergus, P. Perona, and A. Zisserman, "Object Class Recognition by Unsupervised Scale-Invariant Learning," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2003.
57. B. Leibe, A. Leonardis, and B. Schiele, "Robust Object Detection with Interleaved Categorization and Segmentation," Int'l J. Computer Vision, vol. 77, no. 1-3, pp. 259-289, May 2008.
58. C. Gu, J.J. Lim, P. Arbeláez, and J. Malik, "Recognition Using Regions," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2009.
59. B. Alexe, T. Deselaers, and V. Ferrari, "What Is an Object?" Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2010.
60. C. Wojek, G. Dorkó, A. Schulz, and B. Schiele, "Sliding-Windows for Rapid Object Class Localization: A Parallel Technique," Proc. 30th DAGM Symp. Pattern Recognition, 2008.
61. L. Zhang and R. Nevatia, "Efficient Scan-Window Based Object Detection Using GPGPU," Proc. Workshop Visual Computer Vision on GPU's (CVGPU), 2008.
62. B. Bilgic, "Fast Human Detection with Cascaded Ensembles," master's thesis, MIT, Feb. 2010.
63. Q. Zhu, S. Avidan, M. Yeh, and K. Cheng, "Fast Human Detection Using a Cascade of Histograms of Oriented Gradients," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2006.
64. F.M. Porikli, "Integral Histogram: A Fast Way to Extract Histograms in Cartesian Spaces," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2005.
65. A. Ess, B. Leibe, K. Schindler, and L. Van Gool, "Robust Multi-Person Tracking from a Mobile Platform," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 10, pp. 1831-1846, Oct. 2009.
66. M. Bajracharya, B. Moghaddam, A. Howard, S. Brennan, and L.H. Matthies, "A Fast Stereo-Based System for Detecting and Tracking Pedestrians from a Moving Vehicle," Int'l J. Robotics Research, vol. 28, pp. 1466-1485, 2009.
67. D.L. Ruderman, "The Statistics of Natural Images," Network: Computation in Neural Systems, vol. 5, no. 4, pp. 517-548, 1994.
68. S.G. Ghurye, "A Characterization of the Exponential Function," The Am. Math. Monthly, vol. 64, no. 4, pp. 255-257, 1957.
69. J. Friedman, T. Hastie, and R. Tibshirani, "Additive Logistic Regression: A Statistical View of Boosting," Annals of Statistics, vol. 38, no. 2, pp. 337-374, 2000.
70. P. Sabzmeydani and G. Mori, "Detecting Pedestrians by Learning Shapelet Features," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2007.
71. Z. Lin and L.S. Davis, "A Pose-Invariant Descriptor for Human Detection and Segmentation," Proc. 10th European Conf. Computer Vision (ECCV), 2008.
72. S. Maji, A. Berg, and J. Malik, "Classification Using Intersection Kernel SVMs Is Efficient," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2008.
73. X. Wang, T.X. Han, and S. Yan, "An HOG-LBP Human Detector with Partial Occlusion Handling," Proc. IEEE Int'l Conf. Computer Vision (ICCV), 2009.
74. C. Wojek and B. Schiele, "A Performance Evaluation of Single and Multi-Feature People Detection," Proc. 30th DAGM Symp. Pattern Recognition (DAGM), 2008.
75. W. Schwartz, A. Kembhavi, D. Harwood, and L. Davis, "Human Detection Using Partial Least Squares Analysis," Proc. IEEE 12th Int'l Conf. Computer Vision (ICCV), 2009.
76. S. Walk, N. Majer, K. Schindler, and B. Schiele, "New Features and Insights for Pedestrian Detection," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2010.
77. D. Park, D. Ramanan, and C. Fowlkes, "Multiresolution Models for Object Detection," Proc. 11th European Conf. Computer Vision (ECCV), 2010.