Detection of sudden pedestrian crossings for driving assistance systems

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 42, Issue 3, 2012, Pages 729-739

  Xu, Yanwu ^a   Xu, Dong ^a   Lin, Stephen ^b   Han, Tony X ^c   Cao, Xianbin ^d   Li, Xuelong ^e  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b MICROSOFT RESEARCH ASIA   (China)

^c University of Missouri   (United States)

^d BEIHANG UNIVERSITY   (China)

^e INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

Author keywords

Coarse to fine; pedestrian detection; performance evaluation; spatiotemporal refinement; sudden pedestrian crossing

Indexed keywords

A-FRAMES; APPLICATION REQUIREMENTS; CAMERA VIEW; CLASSIFICATION ALGORITHM; COARSE TO FINE; DRIVING ASSISTANCE SYSTEMS; FALSE ALARM RATE; HIGH RESOLUTION; MOVING VEHICLES; PEDESTRIAN DETECTION; PERFORMANCE EVALUATION; PROCESSING SPEED; SPATIOTEMPORAL REFINEMENT; THREE-LEVEL;

CAMERAS; ERRORS; FOOTBRIDGES; INTELLIGENT VEHICLE HIGHWAY SYSTEMS; VIDEO SIGNAL PROCESSING;

CROSSWALKS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CAR DRIVING; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; METHODOLOGY; THEORETICAL MODEL; TRAFFIC ACCIDENT;

ACCIDENTS, TRAFFIC; ALGORITHMS; ARTIFICIAL INTELLIGENCE; AUTOMOBILE DRIVING; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; MODELS, THEORETICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 84861183293     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2011.2175726     Document Type: Article

References (43)

1. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006. (Pubitemid 46405714)
2. I. P. Alonso, D. F. Llorca, M. A. Sotelo, L. M. Bergasa, P. R. de Toro, J. Nuevo, M. Ocana, and M. A. G. Garrido, "Combination of feature extraction methods for SVM pedestrian detection," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 2, pp. 292-307, Jun. 2007. (Pubitemid 46873210)
3. N. Bellotto and H. S. Hu, "Multisensor-based human detection and tracking for mobile service robots," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 1, pp. 167-181, Feb. 2009.
4. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Conf. CVPR, 2005, pp. 886-893. (Pubitemid 43897286)
5. N. Dalal, B. Triggs, and C. Schmid, "Human detection using oriented histograms of flow and appearance," in Proc. ECCV, 2006, pp. 428-441. (Pubitemid 44029745)
6. P. Dollár, C. Wojek, B. Schiele, and P. Perona, "Pedestrian detection: A benchmark," in Proc. IEEE Conf. CVPR, 2009, pp. 304-311.
7. M. Enzweiler and D. M. Gavrila, "Monocular pedestrian detection: Survey and experiments," IEEE Trans. Pattern Anal.Mach. Intell., vol. 31, no. 12, pp. 2179-2195, Dec. 2009.
8. A. Ess, B. Leibe, K. Schindler, and L. van Gool, "A mobile vision system for robust multi-person tracking," in Proc. IEEE Conf. CVPR, 2008, pp. 1-8.
9. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "LIBLINEAR: A library for large linear classification," J. Mach. Learn. Res., vol. 9, pp. 1871-1874, Jun. 2008.
10. D. M. Gavrila, J. Giebel, and S. Munder, "Vision-based pedestrian detection: The protector system," in Proc. Intel. Veh. Symp., 2004, pp. 13-18.
11. D. M. Gavrila and S. Munder, "Multi-cue pedestrian detection and tracking from a moving vehicle," Int. J. Comput. Vis. (IJCV), vol. 73, no. 1, pp. 41-59, Jun. 2007. (Pubitemid 46181616)
12. K. Huang, D. Tao, Y. Yuan, X. Li, and T. Tan, "Biologically inspired features for scene classification in video surveillance," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 1, pp. 307-313, Feb. 2011, DOI: 10.1109/TSMCB.2009.2037923.
13. K. Huang, D. Tao, Y. Yuan, X. Li, and T. Tan, "View-independent human behavior analysis," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 4, pp. 1028-1035, Aug. 2009.
14. I. Laptev, "Improving object detection with boosted histograms," Image Vis. Comput., vol. 27, no. 5, pp. 535-544, Apr. 2009.
15. X. Li, S. Maybank, Y. Yan, D. Tao, and D. Xu, "Gait components and their application to gender recognition," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 38, no. 2, pp. 145-155, Mar. 2008. (Pubitemid 351404111)
16. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. Int. Joint Conf. Artif. Intell., 1981, pp. 674-679. (Pubitemid 14478744)
17. S. Maji, A. C. Berg, and J. Malik, "Classification using intersection kernel support vector machines is efficient," in Proc. IEEE Conf. CVPR, 2008, pp. 1-8.
18. B. S. Manjunath and W. Y. Ma, "Texture features for browsing and retrieval of image data," IEEE Trans. Pattern Anal. Machine Intell., vol. 18, no. 8, pp. 837-842, Aug. 1996. (Pubitemid 126772825)
19. Y. Mu, S. Yan, Y. Liu, T. Huang, and B. Zhou, "Discriminative local binary patterns for human detection in personal album," in Proc. IEEE Conf. CVPR, 2008, pp. 1-8.
20. S. Munder and D. Gavrila, "An experimental study on pedestrian classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 11, pp. 1863-1868, Nov. 2006. (Pubitemid 46405431)
21. S. Paisitkriangkrai, C. Shen, and J. Zhang, "An experimental study on pedestrian classification using local features," in Proc. Int. Symp. Circuits Syst., 2008, pp. 2741-2744.
22. C. Papageorgiou and T. Poggio, "Trainable pedestrian detection," in Proc. Int. Conf. Image Process., 1999, pp. 35-39. (Pubitemid 30549908)
23. R. Poppe, "Vision-based human motion analysis: An overview," Comput. Vis. Image Underst and ., vol. 108, no. 1/2, pp. 4-18, Oct. 2007. (Pubitemid 47333391)
24. Y. Ran, Q. Zheng, R. Chellappa, and T. M. Strat, "Applications of a simple characterization of human gait in surveillance," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 4, pp. 1009-1020, Aug. 2010.
25. P. Sabzmeydani and G. Mori, "Detecting pedestrians by learning shapelet features," in Proc. IEEE Conf. CVPR, 2007, pp. 1-8.
26. S. Turner, L. S and t, J. Toole, R. Benz, and R. Patten, Federal Highway Administration University Course on Bicycle and Pedestrian Transportation, 2006. [Online]. Available: http://www.tfhrc.gov/safety/pedbike/pubs/05085/pdf/ combinedlo.pdf
27. P. Viola, M. Jones, and D. Snow, "Detecting pedestrians using patterns of motion and appearance," Int. J. Comput. Vis. (IJCV), vol. 63, no. 2, pp. 153-161, 2005. (Pubitemid 40536820)
28. X. Y. Wang, T. X. Han, and S. Yan, "A HOG-LBP human detector with partial occlusion h and ling," in Proc. IEEE ICCV, 2009, pp. 32-39.
29. X. Wang, S. Wang, and D. W. Bi, "Distributed visual-target- surveillance system in wireless sensor networks," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 5, pp. 1134-1146, Oct. 2009.
30. C. Wojek and B. Schiele, "A performance evaluation of single and multifeature people detection," in Proc. DAGM Symp., 2008, pp. 82-91.
31. C. Wojek, S. Walk, and B. Schiele, "Multi-cue onboard pedestrian detection," in Proc. IEEE Conf. CVPR, 2009, pp. 794-801.
32. Y. W. Xu, X. B. Cao, and H. Qiao, "An efficient tree classifier ensemblebased approach for pedestrian detection," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 1, pp. 107-117, Feb. 2010.
33. Y. Yuan, Y. Pang, J. Pan, and X. Li, "Scene segmentation based on IPCA for visual surveillance," Neurocomputing, vol. 72, no. 10-12, pp. 2450-2454, Jun. 2009.
34. H. Zhou, Y. Yuan, and C. Shi, "Non-rigid object tracking in complex scenes," Pattern Recognit. Lett., vol. 30, no. 2, pp. 98-102, Jan. 2009.
35. J. Steffens, E. Elagin, and H. Neven, "Person spotter-Fast and robust system for human detection, tracking and recognition," in Proc. 3rd IEEE Int. Conf. Autom. Face Gesture Recog., 1998, pp. 516-521.
36. H. Zhou, A. Wallace, and P. Green, "Efficient tracking and ego-motion recovery using gait analysis," Signal Process., vol. 89, no. 12, pp. 2367-2384, Dec. 2009.
37. H. Zhou, Y. Yuan, and C. Shi, "Object tracking using SIFT features and mean shift," Comput. Vis. Image Underst and ., vol. 113, no. 3, pp. 345-352, Mar. 2009.
38. Y. Huang, S. Fu, and C. Thompson, "Stereovision-based object segmentation for automotive applications," EURASIP J. Appl. Signal Process., vol. 2005, pp. 2322-2329, Jan. 2005. (Pubitemid 43016373)
39. OpenCV. [Online]. Available: http://opencv.willowgarage.com/wiki/
40. A. Shashua, Y. Gdalyahu, and G. Hayun, "Pedestrian detection for driving assistance systems: Single-frame classification," in Proc. Intell. Veh. Symp., 2004, pp. 1-6.
41. T. Yang, J. Li, Q. Pan, C. Zhao, and Y. Zhu, "Active learning based pedestrian detection in real scenes," in Proc. ICPR, 2006, pp. 904-907. (Pubitemid 46553566)
42. M. Stikic and B. Schiele, "Activity recognition from sparsely labeled data using multi-instance learning," in Proc. o4th Int. Symp. LoCA, 2009, pp. 156-173.
43. P. Dollár, Z. Tu, P. Perona, and S. Belongie, "Integral channel features," in Proc. BMVC, 2009, pp. 1-11.