An energy model approach to people counting for abnormal crowd behavior detection

Neurocomputing

Volumn 83, Issue , 2012, Pages 121-135

  Xiong, Guogang ^a   Cheng, Jun ^a,b   Wu, Xinyu ^a,b   Chen, Yen Lun ^a   Ou, Yongsheng ^a,b   Xu, Yangsheng ^a,b  

^a SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Abnormal events; Image potential energy model; Intelligent surveillance; People counting

Indexed keywords

CAMERAS; ENTROPY; KINETIC ENERGY; KINETICS; MOLECULAR PHYSICS; POTENTIAL ENERGY; PROBABILITY DISTRIBUTIONS;

ABNORMAL EVENTS; CAMERA CALIBRATION; ENERGY-BASED MODELS; IMAGE POTENTIAL ENERGY MODELS; INTELLIGENT SURVEILLANCE; PEOPLE COUNTING; PERSPECTIVE DISTORTION; SURVEILLANCE APPLICATIONS;

BEHAVIORAL RESEARCH;

ARTICLE; BEHAVIORAL SCIENCE; BIOSURVEILLANCE; CONTROLLED STUDY; CROWDING; ENTROPY; HISTOGRAM; IMAGE ANALYSIS; IMAGE PROCESSING; INFORMATION PROCESSING; INTERMETHOD COMPARISON; KERNEL METHOD; LEARNING ALGORITHM; MATHEMATICAL MODEL; POPULATION DENSITY; POPULATION DYNAMICS; PRIORITY JOURNAL; PROBABILITY; PROCESS MODEL; RUNNING;

EID: 84862809076     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.12.007     Document Type: Article

References (47)

1. Tao D., Li X., Wu X., Maybank S. Geometric mean for subspace selection. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 31(2):260-274.
2. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: CVPR'05: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, 2005, pp. 20-25.
3. Tao D., Li X., Wu X., Maybank S. General tensor discriminant analysis and gabor features for gait recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29(10):1700-1715.
4. Li X., Hu W., Wang H., Zhang Z. Robust object tracking using a spatial pyramid heat kernel structural information representation. Neurocomputing 2010, 73(16-18):3179-3190.
5. Yuan Y., Pang Y., Pan J., Li X. Scene segmentation based on IPCA for visual surveillance. Neurocomputing 2009, 72(10-12):2450-2454.
6. J. Kim, K. Grauman, Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates, in: CVPR'09: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Florida, USA, 2009, pp. 2921-2928.
7. J. Yin, D. Hu, Q. Yang, Spatio-temporal event detection using dynamic conditional random fields, in: IJCAI'09: Proceedings of 21st International Joint Conference on Artificial Intelligence, vol. 9, Los Angeles, USA, 2009, pp. 1321-1327.
8. Carmona E., Rincón M., Bachiller M., Martínez-Cantos J., Martínez-Tomás R., Mira J. On the effect of feedback in multilevel representation spaces for visual surveillance tasks. Neurocomputing 2009, 72(4-6):916-927.
9. Z. Zhong, W. Ye, S. Wang, M. Yang, Y. Xu, Crowd energy and feature analysis, in: ICIT'07: IEEE International Conference on Integration Technology, Shenzhen, China, 2007, pp. 144-150.
10. Y. Hou, G. Pang, Automated people counting at a mass site, in: ICAL'08: IEEE International Conference on Automation and Logistics, Qingdao, 2008, pp. 464-469.
11. Bian W., Tao D. Max-min distance analysis by using sequential SDP relaxation for dimension reduction. IEEE Trans. Pattern Anal. Mach. Intell. 2011, 33(5):1037-1050.
12. Guan N., Tao D., Luo Z., Yuan B. Non-negative patch alignment framework. IEEE Trans. Neural Networks 2011, 22(8):1218-1230.
13. Hotelling H. Analysis of a complex of statistical variables into principal components. J. Educ. Psychol. 1933, 24(6):417-441.
14. M. Bozzoli, L. Cinque, E. Sangineto, A statistical method for people counting in crowded environments, in: ICIAP'07: the 14th International Conference on Image Analysis and Processing, Modena, 2007, pp. 506-511.
15. Kong D., Gray D., Tao H. A viewpoint invariant approach for crowd counting. Pattern Recognition 2006, 3:1187-1190.
16. D. Yang, H. González-Baños, L. Guibas, Counting people in crowds with a real-time network of simple image sensors, in: The 9th IEEE International Conference on Computer Vision, Nice, France, 2003, pp. 122-129.
17. Lin S., Chen J., Chao H. Estimation of number of people in crowded scenes using perspective transformation. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 2001, 31(6):645-654.
18. S. Challa, K. Aboura, K. Ravikanth, S. Deshpande, Estimating the number of people in buildings using visual information, in: IDC'07: Information, Decision and Control, Adelaide, Australia, 2007, pp. 124-129.
19. X. Wu, G. Liang, K. Lee, Y. Xu, Crowd density estimation using texture analysis and learning, in: ROBIO'06: IEEE International Conference on Robotics and Biomimetics, Kunming, China, 2006, pp. 214-219.
20. Kilambi P., Ribnick E., Joshi A., Masoud O., Papanikolopoulos N. Estimating pedestrian counts in groups. Comput. Vision Image Understanding 2008, 110(1):43-59.
21. Folgado E., Rincón M., Carmona E., Bachiller M. A block-based model for monitoring of human activity. Neurocomputing 2010, 74(8):1283-1289.
22. T. Chen, An automatic bi-directional passing-people counting method based on color image processing, in: The 37th IEEE International Carnahan Conference on Security Technology, Taiwan, 2003, pp. 200-207.
23. J. Guo, X. Wu, T. Cao, S. Yu, Y. Xu, Crowd density estimation via Markov random field (MRF), in: WCICA'10: The 8th World Congress on Intelligent Control and Automation, Jinan, 2010, pp. 258-263.
24. E. Zhang, F. Chen, A fast and robust people counting method in video surveillance, in: 2007 International Conference on Computational Intelligence and Security, Harbin, 2007, pp. 339-343.
25. X. Zhang, G. Sexton, Automatic human head location for pedestrian counting, in: The Sixth International Conference on Image Processing and Its Applications, vol. 2, Dublin, Ireland, 1997, pp. 535-540.
26. V. Rabaud, S. Belongie, Counting crowded moving objects, in: CVPR'06: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, New York, 2006, pp. 705-711.
27. T. Zhao, R. Nevatia, Tracking multiple humans in crowded environment, in: CVPR'04: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, Washington, DC, USA, 2004, pp. 406-413.
28. X. Liu, P. Tu, J. Rittscher, A. Perera, N. Krahnstoever, Detecting and counting people in surveillance applications, in: AVSS'05: IEEE Conference on Advanced Video and Signal Based Surveillance, Genova, 2005, pp. 306-311.
29. L. Kratz, K. Nishino, Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models, in: CVPR'09: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, FL, USA, 2009, pp. 1446-1453.
30. Y. Benezeth, P. Jodoin, V. Saligrama, C. Rosenberger, Abnormal events detection based on spatio-temporal co-occurrences, in: CVPR'09: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, FL, USA, 2009, pp. 2458-2465.
31. H. Zhong, J. Shi, M. Visontai, Detecting unusual activity in video, in: CVPR'04: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, Washington, DC, USA, 2004, pp. 819-826.
32. E. Andrade, R. Fisher, S. Blunsden, Detection of emergency events in crowded scenes, in: The Institution of Engineering and Technology Conference on Crime and Security, 2006, London, UK, 2006, pp. 528-533.
33. X. Wu, Y. Ou, H. Qian, Y. Xu, A detection system for human abnormal behavior, in: IROS'05: IEEE/RSJ International Conference on Intelligent Robots and Systems, Alberta, Canada, 2005, pp. 1204-1208.
34. S. Wang, Z. Miao, Anomaly detection in crowd scene, in: ICSP'10: 10th IEEE International Conference on Signal Processing, Beijing, China, 2010, pp. 1220-1223.
35. S. Wu, B. Moore, M. Shah, Chaotic invariants of lagrangian particle trajectories for anomaly detection in crowded scenes, in: CVPR'10: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Florida, USA, 2010, pp. 2054-2060.
36. J.S. Xie, L. Guo, Y.B. Chen, Z.L., The detection of unusual events in video based on Bayesian surprise model, in: ICISE'10: the 2nd International Conference on Information Science and Engineering, Hangzhou, China, 2010, pp. 4784-4788.
37. D. Chen, P. Huang, Dynamic human crowd modeling and its application to anomalous events detection, in: ICME'10: IEEE International Conference on Multimedia and Expo, 2010, Singapore, 2010, pp. 1582-1587.
38. L. Yong, H. Dongjian, Video-based detection of abnormal behavior in the examination room, in: IFITA'10: International Forum on Information Technology and Applications, vol. 3, Kunming, China, 2010, pp. 295-298.
39. N. Ihaddadene, C. Djeraba, Real-time crowd motion analysis, in: ICPR'08: the 19th International Conference on Pattern Recognition, FL, USA, 2008, pp. 1-4.
40. R. Mehran, A. Oyama, M. Shah, Abnormal crowd behavior detection using social force model, in: CVPR'09: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, FL, USA, 2009, pp. 935-942.
41. M. Sharif, N. Ihaddadene, C. Djeraba, Crowd behaviour monitoring on the escalator exits, in: ICCIT'08: the 11th International Conference on Computer and Information Technology, Venice, Italy, 2008, pp. 194-200.
42. T. Cao, X. Wu, J. Guo, S. Yu, Y. Xu, Abnormal crowd motion analysis, in: ROBIO'09: IEEE International Conference on Robotics and Biomimetics, Guilin, China, 2009, pp. 1709-1714.
43. Gonzalez R., Woods R. Digital Image Processing 2002, Prentice Hall, NJ.
44. Forsyth D., Ponce J. Computer Vision: A Modern Approach 2002, vol. 54. Prentice Hall.
45. Brillouin L. Science and Information Theory 2004, Dover Publications.
46. Lucas B., Kanade T., et al. An iterative image registration technique with an application to stereo vision. IJCAI'81: International Joint Conference on Artificial Intelligence, Vancouver, Canada 1981, vol. 3:674-679.
47. G. Zhang, J. Jia, T. Wong, H. Bao, Recovering consistent video depth maps via bundle optimization, in: CVPR'08: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA, 2008, pp. 1-8.