Background subtraction for automated multisensor surveillance: A comprehensive review

Eurasip Journal on Advances in Signal Processing

Volumn 2010, Issue , 2010, Pages

  Cristani, Marco ^a,b   Farenzena, Michela ^a   Bloisi, Domenico ^a   Murino, Vittorio ^a,b  

^a UNIVERSITY OF VERONA   (Italy)

^b ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

BACKGROUND SUBTRACTION; BACKGROUND SUBTRACTION METHOD; INFRARED CHANNEL; MULTI SENSOR; MULTISENSOR SURVEILLANCE; NEW APPROACHES; VIDEO SURVEILLANCE;

SECURITY SYSTEMS;

EID: 78249277921     PISSN: 16876172     EISSN: 16876180     Source Type: Journal    
DOI: 10.1155/2010/343057     Document Type: Article

References (120)

1. Nguyen H. T., Smeulders A. W. M., Robust tracking using foreground-background texture discrimination International Journal of Computer Vision 2006 69 3 277 293
2. Collins R. T., Liu Y., Leordeanu M., Online selection of discriminative tracking features IEEE Transactions on Pattern Analysis and Machine Intelligence 2005 27 10 1631 1643
3. Chen H.-T., Liu T.-L., Fuh C.-S., Probabilistic tracking with adaptive feature selection Proceedings of the 17th International Conference on Pattern Recognition (ICPR '04) August 2004 736 739
4. Martez-Contreras F., Orrite-Urunuela C., Herrero-Jaraba E., Ragheb H., Velastin S. A., Recognizing human actions using silhouette-based HMM Proceedings of the 6th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS '09) 2009 43 48
5. Grabner H., Bischof H., On-line boosting and vision Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '06) June 2006 260 267
6. Shotton J., Johnson M., Cipolla R., Semantic texton forests for image categorization and segmentation Proceedings of the 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR '08) June 2008 1 8
7. Bicego M., Cristani M., Murino V., Unsupervised scene analysis: a hidden Markov model approach Computer Vision and Image Understanding 2006 102 1 22 41
8. Gong S., Ng J., Sherrah J., On the semantics of visual behaviour, structured events and trajectories of human action Image and Vision Computing 2002 20 12 873 888
9. Piccardi M., Background subtraction techniques: a review Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (SMC '04) October 2004 3099 3104
10. Radke R. J., Andra S., Al-Kofahi O., Roysam B., Image change detection algorithms: a systematic survey IEEE Transactions on Image Processing 2005 14 3 294 307
11. Benezeth Y., Jodoin P. M., Emile B., Laurent H., Rosenberger C., Review and evaluation of commonly-implemented background subtraction algorithms Proceedings of the 19th International Conference on Pattern Recognition (ICPR '08) December 2008
12. Mittal A., Paragios N., Motion-based background subtraction using adaptive kernel density estimation 2 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '04) 2004 302 309
13. Cheung S.-C. S., Kamath C., Robust techniques for background subtraction in urban traffic video 5308 Visual Communications and Image Processing 2004 San Jose, Calif, USA 881 892 Proceedings of SPIE
14. Parks D. H., Fels S. S., Evaluation of background subtraction algorithms with post-processing Proceedings of the 5th International Conference on Advanced Video and Signal Based Surveillance (AVSS '08) September 2008 192 199
15. WALLFLOWER, Test images for wallflower paper. http://research.microsoft. com/en-us/um/people/jckrumm/wallflower/testimages.htm
16. C. for Biometrics and S. Research. Cbsr nir face dataset. http://www.cbsr.ia.ac.cn
17. OTCBVS Benchmark Dataset Collection. http://www.cse.ohio-state.edu/ otcbvs-bench/
18. Miezianko R., Terravic research infrared database
19. Toyama K., Krumm J., Brumitt B., Meyers B., Wallflower: principles and practice of background maintenance 1 Proceedings of the IEEE International Conference on Computer Vision 1999 255 261
20. Sheikh Y., Shah M., Bayesian modeling of dynamic scenes for object detection IEEE Transactions on Pattern Analysis and Machine Intelligence 2005 27 11 1778 1792
21. Jain R., Nagel H. H., On the analysis of accumulative difference pictures from image sequences of real world scenes IEEE Transactions on Pattern Analysis and Machine Intelligence 1978 1 2 206 214
22. Wren C. R., Azarbayejani A., Darrell T., Pentland A. P., Pfinder: real-time tracking of the human body IEEE Transactions on Pattern Analysis and Machine Intelligence 1997 19 7 780 785
23. Heikkil J., Silven O., A real-time system for monitoring of cyclists and pedestrians Proceedings of the 2nd IEEE International Workshop on Visual Surveillance 1999 Fort Collins, Colo, USA 74 81
24. McFarlane N. J. B., Schofield C. P., Segmentation and tracking of piglets in images Machine Vision and Applications 1995 8 3 187 193
25. Cucchiara R., Grana C., Piccardi M., Prati A., Detecting moving objects, ghosts, and shadows in video streams IEEE Transactions on Pattern Analysis and Machine Intelligence 2003 25 10 1337 1342
26. Haritaoglu I., Cutler R., Harwood D., Davis L. S., Backpack: detection of people carrying objects using silhouettes Computer Vision and Image Understanding 2001 81 3 385 397
27. Haritaoglu I., Harwood D., Davis L. S., W 4: real-time surveillance of people and their activities IEEE Transactions on Pattern Analysis and Machine Intelligence 2000 22 8 809 830
28. Friedman N., Russell S., Image segmentation in video sequences: a probabilistic approach Proceedings of the 13th Conference on Uncertainty in Artificial Intelligence (UAI '97) 1997 San Francisco, Calif, USA Morgan Kaufmann Publishers 175 181
29. Stauffer C., Grimson W. E.L., Adaptive background mixture models for real-time tracking 2 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '99) 1999 246 252
30. Wang H., Suter D., A re-evaluation of mixture-of-Gaussian background modeling Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '05) March 2005 1017 1020
31. Zivkovic Z., Improved adaptive Gaussian mixture model for background subtraction Proceedings of the 17th International Conference on Pattern Recognition (ICPR '04) August 2004 28 31
32. Elgammal A., Harwood D., Davis L., Non parametric model for background substraction Proceedings of the 6th European Conference Computer Vision June-July 2000 Dublin, Ireland
33. Elgammal A. M., Harwood D., Davis L. S., Non-parametric model for background subtraction Proceedings of the 6th European Conference on Computer Vision 2000 751 767
34. Duda R., Hart P., Stork D., Pattern Classification 2001 New York, NY, USA John Wiley Sons
35. Levine M., Vision by Man and Machine 1985 New York, NY, USA McGraw-Hill
36. Noriega P., Bernier O., Real time illumination invariant background subtraction using local kernel histograms Proceedings of the British Machine Vision Conference 2006
37. Heikkila M., Pietikainen M., A texture-based method for modeling the background and detecting moving objects IEEE Transactions on Pattern Analysis and Machine Intelligence 2006 28 4 657 662
38. Ojala T., Pietikainen M., Harwood D., Performance evaluation of texture measures with classification based on kullback discrimination of distributions Proceedings of the International Conference on Pattern Recognition (ICPR '94) 1994 582 585
39. Yao J., Odobez J.-M., Multi-layer background subtraction based on color and texture Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '07) June 2007 1 8
40. Klare B., Sarkar S., Background subtraction in varying illuminations using an ensemble based on an enlarged feature set Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '09) 2009 66 73
41. Cristani M., Murino V., A spatial sampling mechanism for effective background subtraction Proceedings of the 2nd International Conference on Computer Vision Theory and Applications (VISAPP '07) March 2007 403 410
42. Barnich O., Van Droogenbroeck M., ViBE: a powerful random technique to estimate the background in video sequences Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '09) 2009 Washington, DC, USA IEEE Computer Society 945 948
43. Rowe S., Blake A., Statistical mosaics for tracking Image and Vision Computing 1996 14 8 549 564
44. Mittal A., Huttenlocher D., Scene modeling for wide area surveillance and image synthesis 2 Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '00) June 2000 160 167
45. Hayman E., Eklundh J.-O., Statistical background subtraction for a mobile observer 1 Proceedings of the 9th IEEE International Conference on Computer Vision 2003 67 74
46. Ren Y., Chua C.-S., Ho Y.-K., Statistical background modeling for non-stationary camera Pattern Recognition Letters 2003 24 13 183 196
47. Irani M., Anandan P., A unified approach to moving object detection in 2d and 3d scenes IEEE Transactions on Pattern Analysis and Machine Intelligence 1998 20 6 577 589
48. Sawhney H. S., Guo Y., Kumar R., Independent motion detection in 3D scenes IEEE Transactions on Pattern Analysis and Machine Intelligence 2000 22 10 1191 1199
49. Yuan C., Medioni G., Kang J., Cohen I., Detecting motion regions in the presence of a strong parallax from a moving camera by multiview geometric constraints IEEE Transactions on Pattern Analysis and Machine Intelligence 2007 29 9 1627 1641
50. Tao H., Sawhney H. S., Kumar R., Object tracking with bayesian estimation of dynamic layer representations IEEE Transactions on Pattern Analysis and Machine Intelligence 2002 24 1 75 89
51. Xiao J., Shah M., Motion layer extraction in the presence of occlusion using graph cuts IEEE Transactions on Pattern Analysis and Machine Intelligence 2005 27 10 1644 1659
52. Jin Y., Tao L., Di H., Rao N. I., Xu G., Background modeling from a free-moving camera by multi-layer homography algorithm Proceedings of the IEEE International Conference on Image Processing (ICIP '08) October 2008 1572 1575
53. Vidail R., Ma Y., A unified algebraic approach to 2-D and 3-D motion segmentation 3021 Proceedings of the 8th European Conference on Computer Vision May 2004 Prague, Czech Republic 1 15 Lecture Notes in Computer Science
54. Kanatani K., Motion segmentation by subspace separation and model selection 2 Proceedings of the 8th International Conference on Computer Vision July 2001 586 591
55. Sheikh Y., Javed O., Kanade T., Background subtraction for freely moving cameras Proceedings of the IEEE International Conference on Computer Vision (ICCV '09) 2009 1219 1225
56. Collins R. T., Liu Y., On-line selection of discriminative tracking features 1 Proceedings of the 9th IEEE International Conference on Computer Vision October 2003 346 352
57. Parag T., Elgammal A., Mittal A., A framework for feature selection for background subtraction Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '06) June 2006 1916 1923
58. Stenger B., Ramesh V., Paragios N., Coetzee F., Buhmann J. M., Topology free hidden Markov models: application to background modeling 1 Proceedings of the IEEE International Conference on Computer Vision 2001 294 301
59. Ohta N., A statistical approach to background subtraction for surveillance systems 2 Proceedings of the 8th International Conference on Computer Vision July 2001 481 486
60. Oliver N. M., Rosario B., Pentland A. P., A Bayesian computer vision system for modeling human interactions IEEE Transactions on Pattern Analysis and Machine Intelligence 2000 22 8 831 843
61. Cristani M., Bicego M., Murino V., Integrated region- and pixel-based approach to background modelling Proceedings of the IEEE Workshop on Motion and Video Computing 2002 3 8
62. Cristani M., Bicego M., Murino V., Multi-level background initialization using hidden Markov models Proceedings of the ACMSIGMM Workshop on Video Surveillance 2003 11 19
63. Xiong Q., Jaynes C., Multi-resolution background modeling of dynamic scenes using weighted match filters Proceedings of the 2nd ACM International Workshop on Video Sureveillance and Sensor Networks (VSSN '04) 2004 New York, NY, USA ACM Press 88 96
64. Park J., Tabb A., Kak A. C., Hierarchical data structure for real-time background subtraction Proceedings of International Conference on Image Processing (ICIP '06) 2006
65. Wang H., Suter D., Background subtraction based on a robust consensus method 1 Proceedings of International Conference on Pattern Recognition 2006 223 226
66. Gao X., Boult T. E., Coetzee F., Ramesh V., Error analysis of background adaption 1 Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '00) June 2000 503 510
67. Gloyer B., Aghajan H. K., Siu K., Kailath T., Video-based freeway-monitoring system using recursive vehicle tracking 2421 Image and Video Processing III 1995 San Jose, Calif, USA 173 180
68. Long W., Yang Y.-H., Stationary background generation: an alternative to the difference of two images Pattern Recognition 1990 23 12 1351 1359
69. Gutchess D., Trajkovicz M., Cohen-Solal E., Lyons D., Jain A. K., A background model initialization algorithm for video surveillance 1 Proceedings of the IEEE International Conference on Computer Vision (ICCV '01) 2001 733 740
70. Colombari A., Cristani M., Murino V., Fusiello A., Exemplarbased background model initialization Proceedings of the third ACM International Workshop on Video Surveillance and Sensor Networks 2005 Hilton, Singapore 29 36
71. Colombari A., Fusiello A., Murino V., Background initialization in cluttered sequences Proceedings of the 5th Conference on Computer Vision and Pattern Recognition (CVPR '06) 2006
72. Zhao T., Nevatia R., Tracking multiple humans in crowded environment Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '04) July 2004 406 413
73. Bahadori S., Iocchi L., Leone G. R., Nardi D., Scozzafava L., Real-time people localization and tracking through fixed stereo vision Applied Intelligence 2007 26 2 83 97
74. Lim S., Mittal A., Davis L., Paragios N., Fast illuminationinvariant background subtraction using two views: error analysis, sensor placement and applications 1 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2005 1071 1078
75. Brown M. Z., Burschka D., Hager G. D., Advances in computational stereo IEEE Transactions on Pattern Analysis and Machine Intelligence 2003 25 8 993 1008
76. Lazaros N., Sirakoulis G. C., Gasteratos A., Review of stereo vision algorithms: from software to hardware International Journal of Optomechatronics 2008 2 4 435 462
77. Beymer D., Konolige K., Real-time tracking of multiple people using continuous detection Proceedings of International Conference on Computer Vision (ICCV '99) 1999
78. Eveland C., Konolige K., Bolles R. C., Background modeling for segmentation of video-rate stereo sequences Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition June 1998 266 271
79. Darrell T., Demirdjian D., Checka N., Felzenszwalb P., Plan-view trajectory estimation with dense stereo background models Proceedings of the 8th International Conference on Computer Vision (ICCV '01) July 2001 628 635
80. Ivanov Y., Bobick A., Liu J., Fast lighting independent background subtraction International Journal of Computer Vision 2000 37 2 199 207
81. Gordon G., Darrell T., Harville M., Woodfill J., Background estimation and removal based on range and color Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '99) June 1999 459 464
82. Harville M., Gordon G., Woodfill J., Foreground segmentation using adaptive mixture models in color and depth Proceedings of the IEEE Workshop on Detection and Recognition of Events in Video 2001 3 11
83. Focken D., Stiefelhagen R., Towards vision-based 3-d people tracking in a smart room Proceedings of the 4th IEEE International Conference on Multimodal Interfaces 2002 400 405
84. Mittal A., Davis L. S., M2tracker: a multi-view approach to segmenting and tracking people in a cluttered scene International Journal of Computer Vision 2003 51 3 189 203
85. Khan S. M., Shah M., A multiview approach to tracking people in crowded scenes using a planar homography constraint 3954 Proceedings of the 9th European Conference on Computer Vision (ECCV '06) 2006 Graz, Austria 133 146 Lecture Notes in Computer Science
86. Lipton A. J., Fujiyoshi H., Patil R. S., Moving target classification and tracking from real-time video Proceedings of the IEEE Workshop Application of Computer Vision 1998 8 14
87. Krumm J., Harris S., Meyers B., Brumitt B., Hale M., Shafer S., Multi-camera multi-person tracking for easyliving Proceedings of the 3rd IEEE International Workshop on Visual Surveillance (VS '00) 2000 3
88. Muoz-Salinas R., Aguirre E., Garca-Silvente M., People detection and tracking using stereo vision and color Image and Vision Computing 2007 25 6 995 1007
89. Bregman A., Auditory Scene Analysis: The Perceptual Organization of Sound 1990 London, UK MIT Press
90. Peltonen V., Computational auditory scene recognition, M.S. thesis 2001 Tampere, Finland Tampere University of Tech.
91. Cowling M., Sitte R., Comparison of techniques for environmental sound recognition Pattern Recognition Letters 2003 24 15 2895 2907
92. Zhang T., Jay Kuo C.-C., Audio content analysis for online audiovisual data segmentation and classification IEEE Transactions on Speech and Audio Processing 2001 9 4 441 457
93. Roweis S., One microphone source separation Advances in Neural Information Processing Systems 2000 793 799
94. Hild K. II, Erdogmus D., Principe J., On-line minimum mutual information method for time-varying blind source separation Proceedings of the International Workshop on Independent Component Analysis and Signal Separation (ICA '01) 2001 126 131
95. Stager M., Lukowica P., Perera N., Buren T. V., Troster G., Starner T., Soundbutton: design of a low power wearable audio classification system Proceedings of the 7th IEEE International Symposium on Wearable Computers 2003 12 17
96. Chen J., Kam A. H., Zhang J., Liu N., Shue L., Bathroom activity monitoring based on sound 3468 Proceedings of the 3rd International Conference on Pervasive Computing May 2005 Munich, Germany 47 61 Lecture Notes in Computer Science
97. Azlan M., Cartwright I., Jones N., Quirk T., West G., Multimodal monitoring of the aged in their own homes Proceedings of the 3rd International Conference on Smart Homes and Health Telematics (ICOST '05) 2005
98. Ellis D., Detecting alarm sounds Proceedings of Consistent and Reliable Acoustic Cues for sound analysis(CRAC '01) September 2001 Aalborg, Denmark
99. Cristani M., Bicego M., Murino V., On-line adaptive background modelling for audio surveillance 2 Proceedings of the 17th International Conference on Pattern Recognition (ICPR '04) August 2004 399 402
100. Moncrieff S., Venkatesh S., West G., Online audio background determination for complex audio environments ACM Transactions on Multimedia Computing, Communications and Applications 2007 3 2
101. Chu S., Narayanan S., Kuo C.-C. J., A semi-supervised learning approach to online audio background detection Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '09) April 2009 1629 1632
102. Huang K., Wang L., Tan T., Maybank S., A real-time object detecting and tracking system for outdoor night surveillance Pattern Recognition 2008 41 1 432 444
103. Stevens M., Pollak J., Ralph S., Snorrason M., Video surveillance at night 5810 Acquisition, Tracking, and Pointing XIX 2005 128 136 Proceedings of SPIE
104. Zhao Y., Gong H., Lin L., Jia Y., Spatio-temporal patches for night background modeling by subspace learning Proceedings of the 19th International Conference on Pattern Recognition (ICPR '08) December 2008
105. Davis J. W., Sharma V., Background-subtraction using contour-based fusion of thermal and visible imagery Computer Vision and Image Understanding 2007 106 2-3 162 182
106. Iwasawa S., Ebiharai K., Ohya J., Morishima S., Real-time estimation of human body posture from monocular thermal images Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition June 1997 15 20
107. Bhanu B., Han J., Kinematic based human motion analysis in infrared sequences Proceedings of the 6th IEEE Workshop on Applications of Computer Vision 2002 208 212
108. Xu F., Liu X., Fujimura K., Pedestrian detection and tracking with night vision IEEE Transactions on Intelligent Transportation Systems 2005 6 1 63 71
109. Nanda H., Davis L., Probabilistic template based pedestrian detection in infrared videos 1 Proceedings of the IEEE Intelligent Vehicles Symposium 2002 15 20
110. Goubet E., Katz J., Porikli F., Pedestrian tracking using thermal infrared imaging 6206 Infrared Technology and Applications XXXII 2006 797 808 Proceedings of SPIE
111. Zhao H., Cheung S. S., Human segmentation by fusing visiblelight and thermal imaginary Proceedings of the International Conference on Computer Vision (ICCV '09) 2009
112. Kumar P., Mittal A., Kumar P., Fusion of thermal infrared and visible sprectrum video for robust surveillance 4338 Proceedings of the 5th Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP '06) December 2006 Madurai, India 528 539 Lectures Notes in Computer Science
113. Han J., Bhanu B., Detecting moving humans using color and infrared video Proceedings of the International Conference on Multisensor Fusion and Integration for Intelligent Systems 2003 228 233
114. Jiang L., Tian F., Shen L. E., Wu S., Yao S., Lu Z., Xu L., Perceptual-based fusion of IR and visual images for human detection Proceedings of the International Symposium on Intelligent Multimedia, Video and Speech Processing (ISIMP '04) October 2004 514 517
115. Rabinkin D., Renomeron R., Dahl A., French J., Flanagan J., Bianchi M., A DSP implementation of source location using microphone arrays The Journal of the Acoustical Society of America 1996 99 4 2503 2529
116. Aarabi P., Zaky S., Robust sound localization using multi-source audiovisual information fusion Information Fusion 2001 2 3 209 223
117. Bhanu B., Zou X., Moving humans detection based on multimodal sensor fusion Proceedings of the Conference on Computer Vision and Pattern Recognition 2004
118. Menegatti E., Mumolo E., Nolich M., Pagello E., A surveillance system based on audio and video sensory agents cooperating with a mobile robot Proceedings of the 8th International Conference on Intelligent Autonomous Systems (IAS '08) 2004
119. Megherbi N., Ambellouis S., Colt O., Cabestaing F., Joint audio-video people tracking using belief theory Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS '05) September 2005 135 140
120. Cristani M., Bicego M., Murino V., Audio-Video integration for background modelling 3022 Proceedings of the 8th European Conference on Computer Vision (ECCV '04) May 2004 Prague, Czech Republic 202 213 Lecture Notes in Computer Science