A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos

Computer Vision and Image Understanding

Volumn 122, Issue , 2014, Pages 4-21

  Sobral, Andrews ^a   Vacavant, Antoine ^b  

^a UNIVERSITÉ DE LA ROCHELLE   (France)

^b UNIVERSITÉ CLERMONT AUVERGNE   (France)

Author keywords

Background subtraction; Foreground segmentation; Motion detection

Indexed keywords

COMPUTER HARDWARE DESCRIPTION LANGUAGES;

BACKGROUND MODEL; BACKGROUND SUBTRACTION; BACKGROUND SUBTRACTION ALGORITHMS; COMPUTER VISION SYSTEM; EXPERIMENTAL ANALYSIS; FOREGROUND OBJECTS; FOREGROUND SEGMENTATION; MOTION DETECTION;

OBJECT DETECTION;

EID: 84898063054     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2013.12.005     Document Type: Article

References (49)

1. M.M. Azab, H.A. Shedeed, A.S. Hussein, A new technique for background modeling and subtraction for motion detection in real-time videos. In: IEEE International Conference on Image Processing (ICIP), 2010, pp. 3453-3456.
2. Y. Benezeth, P.-M. Jodoin, B. Emile, H. Laurent, C. Rosenberger, Review and evaluation of commonly-implemented background subtraction algorithms. In: IEEE International Conference on Pattern Recognition (ICPR), 2008, pp. 1-4.
3. T. Bouwmans Recent advanced statistical background modeling for foreground detection: A systematic survey Recent Patents Comput. Sci. 4 3 2011 147 176
4. T. Bouwmans Background subtraction for visual surveillance: a fuzzy approach Handbook on Soft Computing for Video Surveillance 2012 Taylor and Francis Group
5. T. Bouwmans, and F. El Baf Modeling of dynamic backgrounds by type-2 fuzzy Gaussian mixture models MASAUM J. Basic Appl. Sci. 2009
6. T. Bouwmans, F. El Baf, and B. Vachon Background modeling using mixture of Gaussians for foreground detection - a survey Recent Patents Comput. Sci. 1 3 2008 219 237
7. T. Bouwmans, F. El Baf, and B. Vachon Statistical background modeling for foreground detection: a survey Handbook of Pattern Recognition and Computer Vision vol. 4 2010 World Scientific Publishing 181 199 Ch. 3
8. S. Brutzer, B. Höferlin, G. Heidemann, Evaluation of background subtraction techniques for video surveillance, in: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 1937-1944.
9. S. Calderara, R. Melli, A. Prati, R. Cucchiara, Reliable back ground suppression for complex scenes, in: ACM International Workshop on Video Surveillance and Sensor Networks, 2006.
10. Y.-T. Chen, C.-S. Chen, C.-R. Huang, and Y.-P. Hung Efficient hierarchical method for background subtraction Pattern Recogn. 40 10 2007 2706 2715
11. G. Choquet Theory of capacities Ann. Inst. Fourier 1953 131 295
12. D. Culibrk, O. Marques, D. Socek, H. Kalva, and B. Furht Neural network approach to background modeling for video object segmentation IEEE Trans. Neural Networks 18 6 2007 1614 1627
13. Y. Dhome, N. Tronson, A. Vacavant, T. Chateau, C. Gabard, Y. Goyat, D. Gruyer, A benchmark for background subtraction algorithms in monocular vision: a comparative study, in: IEEE International Conference on Image Processing Theory, Tools and Applications (IPTA), 2010, pp. 66-71.
14. F. El Baf, T. Bouwmans, B. Vachon, Foreground detection using the choquet integral, in: International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), 2008, pp. 187-190.
15. F. El Baf, T. Bouwmans, B. Vachon, Fuzzy integral for moving object detection, in: IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), 2008, pp. 1729-1736.
16. F. El Baf, T. Bouwmans, B. Vachon, Type-2 fuzzy mixture of Gaussians model: Application to background modeling, in: International Symposium on Advances in Visual Computing (ISVC), 2008.
17. F. El Baf, T. Bouwmans, B. Vachon, Fuzzy statistical modeling of dynamic backgrounds for moving object detection in infrared videos, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2009, pp. 60-65.
18. A.B. Godbehere, A. Matsukawa, K. Goldberg, Visual tracking of human visitors under variable-lighting conditions for a responsive audio art installation, in: American Control Conference (ACC), 2012.
19. Y. Goyat, T. Chateau, L. Malaterre, L. Trassoudaine, Vehicle trajectories evaluation by static video sensors, in: IEEE International Conference on Intelligent Transportation Systems, 2006.
20. N. Goyette, P.-M. Jodoin, F. Porikli, J. Konrad, P. Ishwar, Changedetection.net: a new change detection benchmark dataset, in: Workshop on Change Detection (CDW) at the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2012, pp. 1-8.
21. E. Hayman, J.-O. Eklundh, Statistical background subtraction for a mobile observer, in: IEEE International Conference on Computer Vision (ICCV), 2003, pp. 67-74.
22. M. Hofmann, P. Tiefenbacher, G. Rigoll, Background segmentation with feedback: The pixel-based adaptive segmenter, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2012, pp. 38-43.
23. V. Jain, B.B. Kimia, J.L. Mundy, Background modeling based on subpixel edges, in: IEEE International Conference on Image Processing (ICIP), 2007.
24. X. Jian, D. Xiao-Qing, W. Sheng-Jin, W. You-Shou, Background subtraction based on a combination of texture, color and intensity, in: International Conference on Signal Processing (ICSP), 2008.
25. P. Kaewtrakulpong, R. Bowden, An improved adaptive background mixture model for realtime tracking with shadow detection, European Workshop on Advanced Video Based Surveillance Systems (AVSS), 2001.
26. F. Kristensen, P. Nilsson, V. Owall, Background segmentation beyond RGB, in: Asian Conference on Computer Vision (ACCV), 2006, pp. 602-612.
27. A. Lai, N. Yung, A fast and accurate scoreboard algorithm for estimating stationary backgrounds in an image sequence, in: IEEE International Symposium on Circuits and Systems (ISCAS), 1998, pp. 241-244.
28. C. Lallier, E. Renaud, L. Robinault, L. Tougne, A testing framework for background subtraction algorithms comparison in intrusion detection context, in: IEEE International Conference on Advanced Video and Signal-based Surveillance (AVSS), 2011.
29. L. Maddalena, and A. Petrosino A self-organizing approach to background subtraction for visual surveillance applications IEEE Trans. Image Process. 17 7 2008 1168 1177
30. L. Maddalena, and A. Petrosino A fuzzy spatial coherence-based approach to background/foreground separation for moving object detection Neural Comput. Appl. 19 2 2010 179 186
31. N.J. B. McFarlane, and C.P. Schofield Segmentation and tracking of piglets in images Mach. Vis. Appl. 8 3 1995 187 193
32. N.M. Oliver, B. Rosario, and A.P. Pentland A Bayesian computer vision system for modeling human interactions IEEE Trans. Pattern Anal. Mach. Intell. 22 8 2000 831 843
33. A. Prati, I. Mikic, M. Trivedi, and R. Cucchiara Detecting moving shadows: algorithms and evaluation IEEE Trans. Pattern Anal. Mach. Intell. 25 7 2003 918 923
34. M. Sigari, N. Mozayani, and H. Pourreza Fuzzy running average and fuzzy background subtraction: concepts and application Int. J. Comput. Sci. Network Security 8 2 2008 138 143
35. M. Sivabalakrishnan, D. Manjula, Adaptive background subtraction in dynamic environments using fuzzy logic, in: International Journal of Image Processing, 2010.
36. A. Sobral, BGSLibrary: an opencv c++ background subtraction library, in: IX Workshop de Viso Computacional (WVC'2013). Rio de Janeiro, Brazil, 2013, Software available at < http://code.google.com/p/bgslibrary/ >.
37. A. Sobral, L. Oliveira, L. Schnitman, F. Souza, Highway traffic congestion classification using holistic properties, in: International Conference on Signal Processing, Pattern Recognition and Applications (SPPRA'2013). Innsbruck, Austria, 2013, more information available at < http://www.behance.net/andrewssobral >.
38. C. Stauffer, W.E.L. Grimson, Adaptative background mixture models for a real-time tracking, in: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 1999.
39. M. Sugeno, Theory of fuzzy integrals and its applications. Ph.D. thesis, Tokyo Institute of Technology, 1974.
40. K. Toyama, J. Krumm, B. Brumitt, B. Meyers, Wallflower: principles and practice of background maintenance, in: International Conference on Computer Vision (ICCV), 1999, pp. 255-261.
41. O. Tuzel, F. Porikli, P. Meer, A Bayesian approach to background modeling, in: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2005.
42. A. Vacavant, T. Chateau, A. Wilhelm, and L. Lequièvre A benchmark dataset for foreground/background extraction Background Models Challenge (BMC) at Asian Conference on Computer Vision (ACCV) LNCS vol. 7728 2012 Springer 291 300
43. Z. Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli Image quality assessment: from error visibility to structural similarity IEEE Trans. Image Process. 13 4 2004 600 612
44. C. Wren, A. Azarbayejani, T. Darrell, and A. Pentland Pfinder: real-time tracking of the human body IEEE Trans. Pattern Anal. Mach. Intell. 19 7 1997 780 785
45. J. Yao, J. marc Odobez, Multi-layer background subtraction based on color and texture, in: IEEE Computer Vision and Pattern Recognition Conference (CVPR), 2007.
46. H. Zhang, D. Xu, Fusing color and texture features for back ground model, in: International Conference on Fuzzy Systems and Knowledge Discovery, 2006.
47. Z. Zhao, T. Bouwmans, X. Zhang, Y. Fang, A fuzzy background modeling approach for motion detection in dynamic backgrounds, in: International Conference Communications in Computer and Information Science, vol. 346, 2012, pp. 177-185.
48. Z. Zivkovic, Improved adaptive Gaussian mixture model for background subtraction, in: IEEE International Conference on Pattern Recognition (ICPR), 2004.
49. Z. Zivkovic, and F.V. D. Heijden Efficient adaptive density estimation per image pixel for the task of background subtraction Pattern Recog. Lett. 27 7 2006 773 780