SuBSENSE: A universal change detection method with local adaptive sensitivity

IEEE Transactions on Image Processing

Volumn 24, Issue 1, 2015, Pages 359-373

  St Charles, Pierre Luc ^a   Bilodeau, Guillaume Alexandre ^a   Bergevin, Robert ^b  

^a ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

^b UNIVERSITÉ LAVAL   (Canada)

Author keywords

background subtraction; change detection; foreground segmentation; spatiotemporal features; surveillance; video signal processing

Indexed keywords

BINARY IMAGES; C++ (PROGRAMMING LANGUAGE); PIXELS; SECURITY SYSTEMS; SIGNAL DETECTION; SIGNAL PROCESSING; SPACE SURVEILLANCE; VIDEO RECORDING; VIDEO SIGNAL PROCESSING;

BACKGROUND SUBTRACTION; CHANGE DETECTION; FOREGROUND SEGMENTATION; FOREGROUND/BACKGROUND SEGMENTATION; PARALLEL IMPLEMENTATIONS; REAL-TIME PROCESSING SPEED; SPATIO TEMPORAL FEATURES; STATE-OF-THE-ART METHODS;

FEATURE EXTRACTION;

EID: 84919904364     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2378053     Document Type: Article

References (45)

1. P.-L. St-Charles and G.-A. Bilodeau, "Improving background subtraction using local binary similarity patterns," in Proc. IEEE Winter Conf. Appl. Comput. Vis., Mar. 2014, pp. 509-515.
2. P.-L. St-Charles, G.-A. Bilodeau, and R. Bergevin, "Flexible background subtraction with self-balanced local sensitivity," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2014, pp. 414-419.
3. N. Goyette, P.-M. Jodoin, F. Porikli, J. Konrad, and P. Ishwar, "Changedetection.net: A new change detection benchmark dataset," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 1-8.
4. Y. Wang, P.-M. Jodoin, F. Porikli, J. Konrad, Y. Benezeth, and P. Ishwar, "CDnet 2014: An expanded change detection benchmark dataset," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2014, pp. 387-394.
5. O. Barnich and M. Van Droogenbroeck, "ViBe: A universal background subtraction algorithm for video sequences," IEEE Trans. Image Process., vol. 20, no. 6, pp. 1709-1724, Jun. 2011.
6. M. Van Droogenbroeck and O. Paquot, "Background subtraction: Experiments and improvements for ViBe," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 32-37.
7. M. Hofmann, P. Tiefenbacher, and G. Rigoll, "Background segmentation with feedback: The pixel-based adaptive segmenter," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 38-43.
8. N. Friedman and S. Russell, "Image segmentation in video sequences: A probabilistic approach," in Proc. 13th Conf. Uncertainty Artif. Intell., 1997, pp. 175-181.
9. C. Stauffer and W. E. L. Grimson, "Adaptive background mixture models for real-time tracking," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. Jun. 1999, pp. 246-252.
10. Z. Zivkovic, "Improved adaptive Gaussian mixture model for background subtraction," in Proc. 17th Int. Conf. Pattern Recognit., vol. 2. Aug. 2004, pp. 28-31.
11. Z. Zivkovic and F. van der Heijden, "Efficient adaptive density estimation per image pixel for the task of background subtraction," Pattern Recognit. Lett., vol. 27, no. 7, pp. 773-780, 2006.
12. D.-S. Lee, "Effective Gaussian mixture learning for video background subtraction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 827-832, May 2005.
13. P. KaewTraKulPong and R. Bowden, "An improved adaptive background mixture model for real-time tracking with shadow detection," in Video-Based Surveillance Systems. New York, NY, USA: Springer-Verlag, 2002, pp. 135-144.
14. A. Elgammal, D. Harwood, and L. Davis, "Non-parametric model for background subtraction," in Proc. 6th Eur. Conf. Comput. Vis., 2000, pp. 751-767.
15. A. Mittal and N. Paragios, "Motion-based background subtraction using adaptive kernel density estimation," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. Jul. 2004, pp. II-302-II-309.
16. Y. Sheikh and M. Shah, "Bayesian modeling of dynamic scenes for object detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 11, pp. 1778-1792, Nov. 2005.
17. M. Van Droogenbroeck and O. Barnich, "ViBe: A disruptive method for background subtraction," in Background Modeling and Foreground Detection for Video Surveillance, T. Bouwmans, F. Porikli, B. Hoferlin, and A. Vacavant, Eds. Boca Raton, FL, USA: CRC Press, Jun. 2014, ch. 7.
18. K. Kim, T. H. Chalidabhongse, D. Harwood, and L. Davis, "Background modeling and subtraction by codebook construction," in Proc. IEEE Int. Conf. Image Process., Oct. 2004, pp. 3061-3064.
19. M. Wu and X. Peng, "Spatio-temporal context for codebook-based dynamic background subtraction," AEU-Int. J. Electron. Commun., vol. 64, no. 8, pp. 739-747, 2010.
20. B. Wang and P. Dudek, "A fast self-tuning background subtraction algorithm," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2014, pp. 401-404.
21. L. Maddalena and A. Petrosino, "A self-organizing approach to background subtraction for visual surveillance applications," IEEE Trans. Image Process., vol. 17, no. 7, pp. 1168-1177, Jul. 2008.
22. L. Maddalena and A. Petrosino, "The SOBS algorithm: What are the limits?" in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 21-26.
23. M. De Gregorio and M. Giordano, "Change detection with weightless neural networks," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2014, pp. 409-413.
24. A. Morde, X. Ma, and S. Guler, "Learning a background model for change detection," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 15-20.
25. A. Schick, M. Bauml, and R. Stiefelhagen, "Improving foreground segmentations with probabilistic superpixel Markov random fields," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 27-31.
26. R. H. Evangelio and T. Sikora, "Complementary background models for the detection of static and moving objects in crowded environments," in Proc. 8th IEEE Int. Conf. Adv. Video Signal Based-Surveill., Aug. 2011, pp. 71-76.
27. J.-P. Jodoin, G.-A. Bilodeau, and N. Saunier. (2012). "Background subtraction based on local shape." [Online]. Available: http://arxiv.org/abs/1204.6326
28. N. M. Oliver, B. Rosario, and A. P. Pentland, "A Bayesian computer vision system for modeling human interactions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 831-843, Aug. 2000.
29. D.-M. Tsai and S.-C. Lai, "Independent component analysis-based background subtraction for indoor surveillance," IEEE Trans. Image Process., vol. 18, no. 1, pp. 158-167, Jan. 2009.
30. K. Toyama, J. Krumm, B. Brumitt, and B. Meyers, "Wallflower: Principles and practice of background maintenance," in Proc. 7th IEEE Int. Conf. Comput. Vis., vol. 1. Sep. 1999, pp. 255-261.
31. Y. Nonaka, A. Shimada, H. Nagahara, and R. Taniguchi, "Evaluation report of integrated background modeling based on spatio-temporal features," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 9-14.
32. R. Wang, F. Bunyak, G. Seetharaman, and K. Palaniappan, "Static and moving object detection using flux tensor with split Gaussian models," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2014, pp. 420-424.
33. M. Heikkila and M. Pietikainen, "A texture-based method for modeling the background and detecting moving objects," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 657-662, Apr. 2006.
34. S. Zhang, H. Yao, and S. Liu, "Dynamic background modeling and subtraction using spatio-temporal local binary patterns," in Proc. 15th IEEE Int. Conf. Image Process., Oct. 2008, pp. 1556-1559.
35. S. Liao, G. Zhao, V. Kellokumpu, M. Pietikainen, and S. Z. Li, "Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 1301-1306.
36. G.-A. Bilodeau, J.-P. Jodoin, and N. Saunier, "Change detection in feature space using local binary similarity patterns," in Proc. Int. Conf. Comput. Robot Vis., May 2013, pp. 106-112.
37. D. H. Parks and S. S. Fels, "Evaluation of background subtraction algorithms with post-processing," in Proc. 5th IEEE Int. Conf. Adv. Video Signal Based Surveill., Sep. 2008, pp. 192-199.
38. S. Herrero and J. Bescós, "Background subtraction techniques: Systematic evaluation and comparative analysis," in Advanced Concepts for Intelligent Vision Systems, vol. 5807, J. Blanc-Talon, W. Philips, D. Popescu, and P. Scheunders, Eds. Berlin, Germany: Springer-Verlag, vol. 5807, 2009, pp. 33-42.
39. Y. Benezeth, P.-M. Jodoin, B. Emile, H. Laurent, and C. Rosenberger, "Comparative study of background subtraction algorithms," J. Electron. Imag., vol. 19, no. 3, p. 033003, 2010.
40. S. Brutzer, B. Hoferlin, and G. Heidemann, "Evaluation of background subtraction techniques for video surveillance," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 1937-1944.
41. P.-M. Jodoin, S. Piérard, Y. Wang, and M. Van Droogenbroeck, "Overview and benchmarking of motion detection methods," in Background Modeling and Foreground Detection for Video Surveillance, T. Bouwmans, F. Porikli, B. Hoferlin, and A. Vacavant, Eds. Boca Raton, FL, USA: CRC Press, Jun. 2014, ch. 1.
42. H. Wang and D. Suter, "A consensus-based method for tracking: Modelling background scenario and foreground appearance," Pattern Recognit., vol. 40, no. 3, pp. 1091-1105, 2007.
43. M. De Gregorio and M. Giordano, "A WiSARD-based approach to CDnet," in Proc. 11th BRICS Countries Congr., Sep. 2013, pp. 172-177. [Online]. Available: http://www.ieeeexplore.us/xpl/articleDetails.jsp?tp=&arnumber=6855846
44. M. Sedky, M. Moniri, and C. C. Chibelushi, "Spectral-360: A physics-based technique for change detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2014, pp. 405-408.
45. T. S. F. Haines and T. Xiang, "Background subtraction with Dirichlet process mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 4, pp. 670-683, Apr. 2014.