Overview and benchmarking of motion detection methods

Background Modeling and Foreground Detection for Video Surveillance

Volumn , Issue , 2014, Pages 24-1-24-22

  Jodoin, Pierre Marc ^a   Piérard, Sébastien ^b   Wang, Yi ^a   van Droogenbroeck, Marc ^b  

^a UNIVERSITÉ DE SHERBROOKE   (Canada)

^b UNIVERSITY OF LIÈGE   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

MOTION DETECTION; MOVING OBJECTS; PRE-PROCESSING STEP;

MOTION ANALYSIS;

EID: 84969781706     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1201/b17223     Document Type: Chapter

References (101)

1. T. Aach and A. Kaup. Bayesian algorithms for adaptive change detection in image sequences using Markov random fields. Signal Process., Image Commun., 7:147-160, 1995.
2. M.S. Allili, N. Bouguila, and D. Ziou. Finite general Gaussian mixture modelling and application to image and video foreground segmentation. J. of Elec. Imaging, 17:1-23, 2008.
3. O. Barnich and M. Van Droogenbroeck. ViBe: A universal background subtraction algorithm for video sequences. IEEE Trans. Image Process., 20(6):1709-1724, June 2011.
4. F. Bashir and F. Porikli. Performance evaluation of object detection and tracking systems. In Proc. IEEE Int. Workshop on Performance Evaluation of Tracking Systems, 2006.
5. B. Bayer. Color imaging array, u.s. patent 3971065, 1976.
6. Y. Benezeth, P. Jodoin, B. Emile, H. Laurent, and C. Rosenberger. Review and evaluation of commonly-implemented background subtraction algorithms. In Proc. Int. Conf. Pattern Recognition, pages 1-4, December 2008.
7. Y. Benezeth, P-M. Jodoin, B. Emile, H. Laurent, and C. Rosenberger. Comparative study of background subtraction algorithms. J. of Elec. Imaging, 19(3):1-12, 2010.
8. A. F. Bobick and J. W. Davis. The recognition of human movement using temporal templates. IEEE Trans. Pattern Anal. Machine Intell., 23(3):257-267, 2001.
9. T. Bouwmans. Recent advanced statistical background modeling for foreground detection: A systematic survey. Recent Patents on Computer Science, 4(3), 2011.
10. T. Bouwmans, F. El Baf, and B. Vachon. Background modeling using mixture of Gaussians for foreground detection: A survey. Recent Patents on Computer Science, 1(3):219-237, 2008.
11. K. Boyd, V. Costa, J. Davis, and C. Page. Unachievable region in precision-recall space and its effect on empirical evaluation. In 29th International Conference on Machine Learning (ICML), Edinburgh, UK, June-July 2012.
12. S. Brutzer, B. Höferlin, and G. Heidemann. Evaluation of background subtraction techniques for video surveillance. In Proc. IEEE Conf. Computer Vision Pattern Recognition, pages 1937-1944, June 2011.
13. D. Butler, S. Sridharan, and M. Bove. Real-time adaptive background segmentation. In ICME, pages 341-344, 2003.
14. S. Chen, J. Zhang, Y. Li, and J. Zhang. A hierarchical model incorporating segmented regions and pixel descriptors for video background subtraction. IEEE Transactions on Industrial Informatics, 8(1):118-127, February 2012.
15. Y. Chen, C. Chen, C. Huang, and Y. Hung. Efficient hierarchical method for background subtraction. Pattern Recognition, 40(10):2706-2715, 2007.
16. L. Cheng, M. Gong, D. Schuurmans, and T. Caelli. Real-time discriminative background subtraction. IEEE Trans. Image Process., 20(5):1401-1414, 2011.
17. R. Cucchiara, C. Grana, M. Piccardi, and A. Prati. Detecting moving objects, ghosts, and shadows in video streams. IEEE Trans. Pattern Anal. Machine Intell., 25(10):1337-1342, October 2003.
18. Y. Dong, T.X. Han, and G.N. Desouza. Illumination invariant foreground detection using multi-subspace learning. Int. J. Know.-Based Intell. Eng. Syst., 14(1):31-41, 2010.
19. R. Duin. The combining classifier: to train or not to train? In IEEE International Conference on Pattern Recognition (ICPR), volume 2, pages 765-770, Quebec City, Canada, August 2002.
20. R. Duin and D. Tax. Experiments with classifier combining rules. In Multiple Classifier Systems, volume 1857 of Lecture Notes in Computer Science, pages 16-29. Springer, 2000.
21. A. Elgammal, R. Duraiswami, D. Harwood, and L.S. Davis. Background and foreground modeling using nonparametric kernel density for visual surveillance. Proc. IEEE, 90:1151-1163, 2002.
22. A. Elgammal, D. Harwood, and L. Davis. Non-parametric model for background subtraction. Proc. European Conf. Computer Vision, pages 751-767, 2000.
23. R. Evangelio, M. Pätzold, and T. Sikora. Splitting Gaussians in mixture models. In Proc. IEEE Int. Conf. on Advanced Video and Signal-based Surveillance, 2012.
24. R. Evangelio and T. Sikora. Complementary background models for the detection of static and moving objects in crowded environments. In Proc. IEEE Int. Conf. on Advanced Video and Signal-based Surveillance, 2011.
25. N. Friedman and S. Russell. Image segmentation in video sequences: a probabilistic approach. In Proc of Uncertainty in Artificial Intelligence, pages 175-181, 1997.
26. X. Gao, T. Boult, F. Coetzee, and V. Ramesh. Error analysis of background adaption. Proc. IEEE Conf. Computer Vision Pattern Recognition, 2000.
27. N. Goyette, P.-M. Jodoin, F. Porikli, J. Konrad, and P. Ishwar. changedetection.net: A new change detection benchmark dataset. In IEEE Workshop on Change Detection, 2012.
28. N. Goyette, P.-M. Jodoin, F. Porikli, J. Konrad, and P. Ishwar. changedetection.net: A new change detection benchmark dataset. In Change Detection Workshop (CDW), Providence, Rhode Island, June 2012.
29. T. Haines and T. Xiang. Background subtraction with dirichlet processes. In Proc. European Conf. Computer Vision, pages 97-111, 2012.
30. B. Han and L. Davis. Density-based multifeature background subtraction with support vector machine. IEEE Trans. Pattern Anal. Machine Intell., 34(5), 2012.
31. Z. Hao, W. Wen, Z. Liu, and X. Yang. Real-time foreground-background segmentation using adaptive support vector machine algorithm. In Proc of ICANN, pages 603-610, 2007.
32. M. Hofmann. Background segmentation with feedback: The pixel-based adaptive segmenter. In IEEE Workshop on Change Detection, 2012.
33. S.-S. Huang, L.-C. Fu, and P.-Y. Hsiao. Region-level motion-based background modeling and subtraction using MRFs. IEEE Transactions on Image Processing, 16(5):1446-1456, May 2007.
34. O. Javed, K. Shafique, and M. Shah. A hierarchical approach to robust background subtraction using color and gradient information. In Workshop on Motion and Video Computing, pages 22-27, December 2002.
35. J-P. Jodoin, G. Bilodeau, and N. Saunier. Background subtraction based on local shape. Technical Report arXiv:1204.6326v1, Ecole Polytechnique de Montreal, 2012.
36. P-M. Jodoin, M. Mignotte, and J. Konrad. Statistical background subtraction methods using spatial cues. IEEE Trans. Circuits Syst. Video Technol., 17(12):1758-1763, 2007.
37. P. KaewTraKulPong and R. Bowden. An improved adaptive background mixture model for realtime tracking with shadow detection. European Workshop on Advanced Video Based Surveillance Systems, 2001.
38. M. Karaman, L. Goldmann, D. Yu, and T. Sikora. Comparison of static background segmentation methods. In Proc. SPIE Visual Communications and Image Process., 2005.
39. K. Karman and A. von Brandt. Moving object recognition using an adaptive background memory. In Capellini, editor, Time-varying Image Processing and Moving Object Recognition, volume 2, pages 297-307, Amsterdam, The Netherlands, 1990. Elsevier.
40. H. Kim, R. Sakamoto, I. Kitahara, T. Toriyama, and K. Kogure. Robust foreground extraction technique using Gaussian family model and multiple thresholds. In ACCV, pages 758-768, 2007.
41. K. Kim, T. Chalidabhongse, D. Harwood, and L. Davis. Real-time foreground-background segmentation using codebook model, real-time imaging. Real-Time Imaging, 11(3):172-185, 2005.
42. D. Kit, B. Sullivan, and D. Ballard. Novelty detection using growing neural gas for visuospatial memory. In IEEE IROS, 2011.
43. J. Kittler, M. Hatef, and R. Duin. Combining classifiers. In IEEE International Conference on Pattern Recognition (ICPR), volume 2, pages 897-901, Vienna, Austria, August 1996.
44. F. Kristensen, P. Nilsson, and V. Öwall. Background segmentation beyond rgb. In Proc of ACCV, pages 602-612, 2006.
45. L. Kuncheva, C. Whitaker, C. Shipp, and R. Duin. Limits on the majority vote accuracy in classifier fusion. Pattern Analysis & Applications, 6(1):22-31, April 2003.
46. T. Landgrebe, P. Paclík, R. Duin, and A. Bradley. Precision-recall operating characteristic (P-ROC) curves in imprecise environments. In IEEE International Conference on Pattern Recognition (ICPR), volume 4, pages 123-127, Hong Kong, August 2006.
47. L. Li, W. Huang, I. Y. Gu, and Q. Tian. Statistical modeling of complex backgrounds for foreground object detection. IEEE Trans. Image Process., 13(11):1459-1472, 2004.
48. Y. Li. On incremental and robust subspace learning. Pattern Recognit., 37:1509-1518, 2004.
49. C-C Lien, Y-M Jiang, and L-G Jang. Large area video surveillance system with handoff scheme among multiple cameras. In MVA, pages 463-466, 2009.
50. H.-H. Lin, T.-L. Liu, and J.-H. Chuang. A probabilistic SVM approach for background scene initialization. In Proc. IEEE Int. Conf. Image Processing, pages 893-896, 2002.
51. X. Lu and R. Manduchi. Fast image motion segmentation for surveillance applications. Image Vis. Comput., 29(2-3):104-116, 2011.
52. L. Maddalena and A. Petrosino. A self-organizing approach to background subtraction for visual surveillance applications. IEEE Transactions on Image Processing, 17(7):1168-1177, 2008.
53. L. Maddalena and A. Petrosino. The SOBS algorithm: what are the limits? In IEEE Workshop on Change Detection, 2012.
54. A. Manzanera. Local jet feature space framework for image processing and representation. In International Conference on Signal Image Technology & Internet-Based Systems, pages 261-268, Dijon, France, 2011.
55. N. McFarlane and C. Schofield. Segmentation and tracking of piglets in images. Mach. vis. and appl., 8:187-193, 1995.
56. J.M. McHugh, J. Konrad, V. Saligrama, and P.-M. Jodoin. Foreground-adaptive background subtraction. IEEE Signal Process. Lett., 16(5):390-393, May 2009.
57. E. Memin and P. Perez. Dense estimation and object-based segmentation of the optical flow with robust techniques. IEEE Trans. Image Process., 7(5):703-719, 1998.
58. A. Mittal and N. Paragios. Motion-based background subtraction using adaptive kernel density estimation. In Proc. IEEE Conf. Computer Vision Pattern Recognition, pages 302-309, 2004.
59. A. Morde, X. Ma, and S. Guler. Learning a background model for change detection. In IEEE Workshop on Change Detection, 2012.
60. J. Nascimento and J. Marques. Performance evaluation of object detection algorithms for video surveillance. IEEE Trans. Multimedia, 8(8):761-774, 2006.
61. Y. Nonaka, A. Shimada, H. Nagahara, and R. Taniguchi. Evaluation report of integrated background modeling based on spatio-temporal features. In IEEE Workshop on Change Detection, 2012.
62. N. M. Oliver, B. Rosario, and A. P. Pentland. A Bayesian computer vision system for modeling human interactions. IEEE Trans. Pattern Anal. Machine Intell., 22(8):831-843, 2000.
63. S. K. Mitra P. Jaikumar, A. Singh. Background subtraction in videos using bayesian learning with motion information. In British Mach. Vis. Conf, pages 1-10, 2008.
64. T. Parag, A. Elgammal, and A. Mittal. A framework for feature selection for background subtraction. In Proc. IEEE Conf. Computer Vision Pattern Recognition, pages 1916-1923, New York, USA, June 2006.
65. J. Park, A. Tabb, and A. Kak. Hierarchical data structure for real-time background subtraction. In IEEE International Conference on Image Processing (ICIP), pages 1849-1852, 2006.
66. D. Parks and S. Fels. Evaluation of background subtraction algorithms with post-processing. In Proc. IEEE Int. Conf. on Advanced Video and Signal-based Surveillance, pages 192-199, September 2008.
67. M. Piccardi. Background subtraction techniques: a review. In Conf. IEEE Int. Conf. Sys., Man and Cyb., pages 3099-3104, 2004.
68. F. Porikli. Multiplicative background-foreground estimation under uncontrolled illumination using intrinsic images. In Proc. of IEEE Motion Multi-Workshop, Breckenridge, 2005.
69. F. Porikli and O. Tuzel. Bayesian background modeling for foreground detection. Proc. of ACM Visual Surveillance and Sensor Network, 2005.
70. F. Porikli and C. Wren. Change detection by frequency decomposition: wave-back. Proc. of Workshop on Image Analysis for Multimedia Interactive Services, Montreux, 2005.
71. A. Prati, R. Cucchiara, I. Mikic, and M. Trivedi. Analysis and detection of shadows in video streams: A comparative evaluation. In Proc. IEEE Conf. Computer Vision Pattern Recognition, pages 571-577, 2001.
72. R. Radke, S. Andra, O. Al-Kofahi, and B. Roysam. Image change detection algorithms: A systematic survey. IEEE Trans. Image Process., 14:294-307, 2005.
73. D. Riahi, P. St-Onge, and G. Bilodeau. RECTGAUSS-tex: Block-based background subtraction. Technical Report EPM-RT-2012-03, Ecole Polytechnique de Montreal, 2012.
74. P. Rosin and E. Ioannidis. Evaluation of global image thresholding for change detection. Pattern Recognit. Lett., 24:2345-2356, 2003.
75. J. Rymel, J. Renno, D. Greenhill, J. Orwell, and G.A. Jones. Adaptive eigen-backgrounds for object detection. In Proc. IEEE Int. Conf. Image Processing, pages 1847-1850, 2004.
76. A. Schick, M. Bäuml, and R. Stiefelhagen. Improving foreground segmentations with probabilistic superpixel markov random fields. In IEEE Workshop on Change Detection, 2012.
77. M. Sedky, M. Moniri, and C. Chibelushi. Object segmentation using full-spectrum matching of albedo derived from colour images, Patent application PCT GB2009/002829, 2009.
78. C. Stauffer and E. Grimson. Learning patterns of activity using real-time tracking. IEEE Trans. Pattern Anal. Machine Intell., 22(8):747-757, 2000.
79. B. Stenger, V. Ramesh, N. Paragios, F. Coetzee, and J. Buhmann. Topology free Hidden Markov Models: application to background modeling. Proc. IEEE Int. Conf. Computer Vision, 2001.
80. J. Suhr, H. Jung, G. Li, and J. Kim. Mixture of Gaussians-based background subtraction for Bayer-pattern image sequences. IEEE Trans. Circuits Syst. Video Technol., 21(3):365-370, March 2011.
81. D. Tax, M. van Breukelen, R. Duin, and J. Kittler. Combining multiple classifiers by averaging or by multiplying? Pattern Recognition, 33(9):1475-1485, 2000.
82. Y-L. Tian and A. Hampapur. Robust salient motion detection with complex background for real-time video surveillance. In WACV/MOTION, pages 30-35, 2005.
83. F. Tiburzi, M. Escudero, J. Bescos, and J. Martinez. A ground truth for motion-based videoobject segmentation. In Proc. IEEE Int. Conf. Image Processing, pages 17-20, 2008.
84. K. Toyama, J. Krumm, B. Brumitt, and B. Meyers. Wallflower: Principles and practice of background maintenance. In Proc. IEEE Int. Conf. Computer Vision, volume 1, pages 255-261, 1999.
85. M. Van Droogenbroeck and O. Paquot. Background subtraction: Experiments and improvements for ViBe. In IEEE Workshop on Change Detection, pages 32-37, Providence, Rhode Island, USA, June 2012.
86. R. Vezzani and R. Cucchiara. Video surveillance online repository (ViSOR): an integrated framework. Multimedia Tools and Applications, 50(2):359-380, 2010.
87. H. Wang and D. Suter. A consensus-based method for tracking: Modelling background scenario and foreground appearance. Pattern Recognit., 40(3):1091-1105, March 2007.
88. W-H. Wang and R-C. Wu. Fusion of luma and chroma gmms for hmm-based object detection. In Proc of. conference on Advances in Image and Video Technology, pages 573-581, 2006.
89. S. Warfield, K. Zou, and W. Wells. Simultaneous truth and performance level estimation (STAPLE): An algorithm for the validation of image segmentation. IEEE Transactions on Medical Imaging, 23(7):903-921, July 2004.
90. L. Wixson. Detecting salient motion by accumulating directionally-consistent flow. IEEE Trans. Pattern Anal. Machine Intell., 22, 2000.
91. C. R. Wren, A. Azarbayejani, T. Darrell, and A. P. Pentland. Pfinder: Real-time tracking of the human body. IEEE Trans. Pattern Anal. Machine Intell., 19(7):780-785, 1997.
92. L. Xu, A. Krzyżak, and C. Suen. Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Transactions on Systems, Man, and Cybernetics, 22(3):418-435, May-June 1992.
93. M. Xu and T. Ellis. Illumination-invariant motion detection using colour mixture models. In British Mach. Vis. Conf, pages 163-172, 2001.
94. Z. Xu, P. Shi, and I. Yu-Hua Gu. An eigenbackground subtraction method using recursive error compensation. In PCM, pages 779-787, 2006.
95. S. Yoshinaga, A. Shimada, and Taniguchi R. Statistical background model considering relationships between pixels. In IEEE Workshop on Change Detection, 2012.
96. D. Young and J. Ferryman. PETS metrics: Online performance evaluation service. In Proc. IEEE Int. Workshop on Performance Evaluation of Tracking Systems, pages 317-324, 2005.
97. C. Zhao, X. Wang, and W-K. Cham. Background subtraction via robust dictionary learning. EURASIP Journal on Image and Video Processing, 2011.
98. J. Zheng, Y. Wang, N. Nihan, and E. Hallenbeck. Extracting roadway background image: A mode based approach. J. of Transp. Research Report, pages 82-88, 2006.
99. J. Zhong and S. Sclaroff. Segmenting foreground objects from a dynamic textured background via a robust kalman filter. In Proc. IEEE Int. Conf. Computer Vision, pages 44-50, 2003.
100. D. Zhou and H. Zhang. Modified GMM background modeling and optical flow for detection of moving objects. In Conf. IEEE Int. Conf. Sys., Man and Cyb., pages 2224-2229, 2005.
101. Z. Zivkovic and F. Van Der Heijden. Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern Recognit. Lett., 27:773-780, 2006.