A Novel video dataset for change detection benchmarking

IEEE Transactions on Image Processing

Volumn 23, Issue 11, 2014, Pages 4663-4679

  Goyette, Nil ^a   Jodoin, Pierre Marc ^a   Porikli, Fatih ^b   Konrad, Janusz ^c   Ishwar, Prakash ^c  

^a UNIVERSITÉ DE SHERBROOKE   (Canada)

^b MITSUBISHI ELECTRIC RESEARCH LABORATORIES   (United States)

^c Boston University   (United States)

Author keywords

benchmark testing; Change detection algorithms; video surveillance

Indexed keywords

BENCHMARK TESTING; CHANGE DETECTION; CHANGE DETECTION ALGORITHMS; VIDEO DATASET; VIDEO SURVEILLANCE;

EID: 84907483137     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2346013     Document Type: Article

References (87)

1. C. Stauffer and E. Grimson, "Adaptive background mixture models for real-time tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 1999.
2. A. M. Elgammal, D. Harwood, and L. S. Davis, "Non-parametric model for background subtraction," in Proc. 6th Eur. Conf. Comput. Vis., 2000, pp. 751-767.
3. C. R. Wren, A. Azarbayejani, T. Darrell, and A. P. Pentland, "Pfinder: Real-time tracking of the human body," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 780-785, Jun. 1997.
4. N. Goyette, P.-M. Jodoin, F. Porikli, J. Konrad, and P. Ishwar, "Changedetection.net: A new change detection benchmark dataset," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 1-8.
5. T. Bouwmans, "Recent advanced statistical background modeling for foreground detection: A systematic survey," Recent Patents Comput. Sci., vol. 4, no. 3, pp. 147-176, 2011.
6. L. Wixson, "Detecting salient motion by accumulating directionallyconsistent flow," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 774-780, Aug. 2000.
7. Y. Benezeth, P.-M. Jodoin, B. Emile, H. Laurent, and C. Rosenberger, "Comparative study of background subtraction algorithms," J. Electron. Imag., vol. 19, no. 3, pp. 1-12, 2010.
8. A. Elgammal, R. Duraiswami, D. Harwood, and L. S. Davis, "Background and foreground modeling using nonparametric kernel density estimation for visual surveillance," Proc. IEEE, vol. 90, no. 7, pp. 1151-1163, Jul. 2002.
9. O. Barnich and M. Van Droogenbroeck, "ViBe: A universal background subtraction algorithm for video sequences," IEEE Trans. Image Process., vol. 20, no. 6, pp. 1709-1724, Jun. 2011.
10. P. Rosin and E. Ioannidis, "Evaluation of global image thresholding for change detection," Pattern Recognit. Lett., vol. 24, no. 14, pp. 2345-2356, 2003.
11. R. Radke, S. Andra, O. Al-Kofahi, and B. Roysam, "Image change detection algorithms: A systematic survey," IEEE Trans. Image Process., vol. 14, no. 3, pp. 294-307, Mar. 2005.
12. F. Porikli and C. Wren, "Change detection by frequency decomposition: Wave-back," in Proc. Workshop IAMIS, 2005.
13. F. Porikli and O. Tuzel, "Bayesian background modeling for foreground detection," in Proc. ACM Vis. Surveill. Sensor Netw., 2005.
14. A. Schick, M. Bäuml, and R. Stiefelhagen, "Improving foreground segmentations with probabilistic superpixel Markov random fields," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 27-31.
15. F. Tiburzi, M. Escudero, J. Bescos, and J. M. Martinez, "A ground truth for motion-based video-object segmentation," in Proc. 15th IEEE Int. Conf. Image Process., Oct. 2008, pp. 17-20.
16. D. S. Matteson and N. A. Jame, "A nonparametric approach for multiple change point analysis of multivariate data," J. Amer. Statist. Assoc., vol. 109, no. 505, pp. 334-345, 2013.
17. N. J. B. McFarlane and C. P. Schofield, "Segmentation and tracking of piglets in images," Mach. Vis. Appl., vol. 8, no. 3, pp. 187-193, 1995.
18. D. Kit, B. Sullivan, and D. Ballard, "Novelty detection using growing neural gas for visuo-spatial memory," in Proc. IEEE IROS, Sep. 2011, pp. 1194-1200.
19. J. Zheng, Y. Wang, N. L. Nihan, and M. E. Hallenbeck, "Extracting roadway background image: A mode based approach," J. Transp. Res. Rep., vol. 1944, no. 1, pp. 82-88, 2006.
20. J.-P. Jodoin, G. Bilodeau, and N. Saunier, "Background subtraction based on local shape," École Polytechnique, Montréal, QC, Canada, Tech. Rep., 2012.
21. K. Karman and A. von Brandt, "Moving object recognition using an adaptive background memory," in Time-Varying Image Processing and Moving Object Recognition, vol. 2, V. Capellini, Ed. Amsterdam, The Netherlands: Elsevier, 1990, pp. 297-307.
22. J. Zhong and S. Sclaroff, "Segmenting foreground objects from a dynamic textured background via a robust Kalman filter," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2003, pp. 44-50.
23. K. Toyama, J. Krumm, B. Brumitt, and B. Meyers, "Wallflower: Principles and practice of background maintenance," in Proc. 7th IEEE Int. Conf. Comput. Vis., vol. 1. Sep. 1999, pp. 255-261.
24. A. F. Bobick and J. W. Davis, "The recognition of human movement using temporal templates," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 3, pp. 257-267, Mar. 2001.
25. A. Morde, X. Ma, and S. Guler, "Learning a background model for change detection," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 15-20.
26. F. J. Hernandez-Lopez and M. Rivera, "Change detection by probabilistic segmentation from monocular view," Mach. Vis. Appl., vol. 25, no. 5, pp. 1175-1195, 2014.
27. H. Kim, R. Sakamoto, I. Kitahara, T. Toriyama, and K. Kogure, "Robust foreground extraction technique using Gaussian family model and multiple thresholds," in Proc. ACCV, 2007, pp. 758-768.
28. X. Gao, T. E. Boult, F. Coetzee, and V. Ramesh, "Error analysis of background adaption," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2000, pp. 503-510.
29. C. Stauffer and W. E. L. Grimson, "Learning patterns of activity using real-time tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 747-757, Aug. 2000.
30. P.-M. Jodoin, M. Mignotte, and J. Konrad, "Statistical background subtraction using spatial cues," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 12, pp. 1758-1763, Dec. 2007.
31. P. KaewTraKulPong and R. Bowden, "An improved adaptive background mixture model for realtime tracking with shadow detection," in European Workshop on Advanced Video Based Surveillance Systems. New York, NY, USA: Springer-Verlag, 2001.
32. Z. Zivkovic and F. van der Heijden, "Efficient adaptive density estimation per image pixel for the task of background subtraction," Pattern Recognit. Lett., vol. 27, no. 7, pp. 773-780, 2006.
33. T. S. F. Haines and T. Xiang, "Background subtraction with dirichlet processes," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 97-111.
34. R. H. Evangelio, M. Pätzold, and T. Sikora, "Splitting Gaussians in mixture models," in Proc. IEEE Int. Conf. AVSS, Sep. 2012, pp. 300-305.
35. R. H. Evangelio and T. Sikora, "Complementary background models for the detection of static and moving objects in crowded environments," in Proc. 8th IEEE Int. Conf. AVSS, Sep. 2011, pp. 71-76.
36. D. Riahi, P.-L. St-Onge, and G. Bilodeau, "RECTGAUSS-tex: Blockbased background subtraction," Dept. génie informatique et génie logiciel, École Polytechn. de Montreal, Montreal, QC, Canada, Tech. Rep. EPM-RT-2012-03, 2012.
37. M. S. Allili, N. Bouguila, and D. Ziou, "Finite general Gaussian mixture modeling and application to image and video foreground segmentation," J. Electron. Imag., vol. 17, no. 1, pp. 1-23, 2008.
38. L. Li, W. Huang, I. Y.-H. Gu, and Q. Tian, "Statistical modeling of complex backgrounds for foreground object detection," IEEE Trans. Image Process., vol. 13, no. 11, pp. 1459-1472, Nov. 2004.
39. D. Butler, S. Sridharan, and M. Bove, "Real-time adaptive background segmentation," in Proc. ICME, Jul. 2003, pp. 341-344.
40. P. Jaikumar, A. Singh, and S. K. Mitra, "Background subtraction in videos using Bayesian learning with motion information," in Proc. Brit. Mach. Vis. Conf., 2008, pp. 1-10.
41. K. Kim, T. H. Chalidabhongse, D. Harwood, and L. Davis, "Real-time foreground-background segmentation using codebook model," Real- Time Imag., vol. 11, no. 3, pp. 172-185, 2005.
42. Y. Nonaka, A. Shimada, H. Nagahara, and R. Taniguchi, "Evaluation report of integrated background modeling based on spatio-temporal features," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 9-14.
43. S. Yoshinaga, A. Shimada, H. Nagahara, and R. Taniguchi, "Background Model Based on Intensity Change Similarity Among Pixels," in Proc. Frontiers Comput. Vis., Jan. 2013, pp. 276-280.
44. M. Van Droogenbroeck and O. Paquot, "Background subtraction: Experiments and improvements for ViBe," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 32-37.
45. M. Hofmann, P. Tiefenbacher, and G. Rigoll, "Background segmentation with feedback: The pixel-based adaptive segmenter," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 38-43.
46. B. Stenger, V. Ramesh, N. Paragios, F. Coetzee, and J. M. Buhmann, "Topology free hidden Markov models: Application to background modeling," in Proc. 8th IEEE Int. Conf. Comput. Vis., Jul. 2001, pp. 294-301.
47. J. Yao and J. Odobez, "Multi-layer background subtraction based on color and texture," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2007, pp. 1-8.
48. M. Heikkila and M. Pietikainen, "A texture-based method for modeling the background and detecting moving objects," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 657-662, Apr. 2006.
49. A. Mittal and N. Paragios, "Motion-based background subtraction using adaptive kernel density estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jul. 2004, pp. 302-309.
50. N. M. Oliver, B. Rosario, and A. P. Pentland, "A Bayesian computer vision system for modeling human interactions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 831-843, Aug. 2000.
51. Z. Xu, P. Shi, and I. Y.-H. Gu, "An eigenbackground subtraction method using recursive error compensation," in Proc. PCM, 2006, pp. 779-787.
52. Y. Li, "On incremental and robust subspace learning," Pattern Recognit., vol. 37, no. 7, pp. 1509-1518, 2004.
53. Y. Dong, T. X. Han, and G. N. Desouza, "Illumination invariant foreground detection using multi-subspace learning," Int. J. Knowl.- Based Intell. Eng. Syst., vol. 14, no. 1, pp. 31-41, 2010.
54. J. Rymel, J. Renno, D. Greenhill, J. Orwell, and G. Jones, "Adaptive eigen-backgrounds for object detection," in Proc. IEEE Int. Conf. Image Process., Oct. 2004, pp. 1847-1850.
55. F. Seidel, C. Hage, and M. Kleinsteuber, "pROST: A smoothed ℓ p-norm robust online subspace tracking method for background subtraction in video," Mach. Vis. Appl., vol. 25, no. 5, pp. 1227-1240, 2013.
56. C. Guyon, T. Bouwmans, and E. Zahzah, "Foreground detection via robust low rank matrix factorization including spatial constraint with Iterative reweighted regression," in Proc. 21st ICPR, Nov. 2012, pp. 2805-2808.
57. C. Guyon, T. Bouwmans, and E. Zahzah, "Robust principal component analysis for background subtraction: Systematic evaluation and comparative analysis," in Principal Component Analysis, P. Sanguansat, Ed. Rijeka, Croatia: InTech, 2012, ch. 12, pp. 223-238.
58. J. He, L. Balzano, and A. Szlam, "Incremental gradient on the Grassmannian for online foreground and background separation in subsampled video," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1568-1575.
59. E. J. Candès, X. Li, Y. Ma, and J. Wright, "Robust principal component analysis?" J. ACM, vol. 58, no. 3, pp. 11:1-11:37, 2011.
60. N. Wang, T. Yao, J. Wang, and D.-Y. Yeung, "A probabilistic approach to robust matrix factorization," in Computer Vision. Berlin, Germany: Springer-Verlag, 2012, pp. 126-139.
61. F. Porikli, "Multiplicative background-foreground estimation under uncontrolled illumination using intrinsic images," in Proc. 7th IEEE Workshops Appl. Comput. Vis., Breckenridge, CO, USA, Jan. 2005, pp. 20-27.
62. C. Zhao, X. Wang, and W.-K. Cham, "Background subtraction via robust dictionary learning," EURASIP J. Image Video Process., vol. 2011, pp. 1-12, Jan. 2011.
63. E. Memin and P. Perez, "Dense estimation and object-based segmentation of the optical flow with robust techniques," IEEE Trans. Image Process., vol. 7, no. 5, pp. 703-719, May 1998.
64. X. Lu and R. Manduchi, "Fast image motion segmentation for surveillance applications," Image Vis. Comput., vol. 29, nos. 2-3, pp. 104-116, 2011.
65. D. Zhou and H. Zhang, "Modified GMM background modeling and optical flow for detection of moving objects," in Proc. IEEE Int. Conf. Syst., Man Cybern., Oct. 2005, pp. 2224-2229.
66. L. Cheng, M. Gong, D. Schuurmans, and T. Caelli, "Real-time discriminative background subtraction," IEEE Trans. Image Process., vol. 20, no. 5, pp. 1401-1414, May 2011.
67. H.-H. Lin, T.-L. Liu, and J.-H. Chuang, "A probabilistic SVM approach for background scene initialization," in Proc. IEEE Int. Conf. Image Process., Jun. 2002, pp. 893-896.
68. Z. Hao, W. Wen, Z. Liu, and X. Yang, "Real-time foregroundbackground segmentation using adaptive support vector machine algorithm," in Proc. 17th ICANN, 2007, pp. 603-610.
69. B. Han and L. S. Davis, "Density-based multifeature background subtraction with support vector machine," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 5, pp. 1017-1023, May 2012.
70. L. Maddalena and A. Petrosino, "A self-organizing approach to background subtraction for visual surveillance applications," IEEE Trans. Image Process., vol. 17, no. 7, pp. 1168-1177, Jul. 2008.
71. L. Maddalena and A. Petrosino, "The SOBS algorithm: What are the limits?" in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 21-26.
72. M. D. Gregorio and M. Giordano, "A wisard-based approach to CDNet," in Proc. 1st BRICS Countries Congr. (BRICS-CCI)/11th Brazilian Congr. (CBIC) Comput. Intell., 2013.
73. F. De La Torre and M. J. Black, "A framework for robust subspace learning," Int. J. Comput. Vis., vol. 54, nos. 1-3, pp. 117-142, 2003.
74. D. P. Young and J. M. Ferryman, "PETS metrics: Online performance evaluation service," in Proc. IEEE Int. Workshop Perform. Eval. Tracking Syst., Oct. 2005, pp. 317-324.
75. R. Vezzani and R. Cucchiara, "Video surveillance online repository (ViSOR): An integrated framework," Multimedia Tools Appl., vol. 50, no. 2, pp. 359-380, 2010.
76. M. Karaman, L. Goldmann, D. Yu, and T. Sikora, "Comparison of static background segmentation methods," Proc. SPIE, vol. 5960, pp. 2140-2151, Jun. 2005.
77. A. Vacavant, T. Chateau, A. Wilhelm, and L. Lequievre, "A benchmark dataset for outdoor foreground/background extraction," in Proc. 11th ACCV Workshops, 2012, pp. 291-300.
78. S. Brutzer, B. Heidemann, and G. Heidemann, "Evaluation of background subtraction techniques for video surveillance," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 1937-1944.
79. S.-C. S. Cheung and C. Kamath, "Robust background subtraction with foreground validation for urban traffic video," EURASIP J. Appl. Signal Process., vol. 2005, pp. 2330-2340, Jan. 2005.
80. T. Bouwmans, F. El Baf, and B. Vachon, "Background modeling using mixture of Gaussians for foreground detection: A survey," Recent Patents Comput. Sci., vol. 1, no. 3, pp. 219-237, 2008.
81. J. Nascimento and J. Marques, "Performance evaluation of object detection algorithms for video surveillance," IEEE Trans. Multimedia, vol. 8, no. 8, pp. 761-774, Aug. 2006.
82. H. Hassanpour, M. Sedighi, and A. R. Manashty, "Video frame's background modeling: Reviewing the techniques," J. Signal Inf. Process., vol. 2, no. 2, pp. 72-78, 2011.
83. A. Prati, R. Cucchiara, I. Mikic, and M. M. Trivedi, "Analysis and detection of shadows in video streams: A comparative evaluation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Dec. 2001, pp. 571-577.
84. F. Bashir and F. Porikli, "Performance evaluation of object detection and tracking systems," in Proc. IEEE Int. Workshop Perform. Eval. Tracking Syst., Jun. 2006.
85. D. Parks and S. Fels, "Evaluation of background subtraction algorithms with post-processing," in Proc. IEEE 5th Int. Conf. AVSS, Sep. 2008, pp. 192-199.
86. M. Piccardi, "Background subtraction techniques: A review," in Proc. IEEE Int. Conf. Syst., Man Cybern., Oct. 2004, pp. 3099-3104.
87. M. Sedky, C. Chibelushi, and M. Moniri, "Object segmentation using full-spectrum matching of albedo derived from colour images," U.S. Patent 20 120 008 858 A1, Jan. 12, 2012.