Background subtraction based on low-rank and structured sparse decomposition

IEEE Transactions on Image Processing

Volumn 24, Issue 8, 2015, Pages 2502-2514

  Liu, Xin ^a,b   Zhao, Guoying ^b   Yao, Jiawen ^c   Qi, Chun ^a  

^a XI'AN JIAOTONG UNIVERSITY   (China)

^b UNIVERSITY OF OULU   (Finland)

^c University of Texas at Arlington   (United States)

Author keywords

background modeling; Background subtraction; foreground detection; low rank modeling; structured sparsity

Indexed keywords

PIXELS;

BACKGROUND MODEL; BACKGROUND SUBTRACTION; FOREGROUND DETECTION; RANK MODELING; STRUCTURED SPARSITIES;

STATISTICS;

EID: 84929146055     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2419084     Document Type: Article

References (55)

1. A. Vinciarelli, M. Pantic, and H. Bourlard, "Social signal processing: Survey of an emerging domain," Image Vis. Comput., vol. 27, no. 12, pp. 1743-1759, Nov. 2009.
2. C. Stauffer and W. E. L. Grimson, "Adaptive background mixture models for real-time tracking," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. pp. 246-252, Jun. 1999.
3. Z. Zivkovic, "Improved adaptive Gaussian mixture model for background subtraction," in Proc. 17th Int. Conf. Pattern Recognit. (ICPR), vol. 2. Aug. 2004, pp. 28-31.
4. H.-H. Lin, J.-H. Chuang, and T.-L. Liu, "Regularized background adaptation: A novel learning rate control scheme for Gaussian mixture modeling," IEEE Trans. Image Process., vol. 20, no. 3, pp. 822-836, Mar. 2011.
5. X. Liu and C. Qi, "Future-data driven modeling of complex backgrounds using mixture of Gaussians," Neurocomputing, vol. 119, pp. 439-453, Nov. 2013.
6. A. Elgammal, D. Harwood, and L. Davis, "Non-parametric model for background subtraction," in Proc. Eur. Conf. Comput. Vis., 2000, pp. 751-767.
7. N. M. Oliver, B. Rosario, and A. P. Pentland, "A Bayesian computer vision system for modeling human interactions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 831-843, Aug. 2000.
8. L. Li, W. Huang, I. Y.-H. Gu, and Q. Tian, "Statistical modeling of complex backgrounds for foreground object detection," IEEE Trans. Image Process., vol. 13, no. 11, pp. 1459-1472, Nov. 2004.
9. Y. Sheikh and M. Shah, "Bayesian modeling of dynamic scenes for object detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 11, pp. 1778-1792, Nov. 2005.
10. M. Heikkilä and M. Pietikäinen, "A texture-based method for modeling the background and detecting moving objects," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 657-662, Apr. 2006.
11. K. Kim, T. H. Chalidabhongse, D. Harwood, and L. Davis, "Realtime foreground-background segmentation using codebook model," Real-Time Imag., vol. 11, no. 3, pp. 172-185, Jun. 2005.
12. J.-M. Guo, Y.-F. Liu, C.-H. Hsia, M.-H. Shih, and C.-S. Hsu, "Hierarchical method for foreground detection using codebook model," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 6, pp. 804-815, Jun. 2011.
13. L. Maddalena and A. Petrosino, "A self-organizing approach to background subtraction for visual surveillance applications," IEEE Trans. Image Process., vol. 17, no. 7, pp. 1168-1177, Jul. 2008.
14. L. Maddalena and A. Petrosino, "The SOBS algorithm: What are the limits?" in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 21-26.
15. O. Barnich and M. Van Droogenbroeck, "ViBe: A universal background subtraction algorithm for video sequences," IEEE Trans. Image Process., vol. 20, no. 6, pp. 1709-1724, Jun. 2011.
16. M. Hofmann, P. Tiefenbacher, and G. Rigoll, "Background segmentation with feedback: The pixel-based adaptive segmenter," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jun. 2012, pp. 38-43.
17. G. Xue, L. Song, and J. Sun, "Foreground estimation based on linear regression model with fused sparsity on outliers," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 8, pp. 1346-1357, Aug. 2013.
18. A. Bugeau and P. Pérez, "Detection and segmentation of moving objects in complex scenes," Comput. Vis. Image Understand., vol. 113, no. 4, pp. 459-476, Apr. 2009.
19. S. Brutzer, B. Hoferlin, and G. Heidemann, "Evaluation of background subtraction techniques for video surveillance," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 1937-1944.
20. E. J. Candès, X. Li, Y. Ma, and J. Wright, "Robust principal component analysis?" J. ACM, vol. 58, no. 3, p. 11, May 2011.
21. T. Bouwmans and E. H. Zahzah, "Robust PCA via principal component pursuit: A review for a comparative evaluation in video surveillance," Comput. Vis. Image Understand., vol. 122, pp. 22-34, May 2014.
22. Y. Xue, X. Guo, and X. Cao, "Motion saliency detection using low-rank and sparse decomposition," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Mar. 2012, pp. 1485-1488.
23. C. Guyon, T. Bouwmans, and E.-H. Zahzah, "Foreground detection based on low-rank and block-sparse matrix decomposition," in Proc. IEEE Int. Conf. Image Process., Sep./Oct. 2012, pp. 1225-1228.
24. Z. Gao, L.-F. Cheong, and M. Shan, "Block-sparse RPCA for consistent foreground detection," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 690-703.
25. N. Wang, T. Yao, J. Wang, and D.-Y. Yeung, "A probabilistic approach to robust matrix factorization," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 126-139.
26. N. Wang and D.-Y. Yeung, "Bayesian robust matrix factorization for image and video processing," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1785-1792.
27. B. Wohlberg, R. Chartrand, and J. Theiler, "Local principal component pursuit for nonlinear datasets," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Mar. 2012, pp. 3925-3928.
28. X. Zhou, C. Yang, and W. Yu, "Moving object detection by detecting contiguous outliers in the low-rank representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 3, pp. 597-610, Mar. 2013.
29. J. Wright, A. Ganesh, S. Rao, Y. Peng, and Y. Ma, "Robust principal component analysis: Exact recovery of corrupted low-rank matrices via convex optimization," in Proc. Adv. Neural Inf. Process. Syst., 2009, pp. 2080-2088.
30. H. Xu, C. Caramanis, and S. Sanghavi, "Robust PCA via outlier pursuit," in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 2496-2504.
31. G. Tang and A. Nehorai, "Robust principal component analysis based on low-rank and block-sparse matrix decomposition," in Proc. 45th Annu. Conf. Inf. Sci. Syst., Mar. 2011, pp. 1-5.
32. V. Cevher, M. F. Duarte, C. Hegde, and R. Baraniuk, "Sparse signal recovery using Markov random fields," in Proc. Adv. Neural Inf. Process. Syst., 2008, pp. 257-264.
33. J. Huang, X. Huang, and D. Metaxas, "Learning with dynamic group sparsity," in Proc. IEEE 12th Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 64-71.
34. J. Mairal, R. Jenatton, F. R. Bach, and G. R. Obozinski, "Network flow algorithms for structured sparsity," in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 1558-1566.
35. K. Jia, T.-H. Chan, and Y. Ma, "Robust and practical face recognition via structured sparsity," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 331-344.
36. I. Ramírez and G. Sapiro, "Low-rank data modeling via the minimum description length principle," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Mar. 2012, pp. 2165-2168.
37. J. Yao, X. Liu, and C. Qi, "Foreground detection using low rank and structured sparsity," in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2014, pp. 1-6.
38. E. J. Candès, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, Feb. 2006.
39. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
40. M. Dikmen and T. S. Huang, "Robust estimation of foreground in surveillance videos by sparse error estimation," in Proc. 19th Int. Conf. Pattern Recognit. (ICPR), Dec. 2008, pp. 1-4.
41. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. Roy. Statist. Soc. B, Methodol., vol. 58, no. 1, pp. 267-288, 1996.
42. J. Huang, T. Zhang, and D. Metaxas, "Learning with structured sparsity," J. Mach. Learn. Res., vol. 12, pp. 3371-3412, Jan. 2011.
43. Z. Lin, M. Chen, and Y. Ma. (2010). "The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices." [Online]. Available: http://arxiv.org/abs/1009.5055
44. X. Cui, Q. Liu, and D. Metaxas, "Temporal spectral residual: Fast motion saliency detection," in Proc. ACM Int. Conf. Multimedia, 2009, pp. 617-620.
45. N. Goyette, P. Jodoin, F. Porikli, J. Konrad, and P. Ishwar, "Changedetection. net: A new change detection benchmark dataset," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2012, pp. 1-8.
46. A. Vacavant, T. Chateau, A. Wilhelm, and L. Lequièvre, "A benchmark dataset for outdoor foreground/background extraction," in Proc. ACCV Workshops, 2012, pp. 291-300.
47. X. Yuan and J. Yang, "Sparse and low-rank matrix decomposition via alternating direction methods," Optim. Online, 2009. [Online]. Available: http://www.optimization-online.org/DB-HTML/2009/11/2447.html
48. Z. Lin, R. Liu, and Z. Su, "Linearized alternating direction method with adaptive penalty for low-rank representation," in Proc. Adv. Neural Inf. Process. Syst., 2011, pp. 612-620.
49. D. Goldfarb, S. Ma, and K. Scheinberg, "Fast alternating linearization methods for minimizing the sum of two convex functions," Math. Program., vol. 141, nos. 1-2, pp. 349-382, Oct. 2013.
50. Y. Shen, Z. Wen, and Y. Zhang, "Augmented Lagrangian alternating direction method for matrix separation based on low-rank factorization," Optim. Methods Softw., vol. 29, no. 2, pp. 239-263, 2014.
51. Z. Lin and S. Wei. (2010). "A block Lanczos with warm start technique for accelerating nuclear norm minimization algorithms." [Online]. Available: http://arxiv.org/abs/1012.0365
52. N. S. Aybat, D. Goldfarb, and G. Iyengar. (2011). "Fast first-order methods for stable principal component pursuit." [Online]. Available: http://arxiv.org/abs/1105.2126
53. S. Becker, E. J. Candès, and M. Grant, "Templates for convex cone problems with applications to sparse signal recovery," Math. Program. Comp., vol. 3, no. 3, pp. 165-218, 2011.
54. S. D. Babacan, M. Luessi, R. Molina, and A. K. Katsaggelos, "Sparse Bayesian methods for low-rank matrix estimation," IEEE Trans. Signal Process., vol. 60, no. 8, pp. 3964-3977, Aug. 2012.
55. T. Zhou and D. Tao, "GoDec: Randomized low-rank & sparse matrix decomposition in noisy case," in Proc. Int. Conf. Mach. Learn., 2011, pp. 33-40.