Real-time discriminative background subtraction

IEEE Transactions on Image Processing

Volumn 20, Issue 5, 2011, Pages 1401-1414

  Cheng, Li ^a   Gong, Minglun ^b   Schuurmans, Dale ^c   Caelli, Terry ^d  

^a BIOINFORMATICS INSTITUTE   (Singapore)

^b MEMORIAL UNIVERSITY OF NEWFOUNDLAND   (Canada)

^c UNIVERSITY OF ALBERTA   (Canada)

^d UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Background subtraction; graphics processing units (GPUs); large margin methods; one class support vector machine (SVM); online learning with kernels; real time foreground object segmentation from video

Indexed keywords

BACKGROUND SUBTRACTION; GRAPHICS PROCESSING UNITS (GPUS); LARGE-MARGIN METHODS; ONE-CLASS SUPPORT VECTOR MACHINE; ONLINE LEARNING; REAL TIME FOREGROUND OBJECT SEGMENTATION FROM VIDEO;

ALGORITHMS; CONVERGENCE OF NUMERICAL METHODS; E-LEARNING; IMAGE CODING; IMAGE SEGMENTATION; INFERENCE ENGINES; PROGRAM PROCESSORS; SUPPORT VECTOR MACHINES;

COMPUTER GRAPHICS EQUIPMENT;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPUTER GRAPHICS; IMAGE ENHANCEMENT; IMAGE PROCESSING; METHODOLOGY; PROBABILITY;

ALGORITHMS; COMPUTER GRAPHICS; IMAGE ENHANCEMENT; IMAGE PROCESSING, COMPUTER-ASSISTED; MARKOV CHAINS; PATTERN RECOGNITION, AUTOMATED;

EID: 79955364171     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2010.2087764     Document Type: Article

References (53)

1. C. Bregler and J. Malik, "Tracking people with twists and exponential maps," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Washington, DC, 1998, pp. 8-15.
2. M. Isard and A. Blake, "Condensation-Conditional density propagation for visual tracking," Int. J. Comput. Vis., vol. 29, pp. 5-28, 1998. (Pubitemid 128523364)
3. G. Shakhnarovich, P. Viola, and T. Darrell, "Fast pose estimation with parameter-sensitive hashing," in Proc. IEEE Int. Conf. Comput. Vis., Washington, DC, 2003, pp. 750-757.
4. A. Agarwal and B. Triggs, "Learning to track 3D human motion from silhouettes," in Proc. Int. Conf. Mach. Learn., New York, 2004, p. 2.
5. D. M. Gavrila, "The visual analysis of human movement: A survey," Comput. Vis. Image Understand., vol. 73, no. 1, pp. 82-98, 1999.
6. T. B. Moeslund, A. Hilton, and V. Krüger, "A survey of advances in vision-based human motion capture and analysis," Comput. Vis. Image Understand., vol. 104, no. 2, pp. 90-126, 2006. (Pubitemid 44573873)
7. R. Poppe, "Vision-based human motion analysis: An overview," Comput. Vis. Image Understand., vol. 108, no. 1-2, pp. 4-18, 2007. (Pubitemid 47333391)
8. Q. Shi, L.Wang, L. Cheng, and A. J. Smola, "Discriminative human action segmentation and recognition using semi-Markov model," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-8.
9. L. Ren, G. Shakhnarovich, J. K. Hodgins, H. Pfister, and P. Viola, "Learning silhouette features for control of human motion," ACM Trans. Graph., vol. 24, no. 4, pp. 1303-1331, 2005.
10. L. Cheng, S. Wang, D. Schuurmans, T. Caelli, and S. V. N. Vishwanathan, "An online discriminative approach to background subtraction," in Proc. IEEE Int. Conf. Adv. Video Signal Based Surveillance, 2006, p. 2.
11. J. Kivinen and M. K. Warmuth, "Exponentiated gradient versus gradient descent for linear predictors," Inf. Comput., vol. 132, no. 1, pp. 1-64, Jan. 1997.
12. B. Scholkopf, J. Platt, J. Shawe-Taylor, A. Smola, and R. Williamson, "Estimating the support of a high-dimensional distribution," Neural Comput., vol. 13, pp. 1443-1471, 2001. (Pubitemid 33595028)
13. N. Cesa-Bianchi, A. Conconi, and C. Gentile, "On the generalization ability of online learning algorithms," IEEE Trans. Inf. Theory, vol. 50, no. 9, pp. 2050-2057, Sep. 2004.
14. E. Rivlin, M. Rudzsky, R. Goldenberg, U. Bogomolov, and S. Lepchev, "A real-time system for classification of moving objects," in Proc. Int. Conf. Pattern Recognit., 2002, vol. 3, pp. 688-691. (Pubitemid 44848221)
15. A. Griesser, S. D. Roeck, A. Neubeck, and L. V. Gool, "GPU-based foreground-background segmentation using an extended colinearity criterion," Vis., Model. Visualizat., pp. 319-326, 2005.
16. J. Migdal and W. Grimson, "Background subtraction using Markov thresholds," in Proc. IEEE Workshop Motion Video Comput., 2005, pp. 58-65.
17. W. Nam and J. Han, "Motion-based background modeling for foreground segmentation," in Proc. ACMInt.Workshop Video Surveillance Sensor Netw., 2006, pp. 35-44. (Pubitemid 47168322)
18. G. Dalley, J. Migdal, and W. Grimson, "Background subtraction for temporally irregular dynamic textures," in Proc. IEEE Workshop Appl. Comput. Vis., 2008, pp. 1-7.
19. V. Mahadevan and N. Vasconcelos, "Background subtraction in highly dynamic scenes," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2008, pp. 1-6.
20. K. Toyama, J. Krumm, B. Brumitt, and B. Meyers, "Wallflower: Principles and practice of background maintenance," in Proc. IEEE Int. Conf. Comput. Vis., 1999.
21. J. Zhong and S. Sclaroff, "Segmenting foreground objects from a dynamic textured background via a robust kalman filter," in IEEE International Conference on Computer Vision, 2003, pp. 255-261.
22. Y. Sheikh and M. Shah, "Bayesian modeling of dynamic scenes for object detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 11, pp. 1778-1792, Nov. 2005. (Pubitemid 41685113)
23. C. Wren, A. Azarbayejani, T. Darrell, and A. Pantland, "Pfinder:realtime tracking of the human body," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 780-785, Jul. 1997.
24. N. Friedman and S. Russell, "Image segmentation in video sequences: A probabilistic approach," in Proc. 13th Conf. Uncertainty Artif. Intell., 1997, pp. 175-181.
25. Z. Zivkovic and F. Heijden, "Recursive unsupervised learning of finite mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 5, pp. 651-656, May 2004.
26. D. Lee, "Effective gaussian mixture learning for video background subtraction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 827-832, May 2005. (Pubitemid 40608416)
27. C. Stauffer and W. Grimson, "Learning patterns of activity using realtime tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 747-757, Aug. 2000.
28. A. Monnet, A. Mittal, N. Paragios, and V. Ramesh, "Background modeling and subtraction of dynamic scenes," in Proc. IEEE Int. Conf. Comput. Vis., 2003, pp. 1305-1312.
29. A. Elgammal, D. Harwood, and L. Davis, "Non-parametric model for background subtraction," in Proc. Eur. Conf. Comput. Vis., 2000, pp. 751-767.
30. R. Duda and P. Hart, Pattern Classification and Scene Analysis. Hoboken, NJ: Wiley, 1973.
31. A. Mittal and N. Paragios, "Motion-based background subtraction using adaptive kernel density estimation," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2004, pp. 302-309.
32. B. Han, D. Comaniciu, Y. Zhu, and L. Davis, "Incremental density approximation and kernel-based bayesian filtering for object tracking," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2004, pp. 638-644.
33. H. Lin, T. Liu, and J. Chuang, "A probabilistic svm approach for background scene initialization," in Proc. Int. Confer. Image Process., 2002, pp. 893-896.
34. A. Criminisi, G. Cross, A. Blake, and V. Kolmogorov, "Bilayer segmentation of live video," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, pp. 53-60. (Pubitemid 44931312)
35. T. Parag, A. Elgammal, and A. Mittal, "A framework for feature selection for background subtraction," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2006, pp. 1916-1923. (Pubitemid 44931550)
36. Z. Hao, W. Wen, Z. Liu, and X. Yang, "Rea-ttime foreground background segmentation using adaptive support vector machine algorithm," in Proc. Int. Conf. Artif. Neural Netw., 2007, pp. 603-610.
37. A. Ulges and T. Breuel, "A local discriminative model for background subtraction," in Proc. Symp. German Assoc. Pattern Recognit., 2008, pp. 507-516.
38. L. Cheng, S. V. N. Vishwanathan, D. Schuurmans, S. Wang, and T. Caelli, "Implicit online learning with kernels," in NIPS. Cambridge, MA: MIT Press, 2006.
39. V. Vapnik, Statistical Learning Theory. Hoboken, NJ: Wiley, 1998.
40. K. Crammer and Y. Singer, "On the algorithmic implementation of multiclass Kernel-based vector machines," J. Mach. Learn. Res., vol. 2, pp. 265-292, 2001.
41. B. Scholkopf and A. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. Cambridge, MA: MIT Press, 2002.
42. J. Kivinen, A. Smola, and R. Williamson, "Online learning with kernels," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2165-2176, Aug. 2004.
43. N. Schraudolph, "Fast curvature matrix-vector products for secondorder gradient descent," Neural Comput., vol. 14, no. 7, pp. 1723-1738, 2002.
44. J. Kivinen, M.Warmuth, and B. Hassibi, "The p-norm generalization of the LMS algorithm for adaptive control," IEEE Trans. Signal Process., vol. 54, no. 5, pp. 1782-1793, May 2006.
45. O. Dekel, S. Shalev-Shwartz, and Y. Singer, "The forgetron: A Kernelbased perceptron on a budget," SIAM J. Comput., vol. 37, no. 5, pp. 1342-1372, 2008.
46. K. Crammer, J. Kandola, and Y. Singer, "Online classification on a budget," in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2003.
47. J. Weston, A. Bordes, and L. Bottou, "Online (and offline) on an even tighter budget," in Proc. Int. Workshop Artif. Intell. Statist., 2005.
48. G. Cavallanti, N. Cesa-Bianchi, and C. Gentile, "Tracking the best hyperplane with a simple budget perceptron," Mach. Learn., vol. 69, no. 2-3, pp. 143-167, 2007. (Pubitemid 47574313)
49. "Exact maximum a posteriori estimation for binary images," J. Roy. Statist. Soc. Ser. B, vol. 51, no. 2, pp. 271-279, 1989.
50. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, Nov. 2001. (Pubitemid 33137959)
51. N. Dixit, R. Keriven, and N. Paragios, "GPU-Cuts: combinatorial optimisation, graphic processing units and adaptive object extraction CERTIS, Ecole Nationale des Ponts et Chaussees, 2005, Tech. Rep..
52. A. Goldberg and R. Tarjan, "A new approach to the maximum flow problem," in Proc. ACM Symp. Theory Comput., 1986, pp. 136-146.
53. Z. Zivkovic and F. d. Heijden, "Efficient adaptive density estimation per image pixel for the task of background subtraction," Pattern Recognit. Lett., vol. 27, no. 7, pp. 773-780, 2006. (Pubitemid 43374860)