Bayesian foreground and shadow detection in uncertain frame rate surveillance videos

IEEE Transactions on Image Processing

Volumn 17, Issue 4, 2008, Pages 608-621

  Benedek, Csaba ^a,b   Szirányi, Tamás ^a,b  

^a INSTITUTE OF EXPERIMENTAL MEDICINE   (Hungary)

^b PÁZMÁNY PÉTER CATHOLIC UNIVERSITY   (Hungary)

Author keywords

Foreground; Markov random field (MRF); Shadow; Texture

Indexed keywords

BAYESIAN NETWORKS; FEATURE EXTRACTION; MARKOV PROCESSES; PIXELS; TEXTURES;

ADAPTIVE SHADOW MODEL; SHADOW DETECTION; SURVEILLANCE VIDEOS;

IMAGE ANALYSIS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BAYES THEOREM; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION RETRIEVAL; METHODOLOGY; ORGANIZATION AND MANAGEMENT; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; VIDEORECORDING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SECURITY MEASURES; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE; VIDEO RECORDING;

EID: 41849102422     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2008.916989     Document Type: Article

References (48)

1. S. C. Zhu and A. L. Yuille, "A flexible object recognition and modeling system," Int. J. Comput. Vis., vol. 20, no. 3, 1996.
2. L. Havasi, Z. Szlávik, and T. Szirányi, "Higner Order symmetry for non-linear classification of human walk detection," Pattern Recognit. Lett., vol. 27, pp. 822-829, 2006.
3. Y. Sheikh and M. Shah, "Bayesian modeling of dynamic scenes for object detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 11, pp. 1778-1792, Nov. 2005.
4. C. Stauffer and W. E. L. Grimson, "Learning patterns of activity using teal-time tracking," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 22, no. 8. pp. 747-757, Aug. 2000.
5. Y. Zhou, Y. Gong, and H. Tao, "Background segmentation using spatial-temporal multi-resolution MRF." in Proc. Workshop on Motion and Video Computing., 2005, pp. 8-13.
6. A. Licsár, L. Czúni, and T. Szirányi, "Adaptive stabilization of vibration on archive films," in Proc. CAIP, 2003, vol. LNCS, 2756, pp. 230-237.
7. M. Heikkila and M. Pietikainen, "A texture-based method for modeling the backgroud and detecting moving objects," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 657-662, Apr. 2006.
8. J. Zhong and S. Sclaroff, "Segmenting foreground object from a dynamic textured background via a robust Kalman filter," in Proc. IEEE Int. Conf. Computer Vision, 2003, pp. 44-50.
9. S. Chaudhuri and D. Taur, "High-resolution slow-motion sequencing: How to generate a slow-motion sequence from a bit stream," IEEE Signal Process. Mag., vol. 22, no. 2, pp. 13-24, Feb. 2005.
10. J. Kato, T. Watanabe, S. Joga, L. Ying, and H. Hase, "An HMM/MRF-based stochastic framework for robust vehicle tracking," IEEE Trans. Intell. Transport. Syst., vol. 5, no. 3, pp. 142-154, Mar. 2004.
11. J. Rittscher, J. Kato, S. Joga, and A. Blake, "An HMM-based-segmentation method for traffic monitoring," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1291-1296, Sep. 2002.
12. Y. Wang, K.-F. Loe, and J.-K. Wu, "A dynamic conditional ramdom field model for foreground and shadow segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, pp. 279-289, Feb. 2006.
13. R. Cutler and L. Davis, "Robust real-time periodic motion detection, analysis, and application," IEEE Trans. Pattern Anal. Mach. Intell. Vol. 22, no. 8, pp. 781-796, Aug. 2000.
14. L. Czúni and T. Szirányi, "Motion segmentation and tracking with edge relaxation and optimization using fully parallel methods in the cellular nonlinear network architecture," Real-Time Imag., vol. 7, no. 1, pp. 77-95, 2001
15. A. Yilmaz, X. Li, and M. Shah, "Object contour tracking using level sets," in Proc. Asian Conf. Computer Vision, Jaju Islands, Korea, 2004.
16. A. Cavallaro, E. Salvador, and T. Ebrahimi, "Detecting shadows in image sequences," in Proc. Eur. Conf. Visual Media Production, Mar. 2004, pp. 167-174.
17. R. Cucchiara, C. Grana, G. Neri, M. Piccardi, and A. Pratt, "The Sakbot system for moving object detection and tracking," Video-Based Surveillance Systems- Computer Vision and Distributed Processing, pp. 145-157, 2001
18. K. Siala, M. Chakchouk, F. Chaieb, and O. Besbes, "Moving shadow detection with support vector domain description in the color ratios space," in Proc. Int. Conf. Pattern Recognition, 2004, vol. 4, pp. 384-387.
19. Cs. Benedek and T. Szirányi, "Markovian framework for foreground-background shadow separation of real world video scenes," in Proc. Asian Conf. Computer Vision, Hyderabad, India, Jan. 2006, vol. LNCS 3851, pp.898-907.
20. S. Geman and D. Geman, "Stochastic relaxation, gibbs distributions and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-6, no. 6, pp. 721-741, Nov. 1984
21. I. Mikic, P. Cosman, G. Kogut, and M. M. Trivedi, "Moving shadow and object detection in traffic scenes," presented at the Int. Conf. Pattern Recognation, 2000.
22. Y. Wang and T. Tan, "Adaptive foreground and shadow detection in image sequence," in Proc. Int. Conf. Pattern Recognition, 2002, pp. 983-986.
23. A. Blake, C. Rother, M_ Brown, P. Perez, and P. Torr, "Interactive image segmentation using an adaptive GMMRF model," in Proc. Eur. Conf. Computer Vision, 2004, pp. 456-468.
24. Z. Kato, T. C. Pong, and G. Q. Song, "Multicue MRF image segmentation: Combining texture and color," in Proc. Int. Conf. Pattern Recognation, Quebec, QC, Canada, Aug. 2002, pp. 660-663.
25. Cs. Benedek and T. Szirányi, "A Markov random field model for foreground-background separation," in Proc. Joint Hungarian-Austrian Conf. Image Processing and Pattern Recognition, Veszprém, Hungary, May 2005, pp. 103-110.
26. D. Finlayson, S. D. Hordley, C. Lu, and M. S. Drew, "On the removal of shadows from images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 1, pp. 59-68, Jan. 2006.
27. C. Fredembach and G. D. Finlayson, "Hamiltonian path based shadow removal," in Proc. Brit. Machine Vision Conf., 2005, pp. 970-980.
28. N. Paragios and V. Ramesh, "A MRF-based real-time approach for subway monitoring," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001, Vol. 1, pp. 1034-1040.
29. E. Salvador, A. Cavallaro, and T. Ebrahimi, "Cast shadow segmentation using invariant color features," Comput. Vis. Image Understand, no. 2, pp. 238-259, 2004.
30. F. Porikli and J. Thornton, "Shadow flow: A recursive method to learn moving cast shadows," in Proc. IEEE Int. Conf. Computer Vision, 2005, vol. 1, pp. 801-808
31. N. Martel-Brisson and A. Zaccarin, "Moving cast shadow detection from a Gaussian mixture shadow model," in Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognation, Jun. 2005, vol. 2, pp. 643-648.
32. Y. Haeghen, J. Naeyaert, I. Lemahieu, and W. Philips, "An imaging system with calibrated color image acquisition for use in dermatology," IEEE Trans. Med. Imag., vol. 19, no. 7, pp. 722-730, Jul. 2000.
33. M. G. A. Thomson, R. J. Paltridge, T. Yates, and S. Westland, "Color spaces for discrimination and categorization in natural scenes," in Proc. Congr. Int. Colour Association, Jun. 2002, pp. 877-880.
34. L. Li and M. Leung, "Integrating intensity and texture differences for robust change detection," IEEE Trans. Image Process. vol. 11, no. 2, pp. 105-112, Feb. 2002.
35. A. Pratt, I. Mikic, M. M. Trivedi, and R. Cucchiara, "Detecting moving shadows: Algorithms and evaluation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25. no. 7, pp. 918-923, Jul. 2003.
36. Z. Kato, J. Zerubia, and M. Berthod, "Satellite image classification using a modified metropolis dynantics," in Proc. Int. Conf. Acoustics, Speech and Signal processing, Mar. 1992, pp. 573-576.
37. R. Potts, "Some generalized order-disorder transformation," Proc. Cambridge philosoph. Soc., no. 48, pp. 106-106, 1952.
38. D. S. Lee, "Effective Gaussian mixture learning for video background subtraction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5. pp. 827-832, May 2005.
39. D. A. Forsyth, "A novel algorithm for color constancy," Int. J. Comput. Vis., vol. 5, no. 1, pp. 5-36, 1990.
40. E. A. Khan and E. Reinhard, "Evaluation of color spaces for edge classification in outdoor scenes," in Proc. Int. Conf. Image Processing, Genoa, Italy, Sep. 2005, voi. 3, pp. 952-955.
41. W. Feller, An Introduction to Probability Theory and Its Application 2nd ed. New York: Wiley, 1966, vol. 1.
42. W. K. Pratt, Digital Image Processing, 2nd ed. New York: Wiley, 1991.
43. R. Haralick, "Digital step edges from zero crossing of second directional derivatives," IEEE Trans. Pattern Anal. Mach. Intell. vol. PAMI-6, no. 1, pp. 58-68, Jan. 1984.
44. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23. no. 11. pp. 1222-1239, 2001.
45. E. Aarts and J. Korst, Simulated Annealing and Boltzman Machines. New York: Wiley, 1990.
46. Y Boykov and V. Kolmogorov, "An experimental comparison of min-cut/ max-flow algorithms for energy minimization in vision," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1124-1137, Sep. 2004.
47. N. Metropolis, A. Rosenbluth, M. Rosenbluth, A. Teller, and E, Teller, "Equation of state calculations by fast computing machines," J. Chem. Phys., vol. 21, pp. 1087-1092, 1953.
48. J. Besag, "On the statistical analysis of dirty images," J. Roy. Statist. Soc., vol. 48, pp. 259-302, 1986.