Intelligent visual surveillance - A survey

International Journal of Control, Automation and Systems

Volumn 8, Issue 5, 2010, Pages 926-939

  Kim, In Su ^a   Choi, Hong Seok ^a   Yi, Kwang Moo ^a   Choi, Jin Young ^a   Kong, Seong G ^b  

^a Seoul National University   (South Korea)

^b Temple University   (United States)

Author keywords

Behavior understanding; cooperative camera system; image interpretation; motion detection; object tracking; wide area surveillance

Indexed keywords

BEHAVIOR UNDERSTANDING; COOPERATIVE CAMERA SYSTEM; IMAGE INTERPRETATION; MOTION DETECTION; OBJECT TRACKING; WIDE AREA SURVEILLANCE;

CAMERAS; COMPUTER VISION; IMAGE ANALYSIS; MONITORING; OBJECT RECOGNITION; SECURITY SYSTEMS; SENSORS; SURVEYS; TRACKING (POSITION);

BEHAVIORAL RESEARCH;

EID: 79951595685     PISSN: 15986446     EISSN: 20054092     Source Type: Journal    
DOI: 10.1007/s12555-010-0501-4     Document Type: Article

References (97)

1. W. Hu T. Tan L. Wang S. Maybank 2004 A survey on visual surveillance of object motion and behaviors IEEE Trans. on Systems, Man, and Cybernetics - Part C 34 3 334 352 10.1109/TSMCC.2004.829274
2. R. T. Collins, A. J. Lipton, T. Kanade, H. Fujiyoshi, D. Duggins, Y. Tsin, D. Tolliver, N. Enomoto, O. Hasegawa, P. Burt, and L. Wixson, "A system for video surveillance and monitoring," Carnegie Mellon University Technical Report, CMU-RI-TR-00-12, 2000.
3. N. T. Siebel and S. Maybank, "The advisor visual surveillance system." Proc. of the ECCV Workshop on Applications of Computer Vision, pp. 103-111, 2004.
4. C. F. Shu, A. Hampapur, M. Lu, L. Brown, J. Connell, A. Senior, and Y. Tian, "IBM smart surveillance system (S3): an open and extensible framework for event based surveillance," Proc. of IEEE Conf. Advanced Video and Signal Based Surveillance, pp. 318-323, 2005.
5. C. Regazzoni V. Ramesh G. L. Foresti 2001 Special issue on video communications, processing, and understanding for third generation surveillance systems Proc. of the IEEE 89 10 1355 1367 10.1109/5.959335
6. V. Kober 2006 R (Pubitemid 44203144)
7. M. J. Seow V. K. Asrai 2004 Homomorphic processing system and ratio rule for color image enhancement Proc. of the IEEE International Conf. Neural Network 4 2507 2511
8. T. C. Aysal K. E. Barner 2006 Quadratic weighted median filters for edge enhancement of noisy images IEEE Trans. on Image Processing 15 11 3294 3310 10.1109/TIP.2006.882010 (Pubitemid 44615128)
9. S. Thurnhofer S. K. Mitra 1996 A general framework for quadratic Voltera filters for edge enhancement IEEE Trans. on Image Processing 5 6 950 963 10.1109/83.503911 (Pubitemid 126776750)
10. K. E. Barner T. C. Aysal 2006 Polynomial weighted median filtering Proc. of IEEE International Conf. Acoustics Speech and Signal Processing 4 4 153 156
11. J. Duan and G. Qiu, "Novel histogram processing for color image enhancement," Proc. of the 3rd International Conf. Image and Graphics, pp. 55-58, 2004. (Pubitemid 40498029)
12. Y. T. Kim 1997 Contrast enhancement using brightness preserving bi-histogram equalization IEEE Trans. on Consumer Electronics 43 1 1 8 10.1109/30.580378
13. Y. Wang Q. Chen B. M. Zhang 1999 Image Enhancement based on equal area dualistic subimage histogram equalization method IEEE Trans. on Consumer Electronincs 45 1 68 75 10.1109/30.754419
14. S. D. Chen A. R. Ramli 2003 Minimum mean brightness error bi-histogram equalization in contrast enhancement IEEE Trans. on Consumer Electronics 49 4 1310 1319 10.1109/TCE.2003.1261234
15. C. Wang Z. Ye 2005 Brightness preserving histogram equalization with maximum entropy: a variational perspective IEEE Trans. on Consumer. Electronics 51 4 1326 1334 10.1109/TCE.2005.1561863 2171245 (Pubitemid 46489041)
16. D. Y. Tsai Y. B. Lee M. Sekiya S. Sakaguchi I. Yamada 2002 A method of medical image enhancement using wavelet analysis Proc. of International Conf. Signal Processing 1 723 726
17. S. S. Agaian K. Panetta A. M. Grigoryan 2001 Transform based image enhancement algorithms IEEE Trans. on Image Processing 10 3 367 382 1036.68605 10.1109/83.908502 (Pubitemid 32286642)
18. S. Aghagolzadeh O. K. Ersoy 1992 Transform image enhancement Optical Engineering 31 3 614 626 10.1117/12.56095
19. F. T. Arslan A. M. Grigoryan 2004 Image enhancement by the tensor transform Proc. of IEEE International Symp. on Biomedical Imaging: Macro to Nano 1 816 819 (Pubitemid 40514062)
20. F. T. Arslan A. M. Grigoryan 2006 Fast splitting alpha-rooting method of image enhancement: tensor representation IEEE Trans. on Image Processing 15 11 3375 3384 10.1109/TIP.2006.881927 (Pubitemid 44615134)
21. C. R. Wren A. Azarbayejani T. Darrell A. P. Pentland 1997 Pfinder: real-time tracking of the human body IEEE Trans. on Pattern Analysis and Machine Intelligence 19 7 780 785 10.1109/34.598236 (Pubitemid 127762271)
22. C. Stauffer E. Grimson 2000 Learning patterns of activity using real time tracking IEEE Trans. on Pattern Analysis and Machine Intelligence 22 8 747 757 10.1109/34.868677
23. I. Haritaoglu D. Harwood L. S. Davis 2000 W4: real-time surveillance of people and their activities IEEE Trans. on Pattern Analysis and Machine Intelligence 22 8 809 830 10.1109/34.868683
24. N. M. Oliver B. Rosario A. P. Pentland 2000 A Bayesian computer vision system for modeling human interactions IEEE Trans. on Pattern Analysis and Machine Intelligence 22 8 831 843 10.1109/34.868684
25. T. Horprasert, D. Harwood, and L. S. Davies, "A robust background subtraction and shadow detection," Proc. of Asian Conf. Computer Vision, pp. 8-11, 2000.
26. A. J. Lipton, H. Fujiyoshi, and R. S. Patil, "Moving target classification and tracking from real-time video," Proc. of the IEEE Workshop Applications of Computer Vision, pp. 8-14, 1998.
27. J. Barron D. Fleet S. Beauchemin 1994 Performance of optical flow techniques International Journal of Computer Vision 12 1 42 77 10.1007/BF01420984
28. A. Bevilacqua and P. Azzari, "High-quality real time motion detection using PTZ cameras," Proc. of IEEE Conf. Advanced Video and Signal Based Surveillance, pp. 23-23, 2006.
29. R. Cucchiara, A. Prati, and R. Vezzani, "Advanced video surveillance with pan tilt zoom cameras," Proc. of the 6th IEEE International Workshop on Visual Surveillance, 2006.
30. C. Micheloni and G. L. Foresti, "A robust feature tracker for active surveillance of outdoor scenes," Electronic Letters on Computer Vision and Image Analysis, pp. 21-34, 2003.
31. D. Murray A. Basu 1994 Motion tracking with an active camera IEEE Trans. on Pattern Analysis and Machine Intelligence 16 5 449 459 10.1109/34.291452
32. B. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," Proc. of the Imaging understanding workshop, pp. 121-130, 1981.
33. J. Shi and C. Tomasi, "Good features to track," Proc. of IEEE Conf. Computer Vision and Pattern Recognition, pp. 593-600, 1994.
34. A. Yilmaz, O. Javed, and M. Shah, "Object tracking: a survey," ACM Computing Surveys, vol. 38, no. 4, 2006.
35. K. Mikolajczyk C. Schmid 2005 A performance evaluation of local descriptors IEEE Trans. on Pattern Analysis and Machine Intelligence 27 10 1615 1630 10.1109/TPAMI.2005.188 (Pubitemid 41555406)
36. V. Salari I. Sethi 1990 Feature point correspondence in the presence of occlusion IEEE Trans. on Pattern Analysis and Machine Intelligence 12 1 87 91 10.1109/34.41387 (Pubitemid 20653602)
37. T. Broida R. Chellappa 1986 Estimation of object motion parameters from noisy images IEEE Trans. on Pattern Analysis and Machine Intelligence 8 1 90 99 10.1109/TPAMI.1986.4767755 (Pubitemid 16575722)
38. H. Tanizaki 1987 Non-gaussian state-space modeling of nonstationary time series Journal of the American Statistical Association 82 1032 1063 10.2307/2289375 922169
39. G. Hager, M. Dewan, and C. Stewart, "Multiple kernel tracking with SSD," Proc. of IEEE Conf. Computer Vision and Pattern Recognition, pp. 790-797, 2004.
40. D. Comaniciu V. Ramesh P. Meer 2003 Kernel-based object tracking IEEE Trans. on Pattern Analysis and Machine Intelligence 25 5 564 575 10.1109/TPAMI.2003.1195991
41. R. Collins 2003 Mean-shift blob tracking through scale space Proc. of IEEE Conf. Computer Vision and Pattern Recognition 2 234 240
42. T. Lindeberg 1994 Scale-space theory: A basic tool for analyzing structures at different scales Journal of Applied Statistics 21 2 224 270
43. S. Birchfield and S. Rangarajan, "Spatiograms versus histograms for region based tracking," Proc. of IEEE Conf. Computer Vision and Pattern Recognition, pp. 1158-1163, 2005.
44. M. Black A. Jepson 1998 Eigentracking: robust matching and tracking of articulated objects using a view-based representation International Journal of Computer Vision 26 1 63 84 10.1023/A:1007939232436 (Pubitemid 128513060)
45. J. Lim, D. Ross, R. Lin, and M. H. Yang, "Incremental learning for visual tracking," Advances in Neural Information Processing Systems, pp. 793-800, 2005.
46. S. Avidan "Support vector tracking," Proc. of IEEE Conf. Computer Vision and Pattern Recognition, pp. 184-191, 2001.
47. S. Haykin, Neural Networks: A Comprehensive Foundation, Prentice Hall, 2nd Edition, pp. 318-350, 1998.
48. N. Paragios R. Deriche 2002 Geodesic active regions and level set methods for supervised texture segmentation International Journal of Computer Vision 46 3 223 247 1012.68726 10.1023/A:1014080923068 (Pubitemid 34265799)
49. N. Peter Freund 1999 Robust tracking of position and velocity with Kalman snakes IEEE Trans. on Pattern Analysis and Machine Intelligence 21 6 564 569 10.1109/34.771328
50. M. Isard A. Blake 1998 Condensation - conditional density propagation for visual tracking International Journal of Computer Vision 29 1 5 28 10.1023/A:1008078328650 (Pubitemid 128523364)
51. A. Yilmaz X. Li M. Shah 2004 Contour based object tracking with occlusion handling in video acquired using mobile cameras IEEE Trans. on Pattern Analysis and Machine Intelligence 26 11 1531 1536 10.1109/TPAMI.2004.96 (Pubitemid 40168029)
52. J. Sethian, Level Set Methods: Evolving Interfaces in Geometry, Fluid Mechanics Computer Vision and Material Sciences, Cambridge University. Press, 1999.
53. J. K. Aggarwal and P. Sangho, "Human motion: modeling and recognition of actions and interactions," Proc. of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission, pp. 640-647, September 2004. (Pubitemid 40456354)
54. K. Sato J. K. Aggarwal 2004 Temporal spatiovelocity transform and its applications to tracking and interaction Computer Vision and Image Understanding 96 2 100 128 10.1016/j.cviu.2004.02.003
55. I. Haritaoglu, D. Harwood, and L. Davis, "Hydra: Multiple people detection and tracking using silhouettes," Proc. of the 2nd IEEE Workshop on Visual Surveillance, pp. 6-13, 1999.
56. M. Pantic, A. Pentland, A. Nijholt, and T. Huang, "Human computing and machine understanding of human behavior: a survey," Proc. of the International Conf. Multimodal interfaces, pp. 239-248, 2006. (Pubitemid 47129475)
57. H. Fujiyoshi and A. Lipton, "Real-time human motion analysis by image skeletonization," Proc. of the Workshop on Applications of Computer Vision, pp. 15-21, 1998.
58. S. Ju, M. Black, and Y. Yaccob, "Cardboard people: a parameterized model of articulated image motion," Proc. of the IEEE International Conf. Automatic Face and gesture Recognition, pp. 38-44, 1996.
59. M. Leung Y. Yang 1995 First sight: a human body outline labeling system IEEE Trans. on Pattern Analysis Machine Intelligence 17 4 359 377 10.1109/34.385981
60. J. K. Aggarwal Q. Cai W. Liao B. Sabata 1997 Nonrigid motion analysis: articulated and elastic motion Computer Vision and Image Understanding 70 2 142 156 10.1006/cviu.1997.0620
61. J. Park S. Park J. K. Aggarwal 2003 Model-based human motion capture from monocular video sequences Lecture Notes in Computer Science: Computer and Information Sciences 2869 405 412 10.1007/978-3-540-39737-3-51
62. D. Gavrila, Vision-Based 3-D Tracking of Humans in Action, Ph.D. thesis, Department of Computer Science, University of Maryland, 1996.
63. J. O'Rourke N. Badler 1980 Model-based image analysis of human motion using constraint propagation IEEE Trans. on Pattern Analysis and Machine Intelligence 2 6 522 536 (Pubitemid 11463603)
64. C. Myers L. Rabinier A. Rosenberg 1980 Performance tradeoffs in dynamic time warping algorithms for isolated word recognition IEEE Trans. on Acoustics, Speech and Signal Processing 28 6 623 635 0524.68052 10.1109/TASSP.1980.1163491 (Pubitemid 11475385)
65. L. R. Rabiner 1989 A tutorial on hidden Markov models and selected applications in speech recognition Proc. of the IEEE 77 2 257 286 10.1109/5.18626
66. K. Murphy, Dynamic Bayesian Networks: Representation, Inference and Learning, Ph.D. Thesis, University of California at Berkeley, 2002.
67. A. Bobick and A. Wilson, "A state-based technique for the summarization and recognition of gesture," Proc. of the International Conf. Computer Vision, pp. 382-388, June 1995.
68. J. Yang Y. Xu C. S. Chen 1997 Human action learning via hidden markov model IEEE Trans. on System, Man and Cybernetics 27 1 34 44 10.1109/3468.553220 (Pubitemid 127770688)
69. T. Starner J. Weaver A. Pentland 1998 Real-time American sign language recognition using desk and wearable computer-based video IEEE Trans. on Pattern Anal. Mach. Intell 20 12 1371 1375 10.1109/34.735811 (Pubitemid 128741382)
70. N. M. Oliver B. Rosario A. P. Pentland 2000 A bayesian computer vision system for modeling human interactions IEEE Trans. on Pattern Analysis and Machine Intelligence 22 8 831 843 10.1109/34.868684
71. S. Park and J. K. Aggarwal, "Recognition of two-person interactions using a hierarchical Bayesian network," Proc. of ACM SIGMM International Workshop on Video Surveillance, pp. 65-76, 2003.
72. A. F. Bobick and J. Davis, "Real-time recognition of activity using temporal templates," Proc. of the IEEE CS Workshop on Applications of Computer Vision, pp. 39-42, 1996.
73. A. F. Bobick and J. Davis, "Real-time recognition of activity using temporal templates," Proc. of the IEEE Computer Society Workshop on Computer vision, pp. 39-42, 1996.
74. A. D. Wilson, A. F. Bobick, and J. Cassell, "Temporal classification of natural gesture and application to video coding," Proc. of the IEEE Conf. Computer Vision and Pattern Recognition, pp. 948-954, 1997.
75. F. Bremond and G. Medioni, "Scenario recognition in airborne video imagery," Proc. of the International Workshop Interpretation of Visual Motion, pp. 57-64, 1998.
76. S. Intille and A. Bobick, "Representation and visual recognition of complex, multi-agent actions using belief networks," MIT Technical Report, no. 454, 1998.
77. R. Mann A. Jepson J. Siskind 1997 Computational perception of scene dynamics Computer Vision and Image Understanding 65 2 113 128 10.1006/cviu.1996.0576
78. M. Brand and I. Essa, "Causal analysis for visual gesture understanding," MIT Technical Report, 1995.
79. Y. Ivanov A. Bobick 2000 Recognition of visual activities and interactions by stochastic parsing IEEE Trans. on Pattern Analysis and Machine Intelligence 22 8 852 872 10.1109/34.868686
80. D. Ayers and M. Shah, "Recognizing human action in a static room," Proc. of the IEEE Computer Society Workshop on Interpretation of Visual Motion, pp. 42-46, 1998.
81. R. T. Collins and Y. Tsin, "Calibration of an outdoor active camera system," Proc. of the Conf. Computer Vision and Pattern Recognition, pp. 528-534, June 1999.
82. J. Davis X. Chen 2003 Calibrating pan-tilt cameras in wide-area surveillance networks Proc. of IEEE International Conf. Computer Vision 1 144 149 10.1109/ICCV.2003.1238329
83. E. Hemayed, "A survey of camera self-calibration," Proc. of IEEE Conf. Advanced Video and Signal Based Surveillance, pp. 351-357, 2003.
84. I. Pavlidis V. Morellas P. Tsiamyrtzis S. Harp 2001 Urban surveillance systems: from the laboratory to the commercial world Proc. of the IEEE 89 10 1478 1495 10.1109/5.959342
85. I. Paulidis and V. Morellas, "Two examples of indoor and outdoor surveillance systems," in P. Remagnino, G. A. Jones, N. Paragios, and C. S. Regazzoni Eds., Video-based Surveillance Systems, Kluwer Academic Publishers, Boston, pp. 39-51, 2002.
86. C. Micheloni, G. L. Foresti, and L. Snidaro, "A cooperative multicamera system for video-surveillance of parking lots," Proc. of IEE Symp. on Intelligent Distributed Surveillance Systems, pp. 21-24, 2003.
87. J. Krumm, S. Harris, B. Meyers, B. Brumit, M. Hale, and S. Shafer, "Multi-camera multi-person tracking for easy living," Proc. of the 3rd IEEE International Workshop on Visual Surveillance, pp. 8-11, 2000.
88. N. T. Nguyen S. Venkatesh G. West H. H. Bui 2003 Multiple camera coordination in a surveillance system ACTA Automatica Sinica 29 3 408 421
89. D. MaKris, T. Ellis, and J. Black, "Bridging the gaps between cameras," Proc. of International Conf. Multimedia and Expo, June 2004.
90. R. T. Collins A. J. Lipton H. Fujiyoshi T. Kanade 2001 Algorithms for cooperative multisensor surveillance Proc. of the IEEE 89 10 1456 1477 10.1109/5.959341 (Pubitemid 33766632)
91. M. Xu, L. Lowey, and J. Orwell, "Architecture and algorithms for tracking football players with multiple cameras," Proc. of the IEE Workshop on Intelligent Distributed Surveillance Systems, pp. 51-56, 2004.
92. A. Mittal L. S. Davis 2003 M2 tracker: a multiview approach to segmenting and tracking people in a cluttered scene International Journal of Computer Vision 51 3 189 203 10.1023/A:1021849801764
93. J. Kang I. Cohen G. Medioni 2003 Continuous tracking within and across camera streams Proc. of IEEE Computer Society Conf. Computer Vision and Pattern Recognition 1 267 272
94. O. Javed Z. Rasheed K. Shafique M. Shah 2003 Tracking across multiple cameras with disjoint views Proc. of IEEE International Conf. Computer Vision 1 952 957 10.1109/ICCV.2003.1238451
95. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, Wiley-Interscience, 2nd edition, pp. 164-173, 2000.
96. W. Hu, T. Tan, L. Wang, and S. Maybank, "A survey on visual surveillance of object motion and behaviors," IEEE Trans. on Systems, Man and Cybernetics - Part C, vol. 34, no. 3, August 2004.
97. S. Hong H. Lee K.-A. Toh E. Kim 2009 Gait recognition using multi-bipolarized contour vector International Journal of Control, Automation, and Systems 7 5 799 808 10.1007/s12555-009-0512-1