Study of robust and intelligent surveillance in visible and multi-modal framework

Informatica (Ljubljana)

Volumn 31, Issue 4, 2007, Pages 447-461

  Kumar, Praveen ^a   Mittal, Ankush ^a   Kumar, Padam ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY ROORKEE   (India)

Author keywords

Data fusion; Event detection; Object detection and tracking; Video surveillance

Indexed keywords

COMPUTER VISION; DATA FUSION; ECONOMIC ANALYSIS; MODAL ANALYSIS; ROBUST CONTROL; TRAFFIC CONGESTION;

EVENT DETECTION; OBJECT DETECTION AND TRACKING; VIDEO SURVEILLANCE;

INTELLIGENT SYSTEMS;

EID: 38749103113     PISSN: 03505596     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (91)

1. DataMonitor. Global digital video surveillance markets: Finding future opportunities as analog makes way for digital. Market research report (July 2004). www.mindbranch.com/products/R313-6950.html.
2. T. Bodsky, R. Cohen, E. Cohen-Solal, S. Gutta, D. Lyons, V. Philomin, and M. Trajkovic (2001). 'Visual surveillance in retail stores and in the home', in: 'Advanced Video-based Surveillance Systems'. Kluwer Academic Publishers, Boston, , Chapter 4, pp. 50-61
3. J.M. Ferryman, S.J. Maybank, and A.D. Worrall (2000). 'Visual surveillance for moving vehicles', Int. J. Comput. Vis., 37, (2), Kluwer Academic Publishers, Netherlands, pp. 187-19731
4. R. Cucchiara, C. Grana, A. Patri, G. Tardini, and R. Vezzani (2004). Using computer vision techniques for dangerous situation detection in domotic applications. Proc. IEE Workshop on Intelligent Distributed Surveillance Systems, London, pp. 1-5.
5. Frost & Sullivan report, (August 2005); www.frost.com
6. W. Hu, T. Tan, L. Wang, and S. Maybank (August 2004). A survey on visual surveillance of object motion and behaviors. IEEE Transactions on Systems, Man and cybernetics, 34(3):334-350
7. I. Haritaoglu, D. Harwood, and L. Davis. W4: Who, when, where, what: A real time system for detecting and tracking people. In Third Face and Gesture Recognition Conference, pp. 222-227.
8. W. Niu, L. Jiao, D. Han, and Y. Wang (2003). Real-Time Multi-Person Tracking in Video Surveillance. Proceedings of the Pacific Rim Multimedia Conference, Singapore.
9. A. Bobick and J. Davis (December 1996). Real time recognition of activity using temporal templates. IEEE workshop on Applications of Computer Vision, Sarasota, FL, 4 pages.
10. J. Gao, A. G. Hauptmann and H. D. Wactlar. Combining Motion Segmentation with Tracking for Activity Analysis (2004). The Sixth International Conference on Automatic Face and Gesture Recognition (FGR'04), pp. 699-704, Seoul, Korea, May 17-19.
11. E. Stringa, and C.S. Regazzoni. Content-based retrieval and real-time detection from video sequences acquired by surveillance systems. Int. Conf. on Image Processing, Chicago, 1998, pp. 138-142
12. J. Black, T. Ellis and P. Rosin. A novel method for video tracking performance evaluation (2003). The Joint IEEE Int. Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, October, France, pp. 125-132.
13. R. Cucchiara (2005). Multimedia surveillance systems. In VSSN 05: Proceedings of the third ACM international workshop on Video surveillance & sensor networks, New YorkNY, USA, pages 3-10.
14. C. 'O Conaire, E. Cooke, N. O'Connor, N. Murphy, and A. F.Smeaton (2005). Fusion of infrared and visible spectrum video for indoor surveillance. In International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), Montreux, Switzerland, April.
15. C. stauffer. Automated Audio-Visual Activity Analysis. CSAIL Technical Reports, MIT. http://hdl.handle.net/l 721.1/30568
16. A. M. McIvor (2000). Background subtraction techniques. In Image and Vision Computing, Hamilton, New Zealand, Nov.
17. J. J. Wang and S. Singh (2003). Video analysis of human dynamics - a survey. Real-Time Imaging 9(5): 321-346.
18. R. Chellappa, C. L. Wilson and S. Sirohey (1995). Human and machine recognition of faces: a survey. Proc. of the IEEE, vol. 83, No. 5, pp705-740.
19. V. I. Pavlovic, R. Sharma and T. S. Huang (1997). Visual interpretation of hand gestures for human computer interaction: a review. IEEE Transactions on PAMI, vol.19, no.7, pp.677-695, July.
20. A. R. Dick and M. J. Brooks (2003). Issues in Automated Visual Surveillance. DICTA: 195-204.
21. M. Valera and S.A. Velastin (2005). Intelligent distributed surveillance systems: a review vision. In Image and Signal Processing, IEE Proceedings, volume 152, pages 192 - 204, April.
22. A. Amer and C. Regazzoni. Editorial: Introduction to the special issue on video object processing for surveillance applications. Real-Time Imaging Vol. 11, pp: 167-171,2005.
23. Nwagboso, C (1998). User focused surveillance systems integration for intelligent transport systems', in 'Advanced Video-based Surveillance Systems'. Kluwer Academic Publishers, Boston, Chapter 1.1, pp. 8-12.
24. R. T. Collins, A. J. Lipton, T. Kanade, H. Fujiyoshi, D. Duggins, Y.Tsin, D. Tolliver, N. Enomoto, O. Hasegawa, P. Burt, and L.Wixson (2000). A system for video surveillance and monitoring. Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep., CMU-RITR-00-12.
25. M. Chen, S-C. Chen, M-L. Shyu, and K. Wickramaratna. Semantic Event Detection via Multimodal Data Mining. IEEE Signal Processing Magazine, pages 38-46, march 2006.
26. K. Toyama, J. Krumm, B. Brumitt, and B. Meyers (1999). Wallflower: Principles and practice of background maintenance. In Proceedings of the Seventh IEEE International Conference on Computer IEEE Comput. Soc, volume 1, pages 255-261.
27. C. R. Wren, A. Azarbayejani, T. Darrell, and A. P. Pentland (1997). Pfinder: real-time tracking of the human body. IEEE Trans. Pattern Anal. Machine Intell., vol. 19, pp. 780-785, July.
28. C. Stauffer and W.E.L. Grimson (1999). Adaptive background mixture models for real-time tracking. In Proceedings of CVPR99, pages 11:246-252.
29. J. Barron, D. Fleet, and S. Beauchemin (1994) .Performance of optical flow techniques. Int. J. Comput. Vis., vol. 12, no. 1, pp. 42-77.
30. J.M. Ferryman, S.J. Maybank, and A.D. Worrall (2000). Visual surveillance for moving vehicles, Int. J. Comput. Vis., 37, (2), Kluwer Academic Publishers, Netherlands, pp. 187-197
31. G. Welch and G. Bishop (2002). An Introduction to the Kalman Filter. UNC-Chapel Hill, TR 95-041.
32. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp (2002). A tutorial on particle filters for online non-linear/non-Gaussian Bayesian tracking. IEEE Trans, on Signal Process., 50, (2), pp. 174-188
33. A. Senior, A. Hampapur, Y.-L. Tian, L. Brown, S. Pankanti, and R. Bolle. Appearance models for occlusion handling. In 2nd IEEE Int. Workshop on PETS, Kauai, Hawaii, USA, Dec 2001.
34. B. Bhanu, I. Pavlidis, R. Hummel. Guest Editorial: Special issue on computer vision beyond the visible spectrum. Machine Vision and Applications (2000) 11:265-266
35. S.-S. Lin. Review: Extending visible band computer vision techniques to infrared band images. Technical report, GRASP Laboratory, Computer and Information Science Department, University of Pennsylvania, 2001.
36. C. K. Eveland, D. A. Socolinsky, L. B. Wolff. Tracking human faces in infrared video. Image and VisionComputing, Vol. 21, pp. 579-590, 2003.
37. M. Bertozzi, A. Broggi, P. Grisleri, T. Graf, M. Meinecke. Pedestrian Detection in Infrared Images. Proc.IEEE Intelligent Vehicles Symposium 2003, pp. 662-667, Columbus (USA), June 2003.
38. F. Xu, X. Liu, and K. Fujimura. Pedestrian Detection and Tracking With Night Vision. IEEE Transactions on Intelligent Transportation Systems, Vol. 6, No. 1, pp. 63-71, March 2005.
39. J. Davis and V. Sharma. Robust detection of people in thermal imagery. In Proc. Int. Conf. Pat. Rec., pages 713-716,2004
40. J. Han and B. Bhanu. Human activity recognition in thermal infrared imagery. Computer Vision and Pattern Recognition, 20-26 June, 2005.
41. McDaniel, R., Scribner, D., Krebs, W., Warren, P., Ockman, N., McCarley, J. (1998). Image fusion for tactical applications. Proceedings of the SPIE Infrared Technology and Applications XXIV, 3436, 685-695.
42. J. Li. Spatial quality evaluation of fusion of different resolution images. International Archives of Photogrammetry and Remote Sensing, Vol.33, 2000.
43. A. Toet. Heirarchical image fusion. Machine Vision and Applications, 3:1-11, 1990
44. M. Pavel, J. Larimer, and A. Ahumada. Sensor fusion for synthetic vision. In Conference on Computing in Aerospace, AIAA, 1991.
45. H. Li, B. Manjunath, and S. Mitra. Multisensor image fusion using the wavelet transform. In Graphical Models and Image Processing, volume 57, pages 234-245, 1995
46. A. Utsumi, H. Mori, J. Ohya, and M. Yachida. Multipleview-based tracking of multiple humans. In Proceedings of the 14th ICPR, pages 597-601, 1998
47. A. Nakazawa, H. Kato, and S.Inokuchi. Human tracking using distributed vision systems. In Proceedings of the 14"' ICPR, pages 593-596, 1998
48. H. Torresan, B. Turgeon, C. Ibarra-Castanedo, P. Hébert, X. Maldague,. Advanced Surveillance Systems: Combining Video and Thermal Imagery for Pedestrian Detection. In Proc. of SPIE, Thermosense XXVI, volume 5405 of SPIE, pages 506-515, April 2004.
49. J. W. Davis and V. Sharma. Fusion-Based Background-Subtraction using Contour Saliency. Computer Vision and Pattern Recognition, 20-26 June, 2005
50. C.O. Conaire, N. O.Connor, E. Cooke, A. Smeaton. Multispectral Object Segmentation and Retrieval in Surveillance Video. To appear in International Conference on Image Processing, 2006.
51. th Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP), LNCS 4338, pp. 528 - 539, 2006.
52. Ó. Conaire, C O'Connor, N.E. Cooke and E. Smeaton. Comparison of fusion methods for thermo-visual surveillance tracking. In International Conference on Information Fusion, 2006.
53. D. L. Hall and J. Llinas. An introduction to multisensor fusion. In Proceedings of the IEEE: Special Issues on Data Fusion, pages 85(1):6-23, January 1997.
54. R. R. Brooks and S.S. Iyengar. Multi-sensor fusion: fundamentals and applications with software. Upper Saddle River, N.J.: Prentice Hall PTR, 1998.
55. S. Nazarko. Evaluation of data fusion methods using kalman filtering and TBM. Maters thesis. University of Jyväskylä. 2002.
56. Ph. Smets. The Transferable Belief Model for Quantified Belief Representation. In Handbook of defeasible reasoning and uncertainty management systems. Gabbay D. M. and Smets Ph. Eds. Vol. 1, Kluwer, Doordrecht, 1998, pg. 267-301.
57. G. Loy, L. Fletcher, N. Apostolo, and A. Zelinsky. An adaptive fusion architecture for target tracking. In IEEE International Conference on Automatic Face and Gesture Recognition (FGR), 2002.
58. A. Ayoun, and P. Smets. Data association in multitarget detection using the transferable belief model, International Journal of Intelligent Systems, 16:1167-1182. 2001
59. th International Conference on Information Fusion. Sweden, Pp 5461. 2004
60. P.J. Escamilla-Ambrosio, N. Mort. A Hybrid Kalman Filter - Fuzzy Logic Architecture for Multisensor Data Fusion. Proceedings of the 2001 IEEE International Symposium on Intelligent Control, pp. 364-369 , 2001
61. Z. Elouedi, K. Mellouli, P. Smets. Assessing sensor reliability for multisensor data fusion within the transferable belief model. IEEE Transactions on Systems, Man and Cybernetics, Part B, page 782-787. 2004
62. st, 2004, pp. 739-746.
63. G. Rogova and V. Nimier. Reliability in information fusion: Literature. Survey. In Proceedings of 7th International Conference on Information. Fusion, Sweden, pp. 1158-1165. 2004
64. rd IEEE International Conference on Intelligent Sensing and Information Processing (ICISIP), pp. 151-157, 2005.
65. J. Hershey, H. Attias, N. Jojic, and T. Krisjianson. Audio visual graphical models for speech processing. In IEEE International Conference on Speech, Acoustics, and Signal Processing (ICASSP04), Motreal, Canada, May 2004.
66. A. V. Nefian, L. Liang, X. Pi, X. Liu, and K. Murphy. Dynamic bayesian networks for audiovisual speech recognition. In EURASIP Journal on Applied Signal Processing (JASP02), 2002.
67. H. J. Nock, G. Iyengar, and C Neti. Speaker localization using audio-visual synchrony: Anempirical study. In International Conference on Image and Video Retrieval (CIVR03), 2003. pages 488-499.
68. D. Gatica-Perez, G. Lathoud, I. McCowan, J. Odobez, and D. Moore. Audio-visual speaker tracking with importance particle filter. In IEEE International Conference on Image Processing (ICIP03), 2003.
69. N. Checka, K. W. Wilson, M. R. Siracusa, and T. Darrell. Multiple person and speaker activity tracking with a particle filter. In International Conference on Acoustics Speech and Signal Processing (ICASSP04), 2004.
70. H. J. Nock, G. Iyengar, and C. Neti. Assessing face and speech consistency for monologue detection in video. In ACM Multimedia, 2002.
71. P. K. Atrey, M. S. Kankanhalli and R. Jain. Information assimilation framework for event detection in multimedia surveillance systems. Special Issue on "Multimedia Surveillance Systems" in Springer/ACM Multimedia Systems Journal, September 2006
72. D. Whitney, and J. Pisano, TASC, Inc., Reading, Massachusetts. AutoAlert: Automated Acoustic Detection of Incidents. December 26, 1995.
73. M. Cowling, R. Sitte. Comparison of Techniques for Environmental Sound Recognition. Pattern Recognition Letters, Elsevier Science Inc., Vol. 24, Issues 15, pp. 2895-2907, Nov. 2003.
74. Proximity Sensors, http://www.machinedesign.com
75. Z. Zhu, W. Li and G. Wolberg. Integrating LDV Audio and IR Video for Remote Multimodal Surveillance. IEEE Workshop on Object Tracking and Classification In and Beyond the Visible Spectrum, in conjunction with IEEE Conference on Computer Vision and Pattern Recognition, San Diego, CA, June 2005
76. I. Ulrich and J. Borenstein, "The guidecane, applying mobile robot technologies to assist the visually impaired," IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, vol. 31, no. 2, pp. 131-136, 2001.
77. S. Shoval, I. Ulrich, and J. Borenstein, Computerized Obstacle Avoidance Systems for the Blind and Visually Impaired. Intelligent Systems and Technologies in Rehabilitation Engineering, CRC Press, 2000.
78. Caimi, F.M. Bailey, B.C. Blatt, J.H. Undersea object detection and recognition: the use of spatially andtemporally varying coherent illumination. OCEANS '99 MTS/IEEE. Riding the Crest into the 21st Century ,pages 1474-1479 vol.3
79. Heckman, P., and Hodgson, "Underwater Optical Range Gating", IEEE Journal of Quantum Electronics, QE-3,11, Nov. 1967
80. A. F. Bobick, and J. W. Davis. The Recognition of Human Movement Using Temporal Templates. PAM, Vol. 23, No. 3, 2001.
81. K. Takahashi, S. Seki, H.Kojima, and R. Oka, "Recognition of dexterous manipulations from time varying images," in Proc. IEEEWorkshop Motion of Non-Rigid and Articulated Objects, Austin, TX, 1994, pp. 23-28.
82. A. F. Bobick and A. D.Wilson. A state-based technique to the representation and recognition of gesture. IEEE Trans. Pattern Anal. Machine Intell., vol. 19, pp. 1325-1337, Dec. 1997.
83. R. Duggad, U. B. Desai. A Tutorial on Hidden Markov Models. Technical Report No. SPANN 96.1. 1996. Indian Institute of Technology Bombay.
84. L. Rabinier, A tutorial on hidden Markov models and selected applications in speech recognition. Proc. of IEEE. 77 (2) (1989) 257-285.
85. M. Leo, P. Spagnolo, T. D'Orazio, A. Distante. Human Activity Recognition in Archaeological Sites by Hidden Markov Models. PCM (2), 1019-1026, 2004
86. D. Mahajan, N. Kwatra, S. Jain, P. Kalra, S. Banerjee. A Framework for Activity Recognition and Detection of Unusual Activities. 15-21, ICVGIP, 2004, Kolkata, India.
87. M. Yang and N. Ahuja. Extraction and classification of visual motion pattern recognition. In Proc. IEEE Confi Computer Vision and Pattern Recognition, 1998, pp. 892-897.
88. U. Meier, R. Stiefelhagen, J. Yang, and A.Waibel. Toward unrestricted lip reading. Int. J. Pattern Recognit. Artificial Intell., vol. 14, no. 5, pp. 571-585, Aug 2000
89. O. Boiman and M. Irani. Detecting irregularities in images and in video. In Proc. IEEE International Conference on Computer Vision, pages 1985-1988, Beijing, China, Oct. 15-21 2005.
90. D. Zhang, D. Gatica-Perez, S. Bengio, and I. McCowan. Semi-supervised adapted HMMs for unusual event detection. In Proc. IEEE Conf on Computer Vision and Pattern Recognition, volume 1, July 2005.
91. P. Kumar, A. Mittal and P. Kumar. A Multi-modal Data Fusion Framework Using Transferable Belief Model and Kalman filter for Robust Tracking in Dynamic Environment. Communicated to Signal, Video and Image processing Journal, Springer Verlag publication.