Cooperative object tracking and composite event detection with wireless embedded smart cameras

IEEE Transactions on Image Processing

Volumn 19, Issue 10, 2010, Pages 2614-2633

  Wang, Youlu ^a   Velipasalar, Senem ^a   Casares, Mauricio ^a  

^a UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Composite event; Embedded; Event detection; Multiobject tracking; Smart camera; Spatio temporal; Wireless communication

Indexed keywords

COMPOSITE EVENT; EMBEDDED; EVENT DETECTION; MULTI-OBJECT TRACKING; SMART CAMERAS; SPATIO-TEMPORAL; WIRELESS COMMUNICATIONS;

TRACKING (POSITION); WIRELESS TELECOMMUNICATION SYSTEMS;

CAMERAS;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; HUMAN; IMAGE PROCESSING; INSTRUMENTATION; METHODOLOGY; MOVEMENT (PHYSIOLOGY); VIDEORECORDING; WIRELESS COMMUNICATION;

ALGORITHMS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MOVEMENT; PATTERN RECOGNITION, AUTOMATED; VIDEO RECORDING; WIRELESS TECHNOLOGY;

EID: 77956922963     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2010.2052278     Document Type: Article

References (60)

1. A. Adam, E. Rivlin, I. Shimshoni, and D. Reinitz, "Robust real-time unusual event detection using multiple fixed-location monitors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 3, pp. 555-560, Mar. 2008.
2. N. Atsushi, K. Hirokazu, H. Shinsaku, and I. Seiji, "Tracking multiple people using distributed vision systems," in Proc. IEEE Int. Conf. Robotics and Automation, 2002, pp. 2974-2981.
3. J. Black, T. Ellis, and D. Makris, "A hierarchical database for visual surveillance applications," in Proc. IEEE Conf. Multimedia & Expo, 2004, vol. 3, pp. 1571-1574.
4. O. Boiman and M. Irani, "Detecting irregularities in images and in video," in Proc. IEEE Int. Conf. Computer Vision, 2005, pp. 462-469.
5. M. Borg, D. Thirde, J. Ferryman, F. Fusier, V. Valentin, F. Bremond, and M. Thonnat, "Video surveillance for aircraft activity monitoring," in Proc. IEEE Conf. Advanced Video and Signal Based Surveillance, 2005, pp. 16-21.
6. M. Bramberger, A. Doblander, A.Maier, B. Rinner, and H. Schwabach, "Distributed embedded smart cameras for surveillance applications," IEEE Computer, vol. 39, no. 2, pp. 68-75, Feb. 2006.
7. M. Casares, S. Velipasalar, and A. Pinto, "Light-weight salient foreground detection for embedded smart cameras," J. Comput. Vis. Image Understand., in press.
8. P. Chen et al., "CITRIC: A low-bandwidth wireless camera network platform," in Proc. of the ACM/IEEE Int. Conf. Distributed Smart Cameras, 2008, pp. 1-10.
9. R. T. Collins, A. J. Lipton, T. Kanade, H. Fujiyoshi, D. Duggins, Y. Tsin, D. Tolliver, N. Enomoto, O. Hasegawa, P. Burt, and L. Wixson, A System for Video Surveillance and Monitoring: VSAM Final Report Robotics Inst., Carnegie Mellon Univ., Tech. Rep. CMU-RI-TR-00-12, May 2000.
10. R. T. Collins, A. J. Lipton, H. Fujiyoshi, and T. Kanade, "Algorithms for cooperative multisensor surveillance," Proc. IEEE, vol. 89, no. 10, pp. 1456-1477, Oct. 2001.
11. D. Comaniciu, V. Ramesh, and P. Meer, "Real-time tracking of nonrigid objects using mean shift," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2000, vol. 2, pp. 142-149.
12. F. Cupillard, A. Avanzi, F. Bremond, and M. Thonnat, "Video understanding for metro surveillance," in Proc. IEEE Conf. Networking, Sensing & Control, 2004, pp. 186-191.
13. H. Dee and D. Hogg, "Detecting inexplicable behaviour," in Proc. British Machine Vision Conf., 2004, pp. 477-486.
14. I. Downes, L. B. Rad, and H. Aghajan, "Development of a mote for wireless image sensor networks," in Proc. Cognitive Systems With Interactive Sensors, 2006.
15. A. Elgammal, D. Harwood, and L. Davis, "Non-parametric model for background subtraction," in Proc. Eur. Conf. Computer Vision, 2000, pp. 751-767.
16. T. Ellis, "Multi-camera video vurveillance," in Proc. Int. Carnahan Conf. Security Technology, 2002, pp. 228-233.
17. W.-C. Feng, W.-C. Feng, and M. L. Baillif, "Panoptes: Scalable low-power video sensor networking technologies," in Proc. ACM Conf. Multimedia, 2003, pp. 562-571.
18. S. Fleck, F. Busch, P. Biber, and W. Strasser, "3D surveillance-a distributed network of smart cameras for real-time tracking and its visualization in 3D," in Proc. Conf. Computer Vision and Pattern Recognition Workshop, Jun. 2006, pp. 118-118.
19. I. Haritaoglu, D. Harwood, and L. S. Davis, "W : Real-time surveillance of people and their activities," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 809-830, Aug. 2000.
20. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge, UK: Cambridge Univ. Press, 2001.
21. S. Hengstler, D. Prashanth, S. Fong, and H. Aghajan, "Mesheye: A hybrid-resolution smart camera mote for applications in distributed intelligent surveillance," in Proc. Int. Symp. Information Processing in Sensor Networks, 2007, pp. 360-369.
22. Y. A. Ivanov and A. F. Bobick, "Recognition of multi-agent interaction in video surveillance," in Proc. IEEE Conf. Computer Vision, 1999, pp. 169-176.
23. S. Khan and M. Shah, "Consistent labeling of tracked objects in multiple cameras with overlapping fields of view," IEEE Trans. Pattern Anal. Machine Intell., vol. 25, no. 10, pp. 1355-1360, Oct. 2003.
24. K. Kim, T. H. Chalidabhongse, D. Harwood, and L. Davis, "Real-time foreground-background segmentation using codebook model," J. Real-time Imag., vol. 11, pp. 172-185, 2005.
25. R. Kleihorst, A. Abbo, B. Schueler, and A. Danilin, "Camera mote with a high-performance parallel processor for real-time frame-based video processing," in Proc. ACM/IEEE Int. Conf. Distributed Smart Cameras, 2007, pp. 106-116.
26. J. Krumm, S. Harris, B. Meyers, B. Brumitt, M. Hale, and S. Shafer, "Multi-camera multi-person tracking for easyliving," in Proc. IEEE Int. Workshop Visual Surveillance, Jul. 2000, pp. 3-10.
27. P. Kulkarni, D. Ganesan, and P. Shenoy, "The case for multi-tier camera sensor network," in Proc. ACM Workshop on Network and Operating System Support for Digital Audio and Video, 2005, pp. 141-146.
28. B. P. Lai Lo, J. Sun, and S. A. Velastin, "Fusing visual and audio information in a distributed intelligent surveillance system for public transport systems," Acta Automatica Sinica, pp. 393-407, May 2003.
29. G. Medioni, I. Cohen, F. Bremond, S. Hongeng, and R. Nevatia, "Event detection and analysis from video streams," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 8, pp. 873-889, Aug. 2001.
30. R. Nevatia, J. Hobbs, and B. Bolles, "An ontology for video event representation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition Workshops, 2004, p. 119.
31. R. Nevatia, T. Zhao, and S. Hongeng, "Hierarchical language-based representation of events in video streams," in Proc. IEEE CVPR Workshop on Event Mining, 2003, p. 39.
32. K. Nguyen, G. Yeung, S. Ghiasi, and M. Sarrafzadeh, "A general framework for tracking objects in a multi-camera environment," in Proc. Int. Workshop on Digital and Computational Video, 2002, pp. 200-204.
33. N. Oliver, B. Rosario, and A. Pentland, "A Bayesian computer vision system for modeling human interactions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 831-834, Aug. 2000.
34. J. Owens and A. Hunter, "Application of the self-organising map to trajectory classification," in Proc. IEEE Int. Workshop on Visual Surveillance, 2000, pp. 77-83.
35. I. Pavlidis, V. Morellas, P. Tsiamyrtzis, and S. Harp, "Urban surveillance systems: From the laboratory to the commercial world," Proc. IEEE, vol. 89, no. 10, pp. 1478-1497, 2001.
36. M. Piccardi, "Background subtraction techniques: A review," in Proc. IEEE Int. Conf. Systems, Man and Cybernetics, 2004, vol. 4, pp. 3099-3104.
37. F. Porikli and T. Haga, "Event detection by eigenvector decomposition using object and frame features," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004, pp. 462-469.
38. M. Quaritsch, M. Kreuzthaler, B. Rinner, H. Bischof, and B. Strobl, "Autonomous multicamera tracking on embedded smart cameras," EURASIP J. Embedded Syst., 2007, 92827.
39. M. Rahimi, R. Baer, O. I. Iroezi, J. C. Garcia, J. Warrior, D. Estrin, and M. Srivastava, "Cyclops: In situ image sensing and interpretation in wireless sensor networks," in Proc. Int. Conf. Embedded Networked Sensor Systems, 2005, pp. 192-204.
40. B. Rinner and W. Wolf, "An introduction to distributed smart cameras," Proc. IEEE, vol. 96, no. 10, pp. 1565-1575, 2008.
41. B. Rinner, T. Winkler, W. Schriebl, M. Quaritsch, and W. Wolf, "The evolution from single to pervasive smart cameras," in Proc. ACM/IEEE Int. Conf. Distributed Smart Cameras, 2008, pp. 1-10.
42. N. Rota and M. Thonnat, "Video sequence interpretation for visual surveillance," in Proc. IEEE Int. Workshop on Visual Surveillance, 2000, pp. 59-68.
43. A. Rowe, C. Rosenberg, and I. Nourbakhsh, "A second generation low cost embedded color vision system," in Proc. IEEE Embedded Computer Vision Workshop in Conjunction with IEEE Computer Society Conf. Computer Vision and Pattern Recognition, Jun. 2005, vol. 3, p. 136.
44. C. Sacchi and C. S. Regazzoni, "A distributed surveillance system for detection of abandoned objects in unmanned railway environments," IEEE Trans. Veh. Technol., vol. 49, no. 5, pp. 2013-2026, Sep. 2000.
45. L. Shapiro and G. Stockman, Computor Vision. Upper Saddle River, NJ: Prentice-Hall, 2001.
46. V. D. Shet, D. Harwood, and L. S. Davis, "VidMAP: Video monitoring of activity with Prolog," in Proc. IEEE Conf. Advanced Video and Signal Based Surveillance, 2005, pp. 224-229.
47. C. Stauffer and W. E. L. Grimson, "Learning patterns of activity using real-time tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 747-757, Aug. 2000.
48. E. Stringa and C. S. Regazzoni, "Real-time video-shot detection for scene survaillance applications," IEEE Trans. Image Process., vol. 9, no. 1, pp. 69-79, Jan. 2000.
49. T. Teixeira, D. Lymberopoulos, E. Culurciello, Y. Aloimonos, and A. Savvides, "A lightweight camera sensor network operating on symbolic information," in Proc. 1st Workshop on Distributed Smart Cameras, 2006.
50. N. Vaswani, A. Chowdhury, and R. Chellappa, "Activity recognition using the dynamics of the configuration of interacting objects," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003, pp. 633-640.
51. S. Velipasalar, J. Schlessman, C. Chen, W. Wolf, and J. Singh, "A scalable clustered camera system for multiple object tracking," EURASIP J. Image Video Process., 2008, 542808.
52. V. T. Vu, F. Bremond, and M. Thonnat, "Automatic video interpretation: A novel algorithm for temporal scenario recognition," in Proc. Int. Joint Conf. Artificial Intelligence, 2003, pp. 9-15.
53. Y. Wang, M. Casares, and S. Velipasalar, "Cooperative object tracking and event detection with wireless smart cameras," in Proc. IEEE Int. Conf. Advanced Video and Signal Based Surveillance, 2009, pp. 394-399.
54. Y. Wang, M. Casares, and S. Velipasalar, "Detection of composite events spanning multiple camera views with wireless embedded smart cameras," in Proc. ACM/IEEE Int. Conf. Distributed Smart Cameras, 2009, pp. 1-8.
55. H. Watanabe, H. Tanahashi, Y. Satoh, Y. Niwa, and K. Yamamoto, "Event detection for a visual surveillance system using stereo omni-directional system," in Proc. Int. Conf. Knowledge-Based Intelligent Information and Engineering Systems, 2003, pp. 890-896.
56. C. R. Wren, A. Azarbayejani, T. Darrell, and A. P. Pentland, "Pfinder: Real-time tracking of the human body," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 780-785, Jul. 1997.
57. T. Xiang and S. Gong, "Beyond tracking: Modelling activity and understanding behaviour," Int. J. Comput. Vis., vol. 67, no. 1, pp. 21-51, 2006.
58. X. Yuan, Z. Sun, Y. Varol, and G. Bebis, "A distributed visual surveillance system," in Proc. IEEE Conf. Advanced Video and Signal Based Surveillance, Jul. 2003, pp. 199-204.
59. H. Zhong, J. Shi, and M. Visontai, "Detecting unusual activity in video," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004, pp. 819-826.
60. Z. Zivkovic, "Improved adaptive gausian mixture model for background subtraction," in Proc. Int. Conf. Pattern Recognition, 2004, pp. 28-31.