Heterogeneous information fusion and visualization for a large-scale intelligent video surveillance system

IEEE Transactions on Systems, Man, and Cybernetics: Systems

Volumn 47, Issue 4, 2017, Pages 593-604

  Fan, Ching Tang ^a   Wang, Yuan Kai ^a   Huang, Cai Ren ^a  

^a FU JEN CATHOLIC UNIVERSITY   (Taiwan)

Author keywords

Display switching arbitration; information fusion; third generation surveillance system (3GSS); visual surveillance; visualizability; visualization

Indexed keywords

CAMERAS; DATA FUSION; DATA VISUALIZATION; FLOW VISUALIZATION; INFORMATION FUSION; MONITORING; SEMANTICS; SENSOR DATA FUSION; SWITCHING; THREE DIMENSIONAL COMPUTER GRAPHICS; VIDEO STREAMING; VISUALIZATION;

CAMERA SELECTION METHODS; GEOGRAPHICAL INFORMATION; HETEROGENEOUS INFORMATION; INTELLIGENT VIDEO SURVEILLANCE SYSTEMS; MULTI-MODAL INFORMATION; SURVEILLANCE SYSTEMS; VISUAL SURVEILLANCE; VISUALIZABILITY;

SECURITY SYSTEMS;

EID: 85017619710     PISSN: 21682216     EISSN: 21682232     Source Type: Journal    
DOI: 10.1109/TSMC.2016.2531671     Document Type: Article

References (43)

1. X. Li et al., "Smart community: An Internet of things application," IEEE Commun. Mag., vol. 49, no. 11, pp. 68-75, Nov. 2011.
2. T. D. Raty, "Survey on contemporary remote surveillance systems for public safety," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 40, no. 5, pp. 493-515, Sep. 2010.
3. G. J. D. Smith, "Behind the screens: Examining constructions of deviance and informal practices among CCTV control room operators," Surveillance Soc., vol. 2, nos. 2-3, pp. 379-395, 2002.
4. X. Wang, "Intelligent multi-camera video surveillance: A review," Pattern Recognit. Lett., vol. 34, no. 1, pp. 3-19, 2013.
5. L. Yu and T. E. Boult, "Systems issues in distributed multi-modal surveillance," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Minneapolis, MN, USA, Jul. 2007, pp. 1-2.
6. F. Porikli et al., "Video surveillance: Past, present, and now the future," IEEE Signal Process. Mag., vol. 30, no. 3, pp. 190-198, May 2013.
7. Y. K. Wang, L. Y. Wang, Y. C. Huang, and C. T. Fan, "An online object-based key frame extraction method for the abstraction of surveillance videos," in Proc. Nat. Comput. Symp., Taipei, Taiwan, Nov. 2009, pp. 241-249.
8. K.-W. Chen, C.-W. Lin, T.-H. Chiu, M. Y.-Y. Chen, and Y.-P. Hung, "Multi-resolution design for large-scale and high-resolution monitoring," IEEE Trans. Multimedia, vol. 13, no. 6, pp. 1256-1268, Dec. 2011.
9. D. T. Lin and L. Y. Liu, "Method of detecting moving object," U.S. Patent 121 268 603, 2012.
10. Y. Pritch, A. Rav-Acha, and S. Peleg, "Nonchronological video synopsis and indexing," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 1971-1984, Nov. 2008.
11. Y.-K. Wang, C.-T. Fan, K.-Y. Cheng, and P. S. Deng, "Real-time camera anomaly detection for real-world video surveillance," in Proc. Int. Conf. Mach. Learn. Cybern., vol. 4. Guilin, China, Jul. 2011, pp. 1520-1525.
12. C.-C. Huang, S.-J. Wang, Y. J. Chang, and T. Chen, "A hierarchical Bayesian generation framework for vacant parking space detection," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 12, pp. 1770-1785, Dec. 2010.
13. C. C. Lien, Y. T. Tsai, M. H. Tsai, and L. G. Jang, "Vehicle counting without background modeling," in Proc. Int. Conf. Adv. Multimedia Model., Taipei, Taiwan, Jan. 2011, pp. 446-456.
14. J.-W. Hsieh, C.-H. Chuang, S.-Y. Chen, C.-C. Chen, and K.-C. Fan, "Segmentation of human body parts using deformable triangulation," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 40, no. 3, pp. 596-610, May 2010.
15. C.-T. Lin, L. Siana, Y.-W. Shou, and T.-K. Shen, "A conditional entropybased independent component analysis for applications in human detection and tracking," EURASIP J. Adv. Signal Process., vol. 2010, Apr. 2010, Art. no. 468329.
16. R. Khemmar, J. Y. Ertaud, and X. Savatier, "Face detection and recognition based on fusion of omnidirectional and PTZ vision sensors and heteregenous database," Int. J. Comput. Appl., vol. 61, no. 21, pp. 35-44, 2013.
17. N. Haering, P. L. Venetianer, and A. Lipton, "The evolution of video surveillance: An overview," Mach. Vis. Appl., vol. 19, nos. 5-6, pp. 279-290, Sep. 2008.
18. J. Ferenbok and A. Clement, "Hidden changes: From CCTV to 'smart' video surveillance," in Eyes Everywhere: The Global Growth of Camera Surveillance, A. Doyle, R. K. Lipert, and D. Lyon, Eds. New York, NY, USA: Routledge, 2011, pp. 218-234.
19. P. M. Roth et al., "Next-generation 3D visualization for visual surveillance," in Proc. IEEE Conf. Adv. Video Signal Based Surveillance, Klagenfurt, Austria, Sep. 2011, pp. 343-348.
20. A. Girgensohn et al., "DOTS: Support for effective video surveillance," in Proc. Int. Conf. Multimedia, Augsburg, Germany, Sep. 2007, pp. 423-432.
21. N. Martinel, C. Micheloni, C. Piciarelli, and G. L. Foresti, "Camera selection for adaptive human-computer interface," IEEE Trans. Syst., Man, Cybern., Syst., vol. 44, no. 5, pp. 653-664, May 2014.
22. Y.-L. Tian et al., "IBM smart surveillance system (S3): Event based video surveillance system with an open and extensible framework," Mach. Vis. Appl., vol. 19, nos. 5-6, pp. 315-327, Sep. 2008.
23. D. Kieran, J. Weir, and W. Q. Yan, "A framework for an event driven video surveillance system," J. Multimedia, vol. 6, no. 1, pp. 3-13, Feb. 2011.
24. G.-C. Chao, Y.-P. Tsai, and S.-K. Jeng, "Augmented keyframe," J. Vis. Commun. Image Representation, vol. 21, no. 7, pp. 682-692, 2010.
25. A. M. Ferman, A. M. Tekalp, and R. Mehrotra, "Robust color histogram descriptors for video segment retrieval and identification," IEEE Trans. Image Proc., vol. 11, no. 5, pp. 497-508, May 2002.
26. H.-C. Lee and S.-D. Kim, "Rate-driven key frame selection using temporal variation of visual content," Electron. Lett., vol. 38, no. 5, pp. 217-218, Feb. 2002.
27. K. W. Sze, K.-M. Lam, and G. Qiu, "A new key frame representation for video segment retrieval," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 9, pp. 1148-1155, Sep. 2005.
28. B. Erol and F. Kossentini, "Automatic key video object plane selection using the shape information in the MPEG-4 compressed domain," IEEE Trans. Multimedia, vol. 2, no. 2, pp. 129-138, Jun. 2000.
29. C. Kim and J.-N. Hwang, "Object-based video abstraction for video surveillance systems," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 12, pp. 1128-1138, Dec. 2002.
30. E. Spyrou and Y. Avrithis, A Region Thesaurus Approach for High-Level Concept Detection in the Natural Disaster Domain (LNCS 4816). Heidelberg, Germany: Springer, 2007, pp. 74-77.
31. Z. Ji, Y. Su, R. Qian, and J. Ma, "Surveillance video summarization based on moving object detection and trajectory extraction," in Proc. Int. Conf. Signal Process. Syst., Dalian, China, Jul. 2010, pp. V2-250-V2-253.
32. J. Yoder, H. Medeiros, J. Park, and A. Kak, "Cluster-based distributed face tracking in camera networks," IEEE Trans. Image Proc., vol. 19, no. 10, pp. 2551-2563, Oct. 2010.
33. T. Matsuyama and N. Ukita, "Real-time multitarget tracking by a cooperative distributed vision system," Proc. IEEE, vol. 90, no. 7, pp. 1136-1150, Jul. 2002.
34. H. Medeiros, J. Park, and A. C. Kak, "Distributed object tracking using a cluster-based Kalman filter in wireless camera networks," IEEE J. Sel. Topics Signal Process., vol. 2, no. 4, pp. 448-463, Aug. 2008.
35. I. F. Akyildiz, T. Melodia, and K. R. Chowdhury, "A survey on wireless multimedia sensor networks," Comput. Netw., vol. 51, no. 4, pp. 921-960, 2007.
36. N. Martinel, C. Micheloni, C. Piciarelli, and G. L. Foresti, "Camera selection for adaptive human-computer interface," IEEE Trans. Syst., Man, Cybern., Syst., vol. 44, no. 5, pp. 653-664, May 2014.
37. J. Kim and D. Kim, "Probabilistic camera hand-off for visual surveillance," in Proc. Int. Conf. Digit. Smart Cameras, Stanford, CA, USA, Sep. 2008, pp. 1-8.
38. R. Goshorn, J. Goshorn, D. Goshorn, and H. Aghajan. "Architecture for cluster-based automated surveillance network for detecting and tracking multiple persons," in Proc. ACM/IEEE Int. Conf. Distrib. Smart Cameras, Vienna, Austria, Sep. 2007, pp. 219-226.
39. A. Bakhtari, M. D. Naish, M. Eskandari, E. A. Cloft, and B. Benhabib, "Active-vision-based multisensor surveillance-An implementation," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 36, no. 5, pp. 668-680, Sep. 2006.
40. Y. Fu et al., "Multi-view video summarization," IEEE Trans. Multimedia, vol. 12, no. 7, pp. 717-729, Nov. 2010.
41. Vision-Based Intelligent Environment Project. Online. Available: http://cvrc.nctu.edu.tw/~TT/home.php?&lang=en, accessed Oct. 2015.
42. ICDSC Challenge-Smart Homes Data Set. Online. Available: http://wsnl2.stanford.edu/icdsc09challenge/, accessed 2009.
43. C.-M. Huang and L.-C. Fu, "Multitarget visual tracking based effective surveillance with cooperation of multiple active cameras," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 1, pp. 234-247, Feb. 2011.