Interactive exploration of surveillance video through action shot summarization and trajectory visualization

IEEE Transactions on Visualization and Computer Graphics

Volumn 19, Issue 12, 2013, Pages 2119-2128

  Meghdadi, Amir H ^a   Irani, Pourang ^a  

^a UNIVERSITY OF MANITOBA   (Canada)

Author keywords

surveillance video; video browsing and exploration; video summarization; Video visual analytics; video visualization

Indexed keywords

SURVEILLANCE VIDEO; VIDEO BROWSING; VIDEO SUMMARIZATION; VIDEO VISUALIZATION; VISUAL ANALYTICS;

MONITORING; TOOLS; VIDEO RECORDING; VISUALIZATION;

SECURITY SYSTEMS;

ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER INTERFACE; PHOTOGRAPHY; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; VIDEORECORDING; ARTICLE; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER GRAPHICS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; USER-COMPUTER INTERFACE; VIDEO RECORDING;

EID: 84886643615     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2013.168     Document Type: Article

References (33)

1. R. Arai, and S. Watanabe, "A Quantitative Method for Comparing Multi-Agent-Based Simulations in Feature Space," Multi-Agent-Based Simulation IX, Lecture Notes in Computer Science, pp. 154-166, 2009.
2. A. Bartoli, N. Dalal, and R. Horaud, "Motion panoramas," Computer Animation and Virtual Worlds, vol. 15, no. 5, pp. 501-517, 2004. (Pubitemid 41107989)
3. R. Borgo, M. Chen, B. Daubney, E. Grundy, B. Höferlin, D. Weiskopf and X. Xie "A Survey on Video-based Graphics and Video Visualization," Proc. of the EuroGraphics conf., State of the Art Report, 2011.
4. R. Botchen, F. Schick and T. Ertl, "Action-Based Multifield Video Visualization," IEEE Trans. Visualization and Computer Graphics, vol. 14, no. 4, pp. 885-899, 2008. (Pubitemid 351780214)
5. Y. Caspi, A. Axelrod, Y. Matsushita and A. Gamliel "Dynamic stills and clip trailers," The Visual Computer, vol. 22, no. 9, pp. 642-652, 2006. (Pubitemid 44371172)
6. C. D. Correa and K.-L. Ma, "Dynamic video narratives," ACM Trans. Graph., vol. 29, no. 4, pp. 88:1-88:9, 2010.
7. G. Daniel and M. Chen, "Video Visualization," Proc. of IEEE Visualization 2003, pp. 409-416, 2003.
8. P. Dragicevic, G. Ramos, J. Bibliowitcz, D. Nowrouzezahrai, R. Balakrishnan and K. Singh, "Video browsing by direct manipulation," Proc. SIGCHI Conference on Human Factors in Computing Systems, pp. 237-246, 2008.
9. R. O. Duda, P. E. Hart, and D. G. Stork, "Pattern Classification," Wiley, New York, 2001.
10. S. Fels and M. Kenji, "Interactive video cubism," Proc. of 1999 workshop on new paradigms in information visualization and manipulation, pp. 78-82, 1999.
11. D. B. Goldman, B. Curless, D. Salesin and S. M. Seitz. "Schematic storyboarding for video visualization and editing," ACM Trans. Graph. vol. 25, no. 3, pp. 862-871, 2006. (Pubitemid 44481048)
12. K. Hasan, T. Grossman and P. Irani, "Comet and target ghost: techniques for selecting moving targets," Proc. of SIGCHI Conference on Human Factors in Computing Systems, pp. 839-848, 2011.
13. M. Höferlin, B. Höferlin, and D. Weiskopf, "Video visual analytics of tracked moving objects," Proc. of Workshop on Behaviour Monitoring and Interpretation, BMI 2009, vol. 541, pp. 59-64, 2009.
14. M. Höferlin, B. Höferlin, D. Weiskopf and G. Heidemann, "Interactive schematic summaries for exploration of surveillance video," Proc. ACM International Conference on Multimedia Retrieval, ACM ICMR 2011, pp. 9:1-9:8, 2011.
15. M. Höferlin, B. Höferlin, D. Weiskopf, and G. Heidemann, "Evaluation of Fast-Forward Video Visualization," IEEE Trans. Visualization and Computer Graphics, vol. 18, pp. 2095-2103, 2012.
16. M. Höferlin, B. Höferlin, D. Weiskopf and G. Heidemann, "Uncertainty-aware video visual analytics of tracked moving objects," Journal of Spatial Information Science, no. 2, pp. 87-117, 2011.
17. M. Höferlin, B. Höferlin, G. Heidemann and D. Weiskopf "Interactive Schematic Summaries for Faceted Exploration of Surveillance Video," IEEE Trans. Multimedia, vol. 15, no.4, pp. 908-920, 2013.
18. M. Irani, P. Anandan, J. Bergen, R. Kumar and S. Hsu, "Efficient representations of video sequences and their applications," Signal Processing: Image Communication, vol. 8, no. 4, pp. 327-351, 1996. (Pubitemid 126375220)
19. J. Zhong, S. Yuting, R. Qian and M. Jintao "Surveillance video summarization based on moving object detection and trajectory extraction," International Conference on Signal Processing Systems, ICSPS 2010, pp.V2-250-253, 2010.
20. H. Kang, X. Chen, Y. Matsushita and X. Tang, "Space-time video montage," IEEE Conf. on Computer Vision and Pattern Recognition, CVPR2006, vol. 2, pp. 1331-1338, 2006. (Pubitemid 44931475)
21. T. Kapler and W. Wright, "GeoTime Information Visualization," IEEE Symp. Information Visualization, INFOVIS'04, pp. 25-32, 2004. (Pubitemid 40449124)
22. D. Kimber, T. Dunnigan, A. Girgensohn, F. Shipman, T. Turner and T. Yang "Trailblazing: Video playback control by direct object manipulation," IEEE International Conference on Multimedia and Expo, pp. 1015-1018, 2007.
23. K. Kurihara "CinemaGazer: a system for watching videos at very high speed," Proc. of International Working Conference on Advanced Visual Interfaces, pp. 108-115, 2012.
24. F. Li, A. Gupta, E. Sanocki, L. He and Y. Rui, "Browsing digital video," Proc. of SIGCHI conference on Human Factors in Computing Systems. pp. 169-176, 2000.
25. B. Morris and M. Trivedi, "A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance," IEEE Trans. Circuits and Systems for Video Technology, vol. 18, no. 8, pp. 1114-1127, 2008.
26. C. Nguyen, Y. Niu and F. Liu, "Video Summagator: an interface for video summarization and navigation," Proc. of SIGCHI Conference on Human Factors in Computing Systems, pp. 647-650, 2012.
27. N. Papadakis and A. Bugeau, "Tracking with Occlusions via Graph Cuts," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 1, pp.144-157, 2011.
28. C. H. Papadimitriou, and Y. Mihalis, "Shortest paths without a map," Theoretical Computer Science, vol. 84, no. 1, pp. 127-150, 1991.
29. Y. Pritch, A. Rav-Acha, and S. Peleg, "Nonchronological video synopsis and indexing," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 11, pp.1971-1984, 2008.
30. Panasonic video surveillance products, [online] 2013 http://www. panasonic.com/business/psna/products-surveillancemonitoring/index.aspx (Accessed 21 June 2013).
31. K. Sunkavalli, N. Joshi, S. Kang M. Cohen and H. Pfister, "Video Snapshots: Creating High-Quality Images from Video Clips," IEEE Trans. Visualization and Computer Graphics, vol. 18, pp. 1868-1879, 2012.
32. A. Tang, S. Greenberg and S. Fels, "Exploring video streams using slittear visualizations," Extended Abstracts on Human Factors in Computing Systems, pp. 3509-3510, 2009.
33. A. Yilmaz, O. Javed and M. Shah, "Object tracking: A survey", ACM Computing Surveys, vol. 38, no. 14, 2006.