Uncertainty-aware video visual analytics of tracked moving objects

Journal of Spatial Information Science

Volumn 2, Issue 2011, 2011, Pages 87-117

  Höferlin, Markus ^a   Höferlin, Benjamin ^a   Weiskopf, Daniel ^a   Heidemann, Gunther ^a  

^a UNIVERSITY OF STUTTGART   (Germany)

Author keywords

Interactive query; Trajectories; Uncertainty; Video analysis; Video processing; Video surveillance; Video visualization; Visual analytics

Indexed keywords

EID: 79959744061     PISSN: None     EISSN: 1948660X     Source Type: Journal    
DOI: 10.5311/JOSIS.2010.2.1     Document Type: Article

References (64)

1. ANDRIENKO, G., ANDRIENKO, N., AND WROBEL, S. Visual analytics tools for analysis of movement data. ACM SIGKDD Explorations Newsletter 9, 2 (2007), 38-46. doi:10.1145/1345448.1345455.
2. ANDRIENKO, N., ANDRIENKO, G., AND GATALSKY, P. Exploratory spatio-temporal visualization: An analytical review. Journal of Visual Languages and Computing 14, 6 (2003), 503-541. doi:10.1016/S1045-926X(03)00046-6.
3. AUVINET, E., GROSSMANN, E., ROUGIER, C.,DAHMANE, M., AND MEUNIER, J. Leftluggage detection using homographies and simple heuristics. In Proc. 9th IEEE International Workshop on Performance Evaluation in Tracking and Surveillance (PETS'06) (2006), pp. 51-58.
4. BARRON, J., FLEET, D., AND BEAUCHEMIN, S. Performance of optical flow techniques. International Journal of Computer Vision 12, 1 (1994), 43-77. doi:10.1007/BF01420984.
5. BOSCH, H., HEINRICH, J., HÖFERLIN, B., HÖFERLIN, M., KOCH, S., MÜLLER, C., REINA, G., AND WÖRNER, M. Innovative filtering techniques and customized analytics tools. In IEEE Symposiumon Visual Analytics Science and Technology, 2009.VAST'09 (2009), IEEE Computer Society, pp. 269-270. doi:10.1109/VAST.2009.5334300.
6. BOTCHEN, R. P., BACHTHALER, S., SCHICK, F., CHEN, M., MORI, G., WEISKOPF, D., AND ERTL, T. Action-based multifield video visualization. IEEE Transactions on Visualization and Computer Graphics 14, 4 (2008), 885-899. doi:10.1109/TVCG.2008.40.
7. BOUGUET, J. Pyramidal implementation of the Lucas Kanade feature tracker: Description of the algorithm. OpenCV Documentation, Intel Corp., Microprocessor Research Labs (2000).
8. CASPI, Y., AXELROD, A.,MATSUSHITA, Y., AND GAMLIEL, A. Dynamic stills and clip trailers. The Visual Computer 22, 9 (2006), 642-652. doi:10.1007/s00371-006-0046-y.
9. CHEN, M., BOTCHEN, R., HASHIM, R., WEISKOPF, D., ERTL, T., AND THORNTON, I. Visual signatures in video visualization. IEEE Transactions on Visualization and Computer Graphics 12, 5 (2006), 1093-1100. doi:10.1109/TVCG.2006.194.
10. CHENG, K., LUO, S., CHEN, B., AND CHU, H. SmartPlayer: User-centric video fast-forwarding. In Proc. 27th International Conference on Human Factors in Computing Systems (CHI) (2009), ACM New York, NY, USA, pp. 789-798. doi:10.1145/1518701.1518823.
11. CHRISTEL, M. G. Supporting video library exploratory search: When storyboards are not enough. In CIVR '08: Proc. 2008 International Conference on Contentbased Image and Video Retrieval (New York, NY, USA, 2008), ACM, pp. 447-456. doi:10.1145/1386352.1386410.
12. CIPRA, T., AND ROMERA, R. Kalman filter with outliers and missing observations. Test 6, 2 (1997), 379-395. doi:10.1007/BF02564705.
13. CORREA, C., CHAN, Y., AND MA, K. A framework for uncertainty-aware visual analytics. In IEEE Symposium on Visual Analytics Science and Technology, 2009. VAST'09 (2009), IEEE Computer Society, pp. 51-58. doi:10.1109/VAST.2009.5332611.
14. DANIEL, G., AND CHEN, M. Video visualization. In Proc. 14th IEEE Visualization 2003 (VIS'03) (2003), IEEE Computer Society Washington, DC, USA, pp. 409-416. doi:10.1109/VISUAL.2003.1250401.
15. DRAGICEVIC, P., RAMOS, G., BIBLIOWITCZ, J., NOWROUZEZAHRAI, D., BALAKRISHNAN, R., AND SINGH, K. Video browsing by direct manipulation. In Proc. 26th International Conference on Human Factors in Computing Systems (CHI) (Florence, Italy, 2008), ACM, pp. 237-246. doi:10.1145/1357054.1357096.
16. DYKES, J., AND MOUNTAIN, D. Seeking structure in records of spatio-temporal behaviour: Visualization issues, efforts, and applications. Computational Statistics and Data Analysis 43, 4 (2003), 581-603. doi:10.1016/S0167-9473(02)00294-3.
17. ELLIS, G., AND DIX, A. An explorative analysis of user evaluation studies in information visualisation. In Proc. 2006 AVI Workshop on Beyond Time and Errors: Novel Evaluation Methods for Information Visualization (2006), ACM, pp. 15-21. doi:10.1145/1168149.1168152.
18. ENDERT, A., ANDREWS, C., FINK, G. A., AND NORTH, C. Professional analysts using a large, high-resolution display. In IEEE Symposium on Visual Analytics Science and Technology, 2009. VAST'09 (2009), IEEE Computer Society, pp. 273-274. doi:10.1109/VAST.2009.5332485.
19. FERGUSON, P., GURRIN, C., LEE, H., SAV, S., SMEATON, A., O'CONNOR, N., CHOI, Y.-H., AND PARK, H. Enhancing the functionality of interactive TV with contentbased multimedia analysis. In Multimedia, 2009. ISM '09. 11th IEEE International Symposium on (2009), pp. 495-500. doi:10.1109/ISM.2009.70.
20. FISHER, R. The PETS04 surveillance ground-truth data sets. In Proc. 6th IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (2004), IEEE Computer Society, pp. 1-5.
21. GÜTING, R., AND SCHNEIDER, M. Moving objects databases. Morgan Kaufmann, 2005.
22. HÄGERSTRAND, T. What about people in regional science? Papers in Regional Science 24, 1 (1970), 6-21. doi:10.1007/BF01936872.
23. HÖFERLIN, B., HÖFERLIN, M., WEISKOPF, D., AND HEIDEMANN, G. Informationbased adaptive fast-forward for visual surveillance. Multimedia Tools and Applications (2010), in press. doi:10.1007/s11042-010-0606-z.
24. HÖFERLIN, M.,GRUNDY, E., BORGO, R.,WEISKOPF, D., CHEN, M., GRIFFITHS, I.W., AND GRIFFITHS, W. Video visualization for snooker skill training. Computer Graphics Forum 29, 3 (2010), 1053-1062. doi:10.1111/j.1467-8659.2009.01670.x.
25. HÖFERLIN, M., HÖFERLIN, B., AND WEISKOPF, D. Video visual analytics of tracked moving objects. In Proc. 3rdWorkshop on BehaviourMonitoring and Interpretation (2009), vol. 541, Ghent University, Belgium, CEURWorkshop Proceedings, pp. 59-64.
26. HONOVICH, J. Security manager's guide to video surveillance. V3. IPVideoMarket. info. [online, ebook] Available: http://ipvideomarket.info/book, 2009.
27. HORNSBY, K., AND EGENHOFER, M. Modeling moving objects over multiple granularities. Annals of Mathematics and Artificial Intelligence 36, 1 (2002), 177-194. doi:10.1023/A:1015812206586.
28. HUANG, C.-H., SHIH, M.-Y., WU, Y.-T., AND KAO, J.-H. Loitering detection using Bayesian appearance tracker and list of visitors. In Advances in Multimedia Information Processing - PCM 2008, vol. 5353/2008 of Lecture Notes in Computer Science. Springer, 2008, pp. 906-910. doi:10.1007/978-3-540-89796-5_111.
29. JERIAN, M., PAOLINO, S., CERVELLI, F., CARRATO, S., MATTEI, A., AND GAROFANO, L. A forensic image processing environment for investigation of surveillance video. Forensic Science International 167, 2-3 (2007), 207-212. doi:10.1016/j.forsciint.2006.06.048.
30. KEIM, D.,MANSMANN, F., SCHNEIDEWIND, J., THOMAS, J., AND ZIEGLER, H. Visual analytics: Scope and challenges. Lecture Notes In Computer Science 4404 (2008), 76-90. doi:10.1007/978-3-540-71080-6_6.
31. KEIM, D., MANSMANN, F., SCHNEIDEWIND, J., AND ZIEGLER, H. Challenges in visual data analysis. In Proc. 10th International Conference on Information Visualization (2006), IEEE Computer Society, pp. 9-16. doi:10.1109/IV.2006.31.
32. KRAAK, M. The space-time cube revisited from a geovisualization perspective. In Proc. 21st International Cartographic Conference (2003), pp. 1988-1996.
33. KRISTENSSON, P., DAHLBÄCK, N., ANUNDI, D., BJÖRNSTAD, M., GILLBERG, H., HARALDSSON, J., MÅRTENSSON, I., NORDVALL, M., AND STÅHL, J. An evaluation of space time cube representation of spatiotemporal patterns. IEEE Transactions on Visualization and Computer Graphics 15, 4 (2009), 696-702. doi:10.1109/TVCG.2008.194.
34. KUIJPERS, B., AND OTHMAN, W. Trajectory databases: Data models, uncertainty and complete query languages. In Database Theory, ICDT 2007, vol. 4353/2006 of Lecture Notes in Computer Science. Springer, 2009, pp. 224-238. doi:10.1016/j.jcss.2009.10.002.
35. LAUBE, P., DENNIS, T., FORER, P., AND WALKER, M. Movement beyond the snapshot-dynamic analysis of geospatial lifelines. Computers, Environment and Urban Systems 31, 5 (2007), 481-501. doi:10.1016/j.compenvurbsys.2007.08.002.
36. LEO, M., D ORAZIO, T., CAROPPO, A., MARTIRIGGIANO, T., AND SPAGNOLO, P. Automatic monitoring of forbidden areas to prevent illegal accesses. In Pattern Recognition and Image Analysis, vol. 3687/2005 of Lecture Notes in Computer Science. Springer, 2005, pp. 635-643. doi:10.1007/11552499_70.
37. LEYK, S., BOESCH, R., AND WEIBEL, R. A conceptual framework for uncertainty investigation in map-based land cover change modelling. Transactions in GIS 9, 3 (2005), 291-322. doi:10.1111/j.1467-9671.2005.00220.x.
38. LIU, C.-B., AND AHUJA, N. Vision based fire detection. In Proc. 17th International Conference on Pattern Recognition (ICPR'04) Volume 4 (Washington, DC, USA, 2004), IEEE Computer Society, pp. 134-137. doi:10.1109/ICPR.2004.979.
39. MACEACHREN, A., ROBINSON, A., HOPPER, S., GARDNER, S.,MURRAY, R., GAHEGAN, M., AND HETZLER, E. Visualizing geospatial information uncertainty: What we know and what we need to know. Cartography and Geographic Information Science 32, 3 (2005), 139-161. doi:10.1559/1523040054738936.
40. MARK, D., AND EGENHOFER, M. Geospatial lifelines. In Integrating spatial and temporal databases. Dagstuhl Seminar Report (1998), vol. 228.
41. MEYER, S. Data analysis for scientists and engineers. John Wiley&Sons, Inc., 1975. doi:10.1021/ed054pA300.3.
42. MILLER, H. A measurement theory for time geography. Geographical Analysis 37, 1 (2005), 17-45. doi:10.1111/j.1538-4632.2005.00575.x.
43. MITAIM, S., AND KOSKO, B. What is the best shape for a fuzzy set in function approximation? In IEEE International Conference on Fuzzy Systems (1996), IEEE Computer Society, pp. 1237-1243. doi:10.1109/FUZZY.1996.552354.
44. NAISBITT, J. Megatrends: Ten new directions transforming our lives. Warner Books New York, 1982.
45. NILSSON, F. Intelligent network video: Understanding modern video surveillance systems. CRC Press. Taylor&Francis Group, 2009.
46. PANG, A.,WITTENBRINK, C., AND LODHA, S. Approaches to uncertainty visualization. The Visual Computer 13, 8 (1997), 370-390. doi:10.1007/s003710050111.
47. PEKER, K., AND DIVAKARAN, A. Adaptive fast playback-based video skimming using a compressed-domain visual complexity measure. In 2004 IEEE International Conference on Multimedia and Expo, 2004. ICME'04 (2004), vol. 3, pp. 2055-2058.
48. PETROVIC, N., JOJIC, N., AND HUANG, T. Adaptive video fast forward. Multimedia Tools and Applications 26, 3 (2005), 327-344. doi:10.1007/s11042-005-0895-9.
49. PFOSER, D., AND JENSEN, C. Capturing the uncertainty of moving-object representations. In Advances in Spatial Databases, vol. 1651/1999 of Lecture Notes in Computer Science. Springer, 1999, pp. 111-131. doi:10.1007/3-540-48482-5_9.
50. PRITCH, Y., RATOVITCH, S., HENDEL, A., AND PELEG, S. Clustered synopsis of surveillance video. In Proc. 6th IEEE International Conference on Advanced Video and Signal Based Surveillance (2009), IEEE Computer Society, pp. 195-200. doi:10.1109/AVSS.2009.53.
51. SCHOEFFMANN, K., AND BOESZOERMENYI, L. Video browsing using interactive navigation summaries. International Workshop on Content-Based Multimedia Indexing 7 (2009), 243-248. doi:10.1109/CBMI.2009.40.
52. SHI, J., AND TOMASI, C. Good features to track. In Proc. Computer Vision and Pattern Recognition (CVPR '94) (Jun 1994), IEEE Computer Society, pp. 593-600. doi:10.1109/CVPR.1994.323794.
53. SHNEIDERMAN, B. The eyes have it: A task by data type taxonomy for information visualizations. In Proc. IEEE Symposium on Visual Languages (1996), pp. 336-343. doi:/10.1109/VL.1996.545307.
54. SHNEIDERMAN, B., AND PLAISANT, C. Strategies for evaluating information visualization tools: Multi-dimensional in-depth long-term case studies. In Proc. 2006 AVI Workshop on Beyond Time and Errors: Novel Evaluation Methods for Information Visualization (2006), ACM, pp. 1-7. doi:10.1145/1168149.1168158.
55. SILER, W., AND BUCKLEY, J. Fuzzy expert systems and fuzzy reasoning. Wiley-Blackwell, 2005.
56. TAYLOR, B., AND KUYATT, C. Guidelines for evaluating and expressing the uncertainty of nist measurement results. NIST Technical Note 1297, United States Department of Commerce Technology Administration, National Institute of Standards and Technology, 1994.
57. THIRDE, D., LI, L., AND FERRYMAN, F. Overview of the PETS2006 challenge. In Proc. 9th IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS 2006) (2006), IEEE Computer Society, pp. 47-50.
58. THOMAS, J., AND COOK, K. Illuminating the Path: The Research and Development Agenda for Visual Analytics. IEEE Computer Society, 2005.
59. TRAJCEVSKI, G., WOLFSON, O., HINRICHS, K., AND CHAMBERLAIN, S. Managing uncertainty in moving objects databases. ACM Transactions on Database Systems 29, 3(2004), 463-507. doi:10.1145/1016028.1016030.
60. VAST CHALLENGE COMMITTEE. IEEE VAST Challenge 2009. IEEE Symposium on Visual Analytics Science and Technologies (VAST) 2009. [online] Available: http://hcil.cs.umd.edu/localphp/hcil/vast/index.php.
61. WELCH, G., AND BISHOP, G. An introduction to the Kalman filter. Tech. Rep. TR 95-041, Department of Computer Science, University of North Carolina at Chapel Hill, 2004.
62. WOLFSON, O. Moving objects information management: The database challenge (vision paper). In Next Generation Information Technologies and Systems: Proc. 5th International Workshop, vol. 2382/2002 of Lecture Notes in Computer Science. Springer, 2002, pp. 15-26. doi:10.1007/3-540-45431-4_7.
63. WREN, C., AZARBAYEJANI, A., DARRELL, T., AND PENTLAND, A. Pfinder: Realtime tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 7 (1997), 781. doi:10.1109/AFGR.1996.557243.
64. ZADEH, L. Fuzzy sets. Information and Control 8, 3 (1965), 338-353. doi:10.1016/S0019-9958(65)90241-X.