On the correspondence between objects and events for the diagnosis of situations in visual surveillance tasks

Pattern Recognition Letters

Volumn 29, Issue 8, 2008, Pages 1117-1135

  Martinez Tomas R ^a   Rincon M ^a   Bachiller, M ^a   Mira, J ^a  

^a UNIVERSIDAD NACIONAL DE EDUCACIÓN A DISTANCIA   (Spain)

Author keywords

Description levels; Image understanding; Predictive diagnosis task; Semantic gap; Visual surveillance ontology; Visual surveillance systems

Indexed keywords

ARTIFICIAL INTELLIGENCE; IMAGE UNDERSTANDING; ONTOLOGY; SEMANTICS;

DESCRIPTION LEVELS; PREDICTIVE DIAGNOSIS TASK; SEMANTIC GAP; VISUAL SURVEILLANCE ONTOLOGY; VISUAL SURVEILLANCE SYSTEMS;

OBJECT RECOGNITION;

EID: 42049107995     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2007.10.020     Document Type: Article

References (60)

1. Allen J.F. Towards a general theory of action and time. Artificial Intell. 23 (1984) 123-154
2. Arbib M.A. Schema theory: From Kant to McCulloch and beyond. In: Moreno-Díaz R., and Mira-Mira J. (Eds). Brain Processes, Theories and Models: An International Conference in Honor of W.S. McCulloch. 25 Years after His Death (1996), The MIT Press 11-23
3. André E., Herzog G., and Rist T. On the simultaneous interpretation of real world image sequences and their natural language description: The system soccer. In: Yves K. (Ed). Proc. 8th European Conf. of Artificial Intelligence (1988), John Wiley and Sons, Munich 449-454
4. Arens, M., Gerber, R., Nagel, H.H., 2006. Conceptual representations between video signals and natural language descriptions, Image and Vision Comput., Corrected Proof. Available online 24 April 2006.
5. Bobick, A., 1997. Movement, activity, and action: The role of knowledge in the perception of motion. Royal Society Workshop on Knowledge-based Vision in Man and Machine, London. pp. 1257-1265.
6. Brémond F., and Medioni G. Scenario recognition in airborne video imagery. CVPR'98 Workshop on Interpretation of Visual Motion (1998), IEEE Computer Society. 0-8186-8497-6 211-216
7. Brémond, F., Maillot, N., Thonnat, M., Vu, V., 2004. Ontologies for video events. Rapport de recherché l'INRIA RR-5189.
8. Brooks R.A. Intelligence without representation. Artificial Intell. J. 47 (1991) 139-159
9. Buxton H., and Gong S. Advanced visual surveillance using bayesian networks. Proceedings of the Fifth International Conference on Computer Vision (ICCV 95), Massachusetts Institute of Technology, Cambridge, Massachusetts, USA, June 20-23 (1995), IEEE Computer Society 111-123
10. Carmona, E.J., Martínez-Cantos, J., Mira. J., 2007. A new video segmentation method of moving objects based on blob-level knowledge. Pattern Recognition Lett. in press, doi:10.1016/j.patrec.2007.10.007.
11. Castel, C., Chaudron, L., Tessier, C. 1996. What is going on? A high level interpretation of sequences of images. In: Proc. of the Workshop on Conceptual Descriptions from Images (ECCV, 96). Cambridge, UK, pp. 13-27.
12. Chaudron L., Cossart C., Maille N., and Tessier C. A purely symbolic model for dynamic scene interpretation. Internat. J. Artificial Intell. Tools 6 4 (1997) 635-664
13. Chellappa R., and Kashyap R.L. Image understanding. In: Shapiro S.C. (Ed). Encyclopedia of Artificial Intelligence. second ed. vol. 1 (1992), John Wiley & Sons 641-663
14. Christensen, H.I., Matas, J., Kittler, J., 1996. Using grammars for scene interpretation. In: IEEE Internat. Conf. on Image Processing (ICIP'96), Laussane, 1996, pp. 793-796.
15. Chleq, N., Thonnat, M., 1996. Realtime image sequence interpretation for video-surveillance applications. In: IEEE Internat. Conf. on Image Processing (ICIP'96), Laussane, pp. 800-804.
16. Clancey W.J. Situated Cognition: On Human Knowledge and Computer Representations (1997), Cambridge University Press
17. Cohen, I., Medioni, G., 1999. Detecting and tracking moving objects for video surveillance. In: IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'99), Fort Collings, Colorado, June 23-25, 1999, vol. 2, pp. 325-331.
18. Dousson, C., Gaborit, P., Ghalab, M., 1993. Situation recognition: Representation and algorithms. In: Proc. of the 13th Internat. Joint Conf. on Artificial Intell. (IJCAI), Chambéry, France, August 1993, pp. 166-172.
19. Fernyhough J., Cohn A.G., and Hogg D. Building Qualitative Event Models Automatically from visual input. IEEE Internat. Conf. on on Computer Vision (ICCV'98) (1998), IEEE Computer Society 350-355
20. Folgado, E., Rincón, M., Carmona, E.J., Bachiller, M., 2007. A block-based model for monitoring of human activity. Technical Report AVISA-12-07.
21. Forsth D., and Ponce J. Computer Vision: A Modern Approach (2001), Prentice Hall
22. Francois A.R.J., Nevatia R., Hobbs J., and Bolles R.C. VERL: An ontology framework for representing and annotating video events. IEEE Multimedia Magazine October-December (2005) 76-86
23. Gibson J.J. The Ecological Approach to Visual Perception (1979), Houghton Miffin, Boston
24. Haag M., and Nagel H.H. Incremental recognition of traffic situations from video images sequences. Image Vision Comput. 18 (2000) 137-153
25. Herzog, G., 1992. Utilizing interval-based event representations for incremental high-level scene analysis. In: Aurnague, M., Borillo, A., Borillo, M., Bras, M. (Eds.), Proc. of the 4th International Workshop on Semantics of Time, Space, and Movement and SpatioTemporal Reasoning. Chateau de Bonas, France, pp. 425-435.
26. Hongeng S., and Nevatia R. Large-scale event detection using semi-hidden Markov models. IEEE Internat. Conf. on Computer Vision (ICCV'03), Nice, France (2003), IEEE Computer Society 1455-1462
27. Hongeng S., Nevatia R., and Brémond F. Video-based event recognition: Activity representation and probabilistic recognition methods. Computer Vision and Image Understanding 96 (2004) 129-162
28. Howarth R.J. Interpreting a dynamic and uncertain world - task-based control. Artificial Intell. 100 1-2 (1998) 5-85
29. Howarth R.J., and Buxton H. Conceptual descriptions from monitoring and watching image sequences. Image Vision Comput. 18 (2000) 105-135
30. Huang T.S. Visual motion analysis. In: Shapiro S.C. (Ed). Encyclopedia of Artificial Intelligence. second ed. (1992), John Wiley & Sons 1638-1655
31. Intille, S., Bobick, A., 1999. Visual recognition of multi-agent action using binary temporal relations. In: IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'99), Fort Collings, Colorado, pp. 56-62.
32. Ivanov, Y., Stauffer, C., Bobick, A., Grimson, W.E.L., 1999. Video surveillance of interactions. In: IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'99) - 2nd Internat. Workshop on Visual Surveillance. Fort Collings, Colorado, pp. 82-89.
33. Ivanov Y., and Bobick A. Recognition of visual activities and interactions by stochastic parsing. IEEE Trans. on Pattern Anal. Machine Intell. 22 8 (2000) 852-872
34. Kant, I., 1929. Critique of Pure Reason (Translation by N.K. Smith of Kritik der reinen Vernunft, Riga: J.F. Hartknoch, 1781 and 1787).
35. Kittler J., Matas J., Bober J.M., and Nguyen L. Image interpretation: Exploiting multiple cues. Internat. Conf. on Image Processing and Applications (1995), IEEE Computer Society, Edinburgh 1-5
36. Lettvin J.Y., Maturana H.R., McCulloch W.S., and Pitts W. What frog's eye tells the frog's brain. Proc. IRE 47 11 (1959) 1940-1959
37. Levine M.D., Nobel P.B., and Youssef Y.M. A rule-based system for characterizing blood cell motion. In: Huang T.S. (Ed). Image Sequence Processing and Dynamic Scene Analysis (1983), Springer-Verlag, Heidelberg, Germany
38. Mann, R., Jepson, A., Siskind, J.M., 1997. The computational perception of scene dynamics. Computer Vision and Image Understanding, 65(2), 113-128.
39. Marr D. Vision (1982), W.H. Freeman and Company, New York
40. Maturana H.R., and Varela F.J. The Tree of Knowledge: The Biological Roots of Human Understanding (1987), New Science Library (Shambhala), Boston
41. Medioni G., Cohen I., Brémond F., Hongeng S., and Nevatia R. Event detection and analysis from video streams. IEEE Trans. Pattern Anal. Machine Intell. 23 8 (2001) 873-889
42. Mira, J., 2004. Memoria del proyecto TIN2004-07661-C0201, AVISA: Diseño e implementación de un conjunto de agentes de diagnóstico, planificación y control, con capacidad de aprendizaje y cooperación con humanos en tareas de vigilancia. UNED.
43. Mira J., Martínez-Tomás R., Rincón M., Bachiller M., and Fernández-Caballero A. Towards a semi-automatic situation diagnosis system in surveillance tasks based. In: Mira J., and Álvarez J.R. (Eds). Nature Inspited Problem-Solving Methods in Knowledge Engineering (IWINAC- 2007), LNCS-4528 (2007), Springer-Verlag 90-98
44. Moeller R., Neumann B., and Wessel M. Towards computer vision with description logics: Some recent progress. Proc. Speech and Image Understanding (1999), IEEE Computer Society 101-116
45. Nagel H.H. From imagine sequences towards conceptual descriptions. Image. Vision Comput. 6 2 (1988) 59-74
46. Natarajan P., and Nevatia R. Coupled hidden semi Markov models for activity recognition. Workshop on Motion and Video Computing (2007), IEEE Computer Society 10-17
47. Neumann B., and Novak H. Events models for recognition and natural language description of events in real-world image sequences. Proceedings of the Eighth IJCAI, Karlsruhe (1983), Morgan Kaufmann, San Mateo, CA 724-726
48. Neumann, B., 1984. Natural language description of time-varying scenes. Brericht no. 105, FBI-HH-B-105/84, Fachberic Informatik, University of Hamburg.
49. Piaget J. Biology and Knowledge (1971), Edinburgh University Press, Edinburgh
50. Pinhanez, C.S., Bobick, A.F., 1997. PNF propagation and the detection of actions described by temporal intervals. In: DARPA Image Understanding Workshop, New Orleans, Lousiana, pp. 227-234.
51. Pitts W., and McCulloch W.S. How we know universals: The perception of auditory and visual forms. Bulletin of Mathematical Biophysics 9 (1947), Chicago University Press 127-147
52. Rincón, M., Carmona, E.J., Bachiller, M., Folgado, E., 2007. Segmentation of moving objects with information feedback between description levels. In: Mira, J., Álvarez, J.R. (Eds.), IWINAC 2007, Part II, LNCS 4528, pp. 171-181.
53. Rota, N.A., Thonnat, M., 2000a. Activity recognition from video sequences using declarative models. In: European Conf. of Artificial Intell. (ECAI'00), pp. 673-680.
54. Rota, N.A., Thonnat, M., 2000b. Video sequence interpretation for visual surveillance. In: IEEE Internat. Workshop on Visual Surveillance (VS'00). Dublin, Ireland, pp. 59-68.
55. Shanahan M. The Event Calculus explained (1999), Springer Verlag LNAI 1600, pp. 409-430
56. Schreiber G., Akkermans H., Anjewierden A., de Hoog R., Shadbolt N., Van de Velde W., and Wielinga B. Knowledge Engineering and Management: The Common KADS Methodology (1999), MIT Press, Cambridge, MA
57. Siskind J.M. Reconstructing force-dynamic models from video sequences. Artificial Intell. 151 (2003) 91-154
58. Town C.P. Ontological inference for image and video analysis. Internat. J. Machine Vision Appl. 17 2 (2006) 94-115
59. Tostsos J.K., Mylopoulos J., Corvey H.D., and Zucker S.W. A framework for visual motion understanding. IEEE Trans. PAMI 2 6 (1980) 563-573
60. In: Weiss G. (Ed). Multiagent Systems. A Modern Approach to Distributed Artificial Intelligence (2000), The MIT Press