Conceptual representations between video signals and natural language descriptions

Image and Vision Computing

Volumn 26, Issue 1, 2008, Pages 53-66

  Arens, M ^a   Gerber, R ^a   Nagel, H H ^a  

^a UNIVERSITY OF KARLSRUHE   (Germany)

Author keywords

Cognitive vision; Knowledge representation

Indexed keywords

COGNITIVE SYSTEMS; COMPUTER VISION; KNOWLEDGE ACQUISITION; NATURAL LANGUAGE PROCESSING SYSTEMS; TIME VARYING SYSTEMS;

COGNITIVE VISION; CONCEPTUAL DESCRIPTIONS; TRAFFIC SCENES; VISION COMPUTING;

VIDEO SIGNAL PROCESSING;

EID: 35949001271     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2005.07.026     Document Type: Article

References (41)

1. M. Arens, SGTEditor reference manual. Institut für Algorithmen und Kognitive Systeme, Fakultät für Informatik der Universität Karlsruhe (TH), April 2003, Available from: http://cogvisys.iaks.uni-karlsruhe.de/Vid-Text/sgt_editor/
2. M. Arens, Repräsentation und Nutzung von Verhaltenswissen in der Bildfolgenauswertung. Dissertation, Fakultät für Informatik, Universität Karlsruhe (TH). Juli 2004: Dissertationen zur Künstlichen Intelligenz (DISKI) 287; Akademische Verlagsgesellschaft Aka GmbH, Berlin, 2005, (in German).
3. Arens M., and Nagel H.-H. Behavioral knowledge representation for the understanding and creation of video sequences. In: Günter A., Kruse R., and Neumann B. (Eds). Proceedings of the 26th German Conference on Artificial Intelligence (KI-2003), 15-18 September 2003. Hamburg, Germany; Lecture Notes in Artificial Intelligence vol. 2821 (2003), Springer, Berlin 149-163
4. A. Blocher, J.R.J. Schirra, Optional deep case filling and focus control with mental images: ANTLIMA-KOREF, in: C.S. Mellish (Ed.), Proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI-95), 20-25 August, Montréal, Canada 1995, pp. 417-423.
5. Bobick A.F. Video annotation: computers watching video. In: Li S.Z., Mital D.P., Teoh E.K., and Wang H. (Eds). Proceedings of the Second Asian Conference on Computer Vision (ACCV'95), 5-8 December 1995, Singapore. Lecture Notes in Computer Science vol. 1035 (1996), Springer, Berlin 23-31
6. A.F. Bobick, Y.A. Ivanov, Action recognition using probabilistic parsing, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR-98), 23-25 June 1998, Santa Barbara, CA, IEEE Press, New York, 1998, pp. 196-202.
7. Bobick A.F., Intille S.S., Davis J.W., Baird F., Campbell L.W., Ivanov Y.A., Pinhanez C.S., Schütte A., and Wilson A. The kidsroom: a perceptually based interactive and immersive story environment. Presence Teleoperators and Virtual Environments 8 4 (1999) 369-393
8. Bobick A.F., Intille S.S., Davis J.W., Baird F., Pinhanez C.S., Campbell L.W., Ivanov Y.A., Schütte A., and Wilson A. Perceptual user interfaces: the kidsroom. Communications of the ACM 43 3 (2000) 60-61
9. M. Brand, N. Oliver, A. Pentland, Coupled hidden markov models for complex action recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR-97), 17-19 June 1997, San Juan, Puerto Rico, IEEE Press, New York, 1997, pp. 994-999.
10. Brémond F., and Thonnat M. Issues of representing context illustrated by video-surveillance applications. International Journal of Human-Computer Studies 48 3 (1998) 375-391
11. Buxton H. Learning and understanding dynamic scene activity: a review. Image and Vision Computing 21 1 (2003) 125-136
12. H. Buxton, R.J. Howarth, Behavioural descriptions from image sequences, in: Proceedings of the Workshop on Integration of Natural and Vision Processing Language, August 1994, AAAI Press, New York, 1994, pp. 231-239.
13. Buxton H., and Gong S. Visual surveillance in a dynamic and uncertain world. Artificial Intelligence 78 1-2 (1995) 431-459
14. Fernyhough J., Cohn A.G., and Hogg D.C. Constructing qualitative event models automatically from video input. Image and Vision Computing 18 2 (2000) 81-104
15. Galata A., Johnson N., and Hogg: D.C. Learning variable length markov models of behaviour. Computer Vision and Image Understanding 81 3 (2001) 113-398
16. Galata A., Cohn A.G., Magee D.R., and Hogg D.C. Modelling interaction using learnt qualitative spatio-temporal relations and variable length markov models. In: van Harmelen F. (Ed). Proceedings of the 15th European Conference on Artificial Intelligence (ECAI-2002), 21-26 July 2002, Lyon, France (2002), IOS Press, Amsterdam 741-745
17. R. Gerber, Natürlichsprachliche Beschreibung von Straßenverkehrsszenen durch Bildfolgenauswertung. Dissertation, Fakultät für Informatik der Universität Karlsruhe (TH), Karlsruhe, January 2000, (in German). Electronically Available from: http://www.ubka.uni-karlsruhe.de/cgi-bin/psview?document = 2000/informatik/8
18. R. Gerber, H.-H. Nagel, Occurrence extraction from image sequences of road traffic scenes, in: L. van Gool, B. Schiele (Eds.), Proceedings of the Workshop on Cognitive Vision, 19-20 September 2002, ETH Zurich, Switzerland, pp. 1-8, Available from: http://www.vision.ethz.ch/cogvis02/finalpapers/gerber.pdf
19. Gerber R., Nagel H.-H., and Schreiber H. Deriving textual descriptions of road traffic queues from video sequences. In: van Harmelen F. (Ed). Proceedings of the 15th European Conference on Artificial Intelligence (ECAI-2002), 21-26 July 2002, Lyon, France (2002), IOS Press, Amsterdam 736-740
20. Haag M., and Nagel H. Incremental recognition of traffic situations from video image sequences. Image and Vision Computing 18 2 (2000) 137-153
21. Hazarika S.M., and Cohn A.G. Abducing qualitative spatio-temporal histories from partial observations. In: Fensel D., Giunchiglia F., McGuinness D.L., and Williams M.-A. (Eds). Proceedings of the eigth International Conference on Knowledge Representation and Reasoning, 22-25 April 2002, Toulouse, France (2002), Morgan Kaufmann, San Mateo, CA 14-25
22. Howarth R.J. Interpreting a dynamic and uncertain world: task-based control. Artificial Intelligence 100 1-2 (1998) 5-85
23. Howarth R.J., and Buxton H. Conceptual descriptions from monitoring and watching image sequences. Image and Vision Computing 18 2 (2000) 105-135
24. S.S. Intille, A.F. Bobick, Visual recognition of multi-agent action using binary temporal relations, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR-99), 23-25 June 1999, Ft Collins, CO. IEEE Press, New York, 1999, pp. 1056-1062.
25. S.S. Intille, A.F. Bobick, A framework for recognizing multi-agent action from visual evidence, in: Proceedings of the 16th National Conference on Artificial Intelligence (AAAI-99), 18-22 July 1999, Orlando, FL, MIT Press, Cambridge, MA, 1999, pp. 518-525.
26. Intille S.S., and Bobick A.F. Recognizing planned, multiperson action. Computer Vision and Image Understanding 81 3 (2001) 414-445
27. N. Johnson, D.C. Hogg, The acquisition and use of interaction behaviour models, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR-98), 23-25 June 1998, Santa Barbara, CA, IEEE Press, New York, 1998, pp. 866-871.
28. Kamp H., and Reyle U. From Discourse to Logic (1993), Kluwer, Dordrecht The Netherlands
29. Moënne-Loccoz N., Brémond F., and Thonnat M. Recurrent bayesian network for the recognition of human behaviors from video. In: Crowley J.L., Piater J.H., Vincze M., and Paletta L. (Eds). Proceedings of the third International Conference on Computer Vision Systems (ICVS-2003), 1-3 April 2003, Graz, Austria. Lecture Notes in Computer Science vol. 2626 (2003), Springer, Berlin 68-77
30. Nagel H.-H. From images sequences towards conceptual descriptions. Image and Vision Computing 6 2 (1988) 59-74
31. H.-H. Nagel, T. Schwarz, H. Leuck, M. Haag, Tracking turning trucks with trailers, in: S. Maybank, T. Tan (Eds.), Proceedings of the IEEE Workshop on Visual Surveillance, 2 January, Bombay, India 1998, pp. 65-72.
32. N. Oliver, A. Pentland, Graphical models for driver behavior recognition in a smartcar, in: Proceedings of the IEEE Intelligent Vehicles Symposium (IV-2000), Detroit, MI, USA, IEEE Press, New York, 3-5 October 2000, pp. 7-12.
33. A. Ottlik, H.-H. Nagel, On consistent discrimination between directed and diffuse outdoor illumination, in: Proceedings of the 25th DAGM-Symposium (DAGM-2003), 10-12 September 2003, Magdeburg, Germany, Lecture Notes in Computer Science, vol. 2781, Springer, Berlin, 2003, pp. 418-425.
34. C.S. Pinhanez, A.F. Bobick, Approximate world models: incorporating qualitative and linguistic information into vision systems, in: Proceedings of the 13th National Conference on Artificial Intelligence (AAAI-96), 4-8 August 1996, Portland, OR, MIT Press, Cambridge, MA, 1996, pp. 1116-1123.
35. B. Rosario, N. Oliver, A. Pentland, A synthetic agent system for bayesian modeling human interactions, in: Proceedings of the third Annual Conference on Autonomous Agents (AGENTS-99), 1-5 May 1999, Seattle, WA, ACM Press, New York, 1999, pp. 342-343.
36. Rota N., and Thonnat M. Activity recognition from video sequences using declarative models. In: Horn W. (Ed). Proceedings of the 14th European Conference on Artificial Intelligence (ECAI-2000), 20-25 August 2000, Berlin, Germany (2000), IOS Press, Amsterdam 673-677
37. K.H. Schäfer, Unscharfe zeitlogische modellierung von situationen und handlungen in der bildfolgenauswertung und robotik. dissertation, Fakultät für Informatik der Universität Karlsruhe (TH), Karlsruhe, Juli 1996; Dissertationen zur Künstlichen Intelligenz (DISKI), vol. 135, infix-Verlag Sankt Augustin, 1996, (in German).
38. J.R.J. Schirra, Bildbeschreibung als Verbindung von visuellem und sprachlichem Raum. Dissertation, Fakultät für Informatik der Universität des Saarlandes, Saarbrücken, April 1994, Dissertationen zur Künstlichen Intelligenz (DISK1) 71; infix-Verlag: Sankt Augustin, 1994, (in German).
39. V.T. Vu, F. Brémond, M. Thonnat, Human behaviour visualisation and simulation for automatic video understanding, in: Proceedings of the 10th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG-2002), Plzen-Bory, Czech Republic, 2002, pp. 485-492.
40. V.T. Vu, F. Brémond, M. Thonnat, Temporal constraints for video interpretation, in: T. Walsh (Ed.): Proceedings of the ECAI-2002 Workshop on Modelling and Solving Problems with Constraints, Lyon, France, 23 July 2002, Available from: http://www-users.cs.york.ac.uk/~tw/ecai02/
41. Vu V.T., Brémond F., and Thonnat M. Automatic video interpretation: a recognition algorithm for temporal scenarios based on pre-compiled scenario models. In: Crowley J.L., Piater J.H., Vincze M., and Paletta L. (Eds). Proceedings of the third International Conference on Computer Vision Systems (ICVS-2003), 1-3 April 2003, Graz, Austria. Lecture Notes in Computer Science vol. 2626 (2003), Springer, Berlin 523-533