Interpreting a dynamic and uncertain world: Task-based control

Artificial Intelligence

Volumn 100, Issue 1-2, 1998, Pages 5-85

  Howarth, Richard J ^a  

^a UNIVERSITY OF SUSSEX   (United Kingdom)

Author keywords

Attention; Event reasoning; High level computer vision; Surveillance; Visual behaviour

Indexed keywords

ARTIFICIAL INTELLIGENCE; CAMERAS; DATA STRUCTURES; KNOWLEDGE REPRESENTATION;

BAYESIAN NETWORK; HIGH LEVEL COMPUTER VISION;

COMPUTER VISION;

EID: 0032049894     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0004-3702(98)00004-6     Document Type: Article

References (117)

1. P.E. Agre, The dynamic structure of everyday life, Ph.D. Thesis, MIT AI Lab., AI-TR 1085, Cambridge, MA, 1988.
2. P.E. Agre, D. Chapman, Pengi: an implementation of a theory of activity, in: Proceedings AAAI-87, Seattle, WA, 1987, pp. 268-272.
3. J.F. Allen, Towards a general theory of action and time, Artificial Intelligence 23 (1984) 123-154.
4. J.F. Allen, H.A. Kautz, R.N. Pelavin, J.D. Tenenberg, Reasoning about Plans, Morgan Kaufman, Los Altos, CA, 1991.
5. A. Allport, Visual attention, in: M.I. Posner (Ed.), Foundations of Cognitive Science, MIT Press, Cambridge, MA, 1989, pp. 631-682.
6. D.H. Ballard, Animate vision, Artificial Intelligence 48 (1991) 57-86.
7. D.H. Ballard, C.M. Brown, Computer Vision, Prentice-Hall, Englewood Cliffs, NJ, 1982.
8. D.H. Ballard, M.M. Hayhoe, Feng Li, S.D. Whitehead, Hand-eye coordination during sequential tasks, in: G.A. Horridge, H.B. Barlow, J.P. Frisby, M.A. Jeeves (Eds.), Natural and Artificial Low-level Seeing Systems (Special Issue), Philos. Trans. Roy. Soc. London Ser. B: Biological Sci. 337 (1992) 331-339.
9. S. Baluja, D.A. Pomerleau, Using the representation in a neural network's hidden layer for task-specific focus of attention, in: Proceedings IJCAI-95, Montréal, Que., 1995, pp. 133-139.
10. A. Baumberg, D. Hogg, Learning flexible models from image sequences, in: J.-O. Eklundh (Ed.), Proceedings 3rd ECCV Conference, Stockholm, Sweden, Vol. I, Lecture Notes in Computer Science, Vol. 800, Springer, Berlin, 1994, pp. 299-308.
11. D.C. Beardslee, M. Wertheimer, Readings in Perception, Van Nostrand, New York, 1958.
12. R. Bird, P. Wadler, Introduction to Functional Programming, Prentice-Hall, Englewood Cliffs, NJ, 1988.
13. S.S. Blackman, Multiple-Target Tracking with Radar Applications, Artech House, 1986.
14. R.D. Boyle, R.C. Thomas, Computer Vision: A First Course, Blackwell, Oxford, 1988.
15. J.S. Breese, Construction of belief and decision networks, Comput. Intell. 8 (4) (1992) 624-647.
16. R.A. Brooks, A robust layered control system for a mobile robot, IEEE J.. Robotics and Automation 2 (1) (1986) 14-23.
17. R.A. Brooks, Intelligence without reason, in: Proceedings IJCAI-91, Sydney, Australia, 1991, pp. 569-595.
18. K. Bühler, The deictic field of language and deictic words, in: R.J. Jarvella, W. Klein (Eds.), Speech, Place, and Action: Studies in Deixis and Related Topics John Wiley and Sons, New York, 1982, pp. 9-30 (abridged translation of: Sprachtheorie, Fischer, Jena, 1934).
19. H. Buxton, D.R. Corrall, R. Godden, R. Howarth, Z. Hussain, M. Popovich, C.K. Sung, J. Thoméré, A.F. Toal, G. Sullivan, A. Worrall, VIEWS: Visual Inspection and Evaluation of Wide-area Scenes, in: IJCAI-91 Videotape Program, Morgan Kaufmann, Los Altos, CA, 1991 (ISBN 155860-183-X).
20. H. Buxton, S.G. Gong, Visual surveillance in a dynamic and uncertain world, Artificial Intelligence 78 (1995) 371-405.
21. S. Cameron, Collision detection by four dimensional intersection testing, IEEE Trans. Robotics and Automation 6 (3) (1990) 291-302.
22. K.-C. Chang, R. Fung, Refinement and coarsening of Bayesian networks, in: P.P. Bonissone, M. Henrion, L.N. Kanal, J.F. Lemmer (Eds.), Uncertainty in Artificial Intelligence, Vol. 6 North-Holland, Amsterdam, 1991, pp. 435-445.
23. D. Chapman, Planning for conjunctive goals, Artificial Intelligence 32 (1987) 333-377.
24. D. Chapman, Penguins can make cake, AI Magazine 10 (4) (1989) 45-50.
25. D. Chapman, Vision, Instruction and Action, MIT Press, Cambridge, MA, 1991.
26. E. Charniak, R.P. Goldman, A probabilistic model of plan recognition, in: Proceedings AAAI-91, Anaheim, CA, 1991, pp. 160-165.
27. A.N. Clark, Pattern recognition of noisy sequences of behavioural events using functional combinators, Comput. J. 37 (1994) 385-398.
28. D.R. Corrall, A.N. Clark, A.G. Hill, Airside ground movements surveillance, in: NATO AGARD Symposium on Machine Intelligence in Air Traffic Management, Berlin, Germany, 1993, pp. 29:1-29:13.
29. D.R. Corrall, A.G. Hill, Visual surveillance, GEC Review 8 (1992) 15-27.
30. P. Dagum, A. Galper, E. Horvitz, Dynamic network models for forecasting, in: Uncertainty in Artificial Intelligence, Vol. 8, Morgan Kaufman, Los Altos, CA, 1992, pp. 41-48.
31. T. Dean, T. Camus, J. Kirman, Sequential decision making for active perception, in: Proceedings Image Understanding Workshop, Pittsburgh, PA, 1990, pp. 889-894.
32. T.L. Dean, D.V. McDermott, Temporal data base management, Artificial Intelligence 32 (1987) 1-55.
33. Li Du, G.D. Sullivan, K.B. Baker, Quantitative analysis of the viewpoint consistency constraint in model-based vision, in: Proceedings 4th International Conference on Computer Vision, Berlin, Germany, 1993, pp. 632-639.
34. M.A. Fischler, O. Firschein (Eds.), Readings in Computer Vision: Issues, Problems, Principles, and Paradigms, Morgan Kaufman, Los Altos, CA, 1987.
35. M.M. Fleck, Boundaries and topological algorithms, Ph.D. Thesis, MIT AI Lab., AI-TR 1065, Cambridge, MA, 1988.
36. M.M. Fleck, Representing space for practical reasoning, Image and Vision Computing 6 (2) (1988) 75-86.
37. M.M. Fleck, The topology of boundaries, Artificial Intelligence 80 (1996) 1-27.
38. J.A. Fodor, The Modularity of Mind: An Essay on Faculty Psychology, Press, Cambridge, MA, 1983.
39. R.A. Frost, Constructing programs as executable attribute grammars, Comput. J. 35 (4) (1992) 376-387.
40. K.S. Fu, Syntactic Methods in Pattern Recognition, Academic Press, New York, 1974.
41. H. Garfinkel, Studies in Ethnomethodology, Prentice-Hall, Englewood Cliffs, NJ, 1967.
42. E. Geake, Camera keeps an eye on airport vehicles, New Scientist 136 (1850) (1992) 21.
43. J.J. Gibson, The Ecological Approach to Visual Perception, Houghton Mifflin, Boston, MA, 1979.
44. J.J. Gibson, L.E. Crooks, A theoretical field-analysis of automobile-driving, in: E. Reed, R. Jones (Eds.), Reasons for Realism: Selected Essays of James J. Gibson, Lawrence Erlbaum Associates, London, 1982, pp. 119-136; also in: Amer. J. Psychology 51 (1938) 453-471.
45. J.J. Gibson, L.E. Crooks, A theoretical field-analysis of automobile-driving, in: E. Reed, R. Jones (Eds.), Reasons for Realism: Selected Essays of James J. Gibson, Lawrence Erlbaum Associates, London, 1982, pp. 119-136; also in: Amer. J. Psychology 51 (1938) 453-471.
46. S.G. Gong, H. Buxton, Bayesian nets for mapping contextual knowledge to computational constraints in motion segmentation and tracking, in: Proceedings 4th British Machine Vision Conference, Guildford, Surrey, UK, BMVA Press, 1993, pp. 229-238.
47. I.E. Gordon, Theories of Visual Perception, John Wiley and Sons, New York, 1989.
48. S. Hanks, D. McDermott, Modeling a dynamic and uncertain world I: symbolic and probabilistic reasoning about change, Artificial Intelligence 66 (1) (1994) 1-55.
49. P. Hayes, The second naive physics manifesto, in: J.R. Hobbs, R.C. Moore (Eds.), Formal Theories of the Commonsense World, Ablex, Norwood, NJ, 1985, pp. 1-36.
50. J. Heritage, Garfinkel and Ethnomethodology, Polity Press, Cambridge, UK, 1984.
51. A. Herskovits, Language and Spatial Cognition: An Interdisciplinary Study of the Prepositions in English, Cambridge University Press, Cambridge, UK, 1986.
52. B.K.P. Horn, Robot Vision, MIT Press, Cambridge, MA, 1986.
53. I. Horswill, Visual routines and visual search: a real-time implementation and an automata-theoretic analysis, in: Proceedings IJCAI-95, Montréal, Que., 1995, pp. 56-62.
54. R.J. Howarth, MACNET: a language for situated AI systems, Technical Report 684, Queen Mary and Westfield College, London, 1994.
55. R.J. Howarth, Spatial representation, reasoning and control for a surveillance system, Ph.D. Thesis, Queen Mary and Westfield College, University of London, 1994.
56. R.J. Howarth, Interpreting a dynamic and uncertain world: high-level vision, Artificial Intelligence Review 9 (1) (1995) 37-63.
57. R.J. Howarth, H. Buxton, An analogical representation of space and time, Image and Vision Computing 10 (7) (1992) 467-478.
58. R.J. Howarth, H. Buxton, Analogical representation of spatial events for understanding traffic behaviour, in: B. Neumann (Ed.), Proceedings ECAI-92, Vienna, Austria, John Wiley and Sons, New York, 1992, pp. 785-789.
59. R.J. Howarth, H. Buxton, Selective attention in dynamic vision, in: Proceedings IJCAI-93, Chambéry, France, 1993, pp. 1579-1584.
60. R.J. Howarth, H. Buxton, Visual surveillance monitoring and watching, in: B. Buxton, R. Cipolla (Eds.), Proceedings 4th European Conference on Computer Vision, Cambridge, UK, Vol. II, Lecture Notes in Computer Science, Vol. 1065, Springer, Berlin, 1996, pp. 321-334.
61. R.J. Howarth, H. Buxton, Attentional control for visual surveillance, in: S. Maybank, T. Tan (Eds.), IEEE Workshop on Visual Surveillance, Bombay, India, IEEE Press, New York, 1998, pp. 86-93 (held at ICCV-98).
62. E. Hutchins, Understanding Micronesian navigation, in: G. Dedre, A.L. Stevens (Eds.), Mental Models, Lawrence Erlbaum Associates, London, 1983, pp. 191-225.
63. U. Kiaerulff, A computational scheme for reasoning in dynamic probabilistic networks, in: Uncertainty in Artificial Intelligence, Vol. 8, Morgan Kaufman, Los Altos, CA, 1992, pp. 121-129.
64. J.H. Kim, J. Pearl, A computational model for causal and diagnostic reasoning in inference systems, in: Proceedings IJCAI-83, Karlsruhe, Germany, 1983, pp. 190-193.
65. S. King, S. Motet, J. Thoméré, F. Arlabosse, A visual surveillance system for incident detection, in: 1993 AAAI Workshop on AI in Intelligent Vehicle Highway Systems, AAAI Press, Menlo Park, CA, 1994, pp. 30-36.
66. C. Koch, S. Ullman, Shifts in selective visual attention: towards the underlying neural circuity, Human Neurobiology 4 (1985) 219-227.
67. J.J. Koenderink, Solid Shape, MIT Press, Cambridge, MA, 1990.
68. S.M. Kosslyn, R.A. Flynn, J.B. Amsterdam, G. Wang, Components of high-level vision: a cognitive neuroscience analysis and accounts of neurological syndromes, Cognition 34 (1990) 203-277.
69. D.L. LaBerge, Attention, Psychological Sci. 1 (3) (1990) 156-162.
70. J.-C. Latombe, Robot Motion Planning, Kluwer Academic Publishers, Dordrecht, 1991.
71. A.K. Mackworth, Quick and clean: constraint-based vision for situated robots, in: Proceedings IEEE International Conference on Image Processing, Lausanne, Switzerland, Vol. II, IEEE Press, New York, 1996, pp. 789-791.
72. J.V. Mahoney, S. Ullman, Image chunking defining spatial building blocks for scene analysis, in: Z.W. Pylyshyn (Ed.), Computational Processes in Human Vision: An Interdisciplinary Perspective, Ablex, Norwood, NJ, 1988, pp. 169-209.
73. D. Marr, Vision, W.H. Freeman and Company, New York, 1982.
74. R.F. Marslin, G.D. Sullivan, K.B. Baker, Kalman filters in constrained model-based tracking, in: P. Mowforth (Ed.), British Machine Vision Conference 1991, Glasgow, UK, Springer, Berlin, 1991, pp. 371-374.
75. D. McDermott, A temporal logic for reasoning about processes and plans, Cognitive Sci. 6 (1982) 101-155.
76. G.A. Miller, The magic number seven, plus or minus two: some limits on our capacity for processing information, Psychological Review 63 (1956) 81-97; also in: D.C. Beardslee, M. Wertheimer, Readings in Perception, Van Nostrand, New York, 1958, pp. 90-114.
77. G.A. Miller, The magic number seven, plus or minus two: some limits on our capacity for processing information, Psychological Review 63 (1956) 81-97; also in: D.C. Beardslee, M. Wertheimer, Readings in Perception, Van Nostrand, New York, 1958, pp. 90-114.
78. M.C. Mozer, The Perception of Multiple Objects: A Connectionist Approach, MIT Press, Cambridge, MA, 1991.
79. D.W. Murray, K.J. Bradshaw, P.F. McLauchlan, I.D. Reid, P.M. Sharkey, Driving saccade to pursuit using image motion, Internat. J. Computer Vision 16 (1995) 205-228.
80. H.-H. Nagel, From image sequences towards conceptual descriptions, Image and Vision Computing 6 (2) (1988) 59-74.
81. R.E. Neapolitan, Probabilistic Reasoning in Expert Systems: Theory and Algorithms, John Wiley and Sons, New York, 1990.
82. B. Neumann, Natural language descriptions of time-varying scenes, in: D.L. Waltz (Ed.), Semantic Structures: Advances in Natural Language Processing, Lawrence Erlbaum Associates, London, 1989, pp. 167-206.
83. D. Newtson, Foundations of attribution: the perception of ongoing behaviour, in: J.H. Harvey, W.J. Ickes, R.F. Kidd (Eds.), New Directions in Attribution Research: Vol. I, Lawrence Erlbaum Associates, London, 1976, pp. 223-247.
84. A.E. Nicholson, J.M. Brady, The data association problem when monitoring robot vehicles using dynamic belief networks, in: B. Neumann (Ed.), Proceedings ECAI-92, Vienna, Austria, John Wiley and Sons, New York, 1992, pp. 689-693.
85. N.J. Nilsson, Teleo-reactive programs for agent control, J. Artif. Intell. Research 1 (1994) 139-158.
86. D.A. Norman, Cognition in the head and in the world: an introduction to the special issue on situated action, Cognitive Science 17 (1993) 1-6.
87. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufman, Los Altos, CA, 1988.
88. Z.W. Pylyshyn, R.W. Storm, Tracking multiple independent targets: evidence for a parallel tracking mechanism, Spatial Vision 3 (1988) 179-197.
89. R.D. Rimey, C.M. Brown, Where to look next using a Bayes Net: incorporating geometric relations, in: G. Sandini (Ed.), Proceedings 2nd European Conference on Computer Vision, Santa Margherita Ligure, Italy, Lecture Notes in Computer Science, Vol. 588, Springer, Berlin, 1992, pp. 542-550.
90. R.D. Rimey, C.M. Brown, Control of selective perception using Bayes nets and decision theory, Internat. J. Computer Vision 12 (2,3) (1994) 173-207.
91. I. Rock, The Logic of Perception, MIT Press, Cambridge, MA, 1983.
92. S.J. Rosenschein, L.P. Kaelbling, The synthesis of digital machines with provable epistemic properties, in: J.Y. Halpern (Ed.), Theoretical Aspects of Reasoning about Knowledge, Proceedings 1986 Conference, Timberline, OR, Morgan Kaufman, Los Altos, CA, 1986, pp. 83-98.
93. G. Ryle, The Concept of Mind, Hutchinson, 1949; Penguin Books, 1990.
94. R.C. Schank, R.P. Abelson, Scripts, Plans, Goals and Understanding, Lawrence Erlbaum Associates, London, 1977.
95. H. Schöne, Spatial Orientation: The Spatial Control of Behaviour in Animals and Man, Princeton University Press, Princeton, NJ, 1984 (English translation of: Orientierung im Raum ..., Wissenschaftliche Verlagsgesellschaft, 1980).
96. Y. Shoham, Reasoning about Change: Time and Causation from the Standpoint of Artificial Intelligence, MIT Press, Cambridge, MA, 1988.
97. L.E. Sucar, D.F. Gillies, Expressing relational and temporal knowledge in visual probabilistic networks, in: Uncertainty in Artificial Intelligence, Vol. 8, Morgan Kaufman, Los Altos, CA, 1992, pp. 303-309.
98. L. Suchman, Plans and Situated Actions: The Problems of Human-Machine Communication, Cambridge University Press, Cambridge, UK, 1987.
99. G.D. Sullivan, Visual interpretation of known objects in constrained scenes, in: G.A. Horridge H.B. Barlow, J.P. Frisby, M.A. Jeeves (Eds.), Natural and Artificial Low-level Seeing Systems (Special Issue), Philos. Trans. Roy. Soc. London Ser. B: Biological Sci. 337 (1992) 361-370.
100. B. Taylor, Tense and continuity, Linguistics and Philosophy 1 (1977) 199-220.
101. C. Terman, Simulation tools for digital LSI design, Ph.D. Thesis, MIT Laboratory for Computer Science, MIT/LCS/TR-304, Cambridge, MA, 1983.
102. A.F. Toal, H. Buxton, Spatio-temporal reasoning within a traffic surveillance system, in: G. Sandini (Ed.), Proceedings 2nd European Conference on Computer Vision, Santa Margherita Ligure, Italy, Lecture Notes in Computer Science, Vol. 588, Springer, Berlin, 1992, pp. 884-892.
103. A. Treisman, Preattentive processing in vision, in: Z.W. Pylyshyn (Ed.), Computational Processes in Human Vision: An Interdisciplinary Perspective, Ablex, Norwood, NJ, 1988, pp. 341-369; also in: Comput. Vision Graphics Image Process 31 (1985) 156-177.
104. A. Treisman, Preattentive processing in vision, in: Z.W. Pylyshyn (Ed.), Computational Processes in Human Vision: An Interdisciplinary Perspective, Ablex, Norwood, NJ, 1988, pp. 341-369; also in: Comput. Vision Graphics Image Process 31 (1985) 156-177.
105. J.K. Tsotsos, Toward a computational model of attention, in: T. Papathomas, C. Chubb, A. Gorea, E. Kowler (Eds.), Early Vision and Beyond, MIT Press, Cambridge, MA, 1995, pp. 207-218.
106. J.K. Tsotsos, S. M Culhane, W.Y.K. Wai, Y. Lai, N. Davis, F. Nuflo, Modeling visual attention via selective tuning, Artificial Intelligence 78 (1995) 507-545.
107. S. Ullman, Visual routines, in: S. Pinker (Ed.), Visual Cognition, MIT Press, Cambridge, MA, 1985, pp. 97-159; also in: M.A. Fischler, O. Firschein (Eds.), Readings in Computer Vision: Issues, Problems, Principles, and Paradigms, Morgan Kaufman, Los Altos, CA, 1987, pp. 298-328; also in: Cognition 18 (1984).
108. S. Ullman, Visual routines, in: S. Pinker (Ed.), Visual Cognition, MIT Press, Cambridge, MA, 1985, pp. 97-159; also in: M.A. Fischler, O. Firschein (Eds.), Readings in Computer Vision: Issues, Problems, Principles, and Paradigms, Morgan Kaufman, Los Altos, CA, 1987, pp. 298-328; also in: Cognition 18 (1984).
109. S. Ullman, Visual routines, in: S. Pinker (Ed.), Visual Cognition, MIT Press, Cambridge, MA, 1985, pp. 97-159; also in: M.A. Fischler, O. Firschein (Eds.), Readings in Computer Vision: Issues, Problems, Principles, and Paradigms, Morgan Kaufman, Los Altos, CA, 1987, pp. 298-328; also in: Cognition 18 (1984).
110. J.F.A.K. van Benthem, The Logic of Time, Reidel, Dordrecht, 1983.
111. A.H.C. van der Heijden, Selective Attention in Vision, Routledge & Kegan Paul, London, 1992.
112. J.H.C. Whitehead, Combinatorial homotopy I, Bull. Amer. Math. Soc. 55 (1949) 213-245; also in: I.M. James (Ed.), The Mathematical Works of J.H.C. Whitehead: Vol. III on Homotopy Theory, Pergamon Press, Oxford, 1962, pp. 85-177.
113. J.H.C. Whitehead, Combinatorial homotopy I, Bull. Amer. Math. Soc. 55 (1949) 213-245; also in: I.M. James (Ed.), The Mathematical Works of J.H.C. Whitehead: Vol. III on Homotopy Theory, Pergamon Press, Oxford, 1962, pp. 85-177.
114. T. Winograd, F. Flores, Understanding Computers and Cognition: A New Foundation for Design, Ablex, Norwood, NJ, 1986.
115. W.A. Woods, Transition network grammars for natural language analysis, Comm. ACM 13 (10) (1970) 591-606.
116. A.D. Worrall, R.F. Marslin, G.D. Sullivan, K.B. Baker, Model-based tracking, in: P. Mowforth (Ed.), British Machine Vision Conference 1991, Glasgow, UK, Springer, Berlin, 1991, pp. 310-318.
117. A.D. Worrall, G.D. Sullivan, K.B. Baker, Advances in model-based traffic vision, in: Proceedings 4th British Machine Vision Conference, Guildford, Surrey, UK, BMVA Press, 1993, pp. 559-568.