3D Scene interpretation by combining probability theory and logic: The tower of knowledge

Computer Vision and Image Understanding

Volumn 115, Issue 11, 2011, Pages 1581-1596

  Xu, Mai ^a   Petrou, Maria ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Logic and probabilities; Machine learning; Scene labelling systems; System architecture

Indexed keywords

3D MODELS; 3D SCENES; LOGIC AND PROBABILITY; LOGIC RULES; MACHINE-LEARNING; MAXIMUM LIKELIHOOD METHODS; MULTI-VIEW IMAGE; PROBABILISTIC FRAMEWORK; PROBABILITY THEORY; SCENE LABELLING SYSTEMS; STATISTICAL FEATURES; SYSTEM ARCHITECTURES; TRAINING DATA; UTILITY FUNCTIONS;

ARCHITECTURE; BAYESIAN NETWORKS; BUILDING CODES; CONTENT BASED RETRIEVAL; LABELS; MAXIMUM LIKELIHOOD; NETWORK ARCHITECTURE; PROBABILISTIC LOGICS;

THREE DIMENSIONAL;

EID: 80052517382     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2011.08.001     Document Type: Article

References (61)

1. M. Arens, and H.H. Nagel Behavioural knowledge representation for the understanding and creation of video sequences Proceedings of the 26th German Conference on Artificial Intelligence (KI-2003), LNAI 2003 Springer-Verlag Berlin, Heidelberg, New York 149 163 (Pubitemid 37171117)
2. P. Besl, and R.C. Jain Three-dimensional object recognition Comput. Surv. 17 1985 75 145
3. J. Batllea, A. Casalsb, J. Freixeneta, and J. Marti A review on strategies for recognising natural objects in colour images of outdoor scenes Image Vision Comput. 18 6 2000 515 530 (Pubitemid 30567454)
4. P. Carbonetto, N. Freitas, K. Barnard, A statistical model for general contextual object recognition, in: Proceedings of ECCV, 2004, pp. 350-362.
5. L. Cheng, T. Caelli, and A. Sanchez-Azofeifa Component optimisation for image understanding: a Bayesian approach IEEE Trans. Pattern Anal. Mach. Intell. 28 5 2006 684 693
6. N. Chleq, M. Thonnat, Real time image sequence interpretaion for video survellance applications, in: International Conference on Image Processing, IEEE ICIP'96, vol. 2, Lausanne, Switzerland, September 1996, pp 801-804.
7. W.J. Christmas, J. Kittler, and M. Petrou Structural matching in computer vision IEEE Trans. Pattern Anal. Mach. Intell. 17 8 1995 749 764
8. D. Damen, Constraint-based scene interpretation, in: Dagstuhl Logic and Probability for Scene Interpretation Workshop, 2008. < http://kathrin. dagstuhl.de/08091/Materials2/ >.
9. A.R. Dick, P.H.S. Torr, and R. Cipolla Modelling and interpretation of architecture from several images Int. J. Comput. Vision 60 2 2004 111 134
10. A.R. Dick, P.H.S. Torr, S.J. Ruffle, R. Cipolla, Combining single view recognition and multiple view stereo for architectural, in: Proceeding of ICCV, 2001, pp. 268-274. (Pubitemid 32794966)
11. S. Ekvall, D. Kragic, Integrating object and grasp recognition for dynamic scene interpretation, in: Proceeding of 12th ICAR, 2005, pp. 331-336. (Pubitemid 44458681)
12. L. Fei-fei, P. Perona, A Bayesian hierarchical model for learning natural scene categories, in: Proceedings of CVPR, 2005, pp. 524-531.
13. P.C. Fishburn, Utility Theory for Decision Making, Robert E. Krieger Publishing Company, Huntington, NY, 1970, ISBN 978-0471260608.
14. G. Fritz, C. Seifert, L.Paletta, Urban object recognition from informative local features, in: Proceedings of the 2005 ICAR, 2005, pp. 131-137. (Pubitemid 46083787)
15. G. Guerra-Filho, and Y. Aloimonos A language for human action IEEE Comput. 40 5 2007 42 51
16. E.R. Hancock, and J. Kittler Discrete relaxation Pattern Recogn. 23 7 1990 711 733
17. J. Hartz, B. Neumann, Learning a knowledge base of ontological concepts for high-level scene interpretation, in: International Conference on Machine Learning and Applications, 2007, pp. 350-362.
18. S. Haykin Adaptive Filter Theory first ed. 1986 Princeton University Press
19. D. Heesch, M. Petrou, Non-Gibbsian Markov random fields for object recognition, in: Proceedings of BMVC, 2007.
20. D. Heesch, and M. Petrou Markov random fields with asymmetric interactions for modelling spatial context in structured scene labelling J. Sig. Proc. Syst. 10 07 2009 online
21. L. Hotz, and B. Neumann Scene interpretation as a configuration task Kunstliche Intelligenz 3 2005 59 65
22. C. Hudelot, N. Maillot, M. Thonnat, Symbol grounding for semantic image interpretation: from image data to semantics, in: Workshop on Semantic Knowledge in Computer Vision, in Association with ICCV05, 16 October 2005, Beijing, China, pp. 1875-1883.
23. M. Jahangiri, M. Petrou, Fully bottom-up blob extraction in building facades, in: Proceedings of the 9th International Conference on Pattern Recognition and Image Analysis: New Information Technologies, PRIA-9-2008, September 14-20, Nizhni Novgorod, Russian Federation, vol. 1, pp 238-241, 2008.
24. M. Jahangiri, M. Petrou, An attention model for extracting components that merit identification, in: Proceedings of ICIP, 2009.
25. M. Jahangiri, Blob detector tool, 2009. < www.commsp.ee.ic.ac.uk/ jahangiri/blobextraction.zip >
26. Z. Kim, and R. Nevatia Expandable Bayesian networks for 3D object description from multiple views and multiple mode inputs IEEE Trans. Pattern Anal. Mach. Intell. 25 6 2003 769 774
27. Z. Kim, and R. Nevatia Automatic description of complex buildings from multiple fimages Comput. Vision Image Und. 96 1 2004 60 95
28. N. Komodakis, G. Tziritas, N. Paragios, Fast approximately optimal solutions for single and dynamic MRFs, in: Proceedings of CVPR, 2007, pp. 1-8.
29. P. Kohli, J. Rihan, M. Bray, and P. Torr Simultaneous segmentation and pose estimation of humans using dynamic graph cuts Int. J. Comput. Vision 79 3 2008 59 80
30. S. Lee, R. Nevatia, Interactive 3D building modelling using a hierarchical representation, in: Proceedings of the First IEEE International Workshop on Higher-Level Knowledge in 3D Modelling and Motion Analysis, Los Alamitos, CA, USA, 2003, pp. 58-65.
31. S. Lee, S. Jung, R. Nevatia, Integrating ground and aerial views for urban site modelling, in: Proceeding of ICPR, 2002, pp. 107-112 vol.4. (Pubitemid 44850959)
32. I. Levner, V. Bulitko, Machine learning for adaptive image interpretation, in: Proceedings of the 16th Innovative Applications of Artificial Intelligence'04 Conference, San Jose, CA, USA, 2004.
33. M. Marengoni, A. Hanson, S. Zilberstein, and E. Riseman Decision making and uncertainty management in a 3D reconstruction system IEEE Trans. Pattern Anal. Mach. Intell. 25 7 2003 852 858
34. G. Metta, D. Vernon, G. Sandini, The RobotCub Approach to the Development of Cognition, in: L. Berthouze, F. Kaplan, H. Kozima, H. Yano, J. Konczak, G. Metta, J. Nadel, G. Sandini, G. Stojanov, C. Balkenius (Eds.), Proceedings of the 5th International Workshop on Epigenic Robotics: Modelling Cognitive Development in Robotic Systems, Lund University Cognitive Studies, vol. 123, 2004, ISBN 91-974741-4-2.
35. H.H. Nagel From image sequences towards conceptual descriptions Image Vision Comput. 6 2 1988 59 74
36. B. Neumann, R. Moller, A.G. Cohn, D.C. Hogg, Logic and probability for scene interpretation, in: Dagstuhl Workshop, 2008. < http://www.dagstuhl.de/ en/program/calendar/semhp/?semnr=08091 >.
37. B. Neumann, and R. Möller On scene interpretation with description logics Image Vision Comput. 26 1 2008 82 101 (Pubitemid 350051535)
38. A. Ogale, A. Karapurkar, Y. Aloimonos, View-invariant modeling and recognition of human actions using grammars, in: Workshop on Dynamical Vision at ICCV, 2005, pp. 115-126.
39. B. Ommer, J.M. Buhmann, Learning the compositional nature of visual objects, in: Proceedings of CVPR, 2007, pp. 1-8.
40. J. Pearl Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference 1988 Morgan Kaufman Publishers Inc.
41. M. Petrou, Learning in computer vision: some thoughts, in: Proceeding of CIARP, Santiago, Cile, 2007.
42. L. de Raedt Logical and Relational Learning 2008 Springer
43. M. Richardson, and P. Domingos Markov logic networks Mach. Learn. 62 1-2 2006 107 136 (Pubitemid 43202307)
44. B.D. Ripley, and N.L. Hjort Pattern Recognition and Neural Networks 1st ed. 1995 Cambridge University Press
45. S.J. Russell, and P. Norvig Artificial Intelligence: A Modern Approach second ed. 2003 Prentice-Hall Series In Artificial Intelligence
46. G. Sandini, G. Metta, and D. Vernon RobotCub: an open framework for research in embodied cognition Int. J. Humanoid Robotics 8 2 2004
47. S. Savarese, L. Fei-fei, 3D Generic object categorisation, localisation and pose estimation, in: Proceedings of ICCV, 2007, pp. 1-8.
48. G. Schneider, H. Wersing, B. Sendhoff, and E. Korner Evolutionary optimisation of a hierarchical object recognition model IEEE Trans. Syst., Man, Cybern. - Part B: Cybern. 35 3 2005 426 437 (Pubitemid 40802756)
49. C. Siagian, and L. Itti Rapid biologically-inspired scene classification using features shared with visual attention IEEE Trans. Pattern Anal. Mach. Intell. 29 2 2007 300 312 (Pubitemid 46420889)
50. J. Sivic, B.C. Russell, A.A. Efros, A. Zisserman, W.T. Freeman, Discovering objects and their location in images, in: Proceedings of ICCV, 2005, pp. 370-377. (Pubitemid 44054982)
51. H.A. Sturges The choice of a class interval J. Am. Stat. Assoc. 21 153 1926 65 66
52. J. von Neumann, and O. Morgenstern Theory of Games and Economic Behavior second ed. 1947 Princeton University Press
53. V.-T. Vu, F. Bremond, M. Thonnat, Temporal constraints for video interpretation, in: The 15th European Conference on Artificial Intelligence (ECAI'2002), Lyon, France, 21-26 July 2002.
54. M. Weber, M. Welling, P. Perona, Unsupervised learning of models for recognition, in: Proceedings of ECCV, 2000, pp. 18-32.
55. L. Wiskott, and C. Malsburg A neural system for the recognition of partially occluded objects in cluttered scenes Int. J. Pattern Recogn. Artif. Intell. 7 4 1993 735 748
56. E.J. Wisniewsk, and D. Medin The Interaction of Theory and Similarity in Rule Induction first ed. 1995 MIT Press
57. M. Xu, Scene interpretation with the Tower of Knowledge, PhD thesis, Imperial College London, 2010.
58. C.E. Zhambok, and G. Klein Naturalistic Decision Making 1997 Lawrence Erlbaum Associates Mahwah, NJ
59. H. Zimmermann, Fuzzy set theory and its applications, Kluwer Academic Publishers, Boston, ISBN 0-7923-7435-5.
60. IST06, E-training for interpreting images of man-made scenes. < http://www.ipb.uni-bonn.de/projects/etrims/ >.
61. http://www.emtech.net/learning-theories.htm.