A comparative study of object-level spatial context techniques for semantic image analysis

Computer Vision and Image Understanding

Volumn 115, Issue 9, 2011, Pages 1288-1307

  Papadopoulos, G Th ^a,b   Saathoff, C ^c   Escalante, H J ^d   Mezaris, V ^b   Kompatsiaris, I ^b   Strintzis, M G ^a,b  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^b INFORMATICS AND TELEMATICS INSTITUTE   (Greece)

^c University of Koblenz Landau ^*  (Germany)

^d UNIVERSIDAD AUTÓNOMA DE NUEVO LEÓN   (Mexico)

Author keywords

Binary integer programming; Directional relations; Energy based model; Genetic algorithm; Semantic image analysis; Spatial context

Indexed keywords

BINARY INTEGER PROGRAMMING; DIRECTIONAL RELATIONS; ENERGY-BASED MODELS; SEMANTIC IMAGE ANALYSIS; SPATIAL CONTEXT;

IMAGE ANALYSIS; INTEGER PROGRAMMING; SEMANTICS;

GENETIC ALGORITHMS;

EID: 79958249244     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2011.05.005     Document Type: Article

References (58)

1. R. Datta, D. Joshi, J. Li, and J. Wang Image retrieval: ideas, influences, and trends of the new age ACM Computing Surveys (CSUR) 40 2 2008 1 60
2. A. Hanjalic, R. Lienhart, W. Ma, and J. Smith The holy grail of multimedia information retrieval: so close or yet so far away? Proceedings of the IEEE 96 4 2008 541 547
3. S. Nikolopoulos, G. Papadopoulos, I. Kompatsiaris, and I. Patras An evidence-driven probabilistic inference framework for semantic image understanding Proceedings of the 6th International Conference on Machine Learning and Data Mining in Pattern Recognition 2009 Springer-Verlag 525 539
4. C. Carson, S. Belongie, H. Greenspan, and J. Malik Blobworld: image segmentation using expectation-maximization and its application to image querying IEEE Transactions on Pattern Analysis and Machine Intelligence 24 8 2002 1026 1038
5. V. Mezaris, S. Gidaros, G. Papadopoulos, W. Kasper, J. Steffen, R. Ordelman, M. Huijbregts, F. de Jong, I. Kompatsiaris, and M. Strintzis A system for the semantic multi-modal analysis of news audio-visual content EURASIP Journal on Advances in Signal Processing 2010 2010 16
6. J. Luo, M. Boutell, and C. Brown Pictures are not taken in a vacuum IEEE Signal Processing Magazine 23 2006 101 114
7. C. Galleguillos, and S. Belongie Context based object categorization: a critical survey Computer Vision and Image Understanding 114 6 2010 712 722
8. A. Torralba Contextual priming for object detection International Journal of Computer Vision 53 2 2003 169 191
9. J. Verbeek, B. Triggs, Scene segmentation with conditional random fields learned from partially labeled images, in: Neural Information Processing Systems (NIPS), 2008.
10. A. Torralba, K. Murphy, W. Freeman, and M. Rubin Context-based vision system for place and object recognition IEEE International Conference on Computer Vision 2003 IEEE 273 280
11. A. Singhal, J. Luo, W. Zhu, Probabilistic spatial context models for scene content understanding, in: IEEE Conference on Computer Vision and Pattern Recognition, 2003.
12. G. T. Papadopoulos, V. Mezaris, I. Kompatsiaris, M. Strintzis, A statistical learning approach to spatial context exploitation for semantic image analysis, in: International Conference on Pattern Recognition, ICPR, 2010.
13. S. Kumar, and M. Hebert A hierarchical field framework for unified context-based classification IEEE International Conference on Computer Vision, ICCV vol. 2 2005 IEEE 1284 1291 (Pubitemid 44042328)
14. P. Carbonetto, N. Freitas, and K. Barnard A statistical model for general contextual object recognition Computer Vision - ECCV 2004 350 362
15. J. Shotton, J. Winn, C. Rother, and A. Criminisi Textonboost for image understanding: multi-class object recognition and segmentation by jointly modeling texture, layout, and context International Journal of Computer Vision 81 1 2009 2 23
16. X. He, R. Zemel, and M. Carreira-Perpinan Multiscale conditional random fields for image labeling Proceedings of the IEEE Conference on Computer vision and Pattern Recognition 2004 IEEE 695 702
17. D. Parikh, C. Zitnick, T. Chen, From appearance to context-based recognition: dense labeling in small images, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
18. L. Wolf, and S. Bileschi A critical view of context International Journal of Computer Vision 69 2 2006 251 261 (Pubitemid 43814120)
19. G. Papadopoulos, V. Mezaris, I. Kompatsiaris, M. Strintzis, Probabilistic combination of spatial context with visual and co-occurrence information for semantic image analysis, in: IEEE International Conference on Image Processing, ICIP, 2010.
20. C. Galleguillos, A. Rabinovich, S. Belongie, Object categorization using co-occurrence, location and appearance, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1-8.
21. C. Desai, D. Ramanan, C. Fowlkes, Discriminative models for multi-class object layout, in: IEEE International Conference on Computer Vision, IEEE, 2009, pp. 229-236.
22. M. Choi, J. Lim, A. Torralba, A. Willsky, Exploiting hierarchical context on a large database of object categories, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2010, pp. 129-136.
23. Z. Wang, D. Feng, Z. Chi, T. Xia, Annotating image regions using spatial context, in: Eighth IEEE International Symposium on Multimedia, ISM'06, 2006, pp. 55-61.
24. D. Semenovich, and A. Sowmya A spectral method for context based disambiguation of image annotations Proceedings of IEEE International Conference on Image processing 2009 IEEE Press 789 792
25. I. González-Diaz, D. Garcia-Garcia, F. de Maria, A spatially aware generative model for image classification, topic discovery and segmentation, in: IEEE International Conference on Image Processing, ICIP, 2009.
26. J. Yuan, J. Li, B. Zhang, Exploiting spatial context constraints for automatic image region annotation, in: Proceedings of ACM International Conference on Multimedia, 2007, pp. 595-604.
27. M. Boutell, J. Luo, C. Brown, Improved semantic region labeling based on scene context, in: IEEE International Conference on Multimedia and Expo, 2005.
28. D. Heesch, and M. Petrou Markov random fields with asymmetric interactions for modelling spatial context in structured scene labelling Journal of Signal Processing Systems 2009 1 9
29. C. Saathoff, M. Grzegorzek, S. Staab, Labelling image regions using wavelet features and spatial prototypes, in: International Conference on Semantics and Digital Media Technologies, 2008.
30. C. Hudelot, J. Atif, and I. Bloch Fuzzy spatial relation ontology for image interpretation Fuzzy Sets and Systems 159 15 2008 1929 1951
31. A. Torralba, K. Murphy, and W. Freeman Contextual models for object detection using boosted random fields Advances in Neural Information Processing Systems, vol. 17 2005 MIT Press 1401 1408
32. L. Cao, L. Fei-Fei, Spatially coherent latent topic model for concurrent object segmentation and classification, in: Proceedings of ICCV, 2007.
33. J. Sivic, B. Russell, A. Efros, A. Zisserman, W. Freeman, Discovering objects and their location in images, in: IEEE International Conference on Computer Vision, ICCV, 2005, pp. 370-377. (Pubitemid 44054982)
34. M. Fink, P. Perona, Mutual boosting for contextual inference, in: Neural information Processing Systems, vol. 1, 2004.
35. A. Deruyver, and Y. Hodé Qualitative spatial relationships for image interpretation by using a conceptual graph Image and Vision Computing 27 7 2009 876 886
36. C. Saathoff, S. Staab, Exploiting spatial context in image region labelling using fuzzy constraint reasoning, in: International Workshop on Image Analysis for Multimedia Interactive Services, IEEE, 2008, pp. 16-19.
37. H.J. Escalante, M. Montes, and L. Sucar An energy-based model for region-labeling Computer Vision and Image Understanding 115 6 2011 787 803
38. G. Bakir, T. Hofmann, B. Schölkopf, A. Smola, B. Taskar, and S. Vishwanathan Predicting structured data Advances in Neural Informacion Processing Systems 2007 MIT Press 191 246 (Chapter Energy Based Models)
39. V. Mezaris, I. Kompatsiaris, and M. Strintzis Still image segmentation tools for object-based multimedia applications International Journal of Pattern Recognition and Artificial Intelligence 18 2004 701 726
40. D.G. Lowe Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2004 91 110
41. G. Csurka, C. Dance, L. Fan, J. Willamowski, C. Bray, Visual categorization with bags of keypoints, in: Proceedings of ECCV Workshop on Statistical Learning in Computer Vision, 2004.
42. V. Vapnik The Nature of Statistical Learning Theory 2000 Springer-Verlag
43. L. Breiman Random forests Machine Learning 45 1 2001 5 32 (Pubitemid 32933532)
44. T. Speed Statistical Analysis of Gene Expression Microarray Data 2003 CRC Press
45. J. Friedman, T. Hastie, and R. Tibshirani Additive logistic regression: a statistical view of boosting The Annals of Statistics 28 2 2000 337 407 (Pubitemid 33227445)
46. G. Papadopoulos, V. Mezaris, I. Kompatsiaris, and M. Strintzis Combining global and local information for knowledge-assisted image analysis and classification EURASIP Journal on Advances in Signal Processing, Special Issue on Knowledge-Assisted Media Analysis for Interactive Multimedia Applications 2007 2007 15
47. M. Mitchell An Introduction to Genetic Algorithms 1996 MIT Press
48. P. Pardalos, and H. Romeijn Handbook of Global Optimization Vol. 2 2002 Kluwer
49. R. Neapolitan Learning Bayesian Networks 2003 Prentice Hall Upper Saddle River, NJ
50. D.G. Luenberger, Linear and Non-Linear Programming, 1989.
51. G. Winkler Image Analysis, Random Fields and Markov Chain Monte Carlo Methods Applications of Mathematics vol. 27 2006 Springer
52. G. Papadopoulos, C. Saathoff, M. Grzegorzek, V. Mezaris, I. Kompatsiaris, S. Staab, M. Strintzis, Comparative evaluation of spatial context techniques for semantic image analysis, in: Proceedings of WIAMIS '09, 2009, pp. 161-164.
53. B. Russell, A. Torralba, K. Murphy, and W. Freeman LabelMe: a database and web-based tool for image annotation International Journal of Computer Vision 77 1 2008 157 173
54. F. Ge, S. Wang, T. Liu, Image-segmentation evaluation from the perspective of salient object extraction, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2006, pp. 1146-1153. (Pubitemid 44931450)
55. J. Shi, and J. Malik Normalized cuts and image segmentation IEEE Transactions on Pattern Analysis and Machine Intelligence 22 8 2000 888 905
56. T. Adamek, N. O'Connor, N. Murphy, Region-based segmentation of images using syntactic visual features, in: Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), 2005.
57. T. Athanasiadis, P. Mylonas, Y. Avrithis, and S. Kollias Semantic image segmentation and object labeling IEEE Transactions on Circuits and Systems for Video Technology 17 3 2007 298 312
58. O. Morris, M. Lee, and A. Constantinides Graph theory for image analysis: an approach based on the shortest spanning tree IEE Proceedings F Communications, Radar and Signal Processing 133 2 1986 146 152 (Pubitemid 16523176)