A model of multimedia information retrieval

Journal of the ACM

Volumn 48, Issue 5, 2001, Pages 909-970

  Meghini, Carlo ^a,b   Sebastiani, Fabrizio ^a   Straccia, Umberto ^a  

^a CNR   (Italy)

^b ISTI CNR   (Italy)

Author keywords

Description logics; Fuzzy logics; Multimedia information retrieval

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL METHODS; COMPUTER SCIENCE; DATABASE SYSTEMS; FUZZY SETS; IMAGE PROCESSING; MATHEMATICAL MODELS; MULTIMEDIA SYSTEMS; SEMANTICS; STATISTICAL METHODS;

DESCRIPTION LOGICS (DL); DOCUMENT INTERPRETATIONS; MULTIMEDIA DOCUMENTS; MULTIMEDIA INFORMATION RETRIEVAL (MIR);

INFORMATION RETRIEVAL;

EID: 0038167068     PISSN: 00045411     EISSN: None     Source Type: Journal    
DOI: 10.1145/502102.502103     Document Type: Article

References (100)

1. ABITEBOUL, S., CLUET, S., CHRISTOPHIDES, V., MILO, T., MOERKOTTE, G., AND SIMEON, J. 1997. Querying documents in object databases. Int. J. Dig. Lib. 1, 1, 5-19.
2. AIELLO, M., ARECES, C., AND RIJKE, M. 1999. Spatial reasoning for image retrieval. In Proceedings of DL-99, 8th International Workshop on Description Logics (Linkoeping) SE, 23-27.
3. ALP ASLANDOGAN, Y., THIER, C., YU, C., ZOU, J., AND RISHE, N. 1997. Using semantic contents and WordNet in image retrieval. In Proceedings of SIGIR-97, 20th ACM Conference on Research and Development in Information Retrieval (Philadelphia, Pa.). ACM, New York, pp. 286-295.
4. ANDERSON, A., AND BELNAP, N. 1975. Entailment - The Logic of Relevance and Necessity. Princeton University Press, Princeton, N. J.
5. BAADER, F., AND HANSCHKE, P. 1991. A schema for integrating concrete domains into concept languages. In Proceedings of IJCAI-91, 12th International Joint Conference on Artificial Intelligence (Sydney, Australia). pp. 452-457.
6. BAADER, F., AND HOLLUNDER, B. 1991. KRIS: Knowledge representation and inference system - System description. ACM SIGART Bull. 2, 3, 8-14.
7. BACH, J. R., FULLER, C., GUPTA, A., HAMPAPUR, A., HOROWITZ, B., HUMPHREY, R., JAIN, R., AND SHU, C.-F. 1996. The Virage image search engine: An open framework for image management. In Proceedings of SPIE-96, 4th SPIE Conference on Storage and Retrieval for Still Images and Video Databases (San Jose, Calif.), pp. 76-87.
8. BERRUT, C., MULHEM, P., FOUREL, F., AND MECHKOUR, M. 1998. The PRIME information retrieval system applied on a medical corpus. In Proceedings of MINAR-98, Workshop on Multimedia Information Analysis and Retrieval (Hong Kong, China). Lecture Notes in Computer Science, vol. 1464. Springer-Verlag, Heidelberg, Germany, pp. 224-241.
9. BOLLINGER, T., AND PLETAT, U. 1991. The LILOG knowledge representation system. ACM SIGART Bull. 2, 3, 22-27.
10. BORGIDA, A. 1995. Description logics in data management. IEEE Trans. Knowl. Data Eng. 7, 5, 671-682.
11. BOUET, M., AND DJERABA, C. 1998. Visual content-based retrieval in image databases with relevance feedbacks. In Proceedings of MMDBMS-98, 4th International Workshop on Multi-Media Database Management Systems (Dayton, Ohio), pp. 98-105.
12. BRACHMAN, R. J., MCGUINNESS, D. L., PATEL-SCHNEIDER, P. F., ALPERIN RESNICK, L., AND BORGIDA, A. 1991. Living with CLASSIC: When and how to use a KL-ONE-like language. In Principles of Semantic Networks, J. F. Sowa, Ed. Morgan-Kaufmann, San Mateo Calif., pp. 401-456.
13. BRACHMAN, R. J., AND SCHMOLZE, J. G. 1985. An overview of the KL-ONE knowledge representation system. Cog. Sci. 9, 2, 171-216.
14. BRACHMAN, R. J., SELFRIDGE, P. G., TERVEEN, L. G., ALTMAN, B., BORGIDA, A., HALPERN, F., KIRK, T., LAZAR, A., MCGUINNESS, D. L., AND RESNICK, L. A. 1992. Knowledge representation support for data archaeology. In Proceedings of CIKM-92, International Conference on Information and Knowledge Management (Baltimore, Md.). pp. 457-464.
15. BUCHHEIT, M., DONINI, R M., AND SCHAERF, A. 1993. Decidable reasoning in terminological knowledge representation systems. In Proceedings of IJCAI-93, 13th International Joint Conference on Artificial Intelligence (Chambery, France), pp. 704-709.
16. BUONGARZONI, P., MEGHINI, C., SALIS, R., SEBASTIANI, F., AND STRACCIA, U. 1995. Logical and computational properties of the description logic MIRTL. In Proceedings of DL-95, 4th International Workshop on Description Logics (Roma, Italy). pp. 80-84.
17. CIOCCA, R., AND SCHETTINI, R. 1999. Using a relevance feedback mechanism to improve content-based image retrieval. In Proceedings of VISUAL-99, 3rd International Conference on Visual Information Systems (Amsterdam, The Netherlands). Lecture Notes in Computer Science, vol. 1614. Springer-Verlag, Heidelberg, Germany, pp. 107-114.
18. COHN, A. G. 1996. Calculi for qualitative spatial reasoning. In Artificial Intelligence and Symbolic Mathematical Computation, J. Calmet, J. Campbell, and J. Pfalzgraf, Eds. Springer-Verlag, Heidelberg, Germany, pp. 124-143.
19. CRESTANI, F., LALMAS, M., AND VAN RIJSBERGEN, C. J., EDS. 1998. Logic and Uncertainty in Information Retrieval: Advanced Models for the Representation and Retrieval of Information. Kluwer Academic Publishing, Dordrecht, The Netherlands.
20. DAVIDSON, D. 1994. Truth and meaning. In Inquiries into truth and interpretation. Collected essays by Donald Davidson. Clarendon Press, Oxford, England, pp. 17-36.
21. DEL BIMBO, A., MUGNAINI, M., PALA, P., TURCO, F., AND VERZUCOLI, L. 1997. Image retrieval by color regions. In Proceedings of ICIAP'97, 9th International Conference on Image Analysis and Processing (Firenze, Italy). Lecture Notes in Computer Science vol. 1311. Springer-Verlag, Heidelberg, Germany, pp. 180-187.
22. DEL BIMBO, A., AND PALA, P. 1997. Visual image retrieval by elastic matching of user sketches, IEEE Trans. Patt. Anal. Mach. Int. 19, 2, 121-132.
23. DEVANBU, P., BRACHMAN, R. J., SELFRIDGE, P. J., AND BALLARD, B. W. 1991. LASSIE: A knowledge-based software information system. Commun. ACM 34, 5, 36-49.
24. DUBOIS, D., AND PRADE, H. 1980. Fuzzy Sets and Systems. Academic Press, New York.
25. DUNLOP, M. D. 1997. The effect of accessing non-matching documents on relevance feedback. ACM Trans. Inf. Syst. 15, 2, 137-153.
26. DUSCHKA, M. O., AND LEVY, Y. A. 1997. Recursive plans for information gathering. In Proceedings of IJCAI-97, 15th International Joint Conference on Artificial Intelligence (Nagoya, Japan), pp. 778-784.
27. FALOUTSOS, C. 1996. Searching Multimedia Databases by Content. Kluwer Academic Publishers, Dordrecht, The Netherlands
28. FALOUTSOS, C., BARBER, R., FLICKNER, M., HAFNER, J., AND NIBLACK, W. 1994. Efficient and effective querying by image content. J. Int. Inf. Syst. 3, 3/4, 231-262.
29. FUHR, N., AND BUCKLEY, C. 1991. A probabilistic learning approach for document indexing. ACM Trans. Inf. Syst. 9, 3, 223-248.
30. GOBLE, C. A., HAUL, C., AND BECHHOFER, S. 1996. Describing and classifying multimedia using the description logic GRAIL. In Proceedings of SPIE-96, 4th SPIE Conference on Storage and Retrieval for Still Images and Video Databases (San Jose, Calif.). pp. 132-143.
31. GUDIVADA, V. N. 1995. Multimedia systems - An interdisciplinary perspective. ACM Comput. Surv. 7, 4, 545-548.
32. GUDIVADA, V. N., AND RAGHAVAN, V. V. 1995a. Design and evaluation of algorithms for image retrieval by spatial similarity. ACM Trans. Inf. Syst. 13, 2, 115-144.
33. GUDIVADA, V. N., AND RAGHAVAN, V. V. 1995b. Guest editors' introduction to the special issue on content-based image retrieval. IEEE Comput. 28, 9, 18-22.
34. GUDIVADA, V., AND RAGHAVAN, V. V. 1997. Modeling and retrieving images by content. Inf. Proc. Manage. 33, 4, 427-452.
35. GUGLIELMO, E. J., AND ROWE, N. C. 1996. Natural-language retrieval of images based on descriptive captions. ACM Trans. Inf. Syst. 14, 3, 237-267.
36. GUPTA, A., SANTINI, S., AND JAIN, R. 1997. In search of information in visual media. Commun. ACM 40, 12, 34-42.
37. HIRATA, K., AND KATO, T. 1992. Query by visual example. In Proceedings of EDBT-92, 3rd International Conference on Extending Database Technology (Wien, Austria), pp. 56-71.
38. JAIN, A. K., AND VAILAYA, A. 1996. Image retrieval using color and shape. Patt. Rec. 29, 8, 1233-1244.
39. KUNDU, S., AND CHEN, J. 1994. Fuzzy logic or Lukasiewicz logic: A clarification. In Proceedings of ISMIS-94, 8th International Symposium on Methodologies for Intelligent Systems, Z. W. Ras and M. Zemankova, Eds. (Charlotte N.C.). Lecture Notes in Computer Science, vol. 869. Springer-Verlag, Heidelberg, Germany, pp. 56-64.
40. LEE, R. C. 1972. Fuzzy logic and the resolution principle. J. ACM 19, 1, 109-119.
41. LEWIS, D.D. 1992. An evaluation of phrasal and clustered representations on a text categorization task. In Proceedings of SIGIR-92, 15th ACM International Conference on Research and Development in Information Retrieval (Kobenhavn, Denmark). ACM, New York, pp. 37-50.
42. LIU, F., AND PICARD, R. 1996. Periodicity, directionality, and randomness: Wold features for image modelling and retrieval. IEEE Trans. Patt. Anal. Mach. Int. 18, 7, 722-733.
43. LIU, Z., AND SUN, J. 1997, Structured image retrieval, J. Vis. Lang. Comput. 8, 3, 333-357.
44. LUNDQUIST, C., GROSSMAN, D. A., AND FRIEDER, O. 1997. Improving relevance feedback in the vector space model. In Proceedings of CIKM-97, 6th ACM International Conference on Information and Knowledge Management (Las Vegas, Nev.). ACM, New York, pp. 16-23.
45. MACGREGOR, R. 1991. Inside the LOOM description classifier. SIGART Bull. 2, 3, 88-92.
46. MARCUS, S., AND SUBRAHMANIAN, V. 1996. Foundations of multimedia information systems. J. ACM 43, 3, 474-523.
47. MCGUINNESS, D. L., AND WRIGHT, J. 1998. An industrial strength description logic-based configurator platform. IEEE Int. Syst. 13, 4, 69-77.
48. MEGHINI, C. 1995. An image retrieval model based on classical logic. In Proceedings of SIGIR-95, 18th ACM Conference on Research and Development in Information Retrieval (Seattle, Wash.). ACM, New York, pp. 300-308.
49. MEGHINI, C., RABITTI, F., AND THANOS, C. 1991. Conceptual modelling of multimedia documents. IEEE Comput. 24, 10, 23-30.
50. MEGHINI, C., SEBASTIANI, F., AND STRACCIA, U. 1997a. The terminological image retrieval model. In Proceedings of ICIAP'97, 9th International Conference on Image Analysis and Processing (Firenze, Italy). Lecture Notes in Computer Science, vol. 1311. Springer-Verlag, Heidelberg, Germany, pp. 156-163.
51. MEGHINI, C., SEBASTIANI, F., AND STRACCIA, U. 1997b. Modelling the retrieval of structured documents containing texts and images. In Proceedings of ECDL-97, 1st European Conference on Research and Advanced Technology for Digital Libraries (Pisa, Italy). Lecture Notes in Computer Science, vol. 1324. Springer-Verlag, Heidelberg, Germany, pp. 325-344.
52. MEGHINI, C., SEBASTIANI, F., AND STRACCIA, U. 1998. MIRLOG: A logic for multimedia information retrieval. In Logic and Uncertainty in Information Retrieval: Advanced Models for the Representation and Retrieval of Information, F. Crestani, M. Lalmas, and C. J. van Rijsbergen, Eds. Kluwer Academic Publishing, Dordrecht, The Netherlands, pp. 151-185.
53. MEGHINI, C., SEBASTIANI, F., STRACCIA, U., AND THANOS, C. 1993. A model of information retrieval based on a terminological logic. In Proceedings of SIGIR-93, 16th ACM Conference on Research and Development in Information Retrieval (Pittsburgh, Pa.). ACM, New York, pp. 298-307.
54. MEGHINI, C., AND STRACCIA, U. 1996. A relevance terminological logic for information retrieval. In Proceedings of SIGIR-96, 19th ACM Conference on Research and Development in Information Retrieval (Zürich, Switzerland). ACM, New York, pp. 197-205.
55. MEHTRE, B., KANKANHALLI, M. S., AND LEE, W. F. 1997. Shape measures for content-based image retrieval: A comparison. Inf. Proc. Manage. 33, 3, 319-336.
56. MIZZARO, S. 1997. Relevance: The whole history. J. Amer. Soc. Inf. Sci. 48, 9, 810-832.
57. MYERS, K. L. 1994. Hybrid reasoning using universal attachment. Artif. Int. 67, 2, 329-375.
58. NAVARRO, G., AND BAEZA-YATES, R. 1995. A language for queries on structure and contents of textual databases. In Proceedings of SIGIR-95, 18th ACM Conference on Research and Development in Information Retrieval (Seattle, Wash.). ACM, New York, pp. 93-101.
59. NAVARRO, G., AND BAEZA-YATES, R. 1997. Proximal nodes: A model to query document databases by content and structure. ACM Trans. Inf. Syst. 15, 4, 400-435.
60. 2-C: A system for the indexing, storage, and retrieval of medical images by content. Med. Informat. 19, 2, 109-122.
61. OUNIS, I., AND CHEVALLET, J.-P. 1996. Using conceptual graphs in a multifaceted logical model for information retrieval. In Proceedings of DEXA '96, 7th International Conference on Database and Expert Systems Applications (Zürich, Switzerland). Lecture Notes in Computer Science, vol. 1134. Springer-Verlag, Heidelberg, Germany, pp. 812-823.
62. PELTASON, C. 1991. The BACK system - An overview. SIGART Bull. 2, 3, 114-119.
63. PENTLAND, A., PICARD, R., AND SCLAROFF, S. 1994. Photobook: Content-based manipulation of image databases. In Proceedings of SPIE-94, 2nd SPIE Conference on Storage and Retrieval for Still Images and Video Databases (San Jose, Calif.), pp. 34-47.
64. PETRAKIS, E. G., AND FALOUTSOS, C. 1997. Similarity searching in medical image databases. IEEE Trans. Data Knowl. Eng. 9, 3, 435-447.
65. RAVELA, S., AND MANMATHA, R. 1997. Image retrieval by appearance. In Proceedings of SIGIR-97, 20th ACM Conference on Research and Development in Information Retrieval (Philadelphia, Pa.). ACM, New York, pp. 278-285.
66. ROCCHIO, J. J. 1971. Relevance feedback in information retrieval. In The SMART retrieval system: Experiments in automatic document processing, G. Salton, Ed. Prentice-Hall, Englewood Cliffs, N.J., pp. 313-323.
67. RÖLLEKE, T., AND FUHR, N. 1998. Information retrieval with probabilistic datalog. In Logic and Uncertainty in Information Retrieval: Advanced Models for the Representation and Retrieval of Information, F. Crestani, M. Lalmas, and C. J. van Rijsbergen, Eds. Kluwer Academic Publishing, Dordrecht, The Netherlands, pp. 221-245.
68. ROSENFELD, A., AND KAK, A. C. 1982. Digital Picture Processing, 2nd ed. Academic Press, New York.
69. RUI, Y., HUANG, T., ORTEGA, M., AND MEHROTRA, S. 1998. Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Trans. Circ. Syst. Video Tech. 8, 5, 644-655.
70. SALTON, G. 1989. Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer. Addison-Wesley, Reading, Mass.
71. SALTON, G., AND BUCKLEY, C. 1988. Term-weighting approaches in automatic text retrieval. Inf. Proc. Manage. 24, 5, 513-523.
72. SANTINI, S., GUPTA, A., AND JAIN, R. 1999. User interfaces for emergent semantics in image databases. In Proceedings of DS-8, 8th IFIP Working Conference on Database Semantics (Rotorua, New Zealand).
73. SARACEVIC, T. 1975. Relevance: a review of and a framework for the thinking on the notion in information science. J. Amer. Soc. Inf. Sci. 26, 6, 321-343.
74. SCHÄUBLE, P., AND KNAUS, D. 1992. The various roles of information structures. In Proceedings of the 16th Annual Conference of the Gesellschaft für Klassifikation, O. Opitz, B. Lausen, and R. Klar, Eds. (Dortmund, Germany). Springer Verlag, Heidelberg, Germany.
75. SCHMIDT-SCHAUSS, M., AND SMOLKA, G. 1991. Attributive concept descriptions with complements. Artif. Int. 48, 1, 1-26.
76. SEBASTIANI, F. 1994. A probabilistic terminological logic for modelling information retrieval. In Proceedings of SIGIR-94, 17th ACM International Conference on Research and Development in Information Retrieval Dublin, IE, 122-130.
77. SEBASTIANI, F. 1998. On the role of logic in information retrieval. Inf. Proc. Manage. 34, 1, 1-18.
78. SEBASTIANI, F. 1999. Towards a logical reconstruction of information retrieval theory. Cybernet. Syst. 30, 5, 411-428.
79. SMEATON, A. F., AND QUIGLEY, I. 1996. Experiments on using semantic distances between words in image caption retrieval. In Proceedings of SIGIR-96, 19th International Conference on Research and Development in Information Retrieval (Zürich, Switzerland). ACM, New York, pp. 174-180.
80. SMITH, J. R., AND CHANG, S.-F. 1994. Transform features for texture classification and discrimination in large image databases. In Proceedings of the 1st IEEE International Conference on Image Processing (Austin, Tex.). IEEE Computer Society Press, Los Alamitos, Calif., pp. 407-411.
81. SMITH, J. R., AND CHANG, S.-F. 1996. Visualseek: A fully automatic content-based image query system. In Proceedings of MM'96, 4th ACM International Conference on Multimedia (Boston, Mass.). ACM, New York, pp. 87-93.
82. SMITH, J. R., AND CHANG, S.-F. 1997. Visually searching the Web for content. IEEE Multimedia 4, 3, 12-20.
83. SOWA, J. F. 1984. Conceptual Structures: Information Processing in Mind and Machine. Addison-Wesley, Reading, Mass.
84. SPARCK JONES, K., AND WILLETT, P., Eds. 1997. Readings in information retrieval. Morgan-Kaufmann, San Mateo, Calif.
85. SPERBER, D., AND WILSON, D. 1986. Relevance. Communication and Cognition. Basil Blackwell, Oxford, England.
86. SRIHARI, R. 1995. Automatic indexing and content-based retrieval of captioned images. IEEE Comput. 28, 9, 49-56.
87. STRACCIA, U. 1996. Document retrieval by relevance terminological logics. In Proceedings of MIRO-95, Workshop on Multimedia Information Retrieval, I. Ruthven, Ed. (Glasgow, England)
88. STRACCIA, U. 1997a. A four-valued fuzzy propositional logic. In Proceedings of IJCAI-97, 15th International Joint Conference on Artificial Intelligence (Nagoya, Japan), pp. 128-133.
89. STRACCIA, U. 1997b. A sequent calculus for reasoning in four-valued description logics. In Proceedings of TABLEAUX-97, International Conference on Analytic Tableaux and Related Methods (Pont-à-Mousson, France). Lecture Notes in Computer Science, vol. 1227. Springer-Verlag, Heidelberg, Germany, pp. 343-357.
90. STRACCIA, U. 1998. A fuzzy description logic. In Proceedings of AAAI-98, 15th Conference of the American Association for Artificial Intelligence (Madison, Wisc.), pp. 594-599.
91. STRACCIA, U. 2000. A framework for the retrieval of multimedia objects based on four-valued fuzzy description logics. In Soft Computing in Information Retrieval: Techniques and Applications, F. Crestani and G. Pasi, Eds. Physica Verlag, Heidelberg, Germany, pp. 332-357.
92. STRICKER, M., AND ORENGO, M. 1995. Similarity of color images. In Proceedings of SPIE-95, 3rd SPIE Conference on Storage and Retrieval for Still Images and Video Databases (San Jose, Calif.). pp. 381-392.
93. SWAIN, M., AND BALLARD, D. 1991. Color indexing. Int. J. Comput. Vision 7, 1, 11-32.
94. THANOS, C., ED. 1990. Multimedia Office Filing. The MULTOS Approach. North-Holland, Amsterdam, The Netherlands.
95. TRESP, C., AND MOLITOR, R. 1998. A description logic for vague knowledge. In Proceedings of ECAI-98, 13th European Conference on Artificial Intelligence (Brighton, England), pp. 361-365.
96. VAN RIJSBERGEN, C. J. 1986. A non-classical logic for information retrieval. The Comput. J. 29, 481-485.
97. WEIDA, R., AND LITMAN, D. 1992. Terminological reasoning with constraint networks and an application to plan recognition. In Proceedings of KR-92, 3rd International Conference on Principles of Knowledge Representation and Reasoning (Cambridge, Mass.). pp. 282-293.
98. WOOD, M., CAMPBELL, N., AND THOMAS, B. 1998. Iterative refinement by relevance feedback in content-based digital image retrieval. In Proceedings of MM-98. 6th ACM International Conference on Multimedia (Bristol, England). ACM, New York, pp. 13-20.
99. YEN, J. 1991. Generalizing term subsumption languages to fuzzy logic. In Proceedings of IJCAI-91, 12th International Joint Conference on Artificial Intelligence (Sydney, Australia), pp. 472-477.
100. ZADEH, L. A. 1965. Fuzzy sets. Inf. Contr. 8, 3, 338-353.