CLAIRE: A modular support vector image indexing and classification system

ACM Transactions on Information Systems

Volumn 24, Issue 3, 2006, Pages 353-379

  Tsai, Chih Fong ^a   Mcgarry, Ken ^b   Tait, John ^b  

^a NATIONAL CHUNG CHENG UNIVERSITY   (Taiwan)

^b UNIVERSITY OF SUNDERLAND   (United Kingdom)

Author keywords

Content based image retrieval; Image classification; Image indexing; Multiple classifier systems; Support vector machines

Indexed keywords

IMAGE CLASSIFICATION; IMAGE INDEXING; MULTIPLE CLASSIFIER SYSTEMS; SUPPORT VECTOR MACHINES (SVM);

AUTOMATIC INDEXING; COLOR IMAGE PROCESSING; CONTENT BASED RETRIEVAL; PROBABILITY; QUERY LANGUAGES; THESAURI;

PATTERN RECOGNITION;

EID: 33749641638     PISSN: 10468188     EISSN: 10468188     Source Type: Journal    
DOI: 10.1145/1165774.1165777     Document Type: Article

References (70)

1. AKSOY, S. AND HARALICK, R. M. 2000. Using texture in image similarity and retrieval. In Texture Analysis in Machine Vision, M. Pietikainen and H. Bunke, eds. World Scientific, River Edge, NJ 129-149.
2. ANTANI, S., KASTURI, R., AND JAIN, R. 2002. A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video. Pattern Recogn. 35, 945-965.
3. ARMITAGE, L. AND ENSER, P. G. B. 1997. Analysis of user need in image archives. J. Inf. Sci. 23, 287-299.
4. BARNARD, K., DUYGULU, P., FORSYTH, D., DE FREITAS, N., BLEI, D. M., AND JORDAN, M. I. 2003. Matching words and pictures. J. Mach. Learn. Res. 3, 1107-1135.
5. BENITEZ, A. B. AND SMITH, J. R. 2001. New frontiers for intelligent content-based retrieval. In Proceedings of the SPIE Conference on Storage and Retrieval for Media Databases, vol. 4315. San Jose, CA, Jan.
6. BLACK, J. A., JR., FAHMY, G., AND PANCHANATHAN, S. 2002. A method for evaluating the performance of content-based image retrieval system based on subjectivity determined similarity between images. In Proceedings of the International Conference on Image and Video Retrieval. London, UK, 356-366.
7. BOUTELL, M., LUO, J., SHEN, X., AND BROWN, C. M. 2004. Learning multi-label scene classification. Pattern Recogn. 37, 1757-1771.
8. BURGES, C. J. C. 1998. A tutorial on support vector machines for pattern recognition. Data Mining Knowl. Discovery 2, 121-167.
9. BYUN, H. AND LEE, S.-W. 2002. Applications of support vector machines for pattern recognition. In Proceedings of the 1st International Workshop on Pattern Recognition with Support Vector Machines. Niagra Falls, Canada, Aug. 213-236.
10. CAMPBELL, N. W. AND THOMAS, B. T. 1997. Automatic segmentation and classification of outdoor images using neural networks. Int. J. Neural Syst. 8, 137-144.
11. CHAN, P. AND STOLFO, S. J. 1997. On the accuracy of metalearning for scalable data mining. J. Intel. Inf. Syst. 8, 5-28.
12. CHANG, S.-F., SMITH, J.R., BEIGI, M., AND BENITEZ, A. 1997. Visual information retrieval from large distributed on-line repositories. Commun. ACM 40, 63-71.
13. CIOCCA, G., CUSANO, C., SCHETTINI, R., AND BRAMBILLA, C. 2003. Semantic labeling of digital photos by classification. In Proceedings of the Conference Internet Imaging IV, SPIE 5018, Santa Clara, CA, Jan.
14. CLARK, A. A., TROSCIANKO, T., CAMPBELL, N. W., AND THOMAS, B. T. 2000. A comparison between human and machine labelling of image regions. Perception 29, 1127-1138.
15. CORTES, C. AND VAPNIK, V. 1995. Support vector networks. J. Mach. Learn. 20, 273-297.
16. CRISTIANINI, N. AND SHAWE-TAYLOR, J. 2000. An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge University Press, New York.
17. DAS, M., MANMATHA, R., AND RISEMAN, E. M. 1999. Indexing flower patent images using domain knowledge. IEEE Intell. Syst. 15, 24-33.
18. DIETTERICH, T. G. 1997. Machine learning research: Four current directions. Artif. Intell. 18, 97-136.
19. DUMAIS, S., PLATT, J., HECKERMAN, D., AND SAHAMI, M. 1998. Inductive learning algorithms and representations for text categorization. In Proceedings of the International Conference on Information and Knowledge Management, Bethesda, MD, Nov. 148-155.
20. EAKINS, J. P. 2002. Towards intelligent image retrieval. Pattern Recogn. 35, 3-14.
21. FIDEL, R. 1997. The image retrieval task: Implications for the design and evaluation of image databases. New Rev. Hypermedia Multimedia. 3, 181-199.
22. FLICKNER, M., SAWHNEY, H., NIBLACK, W., ASHLEY, J., HUANG, Q., DOM, B., GORKANI, M., HAFNER, J., LEE, D., PETKOVIC, D., STEELE, D., AND YANKER, P. 1995. Query by image and video content: The QBIC system. IEEE Comput. 28, 23-32.
23. FORSYTH, D. A. AND FLECK, M. 1997. Body plans. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition. San Juan, PR, June, 678-683.
24. GUPTA, A. AND JAIN, R. 1997. Visual information retrieval. Commun. ACM 40, 71-79.
25. HSU, C.-W. AND LIN, C.-J. 2002. A comparison of methods for multi-class support vector machines. IEEE Trans. Neural Netw. 12, 1288-1298.
26. IYATOMI, H. AND HAGIWARA, M. 2002. Scenery image recognition and interpretation using fuzzy inference neural networks. Pattern Recogn. 35, 1793-1806.
27. JAIMES, A. AND CHANG, S.-F. 2001. Learning structured visual detectors from user input at multiple levels. Int. J. Images Graphics 1, 415-444.
28. JAIN, A. K., DUIN, R. P. W., AND MAO, J. 2000. Statistical pattern recognition: A review. IEEE Trans. Pattern Anal. Mach. Intell. 22, 4-37.
29. JOACHIMS, T. 2001. Learning to Classify Text Using Support Vector Machines: Methods, Theory and Algorithms. Kluwer Academic, Hingham, MA.
30. KITTLER, J., HATEF, M., DUIN, R. P. W., AND MATAS, J. 1998. On combining classifiers. IEEE Trans. Pattern Recog. Mach. Intell. 20, 226-239.
31. KOHAVI, R. AND FOSTER, P. 1998. Glossary of terms. J. Mach. Learn. 30, 271-274.
32. KURODA, K. AND HAGIWARA, M. 2002. An image retrieval system by impression words and specific object names-IRIS. Neurocomput. 43, 259-276.
33. LAAKSONEN, J. T., KOSKELA, J. M., LAAKSO, S. P., AND OJA, E. 2000. PicSOM - Content-based image retrieval with self-organizing maps. Pattern Recog. Lett. 21, 1197-1207.
34. LAI, T.-S. 2000. CHROMA: A photographic image retrieval system. PhD. Thesis, University of Sunderland, UK.
35. Li, S., KWOK, J. T., ZHU, H., AND WANG, Y. 2003. Texture classification using support vector machines. Pattern Recogn. 36, 2883-2893.
36. MCDONALD, S., LAI, T.-S., AND TAIT, T. 2001. Evaluating a content based image retrieval system. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval. New Orleans, LA, Sept., 232-240.
37. MCDONALD, S. AND TAIT, T. 2003. Search strategies in content-based image retrieval. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval. Toronto, Canada, July 28-Aug. 1, 80-87.
38. OJALA, T., PIETIKANEN, M., AND HARWOOD, D. 1996. A comparative study of texture measures with classification based on feature distributions. Pattern Recogn. 29, 51-59.
39. PAEK, S., SABLE, C. L., HATZIVASSILOGLOU, V., JAIMES, A., SCHIFFMAN, B. H., CHANG, S.-F., AND MCKEOWN, K. R. 1999. Integration of visual and text-based approaches for the content labeling and classification of photographs. In Proceedings of the ACM SIGIR Workshop on Multimedia Indexing and Retrieval. Berkeley, CA, Aug.
40. PAGANO, R. R. 2001. Understanding Statistics in the Behavioral Sciences, 6th ed. Wadsworth/Thomson Learning, CA.
41. PARK, S. B., LEE, J. W., AND KIM, S. K. 2004. Content-based image classification using a neural network. Pattern Recogn. Lett. 25, 287-300.
42. PENTLAND, A., PICARD, R. W., AND SCLAROFF, S. 1996. Photobook: Content-based manipulation of image databases. Int. J. Comput. Vision 18, 233-254.
43. PICHLER, O., TEUNER, A., AND HOSTICKA, B. J. 1996. A comparison of texture feature extraction using adaptive gabor filtering, pyramidal and tree structured wavelet transforms. Pattern Recogn. 29, 733-742.
44. RANDEN, T. AND HUSOY, J. H. 1999. Filtering for texture classification: A comparative study. IEEE Trans. Pattern Anal. Mach. Intell. 21, 291-310.
45. RASMUSSEN, E. M. 1997. Indexing images. Annual Rev. Inf. Sci. Technol. 32, 169-196.
46. ROLI, F. AND GIACINTO, G. 2002. Design of multiple classifier systems. In Hybrid Methods in Pattern Recognition, H. Bunke, and A. Kandel, eds. World Scientific, River Edge, NJ.
47. RUI, Y., HUANG, T. S., AND CHANG, S.-F. 1999. Image retrieval current techniques, promising directions and open issues. J. Visual Commun. Image Representation 10, 39-62.
48. SCHAPIRE, R. E., FREUND, Y., BARTLETT, P., AND LEE, W. S. 1997. Boosting the margin: A new explanation for the effectiveness of voting methods. In Proceedings of the International Conference on Machine Learning. Nashville, TN, July, 322-330.
49. SEBE, N. AND LEW, M. S. 2000. Wavelet based texture classification. In Proceedings of the IEEE International Conference on Pattern Recognition (ICPR). Barcelona, Sept., 3959-3962.
50. SERRANO, N., SAVAKIS, A., AND LUO, J. 2002. A computationally efficient approach to indoor/outdoor scene classification. In Proceedings of the IEEE International Conference on Pattern Recognition, Quebec, Canada, Aug., 146-149.
51. SHARKEY, A. J. C. 1997. Combing Artificial Neural Nets: Ensemble and Modular Multi-Net Systems. Springer Verlag, New York.
52. SHEIKHOLESLAMI, G., CHANG, W., AND ZHANG, A. 1998. SemQuery: Semantic clustering and querying on heterogeneous features for visual data. IEEE Trans. Knowl. Data Eng. 14, 9881002.
53. SMITH, J. R. AND CHANG, S.-F. 1996. VisualSEEk: A fully automated content-based image query system. In. Proceedings of the ACM International Conference on Multimedia. Boston, Nov., 87-98.
54. SMEULDERS, A. W. M., WORRING, M., SANTINI, S., GUPTA, A., AND JAIN, R. 2000. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. In tell. 22, 1349-1380.
55. SONG, Y. AND ZHANG, A. 2003. Analyzing scenery images by monotonic tree. ACM Multimedia Syst. 8, 495-511.
56. SPINK, A. AND JANSEN, J. 2004. Web Search: Public Searching of the Web. Springer Verlag, New York.
57. SZUMMER, M. AND PICARD, R. W. 1998. Indoor-outdoor image classification. In Proceedings of the IEEE International Workshop on Content-Based Access of Image and Video Databases. Bombay, Jan., 42-51.
58. TAIT, J. 2006. Exploratory search: Image retrieval without deep semantics. To appear in Proceedings of the Artificial Intelligence Innovations and Applications. Athens, June.
59. TSAI, C.-F. 2003. Stacked generalization: A novel solution to bridge the semantic gap for content-based image retrieval. Online Inf. Rev. 27, 442-445.
60. TSAI, C.-F., MCGARRY, K., AND TAIT, J. 2003. Image classification using hybrid neural networks. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval. Toronto, Canada, July 28-Aug. 1, 431-432.
61. TSAI, C.-F, MCGARRY, K., AND TAIT, J. 2004. Automatic metadata annotation of images via a two-level learning framework. In Proceedings of the 2nd International Workshop on Semantic Web Conference, in conjunction with the ACM SIGIR '04. Sheffield, UK, July, 32-42.
62. TSAI, C.-F., MCGARRY, K., AND TAIT, J. 2006. Qualitative evaluation of automatic assignment of keywords to images. Inf. Process. Manage. 42, 136-154.
63. TUMER, K. AND GHOSH, J. 1996. Error correlation and error reduction in ensemble classifiers. Connection Sci. 8, 385-404.
64. VAILAYA, A., FIGUEIREDO, M. A. T., JAIN, A. K., AND ZHANG, H.-J. 2001. Image classification for content-based indexing. IEEE Trans. Image Process. 10, 117-130.
65. VELTKAMP, R. C. AND TANASE, M. 2000. Content-based image retrieval systems: A survey. Tech. Rep. UU-CS-2000-34, Utrecht University. Available online from: http://give-lab.cs.uu.nl/cbirsurvey/
66. VOGEL, J. AND SCHIELE, B. 2001. Performance prediction for vocabulary-supported image retrieval. In Proceedings of the IEEE International Conference on Image Processing. Thessaloniki, Greece, Oct., 753-756.
67. WESTERVELD, T. AND DE VRIES, A.P. 2003. Experimental evaluation of a generative probabilistic image retrieval model on 'easy' data. In Proceedings of the Multimedia Information Retrieval Workshop, in conjunction with the 26th Annual ACM SIGIR Conference on Information Retrieval. Toronto, Canada, July 28-Aug. 1.
68. Wu, J. K., KANKANHALLI, M. S., LIM, H.-H., AND HONG, D. 2000. Perspectives on Content-Based Multimedia Systems. Kluwer Academic, Hingham, MA.
69. ZHOU, X. S. AND HUANG, T. S. 2002. Unifying keywords and visual contents in image retrieval. IEEE Multimedia 9, 23-33.
70. ZHU, X., Liu, W., ZHANG, H., AND Wu, L. 2001. An image retrieval and semi-automatic annotation scheme for large image databases on the web. In Proceedings of the 13th SPIE Symposium on Electronic Imaging-EI24 Internet Imaging II. 168-177.