Automatic medical image annotation in ImageCLEF 2007: Overview, results, and discussion

Pattern Recognition Letters

Volumn 29, Issue 15, 2008, Pages 1988-1995

  Deselaers, Thomas ^a   Deserno, Thomas M ^a   Müller, Henning ^b,c  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b UNIVERSITY OF GENEVA   (Switzerland)

^c University of Applied Sciences Sierre   (Switzerland)

Author keywords

Automatic image annotation; Benchmark; Evaluation; Medical images

Indexed keywords

ARTIFICIAL INTELLIGENCE; CHLORINE COMPOUNDS; COMPUTER VISION; IMAGE ANALYSIS; IMAGE PROCESSING; IMAGE RETRIEVAL; LEARNING SYSTEMS; OBJECT RECOGNITION;

AUTOMATIC ANNOTATION; AUTOMATIC IMAGE ANNOTATION; BENCHMARK; CLASS HIERARCHIES; CLASSIFICATION METHODS; CROSS-LANGUAGE IMAGE RETRIEVAL; DISCRIMINATIVE MODELS; EVALUATION; IMAGE ANNOTATION; IMAGE REPRESENTATIONS; LEVELS OF DETAILS; LOCAL IMAGE DESCRIPTORS; MACHINE-LEARNING; MEDICAL ANNOTATION; MEDICAL IMAGES; MEDICAL IMAGING; STATE-OF-THE-ART METHODS; TEST IMAGES; TRAINING IMAGES; VISUAL PROPERTIES;

IMAGE ENHANCEMENT;

EID: 52049110857     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2008.03.001     Document Type: Article

References (28)

1. Clough, P.D., Sanderson, M., 2004. The CLEF 2003 cross language image retrieval track. In: Comparative Evaluation of Multi-lingual Information Access Systems, Lecture Notes in Computer Science, vol. 3237, Trondheim, Norway, pp. 581-593.
2. Clough, P., Müller, H., Sanderson, M., 2005. The CLEF cross language image retrieval track (ImageCLEF) 2004. In: Fifth Workshop of the Cross-Language Evaluation Forum (CLEF 2004), Lecture Notes in Computer Science, vol. 3491, pp. 597-613.
3. Clough, P., Müller, H., Deselaers, T., Grubinger, M., Lehmann, T., Jensen, J., Hersh, W., 2006. The CLEF 2005 cross-language image retrieval track. In: Accessing Multi-lingual Information Repositories, sixth Workshop of the Cross-Language Evaluation Forum, CLEF 2005, Lecture Notes in Computer Science, vol. 4022, Vienna, Austria, pp. 535-557.
4. Clough, P., Grubinger, M., Deselaers, T., Hanbury, A., Müller, H., 2007. Overview of the ImageCLEF 2006 photographic retrieval and object annotation tasks. In: Evaluation of Multi-lingual and Multi-modal Information Retrieval - Seventh Workshop of the Cross-Language Evaluation Forum, CLEF 2006, Lecture Notes in Computer Series, vol. 4730, Alicante, Spain, pp. 579-594.
5. Deselaers, T., Hegerath, A., Keysers, D., Ney, H., 2006. Sparse patch-histograms for object classification in cluttered images. In: DAGM 2006, Pattern Recognition, 27th DAGM Symposium, Lecture Notes in Computer Science, vol. 4174, Berlin, Germany, pp. 202-211.
6. Deselaers, T., Hanbury, A., Viitaniemi, V., Benczúr, A., Brendel, M., Daróczy, B., Escalante Balderas, H.J., Gevers, T., Hern'andez Gracidas, C.A., Hoi, S.C.H., Laaksonen, J., Li, M., Marin Castro, H.M., Ney, H., Rui, X., Sebe, N., Stöttinger, J., Wu, L., 2007a. Overview of the ImageCLEF 2007 object retrieval task. In: Working Notes of the CLEF 2007 Workshop, Budapest, Hungary.
7. Deselaers T., Müller H., Clough P., Ney H., and Lehmann T.M. The CLEF 2005 automatic medical image annotation task. Internat. J. Comput. Vision 74 1 (2007) 51-58
8. Everingham, M., Gool, L.V., Williams, C., Zisserman, A., 2005. Pascal visual object classes challenge results. Tech. Rep., University of Oxford, Oxford, UK.
9. Everingham, M., Zisserman, A., Williams, C.K.I., van Gool, L., Allan, M., Bishop, C.M., Chapelle, O., Dalal, N., Deselaers, T., Dorko, G., Duffner, S., Eichhorn, J., Farquhar, J.D.R., Fritz, M., Garcia, C., Griffiths, T., Jurie, F., Keysers, D., Koskela, M., Laaksonen, J., Larlus, D., Leibe, B., Meng, H., Ney, H., Schiele, B., Schmid, C., Seemann, E., Shawe-Taylor, J., Storkey, A., Szedmak, S., Triggs, B., Ulusoy, I., Viitaniemi, V., Zhang, J., 2006. The 2005 pascal visual object classes challenge. In: Machine Learning Challenges. Evaluating Predictive Uncertainty, Visual Object Classification, and Recognising Textual Entailment (PASCAL Workshop 05), Lecture Notes in Artificial Intelligence, vol. 3944, Southampton, UK, pp. 117-176.
10. Faloutsos C., Barber R., Flickner M., Hafner J., Niblack W., Petkovic D., and Equitz W. Efficient and effective querying by image content. J. Intell. Inform. Systems 3 3-4 (1994) 231-262
11. Grubinger, M., Clough, P., Müller, H., Deselaers, T., 2006. The IAPR benchmark: A new evaluation resource for visual information systems. In: LREC 06 OntoImage 2006: Language Resources for Content-Based Image Retrieval, Genoa, Italy.
12. Grubinger, M., Clough, P., Hanbury, A., Müller, H., 2007. Overview of the imageCLEFphoto 2007 photographic retrieval task. In: Working Notes of the CLEF 2007 Workshop, Budapest, Hungary.
13. Lehmann, T.M., Schubert, H., Keysers, D., Kohnen, M., Wein, B.B., 2003. The IRMA code for unique classification of medical images. In: Proc. SPIE, No. 5033, pp. 440-451.
14. Marée, R., Geurts, P., Piater, J., Wehenkel, L., 2005. Random subwindows for robust image classification. In: IEEE Conf. on Computer Vision and Pattern Recognition (CVPR 2005), IEEE vol. 1, San Diego, CA, USA, pp. 34-40.
15. Moëllic, P.-A., Fluhr, C., 2006. ImageEVAL 2006 official campaign. Tech. Rep., ImagEVAL.
16. Maynard, D., Peters, W., Li, Y., 2006. Metrics for evaluation of ontology-based information extraction. In: Evaluation of Ontologies for the Web, Edinburgh, UK.
17. Müller, H., Deselaers, T., Kim, E., Kalpathy-Kramer, J., Deserno, T.M., Hersh, W., 2007a. Overview of the ImageCLEFmed 2007 medical retrieval and annotation tasks. In: Working Notes of the CLEF 2007 Workshop, Budapest, Hungary.
18. Müller, H., Deselaers, T., Lehmann, T., Clough, P., Hersh, W., 2007b. Overview of the ImageCLEFmed 2006 medical retrieval and annotation tasks. In: Evaluation of Multi-lingual and Multi-modal Information Retrieval - Seventh Workshop of the Cross-Language Evaluation Forum, CLEF 2006, LNCS vol. 4730, Alicante, Spain, pp. 595-608.
19. National Institute of Standards and Technology (NIST), 2001-2008. NIST open MT machine translation evaluation. .
20. Pallet, D.S., 2003. A look at NIST's benchmark ASR tests: Past, present, and future. Tech. Rep., National Institute of Standards and Technology (NIST), Gaithersburg, MD, USA. URL .
21. Sun, A., Lim, E.-P., 2001. Hierarchical text classification and evaluation. In: IEEE International Conference on Data Mining (ICDM 2001), San Jose, CA, USA, pp. 521-528.
22. Springmann, M., Schuldt, H., 2007. Speeding up IDM without degradation of retrieval quality. In: Working Notes of the CLEF Workshop 2007.
23. Setia, L., Burkhardt, H., 2007. Learning taxonomies in large image databases. In: ACM SIGIR Workshop on Multimedia Information Retrieval, Amsterdam, Holland.
24. Setia, L., Teynor, A., Halawani, A., Burkhardt, H., 2006. Image classification using cluster-cooccurrence matrices of local relational features. In: Proc. 8th ACM Internat. Workshop on Multimedia Information Retrieval, Santa Barbara, CA, USA.
25. Snoek, C.G., Worring, M., van Gemert, J.C., Geusebroek, J.-M., Smeulders, A.W., 2006. The challenge problem for automated detection of 101 semantic concepts in multimedia. In: ACM Multimedia, Santa Barbara, CA, USA, pp. 421-430.
26. Tommasi, T., Orabona, F., Caputo, B., 2007. CLEF2007 Image annotation task: An SVM - based cue integration approach. In: Working Notes of the 2007 CLEF Workshop, Budapest, Hungary.
27. Voorhees E.M., and Harman D.K. TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing) (2005), The MIT Press
28. Zhou, X., Gobeill, J., Ruch, P., Müller, H., 2007. University and Hospitals of Geneva at ImageCLEF 2007. In: Working Notes of the 2007 CLEF Workshop, Budapest, Hungary.