A reference data set for the evaluation of medical image retrieval systems

Computerized Medical Imaging and Graphics

Volumn 28, Issue 6, 2004, Pages 295-305

  Müller, Henning ^a   Rosset, Antoine ^a   Vallée, Jean Paul ^a   Terrier, François ^a   Geissbuhler, Antoine ^a  

^a GENEVA UNIVERSITY HOSPITALS   (Switzerland)

Author keywords

Content based search; Evaluation; Gold standard; Ground truth; Medical image retrieval; Reference database

Indexed keywords

COPYRIGHTS; DATA ACQUISITION; DATABASE SYSTEMS; DIAGNOSIS; IMAGE RETRIEVAL; SOCIAL ASPECTS;

IMAGE MANAGEMENT SYSTEMS; PATIENT PRIVACY;

MEDICAL IMAGING;

ARTICLE; COMPARATIVE STUDY; DATA BASE; DIAGNOSTIC IMAGING; IMAGE ANALYSIS; INFORMATION RETRIEVAL; MEDICAL INFORMATION; PRIORITY JOURNAL; PUBLISHING; QUALITY CONTROL;

DATABASES, FACTUAL; DIAGNOSTIC IMAGING; HUMANS; INFORMATION STORAGE AND RETRIEVAL; RADIOLOGY INFORMATION SYSTEMS; SOFTWARE; USER-COMPUTER INTERFACE;

EID: 4043139438     PISSN: 08956111     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compmedimag.2004.04.005     Document Type: Article

References (57)

1. Logan B., Salomon A. A music similarity function based on signal analysis. Proceedings of the second International Conference on Multimedia and Exposition (ICME'2001), Tokyo, Japan. 2001;IEEE Computer Society. p. 952-5
2. Schonfeld D., Lelescu D. VORTEX: Video retrieval and tracking from compressed multimedia databases - Template matching from MPEG2 video compression standard. Kuo C.C.J., Chang S.F., Panchanathan S. Multimedia Storage and Archiving Systems III (VV02). SPIE Proceedings, Boston, MA. vol. 3527:1998;233-244. SPIE Symposium on Voice, Video and Data Communications
3. Smeulders A.W.M., Worring M., Santini S., Gupta A., Jains R. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence. 22:(12):2000;1349-1380
4. Rui Y., Huang T.S., Chang S.F. Image retrieval: past, present and future. Liao M. Proceedings of the International Symposium on Multimedia Information Processing, Taipei, Taiwan. 1997
5. Gupta A., Jain R. Visual information retrieval. Communications of the ACM. 40:(5):1997;70-79
6. Pentland A., Picard R.W., Sclaroff S. Photobook: tools for content-based manipulation of image databases. International Journal of Computer Vision. 18:(3):1996;233-254
7. Carson C., Thomas M., Belongie S., Hellerstein J.M., Malik J. Blobworld: A system for region-based image indexing and retrieval. Huijsmans D.P., Smeulders A.W.M. Third International Conference On Visual Information Systems (VISUAL'99), number 1614. Lecture Notes in Computer Science. 1999;509-516 Springer, Berlin
8. Bach J.R., Fuller C., Gupta A., Hampapur A., Horowitz B., Humphrey R., Jain R., Shu C.F. The Virage image search engine: An open framework for image management. Sethi I.K., Jain R.C. Storage and Retrieval for Image and Video Databases IV. IS&T/SPIE Proceedings, San Jose, CA. vol. 2670:1996;76-87
9. Flickner M., Sawhney H., Niblack W., Ashley J., Huang Q., Dom B., Gorkani M., Hafner J., Lee D., Petkovic D., Steele D., Yanker P. Query by image and video content: the QBIC system. IEEE Computer. 28:(9):1995;23-32
10. Narasimhalu A.D., Kankanhalli M.S., Wu J. Benchmarking multimedia databases. Multimedia Tools and Applications. 4:1997;333-356
11. Gunther NJ, Beretta G. A benchmark for image retrieval using distributed systems over the Internet: BIRDS-I. Technical report, HP Labs, Palo Alto, Technical Report HPL-2000-162, San Jose; 2001.
12. Müller H., Müller W., Marchand-Maillet S., McG Squire D., Pun T. A framework for benchmarking in visual information retrieval. International Journal on Multimedia Tools and Applications. 21:2003;55-73. Special Issue on Multimedia Information Retrieval
13. Leung C., Ip H. Benchmarking for content-based visual information search. Laurini R. Fourth International Conference On Visual Information Systems (VISUAL'2000), number 1929. Lecture Notes in Computer Science. 2000;442-456 Springer, Berlin
14. Smith J.R. Image Retrieval Evaluation. IEEE Workshop on Content-based Access of Image and Video Libraries (CBAIVL'98). 1998;. p. 112-3
15. Lowe H.J., Antipov I., Hersh W., Arnott Smith C. Towards knowledge-based retrieval of medical images. the role of semantic indexing, image content representation and knowledge-based retrieval. Proceedings of the Annual Symposium of the American Society for Medical Informatics (AMIA). 1998;. p. 882-6
16. Traina C. Jr., Traina A.J.M., dos Santos R.R., Senzako E.Y. A support system for content-based medical image retrieval in object oriented databases. Journal of Medical Systems. 21:(6):1997;339-352
17. Rosset A., Ratib O., Geissbuhler A., Vallée J.P. Integration of a multimedia teaching and reference database in a PACS environment. RadioGraphics. 22:(6):2002;1567-1577
18. Petrakis E.G.M. Content-based retrieval of medical images. International Journal of Computer Research. 11:(2):2002;171-182
19. Tagare H.D., Jaffe C., Duncan J. Medical image databases: a content-based retrieval approach. Journal of the American Medical Informatics Association. 4:(3):1997;184-198
20. Shyu C.R., Brodley C.E., Kak A.C., Kosaka A., Aisen A.M., Broderick L.S. ASSERT: A physician-in-the-loop content-based retrieval system for HRCT image databases. Computer Vision and Image Understanding (special issue on content-based access for image and video libraries). 75:(1/2):1999;111-132
21. Dy J.G., Brodley C.E., Kak A., Shyu C.R., Broderick L.S. The Customized-Queries Approach to CBIR using EM. Proceedings of the 1999 IEEE Conference on Computer Vision and Pattern Recognition (CVPR'99). 1999;IEEE Computer Society. p. 400-6
22. Aisen A.M., Broderick L.S., Winer-Muram H., Brodley C.E., Kak A.C., Pavlopoulou C., Dy J., Shyu C.R., Marchiori A. Automated storage and retrieval of thin-section CT images to assist diagnosis: system description and preliminary assessment. Radiology. 228:2003;265-270
23. Keysers D., Dahmen J., Ney H., Wein B.B., Lehmann T.M. A statistical framework for model-based image retrieval in medical applications. Journal of Electronic Imaging. 12:(1):2003;59-68
24. Lehmann T.M., Güld M.O., Thies C., Fischer B., Keysers D., Kohnen D., Schubert H., Wein B.B. Content-based image retrieval in medical applications for picture archiving and communication systems. Medical Imaging, volume 5033 of SPIE Proceedings. 2003
25. Qi H., Snyder W.E. Content-based image retrieval in PACS. Journal of Digital Imaging. 12:(2):1999;81-83
26. Le Bozec C., Zapletal E., Jaulent M.C., Heudes D., Degoulet P. Towards content-based image retrieval in HIS-integrated PACS. Proceedings of the Annual Symposium of the American Society for Medical Informatics (AMIA). 2000;. p. 477-81
27. El-Kwae E., Xu H., Kabuka M.R. Content-based retrieval in picture archiving and communication systems. Journal of Digital Imaging. 13:(2):2000;70-81
28. Mattie M.E., Staib L., Stratmann E., Tagare H.D., Duncan J., Miller P.L. PathMaster: content-based cell image retrieval using automated feature extraction. Journal of the American Medical Informatics Association. 7:2000;404-415
29. Schmidt-Saugeon P., Guillod J., Thiran J.P. Towards a computer-aided diagnosis system for pigmented skin lesions. Computerized Medical Imaging and Graphics. 27:2003;65-78
30. Baeg S., Kehtarnavaz N. Classification of breast mass abnormalities using denseness and architectural distorsion. Electronic Letters on Computer Vision and Image Analysis. 1:(1):2002;1-20
31. Tang L.H.Y., Hanka R., Ip H.H.S. A review of intelligent content-based indexing and browsing of medical images. Health Informatics Journal. 5:1999;40-49
32. Müller H., Michoux N., Bandon D., Geissbuhler A. A review of content-based image retrieval systems in medicine-clinical benefits and future directions. International Journal of Medical Informatics. 73:2004;1-23
33. Patrakis E.G.M., Faloutsos C. Similarity searching in medical image databases. IEEE Transactions on Knowledge and Data Engineering. 9:(3):1997;435-447
34. Korn P., Sidiropoulos N., Faloutsos C., Siegel E., Protopapas Z. Fast and effective retrieval of medical tumor shapes. IEEE Transactions on Knowledge and Data Engineering. 10:(6):1998;889-904
35. Cai W., Feng D.D., Fulton R. Content-based retrieval of dynamic PET functional images. IEEE Transactions on Information Technology in Biomedicine. 4:(2):2000;152-158
36. Schnorrenberg F., Pattichis F.F., Schizas C.N., Kyriacou K. Content-based retrieval of breast cancer biopsy slides. Technology and Health Care. 8:2000;291-297
37. Mojsilovis A., Gomes J. Semantic based Image Categorization, Browsing and Retrieval in Medical Image Databases. IEEE International Conference on Image Processing (ICIP' 2000). 2000
38. Antani S., Long L.R., Thoma G. A biomedical information system for combined content-based retrieval of spine X-ray images and associated text information. Proceedings of the 3rd Indian Conference on Computer Vision, Graphics and Image processing (ICVGIP 2002). 2002
39. Horsch A., Prinz M., Schneider S., Sipilä O., Spinnler K., Vallée J.P., Verdonck-de Leeuw I., Vogl R., Wittenberg T., Zahlmann G. Establishing an international reference image database for research and development in medical image processing. Meth Inform Med. 2004;. in press
40. Voorhees E.M., Harmann D. Overview of the seventh Text REtrieval Conference (TREC-7). The Seventh Text Retrieval Conference. 1998;. p. 1-23
41. Harman D. Overview of the first Text REtrieval Conference (TREC-1). Proceedings of the first Text REtrieval Conference (TREC-1). 1992;. p. 1-20
42. Salton R. The SMART Retrieval System. Experiments in Automatic Document Processing. 1971;Prentice Hall, Englewood Cliffs, NJ
43. Clough P, Sanderson M. The clef 2003 cross language image retrieval task. In Proceedings of the Cross Language Evaluation Forum (CLEF 2004); submitted for publication.
44. Bürkle T., Ammenwerth E., Prokosch H.U., Dudeck J. Evaluation of clinical information systems. What can be evaluated and what cannot. Journal of Evaluation in Clinical Practice. 7:(4):2001;373-385
45. Kushniruk A.W., Patel V.L. Cognitive and usability engineering methods for the evaluation of clinical information systems. International Journal of Biomedical Informatics. 37:(1):2004;56-76
46. Cleverdon CW. Report on the testing and analysis of an investigation into the comparative efficiency of indexing systems. Technical Report. Aslib Cranfield Research Project, Cranfield, USA; September 1962.
47. Sparck Jones K, van Rijsbergen CJ. Report on the need for and provision of an ideal information retrieval test collection. British Library Research and Development Report 5266. Computer Laboratory, University of Cambridge; 1975.
48. Sparck Jones K., Van Rijsbergen C.J. Progress in documentation. Journal of Documentation. 32:1976;59-75
49. Zobel J. How reliable are the results of large-scale information retrieval experiments? Bruce Croft W., Moffat A., van Rijsbergen C.J., Wilkinson R., Zobel J. Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 1998;307-314 ACM Press, New York
50. Manjunath B.S., Ohm J.R., Vasudevan V.V., Yamada A. Color and texture descriptors. IEEE Transactions on Circuits and Systems for Video Technology. 11:(6):2001;703-715
51. Saracevis T. Relevance: a review of and a framework for the thinking on the notion in information science. Journal of the American Society for Information Science. 1975;321-343
52. Schamber L., Eisenberg M.B., Nilan M.S. A re-examination of relevance: toward a dynamic, situational definition. Information Processing and Management. 26:(6):1990;755-775
53. Voorhees E.M. Variations in relevance judgements and the measurement of retrieval effectiveness. Information Processing and Management. 36:2000;697-716
54. Müller H., Rosset A., Vallée J.P., Geissbuhler A. Integrating content-based visual access methods into a medical case database. Proceedings of the Medical Informatics Europe Conference (MIE St Malo, France). 2003
55. Rui Y., Huang T.S., Ortega M., Mehrotra S. Relevance feedback: A power tool for interactive content-based image retrieval. IEEE Transactions on Circuits and Systems for Video Technology. 8:(5):1998;644-655. Special Issue on Segmentation, Description, and Retrieval of Video Content
56. Cleverdon CW, Mills L, Keen M. Factors determining the performance of indexing systems. Technical Report. ASLIB Cranfield Research Project, Cranfield; 1966.
57. Horsch A., Thurmayr R. How to identify and assess tasks and challenges of medical image processing. Proceedings of the Medical Informatics Europe Conference (MIE St Malo, France). 2003;2003