X-ray categorization and retrieval on the organ and pathology level, using patch-based visual words

IEEE Transactions on Medical Imaging

Volumn 30, Issue 3, 2011, Pages 733-746

  Avni, Uri ^a   Greenspan, Hayit ^a,b   Konen, Eli ^c   Sharon, Michal ^c   Goldberger, Jacob ^d  

^a TEL AVIV UNIVERSITY   (Israel)

^b IBM ALMADEN RESEARCH CENTER   (United States)

^c SHEBA MEDICAL CENTER   (Israel)

^d BAR ILAN UNIVERSITY   (Israel)

Author keywords

Chest radiography; computer aided diagnosis (CAD); disease labeling; image categorization; image patches; image retrieval; visual words; X ray

Indexed keywords

CHEST RADIOGRAPHY; COMPUTER-AIDED DIAGNOSIS (CAD); IMAGE CATEGORIZATION; IMAGE PATCHES; VISUAL WORDS;

COMPETITION; COMPUTER AIDED DIAGNOSIS; DISEASES; FACE RECOGNITION; IMAGE RETRIEVAL; IMAGING SYSTEMS; INTERNATIONAL TRADE; MEDICAL IMAGING; PATHOLOGY; RADIOLOGY; X RAY RADIOGRAPHY; X RAYS;

SEARCH ENGINES;

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; DOCUMENTATION; HOSPITAL INFORMATION SYSTEM; HUMAN; INFORMATION RETRIEVAL; METHODOLOGY; NOMENCLATURE; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; DOCUMENTATION; HUMANS; INFORMATION STORAGE AND RETRIEVAL; PATTERN RECOGNITION, AUTOMATED; RADIOGRAPHIC IMAGE INTERPRETATION, COMPUTER-ASSISTED; RADIOLOGY INFORMATION SYSTEMS; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; TERMINOLOGY AS TOPIC;

EID: 79952162060     PISSN: 02780062     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMI.2010.2095026     Document Type: Article

References (46)

1. C. B. Akgul, D. L. Rubin, S. Napel, C. F. Beaulieu, H. Greenspan, and B. Acar, "Content based image retrieval in radiology: Current status and future directions," J. Digital Imag., Jan. 2010.
2. H. Alto, R. M. Rangayyan, and J. E. L. Desautels, "Content-based retrieval and analysis of mammographic masses," J. Electron. Imag., vol. 14, no. 2, 2005.
3. B. André, T. Vercauteren, A. Perchant, A. Buchner,M.Wallace, and N. Ayache, "Introducing space and time in local feature-based endomicroscopic image retrieval," in Medical Content-Based Retrieval for Clinical Decision Support, B. Caputo, H. Müller, T. Syeda-Mahmood, J. Duncan, F. Wang, and J. Kalpathy-Cramer, Eds. Berlin/Heidelberg: Springer, 2010, vol. 5853, Lecture Notes in Computer Science, pp. 18-30.
4. U. Avni, J. Goldberger, and H. Greenspan, "Dense simple features for fast and accurate medical X-ray annotation," in 10th Workshop of the Cross-Language Evaluation Forum (CLEF 2009), LNCS. New York: Springer, 2010, Lecture Notes in Computer Science.
5. U.Avni, J. Goldberger,M. Sharon, E.Konen, and H. Greenspan, "Chest X-ray characterization: From the organ identification to the pathology categorization," presented at the 11thACMSIGMM International Conference on Multimedia Information Retrieval (MIR-2010), Philadelphia, PA, Mar. 29-31, 2010.
6. U. Avni, H. Greenspan, M. Sharon, E. Konen, and J. Goldberger, "X-ray image categorization and retrieval using patch-based visual words representation," in ISBI'09: Proc. 6th IEEE Int. Conf. Symp. Biomed. Imag., Piscataway, NJ, 2009, pp. 350-353, IEEE Press.
7. A. Barla, F. Odone, and A. Verri, "Histogram intersection kernel for image classification," in Proc. ICIP, 2003, vol. 3.
8. A. Bosch, X. Muñoz, A. Oliver, and J. Martí, "Modeling and classifying breast tissue density in mammograms," in Proc. CVPR, 2006, pp. 1552-1558. (Pubitemid 44931504)
9. W. W. Chu, A. F. Cárdenas, and R. K. Taira, "Kmed: A knowledgebased multimedia medical distributed database system," Inf. Syst., vol. 20, no. 2, pp. 75-96, 1995.
10. M. de Berg, M. van Kreveld, M. Overmars, and O. Schwarzkopf, Computational Geometry (Algorithms and Applications). New York: Springer, 1998.
11. A. Depeursinge, A.Vargas, A. Platon, A. Geissbühler, P. Poletti, and H. Müller, "3D case-based retrieval for interstitial lung diseases," MCBRCDS, pp. 39-48, 2009.
12. T. Deselaers, A. Hegerath, D. Keysers, and H. Ney, "Sparse patch-histograms for object classification in cluttered images," in DAGM Symp., 2006, pp. 202-211. (Pubitemid 44608867)
13. J. Dy, C. Brodley, A. Kak, L. Broderick, and A. Aisen, "Unsupervised feature selection applied to content-based retrieval of lung images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 3, pp. 373-378, Mar. 2003.
14. E. El-Kwae, H. Xu, and M. Kabuka, "Content-based retrieval in picture archiving and communication systems," J. Digital Imag., vol. 13, no. 2, pp. 70-81, Feb. 2000.
15. I. El-Naqa, Y. Yongyi, N. P. Galatsanos, R. M. Nishikawa, and M. N. Wernick, "A similarity learning approach to content-based image retrieval: Application to digital mammography," IEEE Trans. Med. Imag., vol. 23, no. 10, pp. 1233-1244, Oct. 2004.
16. Abe et al., "Computer-aided diagnosis in chest radiography: Results of large-scale observer tests at the 1996-2001 RSNA scientific assemblies1," Radiographics, vol. 23, no. 1, pp. 255-265, 2003. (Pubitemid 37421456)
17. H. Müller et al., "Overview of the ImageCLEFmed 2007 medical retrieval and medical annotation tasks," in CLEF, 2007, pp. 472-491.
18. H. Müller et al., "Overview of the ImageCLEFmed 2008 medical image retrieval task," in CLEF, 2008, pp. 512-522.
19. T. M. Lehmann et al., "The IRMA code for unique classification of medical images," in Proc. SPIE, 2003, pp. 109-117.
20. T. M. Lehmann et al., "Content-based image retrieval in medical applications," Methods Inf. Medicine, vol. 43, no. 4, pp. 354-361, Oct. 2004. (Pubitemid 39390344)
21. T. Tommasi et al., "Overview of the CLEF 2009 medical image annotation track," CLEFWorking Notes 2009 [Online]. Available: http:// www.clef-campaign.org/2009/working-notes
22. L. Fei-Fei and P. Perona, "A Bayesian hierarchical model for learning natural scene categories," in Proc. CVPR, 2005, vol. 2, pp. 524-531.
23. H. Greenspan, J. Goldberger, and L. Ridel, "A continuous probabilistic framework for image matching," Comput. Vision Image Understand., vol. 84, no. 3, pp. 384-406, 2001. (Pubitemid 34782018)
24. H. Greenspan and A. T. Pinhas, "Medical image categorization and retrieval for pacs using the gmm-kl framework," IEEE Trans. Inf. Technol. Biomed., vol. 11, no. 2, pp. 190-202, Mar. 2007. (Pubitemid 46523136)
25. M. O. Güld, M. Kohnen, D. Keysers, H. Schubert, B. Wein, J. Bredno, and T. M. Lehmann, "Quality of dicom header information for image categorization," in Proc. SPIE Int. Symp. Medical Imag., San Diego, CA, Feb. 2002, vol. 4685, pp. 280-287. (Pubitemid 34918389)
26. J. A. Hanley and B. J. Mcneil, "The meaning and use of the area under a receiver operating characteristic ROC curve," Radiology, vol. 143, no. 1, pp. 29-36, 1982. (Pubitemid 12142173)
27. C. E. Kahn and C. Thao, "Goldminer: A radiology image search engine," AJR Am. J. Roentgenol., vol. 188, no. 6, pp. 1475-1478, Jun. 2007. (Pubitemid 46866846)
28. W. Khaliq, C. J. Blakeley, S. Maheshwaran, K. Hashemi1, and P. Redman, "Comparison of a pacs workstation with laser hard copies for detecting scaphoid fractures in the emergency department," J. Digital Imag., vol. 23, no. 1, pp. 100-103, 2008.
29. P. Korn, N. Sidiropoulos, C. Faloutsos, E. Siegel, and Z. Protopapas, "Fast and effective retrieval of medical tumor shapes," IEEE Trans. Knowl. Data Eng., vol. 10, no. 6, pp. 889-904, Nov./Dec. 1998. (Pubitemid 128752569)
30. C. Lebozec, M. Jaulent, E. Zapletal, and P. Degoulet, "Unified modeling language and design of a case-based retrieval system in medical imaging," in Proc. Annu. Symp. Am. Soc. Med. Informat. (AMIA), 1998, pp. 887-891.
31. L. R. Long, S. Antani, D.-J. Lee, D. M. Krainak, and G. R. Thoma, "Biomedical information from a national collection of spine X-rays: Film to content-based retrieval," in Soc. Photo-Optical Instrumentat. Eng. (SPIE) Conf. Series, Soc. Photo-Optical Instrumentat. Eng. (SPIE) Conf. Series, May 2003, vol. 5033, pp. 70-84.
32. D. G. Lowe, "Object recognition from local scale-invariant features," Proc. ICCV, vol. 2, pp. 1150-1157, 1999, vol. 2.
33. C. D. Manning, P. Raghavan, and H. Schütze, Introduction to Information Retrieval, 1st ed. Cambridge, U.K.: Cambridge Univ. Press, Jul. 2008.
34. H. Müller, C. Lovis, and A. Geissbuhler, "The medGIFT project on medical image retrieval," Med. Imag. Telemedicine, 2005.
35. H. Müller, N. Michoux, D. Bandon, and A. Geissbühler, "A review of content-based image retrieval systems in medical applications-Clinical benefits and future directions," I. J. Med. Informat., vol. 73, no. 1, pp. 1-23, 2004. (Pubitemid 38229184)
36. H. Müller, X. Zhou, A. Depeursinge, M. J. Pitkänen, J. Iavindrasana, and A. Geissbühler, "Medical visual information retrieval: State of the art and challenges ahead," in Proc. ICME, 2007, pp. 683-686.
37. E. Nowak, F. Jurie, and B. Triggs, "Sampling strategies for bag-offeatures image classification," in Proc. ECCV, 2006, pp. 490-503. (Pubitemid 44029653)
38. E. Osuna, R. Freund, and F. Girosi, Support vector machines: Training and applications Massachusetts Inst. Technol., Cambridge, MA, 1997, Tech. Rep.
39. C. Shyu, C. Brodley, A. Kak, A. Kosaka, A. Aisen, and L. Broderick, "ASSERT: A physician-in-the-loop content-based retrieval system for HRCT image databases," Comput. Vis. Image Understand., pp. 111-132, 1999.
40. J. Sivic and A. Zisserman, "Video google: A text retrieval approach to object matching in videos," in Proc. ICCV, Apr. 2008, vol. 2, pp. 1470-1477.
41. T. Tommasi, F. Orabona, and B. Caputo, "Discriminative cue integration for medical image annotation," Pattern Recognit. Lett., vol. 29, no. 15, pp. 1996-2002, 2008.
42. B. van Ginneken, L. Hogeweg, and M. Prokop, "Computer-aided diagnosis in chest radiography: Beyond nodules," Eur. J. Radiol., vol. 72, no. 2, pp. 226-230, 2009, Digital Radiography.
43. M. Varma and A. Zisserman, "Texture classification: Are filter banks necessary?," in Proc. CVPR, 2003, vol. 2, pp. 691-698.
44. I. Vergara, T. Norambuena, E. Ferrada, A. Slater, and F. Melo, "Star: A simple tool for the statistical comparison of ROC curves," BMC Bioinformatics, vol. 9, no. 1, p. 265, 2008.
45. A.Winter and R. Haux, "A three-level graph-based model for the management of hospital information systems," MethodsInfMed., vol. 34, pp. 378-396, 1995.
46. J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid, "Local features and kernels for classification of texture and object categories: A comprehensive study," Int. J. Comput. Vis., vol. 73, no. 2, pp. 213-238, 2007. (Pubitemid 46181625)