Towards large-scale histopathological image analysis: Hashing-based image retrieval

IEEE Transactions on Medical Imaging

Volumn 34, Issue 2, 2015, Pages 496-506

  Zhang, Xiaofan ^a   Liu, Wei ^b   Dundar, Murat ^c   Badve, Sunil ^d   Zhang, Shaoting ^a  

^a University of North Carolina at Charlotte   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

^c IN 46202 USA   (United States)

^d INDIANA UNIVERSITY   (United States)

Author keywords

Breast lesion; hashing; high dimension; histopathological image analysis; large scale image retrieval; supervised learning

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER AIDED DIAGNOSIS; CONTENT BASED RETRIEVAL; DECISION SUPPORT SYSTEMS; DIAGNOSIS; IMAGE ANALYSIS; IMAGE PROCESSING; IMAGE RETRIEVAL; LEARNING SYSTEMS; MEDICAL IMAGING; SEARCH ENGINES; SEMANTICS; SUPERVISED LEARNING;

BREAST LESION; COMPUTER AIDED DIAGNOSIS(CAD); CONTENTBASED IMAGE RETRIEVAL (CBIR) SYSTEM; FEATURE SELECTION METHODS; HASHING; HIGH DIMENSIONS; HISTOPATHOLOGICAL IMAGE ANALYSIS; IMAGE PROCESSING - METHODS;

IMAGE CLASSIFICATION;

ARTICLE; AUTOANALYSIS; BAYESIAN LEARNING; COMPUTER ASSISTED DIAGNOSIS; DECISION SUPPORT SYSTEM; HISTOPATHOLOGY; HUMAN; HUMAN TISSUE; IMAGE ANALYSIS; IMAGE PROCESSING; IMAGE RETRIEVAL; K NEAREST NEIGHBOR; KERNEL HASHING TECHNIQUE; KERNEL METHOD; MAJOR CLINICAL STUDY; MEASUREMENT ACCURACY; MULTIFACTOR DIMENSIONALITY REDUCTION; PRODUCTIVITY; SUPPORT VECTOR MACHINE; TRIANGULATION; ALGORITHM; BREAST; BREAST TUMOR; CYTOCHEMISTRY; FEMALE; PATHOLOGY; PROCEDURES;

ALGORITHMS; BREAST; BREAST NEOPLASMS; FEMALE; HISTOCYTOCHEMISTRY; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGE PROCESSING, COMPUTER-ASSISTED;

EID: 84922344423     PISSN: 02780062     EISSN: 1558254X     Source Type: Journal    
DOI: 10.1109/TMI.2014.2361481     Document Type: Article

References (56)

1. R. Siegel, D. Naishadham, and A. Jemal, "Cancer statistics, 2013," CA, Cancer J. Clinicians, vol. 63, no. 1, pp. 11-30, 2013.
2. D. C. Sgroi, "Preinvasive breast cancer," Annu. Rev. Pathol. Mech. Disease, vol. 5, pp. 193-221, 2010.
3. D. L. Page, W. D. Dupont, L. W. Rogers, and M. S. Rados, "Atypical hyperplastic lesions of the female breast.Along-termfollow-up study," Cancer, vol. 55, no. 11, pp. 2698-2708, 1985.
4. B.Weyn,G. v. d.Wouwer, A. v. Daele, P. Scheunders,D. v.Dyck, E. v. Marck, andW. Jacob, "Automated breast tumor diagnosis and grading based on wavelet chromatin texture description," Cytometry, vol. 33, no. 1, pp. 32-40, 1998.
5. C. Bilgin, C. Demir, C. Nagi, and B. Yener, "Cell-graph mining for breast tissuemodeling and classification," in Proc. IEEE Int. Conf. Eng. Med. Biol. Soc., 2007, pp. 5311-5314.
6. M. N. Gurcan, L. E. Boucheron, A. Can, A. Madabhushi, N. M. Rajpoot, and B. Yener, "Histopathological image analysis, A review," IEEE Rev. Biomed. Eng., vol. 2, pp. 147-171, Dec. 2009.
7. J. Kong, O. Sertel, H. Shimada, K. L. Boyer, J. H. Saltz, and M. N. Gurcan, "Computer-aided evaluation of neuroblastoma on whole-slide histology images: Classifying grade of neuroblastic differentiation," Pattern Recognit., vol. 42, no. 6, pp. 1080-1092, 2009.
8. P.-W.Huang andC.-H. Lee, "Automatic classification for pathological prostate images based on fractal analysis," IEEE Trans. Med. Imag., vol. 28, no. 7, pp. 1037-1050, Jul. 2009.
9. P.-W. Huang and Y.-H. Lai, "Effective segmentation and classification for HCC biopsy images," Pattern Recognit., vol. 43, no. 4, pp. 1550-1563, 2010.
10. P. Khurd, C. Bahlmann, P. Maday, A. Kamen, S. Gibbs-Strauss, E. M. Genega, and J. V. Frangioni, "Computer-aided Gleason grading of prostate cancer histopathological images using texton forests," in Proc. IEEE Int. Symp. Biomed. Imag., 2010, pp. 636-639.
11. M. Veta, J. Pluim, P. v. Diest, and M. Viergever, "Breast cancer histopathology image analysis: A review," IEEE Trans. Biomed. Eng., vol. 61, no. 5, pp. 1400-1411, May 2014.
12. D. Comaniciu, P. Meer, and D. J. Foran, "Image-guided decision support system for pathology," Mach. Vis. Appl., vol. 11, no. 4, pp. 213-224, 1999.
13. L. Zheng, A. W. Wetzel, J. Gilbertson, and M. J. Becich, "Design and analysis of a content-based pathology image retrieval system," IEEE Trans. Inf. Technol. Biomed., vol. 7, no. 4, pp. 249-255, Dec. 2003.
14. H. Müller, N. Michoux, D. Bandon, and A. Geissbuhler, "A review of content-based image retrieval systems in medical applications-clinical benefits and future directions," Int. J. Med. Inf., vol. 73, no. 1, pp. 1-23, 2004.
15. H. C. Akakin and M. N. Gurcan, "Content-based microscopic image retrieval system for multi-image queries," IEEE Trans. Inf. Technol. Biomed., vol. 16, no. 4, pp. 758-769, Apr. 2012.
16. A. Kumar, J. Kim, W. Cai, M. Fulham, and D. Feng, "Content-based medical image retrieval, A survey of applications to multidimensional and multimodality data," J. Digital Imag., vol. 26, no. 6, pp. 1025-1039, 2013.
17. T. M. Lehmann, M. O. Güld, T. Deselaers, D. Keysers, H. Schubert, K. Spitzer, H. Ney, and B. B.Wein, "Automatic categorization of medical images for content-based retrieval and data mining," Comput. Med. Imag. Graph., vol. 29, no. 2, pp. 143-155, 2005.
18. L. Yang, W. Chen, P. Meer, G. Salaru, L. A. Goodell, V. Berstis, and D. J. Foran, "Virtual microscopy and grid-enabled decision support for large-scale analysis of imaged pathology specimens," IEEE Trans. Inf. Technol. Biomed., vol. 13, no. 4, pp. 636-644, Jul. 2009.
19. D. J. Foran et al., "Imageminer, A software system for comparative analysis of tissue microarrays using content-based image retrieval, high-performance computing, and grid technology," J. Am. Med. Informat. Assoc., vol. 18, no. 4, pp. 403-415, 2011.
20. M. Datar, N. Immorlica, P. Indyk, and V. S. Mirrokni, "Locality-sensitive hashing scheme based on p-stable distributions," in Proc. Annu. ACM Symp. Computat. Geometry, 2004, pp. 253-262.
21. Y. Weiss, A. Torralba, and R. Fergus, "Spectral hashing," in Adv. Neural Inf. Process. Syst., 2008, pp. 1753-1760.
22. B. Kulis and K. Grauman, "Kernelized locality-sensitive hashing," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 6, pp. 1092-1104, Jun. 2012.
23. J. Wang, S. Kumar, and S.-F. Chang, "Semi-supervised hashing for scalable image retrieval," inProc. IEEEInt. Conf.Comput. Vis. Pattern Recognit., 2010, pp. 3424-3431.
24. W. Liu, J. Wang, R. Ji, Y.-G. Jiang, and S.-F. Chang, "Supervised hashing with kernels," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2012, pp. 2074-2081.
25. X. Zhang, W. Liu, and S. Zhang, "Mining histopathological images via hashing-based scalable image retrieval," in Proc. IEEE Int. Symp. Biomed. Imag., 2014, pp. 1111-1114.
26. S. Petushi, F. U. Garcia, M. M. Haber, C. Katsinis, and A. Tozeren, "Large-scale computations on histology images reveal grade-differentiating parameters for breast cancer," BMC Med. Imag., vol. 6, no. 1, p. 14, 2006.
27. L. Yang, W. Chen, P.Meer, G. Salaru, M. D. Feldman, and D. J. Foran, "High throughput analysis of breast cancer specimens on the grid," in Proc. Int. Conf. Med. Image Comput. Comput. Assist. Intervent., 2007, pp. 617-625.
28. J. C. Caicedo, A. Cruz, and F. A. Gonzalez, "Histopathology image classification using bag of features and kernel functions," Artif. Intell. Med., pp. 126-135, 2009.
29. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. IEEE Int. Conf. Comput. Vis., 2003, pp. 1470-1477.
30. A. N. Basavanhally, S. Ganesan, S. Agner, J. P. Monaco, M. D. Feldman, J. E. Tomaszewski, G. Bhanot, and A. Madabhushi, "Computerized image-based detection and grading of lymphocytic infiltration in HER2+ breast cancer histopathology," IEEE Trans. Biomed. Eng., vol. 57, no. 3, pp. 642-653, Mar. 2010.
31. M. M. Dundar, S. Badve, G. Bilgin, V. Raykar, R. Jain, O. Sertel, and M. N. Gurcan, "Computerized classification of intraductal breast lesions using histopathological images," IEEE Trans. Biomed. Eng., vol. 58, no. 7, pp. 1977-1984, Jul. 2011.
32. A. Tabesh, M. Teverovskiy, H.-Y. Pang, V. P. Kumar, D. Verbel, A. Kotsianti, and O. Saidi, "Multifeature prostate cancer diagnosis and Gleason grading of histological images," IEEE Trans.Med. Imag., vol. 26, no. 10, pp. 1366-1378, Oct. 2007.
33. S. Doyle, S. Agner, A. Madabhushi, M. Feldman, and J. Tomaszewski, "Automated grading of breast cancer histopathology using spectral clustering with textural and architectural image features," in Proc. IEEE Int. Symp. Biomed. Imag., 2008, pp. 496-499.
34. J. G. Dy, C. E. Brodley, A. Kak, L. S. Broderick, and A. M. Aisen, "Unsupervised feature selection applied to content-based retrieval of lung images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 3, pp. 373-378, Feb. 2003.
35. I. El-Naqa, Y. Yang, N. P. Galatsanos, R. M. Nishikawa, and M. N. Wernick, "A similarity learning approach to content-based image retrieval: Application to digital mammography," IEEE Trans. Med. Imag., vol. 23, no. 10, pp. 1233-1244, Oct. 2004.
36. H. Greenspan and A. T. Pinhas, "Medical image categorization and retrieval for PACS using the GMM-KL framework," IEEE Trans. Inf. Technol. Biomed., vol. 11, no. 2, pp. 190-202, Mar. 2007.
37. Y. Song,W. Cai, and D. Feng, "Hierarchical spatial matching for medical image retrieval," in ACM Int. Workshop Med. Multimedia Anal. Retrieval, 2011, pp. 1-6.
38. F. Schnorrenberg, C. Pattichis, C. Schizas, and K. Kyriacou, "Contentbased retrieval of breast cancer biopsy slides," Technol. Health Care, vol. 8, no. 5, pp. 291-297, 2000.
39. X. S. Zhou, S. Zillner, M. Moeller, M. Sintek, Y. Zhan, A. Krishnan, and A. Gupta, "Semantics and CBIR: A medical imaging perspective," in ACM Int. Conf. Content-Based Image Video Retrieval, 2008, pp. 571-580.
40. H. Müller, A. Geissbühler, and P. Ruch, "ImageCLEF 2004: Combining image and multi-lingual search for medical image retrieval," in Multilingual Inform. Access for Text, Speech and Images. NewYork: Springer, 2005, pp. 718-727.
41. H. Müller and J. Kalpathy-Cramer, "The imageCLEF medical retrieval task at ICPR 2010-Information fusion," in Proc. IEEE Int. Conf. Pattern Recognit., 2010, pp. 3284-3287.
42. L. Yang, R. Jin, L.Mummert, R. Sukthankar, A.Goode, B. Zheng, S. C. Hoi, andM. Satyanarayanan, "A boosting framework for visuality-preserving distance metric learning and its application to medical image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 30-44, Jan. 2010.
43. G. Langs, H. Müller, B. H. Menze, and A. Hanbury, "VISCERAL: Towards large data in medical imaging - Challenges and directions," in MCBR-CDS MICCAI Workshop, 2013, vol. 7723.
44. A. Hanbury, H. Müller, G. Langs, and B. H. Menze, "Cloud-based evaluation framework for big data," in FIA Book 2013,. NewYork: Springer, 2013, LNCS.
45. Y. Mu, J. Shen, and S. Yan, "Weakly-supervised hashing in kernel space," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., 2010, pp. 3344-3351.
46. J. Wang, S. Kumar, and S.-F. Chang, "Semi-supervised hashing for large-scale search," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 12, pp. 2393-2406, Dec. 2012.
47. X. Liu, J. He, D. Liu, and B. Lang, "Compact kernel hashing with multiple features," in Proc. ACM Int. Conf. Multimedia, 2012, pp. 881-884.
48. B. Kulis and T. Darrell, "Learning to hash with binary reconstructive embeddings," in Adv. Neural Inf. Process. Syst., 2009, pp. 1042-1050.
49. M. Norouzi and D. M. Blei, "Minimal loss hashing for compact binary codes," in Int. Conf. on Mach. Learning, 2011, pp. 353-360.
50. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
51. J. Wang et al., "Bag-of-features based medical image retrieval via multiple assignment and visual words weighting," IEEE Trans. Med. Imag., vol. 30, no. 11, pp. 1996-2011, Nov. 2011.
52. S. Doyle, M. Feldman, J. Tomaszewski, and A. Madabhushi, "A boosted Bayesian multiresolution classifier for prostate cancer detection from digitized needle biopsies," IEEE Trans. Biomed. Eng., vol. 59, no. 5, pp. 1205-1218, May 2012.
53. O. Tuzel, L.Yang, P. Meer, and D. J. Foran, "Classification of hematologic malignancies using texton signatures," Pattern Anal. Appl., vol. 10, no. 4, pp. 277-290, 2007.
54. K. Nguyen, A. K. Jain, and R. L. Allen, "Automated gland segmentation and classification for Gleason grading of prostate tissue images," in Proc. IEEE Int. Conf. Pattern Recognit., 2010, pp. 1497-1500.
55. O. Sertel, J. Kong, U. V. Catalyurek, G. Lozanski, J. H. Saltz, and M. N. Gurcan, "Histopathological image analysis using model-based intermediate representations and color texture: Follicular lymphoma grading," J. Signal Process. Syst., vol. 55, no. 1-3, pp. 169-183, 2009.
56. J. Goldberger, S. Roweis, G. Hinton, and R. Salakhutdinov, "Neighbourhood components analysis," Adv. Neural Inf. Process. Syst., 2004.