Scalable histopathological image analysis via supervised hashing with multiple features

Medical Image Analysis

Volumn 34, Issue , 2016, Pages 3-12

  Jiang, Menglin ^a   Zhang, Shaoting ^b   Huang, Junzhou ^c   Yang, Lin ^d   Metaxas, Dimitris N ^a  

^a RUTGERS UNIVERSITY   (United States)

^b University of North Carolina at Charlotte   (United States)

^c University of Texas at Arlington   (United States)

^d J Crayton Pruitt Family Department of Biomedical Engineering   (United States)

Author keywords

Computer aided diagnosis (CAD); Content based image retrieval (CBIR); Feature fusion; Hashing; Histopathology

Indexed keywords

CASE BASED REASONING; COMPUTER AIDED DIAGNOSIS; CONTENT BASED RETRIEVAL; IMAGE ANALYSIS; IMAGE FUSION; INFORMATION RETRIEVAL; MEDICAL IMAGING; QUERY PROCESSING; SEMANTICS;

COMPUTER AIDED DIAGNOSIS(CAD); CONTENT-BASED IMAGE RETRIEVAL; FEATURE FUSION; HASHING; HISTOPATHOLOGY;

IMAGE RETRIEVAL;

ACCURACY; ARTICLE; BREAST; BREAST CARCINOMA; BREAST HYPERPLASIA; COMPUTER ASSISTED DIAGNOSIS; HISTOPATHOLOGY; HUMAN; IMAGE ANALYSIS; IMAGE RETRIEVAL; INTRADUCTAL CARCINOMA; JOINT KERNEL BASED SUPERVISED HASHING; K NEAREST NEIGHBOR; MAJOR CLINICAL STUDY; PRIORITY JOURNAL; PROCESS OPTIMIZATION; ALGORITHM; BREAST TUMOR; CYTOLOGY; DIAGNOSTIC IMAGING; FACTUAL DATABASE; FEMALE; PATHOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; VALIDATION STUDY;

ALGORITHMS; BREAST; BREAST NEOPLASMS; DATABASES, FACTUAL; FEMALE; HUMANS; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 84989200779     PISSN: 13618415     EISSN: 13618423     Source Type: Journal    
DOI: 10.1016/j.media.2016.07.011     Document Type: Article

References (55)

1. Akakin, H.C., Gurcan, M.N., Content-based microscopic image retrieval system for multi-image queries. IEEE Trans. Inf. Technol. Biomed. 16:4 (2012), 758–769.
2. Akgül, C.B., Rubin, D.L., Napel, S., Beaulieu, C.F., Greenspan, H., Acar, B., Content-based image retrieval in radiology: current status and future directions. J. Digit. Imaging 24:2 (2011), 208–222.
3. Al-Janabi, S., Huisman, A., van Diest, P.J., Digital pathology: current status and future perspectives. Histopathology 61:1 (2012), 1–9.
4. Alto, H., Rangayyan, R.M., Desautels, J.E.L., Content-based retrieval and analysis of mammographic masses. J. Electron. Imaging 14:2 (2005), 023016–1–17.
5. American Cancer Society, Breast Cancer Facts & Figures 2013–2014. 2013, American Cancer Society, Atlanta, GA, USA.
6. André, B., Vercauteren, T., Buchner, A.M., Wallace, M.B., Ayache, N., Learning semantic and visual similarity for endomicroscopy video retrieval. IEEE Trans. Med. Imaging 31:6 (2012), 1276–1288.
7. Avni, U., Greenspan, H., Konen, E., Sharon, M., Goldberger, J., X-ray categorization and retrieval on the organ and pathology level, using patch-based visual words. IEEE Trans. Med. Imaging 30:3 (2011), 733–746.
8. Caicedo, J.C., Cruz, A., González, F.A., Histopathology image classification using bag of features and kernel functions. Proceedings of Artificial Intelligence and Medication, 2009, 126–135.
9. Caicedo, J.C., González, F.A., Romero, E., Content-based histopathology image retrieval using a kernel-based semantic annotation framework. J. Biomed. Inform. 44:4 (2011), 519–528.
10. Cruz-Roa, A., González, F.A., Galaro, J., Judkins, A.R., Ellison, D., Baccon, J., Madabhushi, A., Romero, E., A visual latent semantic approach for automatic analysis and interpretation of anaplastic medulloblastoma virtual slides. Proceedings of Medical Image Computation and Computational Assistance Intervention (Part 1), 2012, 157–164.
11. Dalal, N., Triggs, B., Histograms of oriented gradients for human detection. Proceedings of the IEEE Computational Visualisation and Pattern Recognition, 2005, 886–893.
12. Dundar, M.M., Badve, S., Bilgin, G., Raykar, V.C., Jain, R.K., Sertel, O., Gurcan, M.N., Computerized classification of intraductal breast lesions using histopathological images. IEEE Trans. Biomed. Eng. 58:7 (2011), 1977–1984.
13. Foran, D.J., Yang, L., Chen, W., Hu, J., Goodell, L.A., Reiss, M., Wang, F., Kurc, T., Pan, T., Sharma, A., Saltz, J.H., ImageMiner: a software system for comparative analysis of tissue microarrays using content-based image retrieval, high-performance computing, and grid technology. J. Am. Med. Inform. Assoc. 18:4 (2011), 403–415.
14. Gionis, A., Indyk, P., Motwani, R., Similarity search in high dimensions via hashing. Proceedings of Very Large Data Base, 1999, 518–529.
15. Gönen, M., Alpaydin, E., Multiple kernel learning algorithms. J. Mach. Learn. Res. 12 (2011), 2211–2268.
16. Gurcan, M.N., Boucheron, L.E., Can, A., Madabhushi, A., Rajpoot, N.M., Yener, B., Histopathological image analysis: a review. IEEE Rev. Biomed. Eng. 2 (2009), 147–171.
17. Hassan, E., Chaudhury, S., Gopal, M., Feature combination in kernel space for distance based image hashing. IEEE Trans. Multimedia 14:4 (2012), 1179–1195.
18. He, J., Liu, W., Chang, S., Scalable similarity search with optimized kernel hashing. Proceedings of the ACM International Conference on Knowledge and Discovring Data Mining, 2010, 1129–1138.
19. Huang, P.-W., Lai, Y.-H., Effective segmentation and classification for HCC biopsy images. Pattern Recognit. 43:4 (2010), 1550–1563.
20. Jiang, M., Zhang, S., Huang, J., Yang, L., Metaxas, D.N., Joint kernel-based supervised hashing for scalable histopathological image analysis. Proceedings of the Medical Image Computing and Computational Assistance Intervention (Part 3), 2015, 366–373.
21. Jiang, M., Zhang, S., Li, H., Metaxas, D.N., Computer-aided diagnosis of mammographic masses using scalable image retrieval. IEEE Trans. Biomed. Eng. 62:2 (2015), 783–792.
22. Kulis, B., Grauman, K., Kernelized locality-sensitive hashing. IEEE Trans. Pattern Anal. Mach. Intell. 34:6 (2012), 1092–1104.
23. Kumar, A., Kim, J., Cai, W., Fulham, M., Feng, D., Content-based medical image retrieval: a survey of applications to multidimensional and multimodality data. J. Digit. Imaging 26:6 (2013), 1025–1039.
24. Langs, G., Hanbury, A., Menze, B.H., Müller, H., VISCERAL: towards large data in medical imaging - challenges and directions. Proceedings of the International Workshop of Medical Content-Based Retr. Clin. Decis. Support, 2012, 92–98.
25. Li, Y., Chen, C., Liu, W., Huang, J., Sub-selective quantization for large-scale image search. Proceedings of the AAAI Conference on Artificial Intelligence, 2014, 2803–2809.
26. Liang, Y., Wang, F., Treanor, D., Magee, D., Teodoro, G., Zhu, Y., Kong, J., A 3D primary vessel reconstruction framework with serial microscopy images. Proceedings of Medical Image Computing and Computational Assistance Intervention (Part 3), 2015, 251–259.
27. Liang, Y., Wang, F., Treanor, D., Magee, D., Teodoro, G., Zhu, Y., Kong, J., Liver whole slide image analysis for 3D vessel reconstruction. Proceedings of the IEEE International Symposium on Biomedical Imaging, 2015, 182–185.
28. Liang, Y., Wang, F., Treanor, D., Magee, D.R., Roberts, N., Teodoro, G., Zhu, Y., Kong, J., A framework for 3D vessel analysis using whole slide images of liver tissue sections. Int. J. Comput. Biol. Drug Des. 9:1–2 (2016), 102–119.
29. Liu, J., Zhang, S., Liu, W., Zhang, X., Metaxas, D.N., Scalable mammogram retrieval using anchor graph hashing. Proceedings of the IEEE International Symposium on Biomedical Imaging, 2014, 898–901.
30. Liu, W., Wang, J., Ji, R., Jiang, Y., Chang, S., Supervised hashing with kernels. Proceedings of the IEEE on Computational Visualisation and Pattern Recognition, 2012, 2074–2081.
31. Liu, W., Wang, J., Kumar, S., Chang, S., Hashing with graphs. Proceedings of the International Conference on Machine Learning, 2011, 1–8.
32. Liu, X., He, J., Lang, B., Multiple feature kernel hashing for large-scale visual search. Pattern Recognit. 47:2 (2014), 748–757.
33. Lowe, D.G., Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60:2 (2004), 91–110.
34. Müller, H., Michoux, N., Bandon, D., Geissbühler, A., A review of content-based image retrieval systems in medical applications - clinical benefits and future directions. Int. J. Med. Inform. 73:1 (2004), 1–23.
35. Nguyen, K., Jain, A.K., Allen, R.L., Automated gland segmentation and classification for Gleason grading of prostate tissue images. Proceedings of the International Conference on Pattern Recognition, 2010, 1497–1500.
36. Nistér, D., Stewénius, H., Scalable recognition with a vocabulary tree. Proceedings of the IEEE Computation and Visualisation Pattern Recognition, 2006, 2161–2168.
37. Oliva, A., Torralba, A., Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vis. 42:3 (2001), 145–175.
38. Sivic, J., Zisserman, A., Video google: A text retrieval approach to object matching in videos. Proceedings of the IEEE International Conference on Computation and Visualisation., 2003, 1470–1477.
39. Tabesh, A., Teverovskiy, M., Pang, H., Kumar, V.P., Verbel, D., Kotsianti, A., Saidi, O., Multifeature prostate cancer diagnosis and Gleason grading of histological images. IEEE Trans. Med. Imaging 26:10 (2007), 1366–1378.
40. Tamaki, T., Yoshimuta, J., Kawakami, M., Raytchev, B., Kaneda, K., Yoshida, S., Takemura, Y., Onji, K., Miyaki, R., Tanaka, S., Computer-aided colorectal tumor classification in NBI endoscopy using local features. Med. Image Anal. 17:1 (2013), 78–100.
41. Tuzel, O., Yang, L., Meer, P., Foran, D.J., Classification of hematologic malignancies using texton signatures. Pattern Anal. Appl. 10:4 (2007), 277–290.
42. Veta, M., Pluim, J.P.W., van Diest, P.J., Viergever, M.A., Breast cancer histopathology image analysis: a review. IEEE Trans. Biomed. Eng. 61:5 (2014), 1400–1411.
43. Wang, J., Kumar, S., Chang, S., Semi-supervised hashing for large-scale search. IEEE Trans. Pattern Anal. Mach. Intell. 34:12 (2012), 2393–2406.
44. Wei, C.-H., Li, Y., Huang, P.J., Mammogram retrieval through machine learning within BI-RADS standards. J. Biomed. Inform. 44:4 (2011), 607–614.
45. Weiss, Y., Torralba, A., Fergus, R., Spectral hashing. Proceedings of Neural Information Processing System, 2008, 1753–1760.
46. Yang, L., Chen, W., Meer, P., Salaru, G., Goodell, L.A., Berstis, V., Foran, D.J., Virtual microscopy and Grid-enabled decision support for large-scale analysis of imaged pathology specimens. IEEE Trans. Inf. Technol. Biomed. 13:4 (2009), 636–644.
47. Yang, W., Lu, Z., Yu, M., Huang, M., Feng, Q., Chen, W., Content-based retrieval of focal liver lesions using bag-of-visual-words representations of single- and multiphase contrast-enhanced CT images. J. Digit. Imaging 25:6 (2012), 708–719.
48. Zhang, D., Wang, F., Si, L., Composite hashing with multiple information sources. Proceedings of ACM International Conference Research and Development Information Retr., 2011, 225–234.
49. Zhang, S., Yang, M., Cour, T., Yu, K., Metaxas, D.N., Query specific rank fusion for image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 37:4 (2015), 803–815.
50. Zhang, X., Dou, H., Ju, T., Xu, J., Zhang, S., Fusing heterogeneous features from stacked sparse autoencoder for histopathological image analysis. IEEE J. Biomed. Health Inform, PP(99), 2015, 1, 10.1109/JBHI.2015.2461671.
51. Zhang, X., Liu, W., Dundar, M., Badve, S., Zhang, S., Towards large-scale histopathological image analysis: hashing-based image retrieval. IEEE Trans. Med. Imaging 34:2 (2015), 496–506.
52. Zhang, X., Xing, F., Su, H., Yang, L., Zhang, S., High-throughput histopathological image analysis via robust cell segmentation and hashing. Med. Image Anal. 26:1 (2015), 306–315.
53. Zhang, X., Yang, L., Liu, W., Su, H., Zhang, S., Mining histopathological images via composite hashing and online learning. Proceedings of Medical Image Computing Computational Assistance Intervention(Part 2), 2014, 479–486.
54. Zheng, B., Lu, A., Hardesty, L.A., Sumkin, J.H., Hakim, C.M., Ganott, M.A., Gur, D., A method to improve visual similarity of breast masses for an interactive computer-aided diagnosis environment. Med. Phys. 33:1 (2006), 111–117.
55. Zheng, L., Wetzel, A.W., Gilbertson, J.R., Becich, M.J., Design and analysis of a content-based pathology image retrieval system. IEEE Trans. Inf. Technol. Biomed. 7:4 (2003), 249–255.