Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 2424-2433

  Hou, Le ^a   Samaras, Dimitris ^a   Kurc, Tahsin M ^b,c   Gao, Yi ^a,b   Davis, James E ^d   Saltz, Joel H ^a,b,d,e  

^a USA   (United States)

^b Stony Brook University   (United States)

^c OAK RIDGE NATIONAL LABORATORY   (United States)

^d STONY BROOK UNIVERSITY   (United States)

^e Stony Brook School of Dental Medicine   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; CONVOLUTION; DISEASES; MAXIMUM PRINCIPLE; NEURAL NETWORKS; PATTERN RECOGNITION; TISSUE;

CANCER SUBTYPES; CELLULAR LEVELS; CLASSIFICATION ACCURACY; CLASSIFICATION RESULTS; CONVOLUTIONAL NEURAL NETWORK; EXPECTATION MAXIMIZATION; NON-SMALL CELL LUNG CARCINOMATA; SPATIAL RELATIONSHIPS;

IMAGE CLASSIFICATION;

EID: 84986300630     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.266     Document Type: Conference Paper

References (57)

1. Brain tumor statistics. http://www.abta.org/about-us/news/brain-tumor-statistics/.
2. The cancer genome atlas. https://tcga-data.nci. nih.gov/tcga/.
3. Non-small-cell lung carcinoma. http://www.cancer. org/cancer/lungcancer-non-smallcell/.
4. D. Altunbay, C. Cigir, C. Sokmensuer, and C. Gunduz-Demir. Color graphs for automated cancer diagnosis and grading. J Biomed Eng, 2010.
5. J. Amores. Multiple instance classification: Review, taxonomy and comparative study. AIJ, 2013.
6. S. Andrews, I. Tsochantaridis, and T. Hofmann. Support vector machines for multiple-instance learning. In NIPS, 2002.
7. Y. Bengio, A. Courville, and P. Vincent. Representation learning: A review and new perspectives. PAMI, 2013.
8. C. M. Bishop et al. Pattern recognition and machine learning. 2006.
9. D. J. Brat, R. A. Prayson, T. C. Ryken, and J. J. Olson. Diagnosis of malignant glioma: role of neuropathology. Journal of neuro-oncology, 2008.
10. C.-C. Chang and C.-J. Lin. Libsvm: a library for support vector machines. TIST, 2011.
11. H. Chang, Y. Zhou, A. Borowsky, K. Barner, P. Spellman, and B. Parvin. Stacked predictive sparse decomposition for classification of histology sections. IJCV, 2014.
12. L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv, 2014.
13. Z. Chen, Z. Chi, H. Fu, and D. Feng. Multi-instance multilabel image classification: A neural approach. Neurocomputing, 2013.
14. D. C. Cireşan, A. Giusti, L. M. Gambardella, and J. Schmidhuber. Mitosis detection in breast cancer histology images with deep neural networks. In MICCAI. 2013.
15. L. A. Cooper, J. Kong, D. A. Gutman, F. Wang, J. Gao, C. Appin, S. Cholleti, T. Pan, A. Sharma, L. Scarpace, et al. Integrated morphologic analysis for the identification and characterization of disease subtypes. JAMIA, 2012.
16. E. Cosatto, P.-F. Laquerre, C. Malon, H.-P. Graf, A. Saito, T. Kiyuna, A. Marugame, and K. Kamijo. Automated gastric cancer diagnosis on h&e-stained sections; ltraining a classifier on a large scale with multiple instance machine learning. In Medical Imaging, 2013.
17. A. Cruz-Roa, A. Basavanhally, F. González, H. Gilmore, M. Feldman, S. Ganesan, N. Shih, J. Tomaszewski, and A. Madabhushi. Automatic detection of invasive ductal carcinoma in whole slide images with convolutional neural networks. In Medical Imaging, 2014.
18. T. G. Dietterich, R. H. Lathrop, and T. Lozano-Pérez. Solving the multiple instance problem with axis-parallel rectangles. AIJ, 1997.
19. L. Fei-Fei and P. Perona. A Bayesian hierarchical model for learning natural scene categories. In CVPR, 2005.
20. J. Foulds and E. Frank. A review of multi-instance learning assumptions. Knowl Eng Rev, 2010.
21. J. E. Grilley-Olson, D. T. Moore, K. O. Leslie, B. F. Qaqish, X. Yin, M. A. Socinski, T. E. Stinchcombe, L. B. Thorne, T. C. Allen, P. M. Banks, et al. Validation of interobserver agreement in lung cancer assessment: hematoxylin-eosin diagnostic reproducibility for non-small cell lung cancer: the 2004 world health organization classification and therapeutically relevant subsets. Archives of pathology & laboratory medicine, 2013.
22. M. Gupta, A. Djalilvand, and D. J. Brat. Clarifying the diffuse gliomas an update on the morphologic features and markers that discriminate oligodendroglioma from astrocytoma. AJCP, 2005.
23. K. He, X. Zhang, S. Ren, and J. Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In ICCV, 2015.
24. M. Hoai and A. Zisserman. Improving human action recognition using score distribution and ranking. In ACCV. 2014.
25. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv, 2014.
26. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei. Large-scale video classification with convolutional neural networks. In CVPR, 2014.
27. M. Kim and F. Torre. Gaussian processes multiple instance learning. In ICML, 2010.
28. M. M. Kokar, J. A. Tomasik, and J. Weyman. Data vs. decision fusion in the category theory framework. 2001.
29. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012.
30. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. Proceedings of the IEEE, 1998.
31. C. H. Li, I. Gondra, and L. Liu. An efficient parallel neural network-based multi-instance learning algorithm. J Supercomput, 2012.
32. K. Ma, T. F. Y. Vicente, D. Samaras, M. Petrucci, and D. L. Magnus. Texture classification for rail surface condition evaluation. In WACV, 2016.
33. O. Maron and T. Lozano-Pérez. A framework for multipleinstance learning. NIPS, 1998.
34. S. E. Mills. Histology for pathologists. Lippincott Williams & Wilkins, 2012.
35. H. S. Mousavi, V. Monga, G. Rao, and A. U. Rao. Automated discrimination of lower and higher grade gliomas based on histopathological image analysis. JPI, 2015.
36. M. H. Nguyen, L. Torresani, F. De La Torre, and C. Rother. Weakly supervised discriminative localization and classification: a joint learning process. In ICCV, 2009.
37. T. Ojala, M. Pietikainen, and T. Maenpaa. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. PAMI, 2002.
38. M. Oquab, L. Bottou, I. Laptev, and J. Sivic. Weakly supervised object recognition with convolutional neural networks. In NIPS.
39. G. Papandreou, L.-C. Chen, K. Murphy, and A. L. Yuille. Weakly-and semi-supervised learning of a dcnn for semantic image segmentation. arXiv, 2015.
40. D. Pathak, E. Shelhamer, J. Long, and T. Darrell. Fully convolutional multi-class multiple instance learning. arXiv, 2014.
41. P. O. Pinheiro and R. Collobert. Weakly supervised semantic segmentation with convolutional networks. arXiv, 2014.
42. S. Poria, E. Cambria, and A. Gelbukh. Deep convolutional neural network textual features and multiple kernel learning for utterance-level multimodal sentiment analysis.
43. J. Ramon and L. De Raedt. Multi instance neural networks. 2000.
44. A. C. Ruifrok and D. A. Johnston. Quantification of histochemical staining by color deconvolution. Anal Quant Cytol Histol, 2001.
45. A. Seff, L. Lu, K. M. Cherry, H. R. Roth, J. Liu, S. Wang, J. Hoffman, E. B. Turkbey, and R. M. Summers. 2d view aggregation for lymph node detection using a shallow hierarchy of linear classifiers. In MICCAI. 2014.
46. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR, 2014.
47. F. Tabib Mahmoudi, F. Samadzadegan, and P. Reinartz. a decision level fusion method for object recognition using multi-angular imagery. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2013.
48. T. H. Vu, H. S. Mousavi, V. Monga, U. Rao, and G. Rao. Dfdl: Discriminative feature-oriented dictionary learning for histopathological image classification. arXiv, 2015.
49. N. Weidmann, E. Frank, and B. Pfahringer. A two-level learning method for generalized multi-instance problems. In ECML. 2003.
50. Y. Xu, Z. Jia, Y. Ai, F. Zhang, M. Lai, E. I. Chang, et al. Deep convolutional activation features for large scale brain tumor histopathology image classification and segmentation. In ICASSP, 2015.
51. Y. Xu, T. Mo, Q. Feng, P. Zhong, M. Lai, E. I. Chang, et al. Deep learning of feature representation with multiple instance learning for medical image analysis. In ICASSP, 2014.
52. Y. Xu, J.-Y. Zhu, I. Eric, C. Chang, M. Lai, and Z. Tu. Weakly supervised histopathology cancer image segmentation and classification. Medical image analysis, 2014.
53. J. Yang, Y.-G. Jiang, A. G. Hauptmann, and C.-W. Ngo. Evaluating bag-of-visual-words representations in scene classification. In Workshop on multimedia information retrieval, 2007.
54. C. Zhang, J. C. Platt, and P. A. Viola. Multiple instance boosting for object detection. In NIPS, 2005.
55. Q. Zhang and S. A. Goldman. Em-dd: An improved multiple-instance learning technique. In NIPS, 2001.
56. Y. Zhou, H. Chang, K. Barner, P. Spellman, and B. Parvin. Classification of histology sections via multispectral convolutional sparse coding. In CVPR, 2014.
57. Z.-H. Zhou and M.-L. Zhang. Neural networks for multiinstance learning. In ICIIT, 2002.