Weakly supervised histopathology cancer image segmentation and classification

Medical Image Analysis

Volumn 18, Issue 3, 2014, Pages 591-604

  Xu, Yan ^a,b   Zhu, Jun Yan ^c   Chang, Eric I Chao ^b   Lai, Maode ^d   Tu, Zhuowen ^e  

^a BEIHANG UNIVERSITY   (China)

^b MICROSOFT RESEARCH ASIA   (China)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d ZHEJIANG UNIVERSITY SCHOOL OF MEDICINE   (China)

^e UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Classification; Clustering; Histopathology image; Image segmentation; Multiple instance learning

Indexed keywords

CLASSIFICATION (OF INFORMATION); CYTOLOGY; DISEASES; IMAGE CLASSIFICATION; LEARNING SYSTEMS; MEDICAL IMAGE PROCESSING; TISSUE;

CANCER DIAGNOSIS; CLUSTERING; CONTEXTUAL CONSTRAINTS; HISTOPATHOLOGY IMAGE; INTEGRATED FRAMEWORKS; MANUAL ANNOTATION; MULTIPLE INSTANCE LEARNING; WEAKLY SUPERVISED LEARNING;

IMAGE SEGMENTATION;

AMBIGUITY; ARTICLE; CANCER CLASSIFICATION; COLON CANCER; CYTOLOGY; HISTOPATHOLOGY; HUMAN; IMAGE ANALYSIS; IMAGE SEGMENTATION; LEARNING ALGORITHM; MULTIPLE CLUSTERED INSTANCE LEARNING; MULTIPLE INSTANCE LEARNING; PRIORITY JOURNAL; ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CLASSIFICATION; COLON TUMOR; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; MICROSCOPY; PATHOLOGY; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COLONIC NEOPLASMS; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MICROSCOPY; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 84896123432     PISSN: 13618415     EISSN: 13618423     Source Type: Journal    
DOI: 10.1016/j.media.2014.01.010     Document Type: Article

References (66)

1. Ahonen, T., Matas, J., He, C., Pietikäinen, M., 2009. Rotation invariant image description with local binary pattern histogram fourier features. In: Scandinavian Conference on Image Analysis.
2. Altunbay D., Cigir C., Sokmensuer C., Gunduz-Demir C. Color graphs for automated cancer diagnosis and grading. IEEE Trans. Biomed. Eng. 2010, 57:665-674.
3. Andrews, S., Tsochantaridis, I., Hofmann, T., 2003. Support vector machines for multiple-instance learning. In: Advances in Neural Information Processing Systems.
4. Artan Y., Haider M.A., Langer D.L., van der Kwast T.H., Evans A.J., Yang Y., Wernick M.N., Trachtenberg J., Yetik I.S. Prostate cancer localization with multispectral MRI using cost-sensitive support vector machines and conditional random fields. IEEE Trans. Image Process. 2010, 19:2444-2455.
5. Artan Y., Haider M.A., Langer D.L., van der Kwast T.H., Evans A.J., Yang Y., Wernick M.N., Trachtenberg J., Yetik I.S. A boosted bayesian multiresolution classifier for prostate cancer detection from digitized needle biopsies. IEEE Trans. Biomed. Eng. 2012, 59:1205-1218.
6. Babenko, B., Dollár, P., Tu, Z., Belongie, S., 2008. Simultaneous learning and alignment: multi-instance and multi-pose learning. In: European Conference on Computer Vision Workshop on Faces in Real-Life Images.
7. Babenko B., Yang M.H., Belongie S. Robust object tracking with online multiple instance learning. IEEE Trans. Pattern Anal. Mach. Intell. 2011, 33:1619-1632.
8. Bertsekas D.P., Bertsekas D.P. Nonlinear Programming 1999, Athena Scientific. second ed.
9. Boucheron, L.E., 2008. Object- and Spatial-Level Quantitative Analysis of Multispectral Histopathology Images for Detection and Characterization of Cancer. Ph.D. thesis. University of California, Santa Barbara.
10. Dietterich T., Lathrop R., Lozano-Pérez T. Solving the multiple instance problem with axis-parallel rectangles. Artif. Intell. 1997, 89:31-71.
11. Dollár, P., Babenko, B., Belongie, S., Perona, P., Tu, Z., 2008. Multiple component learning for object detection. In: European Conference on Computer Vision.
12. Duda R.O., Hart P.E., Stork D.G. Pattern Classification 2001, Wiley-Interscience. second ed.
13. Dundar M., Fung G., Krishnapuram B., Rao B. Multiple instance learning algorithms for computer aided diagnosis. IEEE Trans. Biomed. Eng. 2008, 55:1005-1015.
14. Dundar, M., Badve, S., Raykar, V., Jain, R., Sertel, O., Gurcan, M., 2010. A multiple instance learning approach toward optimal classification of pathology slides. In: International Conference on Pattern Recognition, pp. 2732-2735.
15. Esgiar A., Naguib R., Sharif B., Bennett M., Murray A. Fractal analysis in the detection of colonic cancer images. IEEE Trans. Inform. Technol. Biomed. 2002, 6:54-58.
16. Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A., 2009. The PASCAL Visual Object Classes Challenge 2009 (VOC2009) Results. <>. http://www.pascal-network.org/challenges/VOC/voc2009/workshop/index.html.
17. Felzenszwalb P.F., Girshick R.B., McAllester D.A., Ramanan D. Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32:1627-1645.
18. Fung, G., Dundar, M., Krishnapuram, B., Rao, B., 2006. Multiple instance algorithms for computer aided diagnosis. In: Advances in Neural Information Processing Systems 19 (NIPS 2006), Vancouver, CA, pp. 1015-1021.
19. Fung, G., Dundar, M., Krishnapuram, B., Rao, R., 2007. Multiple instance learning for computer aided diagnosis. In: Advances in Neural Information Processing Systems, pp. 425-432.
20. Galleguillos, C., Babenko, B., Rabinovich, A., Belongie, S., 2008. Weakly supervised object recognition and localization with stable segmentations. In: European Conference on Computer Vision.
21. Gärtner, T., Flach, P.A., Kowalczyk, A., Smola, A.J., 2002. Multi-instance kernels. In: International Conference on Machine Learning.
22. Huang P.W., Lee C.H. Automatic classification for pathological prostate images based on fractal analysis. IEEE Trans. Med. Imag. 2009, 28:1037-1050.
23. Jin, R., Wang, S., Zhou, Z.H., 2009. Learning a distance metric from multi-instance multi-label data. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 896-902.
24. Keeler, J.D., Rumelhart, D.E., Leow, W.K., 1990. Integrated segmentation and recognition of hand-printed numerals. In: Advances in Neural Information Processing Systems, pp. 285-290.
25. Kong J., Sertel O., Shimada H., Boyer K.L., Saltz J.H., Gurcan M.N. Computer-aided evaluation of neuroblastoma on whole-slide histology images: classifying grade of neuroblastic differentiation. Pattern Recogn. 2009, 42:1080-1092.
26. Kong H., Gurcan M., Belkacem-Boussaid K. Partitioning histopathological images: an integrated framework for supervised color-texture segmentation and cell splitting. IEEE Trans. Med. Imag. 2011, 30:1661-1677.
27. Lafferty, J.D., McCallum, A., Pereira, F.C.N., 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In: International Conference on Machine Learning, pp. 282-292.
28. Lezoray O., Cardot H. Cooperation of color pixel classification schemes and color watershed: a study for microscopic images. IEEE Trans. Image Process. 2002, 11:783-789.
29. Liang, J., Bi, J., 2007. Computer aided detection of pulmonary embolism with tobogganing and multiple instance classification in CT pulmonary angiography. In: International Conference on Information Processing in Medical Imaging, pp. 630-641.
30. Liu, Q., Qian, Z., Marvasty, I., Rinehart, S., Voros, S., Metaxas, D., 2010. Lesion-specific coronary artery calcium quantification for predicting cardiac event with multiple instance support vector machines. In: International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 484-492.
31. Loeff, N., Arora, H., Sorokin, A., Forsyth, D.A., 2005. Efficient unsupervised learning for localization and detection in object categories. In: Advances in Neural Information Processing Systems.
32. Lowe D.G. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 2004, 60:91-110.
33. Lu, L., Bi, J., Wolf, M., Salganicoff, M., 2011. Effective 3D object detection and regression using probabilistic segmentation features in CT images. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1049-1056.
34. Madabhushi A. Digital pathology image analysis: opportunities and challenges. Imag. Med. 2009, 1:7-10.
35. Maron, O., Lozano-Pérez, T., 1997. A framework for multiple-instance learning. In: Advances in Neural Information Processing Systems.
36. Mason, L., Baxter, J., Bartlett, P., Frean, M., 2000. Boosting algorithms as gradient descent. In: Advances in Neural Information Processing Systems.
37. Monaco J.P., Tomaszewski J.E., Feldman M.D., Hagemann I., Moradi M., Mousavi P., Boag A., Davidson C., Abolmaesumi P., Madabhushi A. High-throughput detection of prostate cancer in histological sections using probabilistic pairwise Markov models. Med. Image Anal. 2010, 14:617-629.
38. Ojala T., Pietikäinen M., Mäenpää T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 2002, 24:971-987.
39. Park S., Sargent D., Lieberman R., Gustafsson U. Domain-specific image analysis for cervical neoplasia detection based on conditional random fields. IEEE Trans. Med. Imag. 2011, 30:867-878.
40. Portilla J., Simoncellt E.P. A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vis. 2000, 40:49-71.
41. Ramon, J., Raedt, L.D., 2000. Multi instance neural networks. In: ICML, Workshop on Attribute-Value and Relational Learning.
42. Raykar, V.C., Krishnapuram, B., Bi, J., Dundar, M., Rao, R.B., 2008. Bayesian multiple instance learning: automatic feature selection and inductive transfer. In: Proceedings of the 25th International Conference on Machine Learning (ICML 2008), Helsinki, pp. 808-815.
43. Sertel O., Kong J., Shimada H., Catalyurek U.V., Saltz J.H., Gurcan M.N. Computer-aided prognosis of neuroblastoma on whole-slide images: classification of stromal development. Pattern Recogn. 2009, 42:1093-1103.
44. Shotton, J., Johnson, M., Cipolla, R., 2008. Semantic texton forests for image categorization and segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8.
45. Soares J.V.B., Leandro J.J.G., Cesar R.M., Jelinek H.F., Cree M.J. Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification. IEEE Trans. Med. Imag. 2006, 25:1214-1222.
46. Tabesh A., Teverovskiy M., Pang H.Y., Kumar V., Verbel D., Kotsianti A., Saidi O. Multifeature prostate cancer diagnosis and Gleason grading of histological images. IEEE Trans. Med. Imag. 2007, 26:1366-1378.
47. Ta V.T., Lézoray O., Elmoataz A., Schüpp S. Graph-based tools for microscopic cellular image segmentation. Pattern Recogn. 2009, 42:1113-1125.
48. Taskar, B., Guestrin, C., Koller, D., 2003. Max-margin Markov networks. In: Advances in Neural Information Processing Systems.
49. Tu Z., Bai X. Auto-context and its application to high-level vision tasks and 3D brain image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 21:1744-1757.
50. Tuytelaars T., Lampert C.H., Blaschko M.B., Buntine W. Unsupervised object discovery: a comparison. Int. J. Comput. Vis. 2009, 88:284-302.
51. Vedaldi, A., Gulshan, V., Varma, M., Zisserman, A., 2009. Multiple kernels for object detection. In: International Conference on Computer Vision, pp. 606-613.
52. Vezhnevets, A., Buhmann, J.M., 2010. Towards weakly supervised semantic segmentation by means of multiple instance and multitask learning. In: IEEE Conference on Computer Vision and Pattern Recognition.
53. Vijayanarasimhan, S., Grauman, K., 2008. Keywords to visual categories: multiple-instance learning for weakly supervised object categorization. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8.
54. Viola P.A., Jones M.J. Robust real-time face detection. Int. J. Comput. Vis. 2004, 57:137-154.
55. Viola, P.A., Platt, J., Zhang, C., 2005. Multiple instance boosting for object detection. In: Advances in Neural Information Processing Systems.
56. Wang Y., Rajapakse J.C. Contextual modeling of functional MR images with conditional random fields. IEEE Trans. Med. Imag. 2006, 25:804-812.
57. Wang, J., Zucker, Jean-Daniel, 2000. Solving multiple-instance problem: a lazy learning approach. In: International Conference on Machine Learning.
58. Xu, Y., Zhang, J., Chang, E.I.C., Lai, M., Tu, Z., 2012a. Contexts-constrained multiple instance learning for histopathology image segmentation. In: International Conference on Medical Image Computing and Computer Assisted Intervention.
59. Xu, Y., Zhu, J.Y., Chang, E., Tu, Z., 2012b. Multiple clustered instance learning for histopathology cancer image classification, segmentation and clustering. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 964-971.
60. Yang, L., Tuzel, O., Meer, P., Foran, D., 2008. Automatic image analysis of histopathology specimens using concave vertex graph. In: International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 833-841.
61. Zha, Z.J., Mei, T., Wang, J., Qi, G.J., Wang, Z., 2008. Joint multi-label multi-instance learning for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8.
62. Zhang, Q., Goldman, S.A., 2001. EM-DD: an improved multiple-instance learning technique. In: Advances in Neural Information Processing Systems, pp. 1-8.
63. Zhang M.L., Zhou Z.H. Multi-instance clustering with applications to multi-instance prediction. Appl. Intell. 2009, 31:47-68.
64. Zhang, D., Wang, F., Si, L., Li, T., 2009. M3IC: maximum margin multiple instance clustering. In: International Joint Conference on Artificial Intelligence.
65. Zhou, Z.H., Zhang, M.L., 2007. Multi-instance multilabel learning with application to scene classification. In: Advances in Neural Information Processing Systems.
66. Zhu, X., 2008. Semi-Supervised Learning Literature Survey. Computer Science TR 1530, University of Wisconsin-Madison.