Automated classification of brain tumor type in whole-slide digital pathology images using local representative tiles

Medical Image Analysis

Volumn 30, Issue , 2016, Pages 60-71

  Barker, Jocelyn ^a   Hoogi, Assaf ^a   Depeursinge, Adrien ^a,b   Rubin, Daniel L ^a  

^a STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF APPLIED SCIENCES WESTERN SWITZERLAND   (Switzerland)

Author keywords

Computer aided diagnosis; Digital pathology; Object classification

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTER GRAPHICS; DIAGNOSIS; DISEASES; IMAGE ANALYSIS; PATHOLOGY; TUMORS;

AUTOMATED CLASSIFICATION; CLASSIFICATION ACCURACY; COMPUTERIZED ANALYSIS; DIGITAL PATHOLOGIES; DIMENSIONALITY REDUCTION; GLIOBLASTOMA MULTIFORME; OBJECT CLASSIFICATION; STABILITY AND ROBUSTNESS;

COMPUTER AIDED DIAGNOSIS;

ARTICLE; AUTOMATION; BRAIN CANCER; CANCER CLASSIFICATION; CANCER GRADING; CANCER TISSUE; CLASSIFICATION ALGORITHM; CLINICAL FEATURE; COARSE TO FINE ANALYSIS; COMPUTER ASSISTED DIAGNOSIS; DIAGNOSTIC ACCURACY; DIAGNOSTIC TEST ACCURACY STUDY; DIGITAL IMAGING; DIGITAL SLIDE SCANNER; ELASTIC NET CLASSIFIER; GLIOBLASTOMA; GLIOMA; HEALTH CARE COST; HISTOPATHOLOGY; HUMAN; HUMAN TISSUE; IMAGE ANALYSIS; IMAGE PROCESSING; IMAGE QUALITY; METHODOLOGY; MULTIFACTOR DIMENSIONALITY REDUCTION; PRIORITY JOURNAL; TUMOR DIFFERENTIATION; VALIDATION STUDY; ALGORITHM; AUTOMATED PATTERN RECOGNITION; BIOPSY; BRAIN TUMOR; CLASSIFICATION; DIAGNOSTIC IMAGING; DIFFERENTIAL DIAGNOSIS; EVALUATION STUDY; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; MICROSCOPY; PATHOLOGY; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING;

ALGORITHMS; BIOPSY; BRAIN NEOPLASMS; DIAGNOSIS, DIFFERENTIAL; GLIOMA; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MICROSCOPY; PATHOLOGY; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SUBTRACTION TECHNIQUE;

EID: 84956999616     PISSN: 13618415     EISSN: 13618423     Source Type: Journal    
DOI: 10.1016/j.media.2015.12.002     Document Type: Article

References (88)

1. Adiga U., Malladi R., Fernandez-Gonzalez R., de Solorzano C.O. High-throughput analysis of multispectral images of breast cancer tissue. IEEE Trans. Image Process. 2006, 15:2259-2268.
2. Aiad H., Abdou A., Bashandy M., Said A., Ezz-Elarab S., Zahran A. Computerized nuclear morphometry in the diagnosis of thyroid lesions with predominant follicular pattern. Ecancermedicalscience 2009, 3:146.
3. Alexe G., Monaco J., Doyle S., Basavanhally A., Reddy A., Seiler M., Ganesan S., Bhanot G., Madabhushi A. Towards improved cancer diagnosis and prognosis using analysis of gene expression data and computer aided imaging. Exp. Biol. Med. 2009, 234:860-879.
4. Al-Kadi O.S. Texture measures combination for improved meningioma classification of histopathological images. Pattern Recognit. 2010, 43:2043-2053.
5. Altunbay D., Cigir C., Sokmensuer C., Gunduz-Demir C. Color graphs for automated cancer diagnosis and grading. IEEE Trans. Biomed. Eng. 2010, 57:665-674.
6. Arthur D., Vassilvitskii S. K-means++: the advantages of careful seeding. Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA'07 2007, 1027-1035. Society for Industrial and Applied Mathematics, Philadelphia, PA, USA.
7. Baak J.P.A., Kurver P.H.J., Overdiep S.H., Delemarre J.F.M., Boon M.E., Lindeman J., Diegenbach P.C. Quantitative, microscopical, computer-aided diagnosis of endometrial hyperplasia or carcinoma in individual patients. Histopathology 1981, 5:689-695.
8. Basavanhally A.N., Agner S., Alexe G., Bhanot G., Ganesan S., Madabhushi A. Manifold learning with graph-based features for identifying extent of lymphocytic infiltration from high grade, HER2 breast cancer histology. Image Anal. Appl. Biol. (in Conjunction with MICCAI) 2008.
9. Basavanhally A.N., Ganesan S., Agner S., Monaco J.P., Feldman M.D., Tomaszewski J.E., Bhanot G., Madabhushi A. Computerized image-based detection and grading of lymphocytic infiltration in HER2+ breast cancer histopathology. IEEE Trans. Biomed. Eng. 2010, 57:642-653.
10. Brook A., El-Yaniv R., Issler E., Kimmel R., Meir R., Peleg D. Breast cancer diagnosis from biopsy images using generic features and SVMs. Presented at the IEEE Transactions on Information Technology in Biomedicine 2007.
11. Bueno G., Fernández M., Serrano I., Vállez N., Gutiérrez J., Déniz O., Salido J. Statistical and frequential bag of features for automatic classification of gliomas. Proceedings of Digital Pathology Classification and Segmentation Challenge. Presented at the MICCAI 2014.
12. Cavenee W.K., Louis D.N., Ohgaki H., Wiestler WHO Classification of Tumours of the Central Nervous System 2007, WHO Press, World Health Organization, Geneva, Switzerland.
13. Chang H., Parvin B. Segmentation of Necrosis based on Spatial Organization. Proceedings of Digital Pathology Classification and Segmentation Challenge. Presented at the MICCAI 2014.
14. Coons S.W., Johnson P.C., Scheithauer B.W., Yates A.J., Pearl D.K. Improving diagnostic accuracy and interobserver concordance in the classification and grading of primary gliomas. Cancer 1997, 79:1381-1393.
15. Depeursinge A., Foncubierta-Rodriguez A., Van De Ville D., Muller H. Rotation covariant texture learning using steerable riesz wavelets. IEEE Trans. Image Process. 2014, 23:898-908.
16. Divakar, R., 2009. Auto contrast. MATLAB Central File Exchange.
17. Doi K. Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput. Med. Imaging Graph. 2007, 31:198-211.
18. Doyle S., Agner S., Madabhushi A., Feldman M., Tomaszewski J. Automated grading of breast cancer histopathology using spectral clustering with textural and architectural image features. Proceedings of 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, ISBI 2008 2008, 496-499.
19. Doyle S., Feldman M.D., Shih N., Tomaszewski J., Madabhushi A. Cascaded discrimination of normal, abnormal, and confounder classes in histopathology: Gleason grading of prostate cancer. BMC Bioinf. 2012, 13:282.
20. Doyle S., Feldman M., Tomaszewski J., Madabhushi A. A boosted Bayesian multiresolution classifier for prostate cancer detection from digitized needle biopsies. IEEE Trans. Biomed. Eng. 2012, 59:1205-1218.
21. Doyle S., Hwang M., Shah K., Madabhushi A., Feldman M., Tomaszeweski J. Automated grading of prostate cancer using architextural and textural image features,. Proceedings of the 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, ISBI 2007 2007, 1284-1287.
22. Dundar M.M., Badve S., Bilgin G., Raykar V., Jain R., Sertel O., Gurcan M.N. Computerized classification of intraductal breast lesions using histopathological Images. IEEE Trans. Biomed. Eng. 2011, 58:1977-1984.
23. Dundar M.M., Badve S., Raykar V.C., Jain R.K., Sertel O., Gurcan M.N. A multiple instance learning approach toward optimal classification of pathology Slides. Proceedings of the 20th International Conference on Pattern Recognition (ICPR) 2010, 2732-2735.
24. Esgiar A.N., Naguib R.N.G., Sharif B.S., Bennett M.K., Murray A. Fractal analysis in the detection of colonic cancer images. IEEE Trans. Inf. Technol. Biomed. 2002, 6:54-58.
25. Farjam R., Soltanian-Zadeh H., Jafari-Khouzani K., Zoroofi R.A. An image analysis approach for automatic malignancy determination of prostate pathological images. Cytometry B: Clin. Cytom. 2007, 72:227-240.
26. Fatima K., Arooj A., Majeed H. A new texture and shape based technique for improving meningioma classification. Microsc. Res. Tech 2014, 77:862-873.
27. Friedman J.H., Hastie T., Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 2010, 33:1-22.
28. Gil J., Wu H.-S. Applications of image analysis to anatomic pathology: realities and promises. Cancer Investig. 2003, 21:950-959.
29. Glotsos D., Kalatzis I., Spyridonos P., Kostopoulos S., Daskalakis A., Athanasiadis E., Ravazoula P., Nikiforidis G., Cavouras D. Improving accuracy in astrocytomas grading by integrating a robust least squares mapping driven support vector machine classifier into a two level grade classification scheme. Comput. Methods Prog. Biomed. 2008, 90:251-261.
30. Gunduz C., Yener B., Gultekin S.H. The cell graphs of cancer. Bioinformatics 2004, 20:i145-i151.
31. Gupta N., Sarkar C., Singh R., Karak A.K. Evaluation of diagnostic efficiency of computerized image analysis based quantitative nuclear parameters in papillary and follicular thyroid tumors using paraffin-embedded tissue sections. Pathol. Oncol. Res. 2001, 7:46-55.
32. Gurcan M.N., Boucheron L., Can A., Madabhushi A., Rajpoot N., Yener B. Histopathological image analysis: a review. IEEE Rev. Biomed. Eng. 2009, 2:147-171.
33. Gurcan M.N., Pan T., Shimada H., Saltz J. Image analysis for neuroblastoma classification: segmentation of cell nuclei. Proceedings of Annual International Conference of the IEEE Engineering in Medicine and Biology Society 2006, 1:4844-4847.
34. Hall B.H., Ianosi-Irimie M., Javidian P., Chen W., Ganesan S., Foran D.J. Computer-assisted assessment of the human epidermal growth factor receptor 2 immunohistochemical assay in imaged histologic sections using a membrane isolation algorithm and quantitative analysis of positive controls. BMC Med. Imaging 2008, 8:11.
35. Hamilton P.W., Bankhead P., Wang Y., Hutchinson R., Kieran D., McArt D.G., James J., Salto-Tellez M. Digital pathology and image analysis in tissue biomarker research. Methods: Adv. Bound. Mol. Cell. Pathol. 2014, 70:59-73.
36. Haralick R.M., Shanmugam K., Dinstein I. Textural features for image classification. IEE Trans. Syst. Man Cybern. 1973, SMC-3:610-621.
37. Hou H.S., Andrews H. Cubic splines for image interpolation and digital filtering. IEEE Trans. Acoust. Speech Signal Process. 1978, 26:508-517.
38. Huang P.-W., Lai Y.-H. Effective segmentation and classification for HCC biopsy images. Pattern Recognit 2010, 43:1550-1563.
39. Huang P.-W., Lee C.-H. Automatic classification for pathological prostate images based on fractal analysis. IEEE Trans. Med. Imaging 2009, 28:1037-1050.
40. Jafari-Khouzani K., Soltanian-Zadeh H. Multiwavelet grading of pathological images of prostate. IEEE Trans. Biomed. Eng 2003, 50:697-704.
41. Kamentsky L., Jones T.R., Fraser A., Bray M.-A., Logan D.J., Madden K.L., Ljosa V., Rueden C., Eliceiri K.W., Carpenter A.E. Improved structure, function and compatibility for CellProfiler: modular high-throughput image analysis software. Bioinfor. Oxf. Engl. 2011, 27:1179-1180.
42. Khasraw M., Lassman A.B. Advances in the treatment of malignant gliomas. Curr. Oncol. Rep. 2010, 12:26-33. 10.1007/s11912-009-0077-4.
43. Kong J., Cooper L.A.D., Wang F., Gao J., Teodoro G., Scarpace L., Mikkelsen T., Schniederjan M.J., Moreno C.S., Saltz J.H., Brat D.J. Machine-based morphologic analysis of glioblastoma using whole-slide pathology images uncovers clinically relevant molecular correlates. PLoS One 2013, 8:e81049.
44. Kong J., Sertel O., Shimada H., Boyer K.L., Saltz J.H., Gurcan M.N. Computer-aided evaluation of neuroblastoma on whole-slide histology images: classifying grade of neuroblastic differentiation. Pattern Recognit. 2009, 42:1080-1092.
45. Kong J., Shimada H., Boyer K., Saltz J., Gurcan M. Image analysis for automated assessment of grade of neuroblastic differentiation. Proceedings of the 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, ISBI 2007 2007, 61-64.
46. Kwak J.T., Hewitt S.M., Sinha S., Bhargava R. Multimodal microscopy for automated histologic analysis of prostate cancer. BMC Cancer 2011, 11:62.
47. Land W.H., McKee D.W., Zhukov T., Song D., Qian Wei A kernelised fuzzy-support vector machine CAD system for the diagnosis of lung cancer from tissue images. Int. J. Funct. Inform. Pers. Med. 2008, 1:26-52.
48. Lessmann B., Nattkemper T.W., Hans V.H., Degenhard A. A method for linking computed image features to histological semantics in neuropathology. J. Biomed. Inform. 2007, 40:631-641. (Intelligent Data Analysis in Biomedicine).
49. Meng T., Lin L., Shyu M.-L., Chen S.-C. Histology image classification using supervised classification and multimodal fusion. Proceedings of 2010 IEEE International Symposium on Multimedia (ISM) 2010, 145-152.
50. Meyer F. Iterative image transformations for an automatic screening of cervical smears. J. Histochem. Cytochem. 1979, 27:128-135.
51. Monaco J.P., Tomaszewski J.E., Feldman M.D., Moradi M., Mousavi P., Boag A., Davidson C., Abolmaesumi P., Madabhushi A. Detection of prostate cancer from whole-mount histology imagesusing Markov random fields. Workshop on Microscopic Image Analysis with Applications in Biology. Presented at the MICCAI, New York, NY 2008.
52. Monaco J.P., Tomaszewski J.E., Feldman M.D., Hagemann I., Moradi M., Mousavi P., Boag A., Davidson C., Abolmaesumi P., Madabhushi A. High-throughput detection of prostate cancer in histological sections using probabilistic pairwise Markov models. Med. Image Anal. 2010, 14:617-629.
53. Mousavi H.S., Monga V., Rao G., Rao A.U.K. Automated discrimination of lower and higher grade gliomas based on histopathological image analysis. J. Pathol. Inform. 2015, 6:15.
54. Naik S., Doyle S., Agner S., Madabhushi A., Feldman M., Tomaszewski J. Automated gland and nuclei segmentation for grading of prostate and breast cancer histopathology. Proceedings of the 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, ISBI 2008 2008, 284-287.
55. Naik S., Doyle S., Feldman M., Tomaszewski J., Madabhushi A. Gland segmentation and computerized gleason grading of prostate histology by integrating low-, high-level and domain specific information. Presented at the MIAAB Workshop 2007.
56. Onega T., Weaver D., Geller B., Oster N., Tosteson A.N.A., Carney P.A., Nelson H., Allison K.H., O'Malley F.P., Schnitt S.J., Elmore J.G. Digitized whole slides for breast pathology interpretation: current practices and perceptions. J. Digit. Imaging 2014, 27:642-648.
57. Ostrom, Q.T., Gittleman, H., Liao, P., Rouse, C., Chen, Y., Dowling, J., Wolinsky, Y., Kruchko, C., Barnholtz-Sloan, J., 2014. CBTRUS statistical report: primary brain and central nervous system tumors diagnosed in the United States in 2007-2011. Neuro-Oncol. 16, iv1-iv63.
58. Ozolek J.A., Tosun A.B., Wang W., Chen C., Kolouri S., Basu S., Huang H., Rohde G.K. Accurate diagnosis of thyroid follicular lesions from nuclear morphology using supervised learning. Med. Image Anal. 2014, 18:772-780.
59. Pencina M.J., D' Agostino R.B., D' Agostino R.B., Vasan R.S. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat. Med. 2008, 27:157-172.
60. Petushi S., Garcia F.U., Haber M.M., Katsinis C., Tozeren A. Large-scale computations on histology images reveal grade-differentiating parameters for breast cancer. BMC Med. Imaging 2006, 6:14.
61. Preusser M., de Ribaupierre S., Wöhrer A., Erridge S.C., Hegi M., Weller M., Stupp R. Current concepts and management of glioblastoma. Ann. Neurol. 2011, 70:9-21. 10.1002/ana.22425.
62. Qureshi H., Rajpoot N., Nattkemper T., Hans V. Comparative analysis of discriminant wavelet packet features and raw image features for classification of meningioma subtypes. Presented at the Medical Image Understanding and Analysis, Aberystwyth, Wales 2007.
63. Qureshi H., Sertel O., Rajpoot N., Wilson R., Gurcan M. Adaptive discriminant wavelet packet transform and local binary patterns for meningioma subtype classification. Medical Image Computing and Computer-Assisted Intervention - MICCAI 2008, Lecture Notes in Computer Science 2008, 196-204. Springer, Berlin, Heidelberg. D. Metaxas, L. Axel, G. Fichtinger, G. Székely (Eds.).
64. Ruifrok A.C., Johnston D.A. Quantification of histochemical staining by color deconvolution. Anal. Quant. Cytol. Histol.: Int. Acad. Cytol. Am. Soc. Cytol. 2001, 23:291-299.
65. Ruiz A., Sertel O., Ujaldon M., Catalyurek U., Saltz J., Gurcan M. Pathological image analysis using the GPU: stroma classification for neuroblastoma. Proceedings of IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2007. 2007, 78-88.
66. Sboner A., Eccher C., Blanzieri E., Bauer P., Cristofolini M., Zumiani G., Forti S. A multiple classifier system for early melanoma diagnosis. Artif. Intell. Med. 2003, 27:29-44.
67. Schnorrenberg F., Pattichis C.S., Kyriacou K.C., Schizas C.N. Computer-aided detection of breast cancer nuclei. IEEE Trans. Inf. Technol. Biomed. 1997, 1:128-140.
68. Sertel O., Kong J., Shimada H., Catalyurek U.V., Saltz J.H., Gurcan M.N. Computer-aided prognosis of neuroblastoma on whole-slide images: classification of stromal development. Pattern Recognit. 2009, 42:1093-1103.
69. Sertel O., Lozanski G., Shana'ah A., Gurcan M.N. Computer-aided detection of centroblasts for follicular lymphoma grading using adaptive likelihood based cell segmentation. IEEE Trans. Biomed. Eng. 2010, 57:2613-2616.
70. Sparks R., Madabhushi A. Explicit shape descriptors: novel morphologic features for histopathology classification. Med. Image Anal. 2013, 17:997-1009.
71. Sudbø J., Marcelpoil R., Reith A. New algorithms based on the Voronoi diagram applied in a pilot study on normal mucosa and carcinomas. Anal. Cell. Pathol. 2000, 21:71-86.
72. Tabesh, A., Kumar, V.P., Pang, H.-Y., Verbel, D., Kotsianti, A., Teverovskiy, M., Saidi, O., 2005. Automated prostate cancer diagnosis and Gleason grading of tissue microarrays. pp. 58-70.
73. Tabesh A., Teverovskiy M. Tumor classification in histological images of prostate using color texture. Proceedings of the Fortieth Asilomar Conference on Signals, Systems and Computers, ACSSC'06 2006, 841-845.
74. Tabesh A., Teverovskiy M., Pang H.-Y., Kumar V.P., Verbel D., Kotsianti A., Saidi O. Multifeature prostate cancer diagnosis and gleason grading of histological images. IEEE Trans. Med. Imaging 2007, 26:1366-1378.
75. Tahir M.A., Bouridane A. Novel round-robin tabu search algorithm for prostate cancer classification and diagnosis using multispectral imagery. IEEE Trans. Inf. Technol. Biomed. 2006, 10:782-793.
76. Tasoulis D.K., Spyridonos P., Pavlidis N.G., Cavouras D., Ravazoula P., Nikiforidis G., Vrahatis M.N. Urinary bladder tumor grade diagnosis using on-line trained neural networks. Knowledge-Based Intelligent Information and Engineering Systems, Lecture Notes in Computer Science 2003, 199-206. Springer, Berlin, Heidelberg. V. Palade, R.J. Howlett, L. Jain (Eds.).
77. Teverovskiy M., Kumar V., Ma J., Kotsianti A., Verbel D., Tabesh A., Pang H.-Y., Vengrenyuk Y., Fogarasi S., Saidi O. Improved prediction of prostate cancer recurrence based on an automated tissue image analysis system. Proceedings of IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2004 2004, 1:257-260.
78. Thiran J.P., Macq B. Morphological feature extraction for the classification of digital images of cancerous tissues. IEEE Trans. Biomed. Eng. 1996, 43:1011-1020.
79. Tsai H.-W., Tsai H.-H., Kuo F.-Y., Chang K.-C. Computerized analyses of morphology and proliferative activity differentiate hepatoblastoma from paediatric hepatocellular carcinoma. Histopathology 2009, 54:328-336.
80. Tuzel O., Yang L., Meer P., Foran D.J. Classification of hematologic malignancies using texton signatures. Pattern Anal. Appl. 2007, 10:277-290.
81. Wang W., Ozolek J.A., Rohde G.K. Detection and classification of thyroid follicular lesions based on nuclear structure from histopathology images. Cytometry A 2010, 77:485-494.
82. Wetzel A.W., Crowley R., Kim S., Dawson R., Zheng L., Joo Y.M., Yagi Y., Gilbertson J., Gadd C., Deerfield D.W., Becich M.J. Evaluation of prostate tumor grades by content-based image retrieval. 27th AIPR Workshop: Advances in Computer-Assisted Recognition. Presented at the AIPR, Washington, DC 1999, 244-252. 10.1117/12.339826.
83. Weyn B., van de Wouwer G., van Daele A., Scheunders P., van Dyck D., van Marck E., Jacob W. Automated breast tumor diagnosis and grading based on wavelet chromatin texture description. Cytometry 1998, 33:32-40.
84. Xu Y., Jia Z., Zhang F., Ai Y., Lai M., Chang E.I.-C. Deep convolutional activation features for large brain tumor histopathology image classification, in: digital pathology classification and segmentation challenge. Presented at the MICCAI 2014.
85. Xu Y., Zhu J.-Y., Chang E.I.-C., Lai M., Tu Z. Weakly supervised histopathology cancer image segmentation and classification. Med. Image Anal. 2014, 18:591-604.
86. Yang L., Chen W., Meer P., Salaru G., Goodell L.A., Berstis V., Foran D.J. Virtual microscopy and grid-enabled decision support for large-scale analysis of imaged pathology specimens. IEEE Trans. Inf. Technol. Biomed. 2009, 13:636-644.
87. Zhao D., Daut D.G. Shape recognition using morphological transformations. Proceedings of 1991 International Conference on Acoustics, Speech, and Signal Processing, ICASSP-91 1991, 4:2565-2568.
88. Zou H., Hastie T. Regularization and variable selection via the Elastic Net. J. R. Stat. Soc. Ser. B 2005, 67:301-320.