Pathology imaging informatics for quantitative analysis of whole-slide images

Journal of the American Medical Informatics Association

Volumn 20, Issue 6, 2013, Pages 1099-1108

  Kothari, Sonal ^a   Phan, John H ^b   Stokes, Todd H ^b   Wang, May D ^a,b,c  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b Wallace H Coulter Department of Biomedical Engineering   (United States)

^c GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFACT; CELL STRUCTURE; DECISION SUPPORT SYSTEM; HIDDEN MARKOV MODEL; HISTOGRAM; HISTOPATHOLOGY; HUMAN; IMAGE PROCESSING; IMAGING; MEDICAL INFORMATICS; MICROSCOPY; NUCLEAR SHAPE; QUALITY CONTROL; QUANTITATIVE ANALYSIS; REVIEW; TISSUE SECTION; TUMOR BIOPSY;

CANCER PREDICTION; COMPUTER-AIDED DIAGNOSIS; DECISION SUPPORT SYSTEMS; PATHOLOGY IMAGING INFORMATICS; WHOLE-SLIDE IMAGES;

ARTIFACTS; BIOPSY; DECISION SUPPORT SYSTEMS, CLINICAL; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGE PROCESSING, COMPUTER-ASSISTED; PATHOLOGY;

EID: 84886247903     PISSN: 10675027     EISSN: 1527974X     Source Type: Journal    
DOI: 10.1136/amiajnl-2012-001540     Document Type: Review

References (96)

1. Gabril MY, Yousef GM. Informatics for practicing anatomical pathologists: marking a new era in pathology practice. Mod Pathol 2010;23:349-58.
2. Wetzel A. Computational aspects of pathology image classification and retrieval. J Supercomput 1997;11:279-93.
3. Fuchs TJ, Buhmann JM. Computational pathology: challenges and promises for tissue analysis. Comput Med Imaging Graph 2011;35:515-30.
4. Amin W, Chandran U, Parwani Anil V, et al. Biomedical informatics for anatomic pathology. In: Cheng L, Bostwick DG, eds. Essentials of anatomic pathology. New York: Springer, 2011:469-80.
5. Gurcan MN, Boucheron L, Can A, et al. Histopathological image analysis: a review. IEEE Rev Biomed Eng 2009;2:147-71.
6. Sadimin ET, Foran DJ. Pathology imaging informatics for clinical practice and investigative and translational research. N Am J Med Sci (Boston) 2012;5:103-9.
7. Ho J, Parwani AV, Jukic DM, et al. Use of whole slide imaging in surgical pathology quality assurance: design and pilot validation studies. Hum Pathol 2006;37:322-31.
8. Pantanowitz L, Valenstein PN, Evans AJ, et al. Review of the current state of whole slide imaging in pathology. J Pathol Inform 2011;2:36.
9. Dunkle R. Role of image informatics in accelerating drug discovery and development. Drug Discovery 2003;4:75-82.
10. Melamed J, Datta MW, Becich MJ, et al. The cooperative prostate cancer tissue resource: a specimen and data resource for cancer researchers. Clin Cancer Res 2004;10:4614-21.
11. McLendon R, Friedman A, Bigner D, et al. Comprehensive genomic characterization defines human glioblastoma genes and core pathways. Nature 2008;455:1061-8.
12. Uhlen M, Oksvold P, Fagerberg L, et al. Towards a knowledge-based human protein atlas. Nat Biotechnol 2010;28:1248-50.
13. Kothari S, Phan JH, Osunkoya AO, et al. Biological interpretation of morphological patterns in histopathological whole-slide images. Proceedings of the 3rd ACM Conference on Bioinformatics, Computational Biology and Biomedicine. 2012:218-25.
14. Palokangas S, Selinummi J, Yli-Harja O. Segmentation of folds in tissue section images. Conference Proceedings of the IEEE Engineering in Medicine and Biology Society. 2007:5642-5.
15. Bautista PA, Yagi Y. Detection of tissue folds in whole slide images. Conference Proceedings of the IEEE Engineering in Medicine and Biology Society. 2009:3669-72.
16. Gao D, Padfield D, Rittscher J, et al. Automated training data generation for microscopy focus classification. Med Image Comput Comput Assist Interv 2010;13:446-53.
17. Wu HS, Murray J, Morgello S, et al. Restoration of distorted colour microscopic images from transverse chromatic aberration of imperfect lenses. J Microsc 2011;241:125-31.
18. Kothari S, Phan JH, Moffitt RA, et al. Automatic batch-invariant color segmentation of histological cancer images. Proceedings of the IEEE International Symposium on Biomedical Imaging. 2011:657-60.
19. Macenko M, Niethammer M, Marron JS, et al. A method for normalizing histology slides for quantitative analysis. Proceedings of the IEEE International Symposium on Biomedical Imaging. 2009:1107-10.
20. Magee D, Treanor D, Crellin D, et al. Colour normalisation in digital histopathology images. Proceedings of the Optical Tissue Image analysis in Microscopy, Histopathology and Endoscopy (MICCAI Workshop), 2009:100-11.
21. Kong H, Gurcan M, Belkacem-Boussaid K. Partitioning histopathological images: an integrated framework for supervised color-texture segmentation and cell splitting. IEEE Trans Med Imaging 2011;30:1661-77.
22. Kong J, Sertel O, Shimada H, et al. Computer-aided evaluation of neuroblastoma on whole-slide histology images: classifying grade of neuroblastic differentiation. Pattern Recognition 2009;42:1080-92.
23. Doyle S, Feldman M, Tomaszewski J, et al. A boosted bayesian multi-resolution classifier for prostate cancer detection from digitized needle biopsies. IEEE Trans Biomed Eng 2010;59:1205-18.
24. Kothari S, Phan JH, Wang MD. Scale normalization of histopathological images for batch invariant cancer diagnostic models. Conference Proceedings of the IEEE Engineering in Medicine and Biology Society. 2012:4406-9.
25. Chen C, Grennan K, Badner J, et al. Removing batch effects in analysis of expression microarray data: An evaluation of six batch adjustment methods. PLoS ONE 2011;6:e17238.
26. Luo J, Schumacher M, Scherer A, et al. A comparison of batch effect removal methods for enhancement of prediction performance using maqc-ii microarray gene expression data. Pharmacogenomics J 2010;10:278-91.
27. He Z, Yu W. Stable feature selection for biomarker discovery. Comput Biol Chem 2010;34:215-25.
28. Hsu W, Lee Mong L, Zhang J. Image mining: trends and developments. J Intell Inf Syst 2002;19:7-23.
29. Tabesh A, Teverovskiy M, Ho-Yuen P, et al. Multifeature prostate cancer diagnosis and gleason grading of histological images. IEEE Trans on Med Imaging 2007;26:1366-78.
30. Kothari S, Phan JH, Young AN, et al. Histological image feature mining reveals emergent diagnostic properties for renal cancer. Proceedings of the IEEE International Conference on Bioinformatics Biomedicine. 2011:422-5.
31. Fuchs T, Wild P, Moch H, et al. Computational pathology analysis of tissue microarrays predicts survival of renal clear cell carcinoma patients. In: Metaxas D, Axel L, Fichtinger G, Székely G, eds. Medical image computing and computer-assisted intervention. Berlin/Heidelberg: Springer, 2008:1-8.
32. Rahman M, Bhattacharya P, Desai BC. A framework for medical image retrieval using machine learning and statistical similarity matching techniques with relevance feedback. IEEE Trans Inf Technol Biomed 2007;11:58-69.
33. Yang L, Tuzel O, Chen W, et al. Pathminer: a web-based tool for computer-assisted diagnostics in pathology. IEEE Trans Inf Technol Biomed 2009;13:291-9.
34. Kovalev V, Dmitruk A, Safonau I, et al. A method for identification and visualization of histological image structures relevant to the cancer patient conditions. In: Real P, Diaz-Pernil D, Molina-Abril H, Berciano A, Kropatsch W, eds. Computer analysis of images and patterns. Berlin/Heidelberg: Springer, 2011: 460-8.
35. Chaudry Q, Raza S, Young A, et al. Automated renal cell carcinoma subtype classification using morphological, textural and wavelets based features. J Signal Processing Syst 2009;55:15-23.
36. Po-Whei H, Cheng-Hsiung L. Automatic classification for pathological prostate images based on fractal analysis. IEEE Trans Med Imaging 2009;28:1037-50.
37. Jafari-Khouzani K, Soltanian-Zadeh H. Multiwavelet grading of pathological images of prostate. IEEE Trans Biomed Eng 2003;50:697-704.
38. Celebi ME, Kingravi HA, Uddin B, et al. A methodological approach to the classification of dermoscopy images. Comput Med Imaging Graph 2007; 31:362-73.
39. Sertel O, Kong J, Catalyurek U, et al. Histopathological image analysis using model-based intermediate representations and color texture: Follicular lymphoma grading. J Signal Processing Syst 2009;55:169-83.
40. Jun K, Shimada H, Boyer K, et al. Image analysis for automated assessment of grade of neuroblastic differentiation. Proceedings of the IEEE International Symposium on Biomedical Imaging. 2007:61-4.
41. Meurie C, Lebrun G, Lezoray O, et al. A comparison of supervised pixels-based color image segmentation methods. Application in cancerology. WSEAS Trans Computers 2003;2:739-44.
42. Mao K, Zhao P, Tan P. Supervised learning-based cell image segmentation for p53 immunohistochemistry. IEEE Trans Biomed Eng 2006;53:1153-63.
43. Ranefalla P, Egevadb L, Nordina B, et al. A new method for segmentation of colour images applied to immunohistochemically stained cell nuclei. Anal Cell Pathol 1997;15:145-56.
44. Gunduz-Demir C, Kandemir M, Tosun A, et al. Automatic segmentation of colon glands using object-graphs. Med Image Anal 2010;14:1-12.
45. Monaco J, Tomaszewski J, Feldman M, et al. High-throughput detection of prostate cancer in histological sections using probabilistic pairwise Markov models. Med Image Anal 2010;14:617-29.
46. Zhang D, Lu G. Review of shape representation and description techniques. Pattern Recognition 2004;37:1.
47. Kothari S, Phan JH, Young AN, et al. Histological image classification using biologically interpretable shape-based features. BMC Medical Imaging 2013;13:9.
48. Boucheron L. Object-and spatial-level quantitative analysis of multispectral histopathology images for detection and characterization of cancer. PhD thesis, Santa Barbara: University of California, 2008.
49. Cooper LAD, Jun K, Gutman DA, et al. An integrative approach for in silico glioma research. IEEE Trans Biomed Eng 2010;57:2617-21.
50. Kothari S, Chaudry Q, Wang MD. Extraction of informative cell features by segmentation of densely clustered tissue images. Conference Proceedings of the IEEE Engineering in Medicine and Biology Society. 3-6 September 2009, 6706-9.
51. Muthu Rama Krishnan M, Pal M, Paul RR, et al. Computer vision approach to morphometric feature analysis of basal cell nuclei for evaluating malignant potentiality of oral submucous fibrosis. J Med Syst 2012;36:1746-56.
52. Gunduz C, Yener B, Gultekin SH. The cell graphs of cancer. Bioinformatics 2004;20 (Suppl. 1):i145-i51.
53. Bilgin CC, Bullough P, Plopper GE, et al. Ecm-aware cell-graph mining for bone tissue modeling and classification. Data Min Knowl Discov 2009;20:416-38.
54. Basavanhally AN, Ganesan S, Agner S, et al. Computerized image-based detection and grading of lymphocytic infiltration in her2+ breast cancer histopathology. IEEE Trans Biomed Eng 2010;57:642-53.
55. Sudbø J, Marcelpoil R, Reith A. New algorithms based on the voronoi diagram applied in a pilot study on normal mucosa and carcinomas. Anal Cell Pathol 2000; 21:71-86.
56. Sudbo J, Bankfalvi A, Bryne M, et al. Prognostic value of graph theory-based tissue architecture analysis in carcinomas of the tongue. Lab Invest 2000;80:1881-9.
57. Cruz-Roa A, Caicedo JC, González FA. Visual pattern mining in histology image collections using bag of features. Artif Intell Med 2011;52:91.
58. Raza S, Parry R, Moffitt R, et al. An analysis of scale and rotation invariance in the bag-of-features method for histopathological image classification. In: Fichtinger G, Martel A, Peters T, eds. Medical image computing and computer-assisted intervention. Berlin/Heidelberg: Springer, 2011:66-74.
59. Rahman M, Antani S, Thoma G. A learning-based similarity fusion and filtering approach for biomedical image retrieval using svm classification and relevance feedback. IEEE Trans Inf Technol Biomed 2011;15:640-6.
60. Caicedo JC, González FA, Romero E. Content-based histopathology image retrieval using a kernel-based semantic annotation framework. J Biomed Inform 2011;44:519-28.
61. Yu F, Ip Horace HS. Semantic content analysis and annotation of histological images. Comput Biol Med 2008;38:635-49.
62. Tang HL, Hanka R, Ip HHS. Histological image retrieval based on semantic content analysis. IEEE Trans Inf Technol Biomed 2003;7:26-36.
63. Gutiérrez R, Gómez F, Roa-Peña L, et al. A supervised visual model for finding regions of interest in basal cell carcinoma images. Diagn Pathol 2011;6:26.
64. Romo D, Romero E, González F. Learning regions of interest from low level maps in virtual microscopy. Diagn Pathol 2011;6(SUPPL. 1):S22.
65. DiFranco MD, O'Hurley G, Kay EW, et al. Ensemble based system for whole-slide prostate cancer probability mapping using color texture features. Comput Med Imaging Graph 2011;35:629-45.
66. Thomas K, Sottile M, Salafia C. Unsupervised segmentation for inflammation detection in histopathology images. In: Elmoataz A, Lezoray O, Nouboud F, Mammass D, Meunier J, eds. Image and signal processing. Berlin/Heidelberg: Springer, 2010:541-9.
67. Roullier V, Lézoray O, Ta VT, et al. Multi-resolution graph-based analysis of histopathological whole slide images: Application to mitotic cell extraction and visualization. Comput Med Imaging Graph 2011;35:603-15.
68. Chang H, Fontenay GV, Han J, et al. Morphometic analysis of tcga glioblastoma multiforme. BMC Bioinformatics 2011;12:484.
69. Samsi S, Krishnamurthy AK, Gurcan MN. An efficient computational framework for the analysis of whole slide images: Application to follicular lymphoma immunohistochemistry. J Comput Sci 2012;3:269-79.
70. Huang CH, Veillard A, Roux L, et al. Time-efficient sparse analysis of histopathological whole slide images. Comput Med Imaging Graph 2011;35:579-91.
71. Herold J, Loyek C, Nattkemper Tim W. Multivariate image mining. WIREs Data Mining Knowl Discov 2011;1:2.
72. Liu CL, Prapong W, Natkunam Y, et al. Software tools for high-throughput analysis and archiving of immunohistochemistry staining data obtained with tissue microarrays. Am J Pathol 2002;161:1557-65.
73. Cooper LAD, Jun K, Fusheng W, et al. Morphological signatures and genomic correlates in glioblastoma. Proceedings of the IEEE International Symposium on Biomedical Imaging. 2011;1624-7.
74. Lobenhofer EK, Boorman GA, Phillips KL, et al. Application of visualization tools to the analysis of histopathological data enhances biological insight and interpretation. Toxicol Pathol 2006;34:921-8.
75. Lessmann B, Nattkemper TW, Hans VH, et al. A method for linking computed image features to histological semantics in neuropathology. J Biomed Inform 2007;40:631-41.
76. Iglesias-Rozas JR, Hopf N. Histological heterogeneity of human glioblastomas investigated with an unsupervised neural network (som). Histol Histopathol 2005;20:351-6.
77. Stephanakis I, Anastassopoulos G, Iliadis L. Color segmentation using self-organizing feature maps (sofms) defined upon color and spatial image space. In: Diamantaras K, Duch W, Iliadis L, eds. Artificial neural networks-icann. Berlin/ Heidelberg: Springer, 2010: 500-10.
78. Datar M, Padfield D, Cline H. Color and texture based segmentation of molecular pathology images using hsoms. Proceedings of the IEEE International Symposium on Biomedical Imaging. 2008;292-5.
79. Rabinovich A, Krajewski S, Krajewska M, et al. Framework for parsing, visualizing and scoring tissue microarray images. IEEE Trans Inf Technol Biomed 2006;10:209-19.
80. Yang L, Chen W, Meer P, et al. Virtual microscopy and grid-enabled decision support for large-scale analysis of imaged pathology specimens. IEEE Trans Inf Technol Biomed 2009;13:636-44.
81. Marchevsky AM, Dulbandzhyan R, Seely K, et al. Storage and distribution of pathology digital images using integrated web-based viewing systems. Arch Pathol Lab Med 2002;126:533-9.
82. Mayerich D, Abbott L, McCormick B. Knife-edge scanning microscopy for imaging and reconstruction of three-dimensional anatomical structures of the mouse brain. J Microsc 2008;231:134-43.
83. Won-Ki J, Schneider J, Turney SG, et al. Interactive histology of large-scale biomedical image stacks. IEEE Trans Vis Comput Graph 2010;16:1386-95.
84. Zwönitzer R, Kalinski T, Hofmann H, et al. Digital pathology: Dicom-conform draft, testbed, and first results. Comput Methods Programs Biomed 2007;87:181-8.
85. Triola MM, Holloway WJ. Enhanced virtual microscopy for collaborative education. BMC Med Educ 2011;11.
86. Nock R. Fast and reliable color region merging inspired by decision tree pruning. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2001;1:271-6.
87. Monaco JP, Tomaszewski JE, Feldman MD, et al. High-throughput detection of prostate cancer in histological sections using probabilistic pairwise markov models. Med Image Anal 2010;14:617-29.
88. Ding C, Peng H. Minimum redundancy feature selection from microarray gene expression data. J Bioinform Comput Biol 2005;3:185-205.
89. Sidiropoulos K, Glotsos D, Kostopoulos S, et al. Real time decision support system for diagnosis of rare cancers, trained in parallel, on a graphics processing unit. Comput Biol Med 2012;42:376-86.
90. Phan JH, Quo CF, Cheng C, et al. Multiscale integration of -omic, imaging, and clinical data in biomedical informatics. IEEE Rev Biomed Eng 2012;5:74-87.
91. Srivastava S, Rodríguez JJ, Rouse AR, et al. Computer-aided identification of ovarian cancer in confocal microendoscope images. J Biomed Opt 2008;13:024021.
92. Lei Z, Wetzel AW, Gilbertson J, et al. Design and analysis of a content-based pathology image retrieval system. IEEE Trans Inf Technol Biomed 2003;7:249-55.
93. Foran DJ, Yang L, Chen W, et al. Imageminer: a software system for comparative analysis of tissue microarrays using content-based image retrieval, high-performance computing, and grid technology. J Am Med Inform Assoc 2011;18:403-15.
94. Doyle S, Monaco J, Feldman M, et al. An active learning based classification strategy for the minority class problem: application to histopathology annotation. BMC Bioinformatics 2011;12:424.
95. Cosatto E, Miller M, Graf HP, et al. Grading nuclear pleomorphism on histological micrographs. Proceedings of the International Conference on Pattern Recognition. 2008:1-4.
96. Begelman G, Pechuk M, Rivlin E, et al. A microscopic telepathology system for multiresolution computer-aided diagnostics. J Multimed 2006;1.