High-throughput histopathological image analysis via robust cell segmentation and hashing

Medical Image Analysis

Volumn 26, Issue 1, 2015, Pages 306-315

  Zhang, Xiaofan ^a   Xing, Fuyong ^b   Su, Hai ^b   Yang, Lin ^b   Zhang, Shaoting ^a  

^a University of North Carolina at Charlotte   (United States)

^b J Crayton Pruitt Family Department of Biomedical Engineering   (United States)

Author keywords

Cell segmentation; Hashing; Histopathological image analysis; Image retrieval; Large scale

Indexed keywords

BIOLOGICAL ORGANS; CELLS; CLASSIFICATION (OF INFORMATION); COMPUTATIONAL EFFICIENCY; COMPUTER AIDED DIAGNOSIS; CYTOLOGY; DIAGNOSIS; IMAGE ANALYSIS; IMAGE PROCESSING; IMAGE RETRIEVAL; STATISTICAL TESTS;

CELL SEGMENTATION; HASHING; HISTOPATHOLOGICAL IMAGE ANALYSIS; HISTOPATHOLOGICAL IMAGES; LARGE-SCALE; ROBUST SEGMENTATION; SCALABLE SOLUTION; SQUAMOUS CARCINOMA;

IMAGE SEGMENTATION;

ALGORITHM; ARTICLE; CELL MATURATION; CELLULAR DISTRIBUTION; CONTROLLED STUDY; HIGH THROUGHPUT SCREENING; HISTOPATHOLOGY; HUMAN; HUMAN CELL; IMAGE ANALYSIS; IMAGE RETRIEVAL; KERNEL METHOD; LUNG ADENOCARCINOMA; LUNG PARENCHYMA; MICROSCOPY; PRIORITY JOURNAL; SQUAMOUS CELL LUNG CARCINOMA; SUPPORT VECTOR MACHINE; TUMOR DIFFERENTIATION; ADENOCARCINOMA; AUTOMATED PATTERN RECOGNITION; CELL TRACKING; COMPUTER ASSISTED DIAGNOSIS; DIFFERENTIAL DIAGNOSIS; IMAGE ENHANCEMENT; LUNG TUMOR; PATHOLOGY; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SQUAMOUS CELL CARCINOMA;

ADENOCARCINOMA; CARCINOMA, SQUAMOUS CELL; CELL TRACKING; DIAGNOSIS, DIFFERENTIAL; HIGH-THROUGHPUT SCREENING ASSAYS; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; LUNG NEOPLASMS; MICROSCOPY; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 84947426440     PISSN: 13618415     EISSN: 13618423     Source Type: Journal    
DOI: 10.1016/j.media.2015.10.005     Document Type: Article

References (80)

1. Akakin C.H., Kong H., Elkins C., Hemminger J., Miller B., Ming J., Plocharczyk E., Roth R., M.W., Ziegler R., Lozanski G., Gurcan M. Automated detection of cells from immunohistochemically-stained tissues: application to Ki-67 nuclei staining. Proc. SPIE 2012, 8315:831503.
2. Al-Kofahi Y., Lassoued W., Lee W., Roysam B. Improved automatic detection and segmentation of cell nuclei in histopathology images. IEEE Trans. Biomed. Eng. 2010, 57(4):841-852.
3. Al-Lahham H.Z., Alomari R.S., Hiary H., Chaudhary V. Automating proliferation rate estimation from Ki-67 histology images. Proceedings of the SPIE Medical Imaging Conference 2012, 83152A.
4. Ali S., Madabhushi A. An integrated region-, boundary-, shape-based active contour for multiple object overlap resolution in histological imagery. IEEE Trans. Med. Imaging 2012, 31(7):1448-1460.
5. Ali S., Veltri R., Epstein J.I., Christudass C., Madabhushi A. Adaptive energy selective active contour with shape priors for nuclear segmentation and gleason grading of prostate cancer. Proceedings of the MICCAI Conference 2011, 661-669.
6. Andoni A., Indyk P. Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. IEEE Symposium on Foundations of Computer Science (FOCS), Berkeley, CA 2006.
7. Bernardis E., Yu S. Finding dots: Segmentation as popping out regions from boundaries. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2010, 199-206.
8. Boykov Y., Funka-Lea G. Graph cuts and efficient N-D image segmentation. Inter. J. Comput. Vision 2006, 70(2):109-131.
9. Cai H., Xu X., Lu J., Lichtman J.W., Yung S.P., Wong S.T.C. Repulsive force based snake model to segment and track neuronal axons in 3d microscopy image stacks. NeuroImage 2006, 32(4):1608-1620.
10. Chang H., Han J., Spellman P.T., Parvin B. Multireference level set for the characterization of nuclear morphology in glioblastoma multiforme. IEEE Trans. Biomed. Eng. 2012, 59(12):3460-3467.
11. Chen C., Li H., Zhou X., Wong S. Constraint factor graph cut-based active contour method for automated cellular image segmentation in RNAi screening. J. Microsc. 2008, 230(2):177-191.
12. Cheng J., Rajapakse J. Segmentation of clustered nuclei with shape markers and marking function. IEEE Trans. Biomed. Eng. 2009, 56(3):741-748.
13. Cohen L.D. On active contour models and balloons. CVGIP: Image Underst. 1991, 53(2):211-218.
14. Comaniciu D., Meer P., Foran D.J. Image-guided decision support system for pathology. Mach. Vis. Appl. 1999, 11(4):213-224.
15. Dalal N., Triggs B. Histograms of oriented gradients for human detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2005, 1:886-893.
16. Datar M., Immorlica N., Indyk P., Mirrokni V.S. Locality-sensitive hashing scheme based on p-stable distributions. Proceedings of International Symposium on Computational Geometry, SoCG 2004, 253-262. ACM.
17. Doyle S., Agner S., Madabhushi A., Feldman M., Tomaszewski J. Automated grading of breast cancer histopathology using spectral clustering with textural and architectural image features. Proceedings of the IEEE International Symposium on Biomedical Imaging, Proceedings of the IEEE International Symposium on Biomedical Imaging, ISBI 2008, 496-499.
18. Dy J.G., Brodley C.E., Kak A., Broderick L.S., Aisen A.M. Unsupervised feature selection applied to content-based retrieval of lung images. IEEE Trans. Pattern Anal. Mach. Intell. 2003, 25(3):373-378.
19. Edwards S., Roberts C., McKean M., Cockburn J., Jeffrey R., Kerr K. Preoperative histological classification of primary lung cancer: accuracy of diagnosis and use of the non-small cell category. Am. J. Clin. Pathol. 2000, 53(7):537-540.
20. El-Naqa I., Yang Y., Galatsanos N.P., Nishikawa R.M., Wernick M.N. A similarity learning approach to content-based image retrieval: application to digital mammography. IEEE Trans. Med. Imaging 2004, 23(10):1233-1244.
21. Faustino G.M., Gattass M., Rehen S., de Lucena C. Automatic embryonic stem cells detection and counting method in fluorescence microscopy images. Proceedings of the IEEE International Symposium on Biomedical Imaging, ISBI 2009, 799-802.
22. Felzenszwalb P.F., Huttenlocher D.P. Efficient graph-based image segmentation. Int. J. Comput. Vis. 2004, 59(2):167-181.
23. Foran D.J., Yang L., et al. Imageminer: a software system for comparative analysis of tissue microarrays using content-based image retrieval, high-performance computing, and grid technology. J. Am. Med. Inform. Assoc. 2011, 18(4):403-415.
24. Freeman D.L. Harrison's principles of internal medicine. J. Am. Med. Assoc. 2001, 286(8):506.
25. Grady L., Schwartz E.L. Isoperimetric graph partitioning for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28(3):469-475.
26. Grala B., Markiewicz T., Kozłowski W., Osowski S., Słodkowska J., Papierz W. New automated image analysis method for the assessment of Ki-67 labeling index in meningiomas. Folia Histochem. Cytobiol. 2009, 47(4).
27. Grau V., Mewes A.U.J., Alcaniz M., Kikinis R., Warfield S. Improved watershed transform for medical image segmentation using prior information. IEEE Trans. Med. Imaging 2004, 23(4):447-458.
28. Greenspan H., Pinhas A.T. Medical image categorization and retrieval for PACs using the GMM-KL framework. IEEE Trans. Inf. Technol. BioMed. 2007, 11(2):190-202.
29. Hanbury A., Müller H., Langs G., Menze B.H. Cloud-based evaluation framework for big data. FIA Book 2013 2013, Springer.
30. Janowczyk A., Chandran S., Singh R., Sasaroli D., Coukos G., Feldman M.D., Madabhushi A. High-throughput biomarker segmentation on ovarian cancer tissue microarrays via hierarchical normalized cuts. IEEE Trans. Biomed. Eng. 2012, 59(5):1240-1252.
31. Jung C., Kim C. Segmenting clustered nuclei using H-minima transform-based marker extraction and contour parameterization. IEEE Trans. Biomed. Eng. 2010, 57(10):2600-2604.
32. Kårsnäs A., Dahl A.L., Larsen R. Learning histopathological patterns. J. Pathol. Inform. 2011, 2.
33. Kayser G., Riede U., Werner M., Hufnagl P., Kayser K. Towards an automated morphological classification of histological images of common lung carcinomas. Electr. J. Pathol. Histol. 2002, 8:3-22.
34. Kolmogorov V., Zabih R. What energy functions can be minimized via graph cuts?. IEEE Trans. Pattern Anal. Mach. Intell. 2004, 26(2):147-159.
35. Kong H., Gurcan M., Belkacem-Boussaid K. Partitioning histopathological images: an integrated framework for supervised color-texture segmentation and cell splitting. IEEE Trans. Med. Imaging 2011, 30(9):1661-1677.
36. Kulis B., Grauman K. Kernelized locality-sensitive hashing for scalable image search. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2009.
37. Langs G., Müller H., Menze B.H., Hanbury A. Visceral: towards large data in medical imaging - challenges and directions. Volume 7723 of Lecture Notes in Computer Science 2013, Springer.
38. Li G., Liu T., Tarokh A., Nie J., Guo L., Mara A., Holley S., Wong S.T. 3D cell nuclei segmentation based on gradient flow tracking. BMC Cell Biol. 2007, 8(1):40.
39. Lin G., Adiga U., Olson K., Guzowski J.F., Barnes C.A., Roysam B. A hybrid 3d watershed algorithm incorporating gradient cues and object models for automatic segmentation of nuclei in confocal image stacks. Cytom. Part A 2003, 56(1):23-36.
40. Liu W., Wang J., Ji R., Jiang Y.-G., Chang S.-F. Supervised hashing with kernels. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2012, 2074-2081.
41. Liu W., Wang J., Kumar S., Chang S.-F. Hashing with graphs. Proceedings of the 28th International Conference on Machine Learning (ICML-11) 2011, 1-8.
42. Lou X., Koethe U., Wittbrodt J., Hamprecht F. Learning to segment dense cell nuclei with shape prior. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2012, 1012-1018.
43. Loukas C.G., Wilson G.D., Vojnovic B., Linney A. An image analysis-based approach for automated counting of cancer cell nuclei in tissue sections. Cytom. Part A 2003, 55(1):30-42.
44. Lucchi A., Smith K., Achanta R., Lepetit V., Fua P. A fully automated approach to segmentation of irregularly shaped cellular structures in em images. Proceedings of the MICCAI Conference 2010, 6362:463-471.
45. Mao K., Zhao P., Tan P. Supervised learning-based cell image segmentation for p53 immunohistochemistry. IEEE Trans. Biomed. Eng. 2006, 53(6):1153-1163.
46. Markiewicz T., Jochymski C., Koktysz R., Kozlowski W. Automatic cell recognition in immunohistochemical gastritis stains using sequential thresholding and SVM network. Proceedings of the IEEE International Symposium on Biomedical Imaging, ISBI 2008, 971-974.
47. Markiewicz T., Wisniewski P., Osowski S., Patera J., Kozlowski W., Koktysz R. Comparative analysis of methods for accurate recognition of cells through nuclei staining of Ki-67 in neuroblastoma and estrogen/progesterone status staining in breast cancer. Anal. and Quant. Cytol. Histol. 2009, 31(1):49.
48. Mijović Ž., Mihailović D., Kostov M. Discriminant analysis of nuclear image variables in lung carcinoma. Facta Univ. Ser.: Med. Biol. 2008, 15(1):28-32.
49. Monaco J., Hipp J., Lucas D., Smith S., Balis U., Madabhushi A. Image segmentation with implicit color standardization using spatially constrained expectation maximization: detection of nuclei. Proceedings of the MICCAI Conference 2012, 365-372.
50. Müller H., Geissbühler A., Ruch P. ImageCLEF 2004: combining image and multi-lingual search for medical image retrieval. Multilingual Information Access for Text, Speech and Images 2005, 718-727. Springer.
51. Nath S.K., Palaniappan K., Bunyak F. Cell segmentation using coupled level sets and graph-vertex coloring. Proceedings of the MICCAI Conference 2006, 101-108.
52. National Cancer Institute, 2013. The cancer genome atlas. Retrieved from: (accessed 2015). https://tcga-data.nci.nih.gov.
53. Ozolek J.A., Tosun A.B., Wang W., Chen C., Kolouri S., B.S., Huang H., Rohde G.K. Accurate diagnosis of thyroid follicular lesions from nuclear morphology using supervised learning. Med. Image Anal. 2014, 18(5):772-780.
54. Park C., Huang J.Z., Ji J.X., Ding Y. Segmentation, inference and classification of partially overlapping nanoparticles. IEEE Trans. Pattern Anal. Mach. Intell. 2013, 35(3):669-681.
55. Qi X., Xing F., Foran D., Yang L. Robust segmentation of overlapping cells in histopathology specimens using parallel seed detection and repulsive level set. IEEE Trans. Biomed. Eng. 2012, 59(3):754-765.
56. Schmitt O., Hasse M. Radial symmetries based decomposition of cell clusters in binary and gray level images. J. Pattern Recognit. 2008, 41(6):1905-1923.
57. Sertel O., Kong J., Catalyurek U.V., Lozanski G., Saltz J.H., Gurcan M.N. Histopathological image analysis using model-based intermediate representations and color texture: Follicular lymphoma grading. J. Signal Process. Syst. 2009, 55(1-3):169-183.
58. Shen F., Shen C., Liu W., Shen H. Supervised discrete hashing. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015, IEEE.
59. Shen F., Shen C., Shi Q., Van Den Hengel A., Tang Z. Inductive hashing on manifolds. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2013, 1562-1569. IEEE.
60. Shi J., Malik J. Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22(8):888-905.
61. Siegel R., Naishadham D., Jemal A. Cancer statistics, 2013. CAJC 2013, 63(1):11-30.
62. Song Y., Cai W., Feng D. Hierarchical spatial matching for medical image retrieval. International ACM Workshop on Medical Multimedia Analysis and Retrieval 2011, 1-6. ACM.
63. Tabesh A., Teverovskiy M., Pang H.-Y., Kumar V.P., Verbel D., Kotsianti A., Saidi O. Multifeature prostate cancer diagnosis and gleason grading of histological images. Trans. Med. Imaging 2007, 26(10):1366-1378.
64. Thunnissen F., Diegenbach P., Van Hattum A., Tolboom J., van der Sluis D., Schaafsma W., Houthoff H., Baak J.R. Further evaluation of quantitative nuclear image features for classification of lung carcinomas. Pathol.: Res. Pract. 1992, 188(4):531-535.
65. Travis W.D., Brambilla E., Noguchi M., Nicholson A.G., Geisinger K., Yatabe Y., Powell C.A., Beer D., Riely G., Garg K., et al. International Association for the Study of Lung Cancer/American Thoracic Society/European Respiratory Society: international multidisciplinary classification of lung adenocarcinoma: executive summary. Proc. Am. Thorac. Soc. 2011, 8(5):381-385.
66. Vincent L., Soille P. Watersheds in digital spaces: an efficient algorithm based on immersion simulations. IEEE Trans. Pattern Anal. Mach. Intell. 1991, 13(6):583-598.
67. Wang J., Kumar S., Chang S.-F. Semi-supervised hashing for large-scale search. IEEE Trans. Pattern Anal. Mach. Intell. 2012, 34(12):2393-2406.
68. Weiss Y., Torralba A., Fergus R. Spectral hashing. Proceedings of Neural Information Processing Systems, NIPS 2008.
69. Wu Z., Gurari D., Wong J.Y., Betke M. Hierarchical partial matching and segmentation of interacting cells. Proceedings of the MICCAI Conference 2012, 389-396.
70. Xie Y., Ji Q. A new efficient ellipse detection method. Proceedings of International Conference on Pattern Recognition, ICPR 2002, 2:957-960.
71. Xing F., Su H., Neltner J., Yang L. Automatic Ki-67 counting using robust cell detection and online dictionary learning. IEEE Trans. Biomed. Eng. 2014, 61(3):859-870.
72. Xu C., Prince J.L. Snakes, shapes, and gradient vector flow. Trans. Image Process. 1998, 7(3):359-369.
73. Xu N., Ahuja N., Bansal R. Object segmentation using graph cuts based active contours. Comput. Vision Image Underst. 2007, 107:210-224.
74. Yan P., Zhou X., Shah M., Wong S. Automatic segmentation of high-throughput rnai fluorescent cellular images. IEEE Trans. Inf. Technol. Biomed. 2008, 12(1):109-117.
75. Yu W., Lee H.K., Hariharan S., Bu W., Ahmed S. Quantitative neurite outgrowth measurement based on image segmentation with topological dependence. Cytom. Part A 2009, 75(4):289-297.
76. Yu W., Lee H.K., Hariharan S., Bu W., Ahmed S. Evolving generalized Voronoi diagrams for accurate cellular image segmentation. Cytom. Part A 2010, 77(4):379-386.
77. Zhang X., Liu W., Dundar M., Badve S., Zhang S. Towards large-scale histopathological image analysis: hashing-based image retrieval. IEEE Trans. Med. Imaging 2015, 34(2):496-506.
78. Zhang X., Su H., Yang L., Zhang S. Fine-grained histopathological image analysis via robust segmentation and large-scale retrieval. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015.
79. Zhang C., Yarkony J., Hamprecht F.A. Cell detection and segmentation using correlation clustering. Proceedings of the MICCAI Conference 2014, 8673:9-16.
80. Zhang X., Yang L., Liu W., Su H., Zhang S. Mining histopathological images via composite hashing and online learning. Medical Image Computing and Computer-Assisted Intervention 2014, 479-486. Springer.