Large-Scale Multi-Class Image-Based Cell Classification with Deep Learning

IEEE Journal of Biomedical and Health Informatics

Volumn 23, Issue 5, 2019, Pages 2091-2098

  Meng, Nan ^a   Lam, Edmund Y ^a   Tsia, Kevin K ^a   So, Hayden Kwok Hay ^a  

^a UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

bright field imaging; Cell classification; convolutional neural network; multiclass classification

Indexed keywords

CELLS; CONVOLUTION; CONVOLUTIONAL NEURAL NETWORKS; CYTOLOGY; DEEP LEARNING; IMAGE CLASSIFICATION; LARGE DATASET; LEARNING ALGORITHMS; NEAREST NEIGHBOR SEARCH; SUPPORT VECTOR MACHINES;

BIOLOGICAL APPLICATIONS; BRIGHT FIELDS; CELL CLASSIFICATION; COMPARATIVE ANALYSIS; K NEAREST NEIGHBOR (KNN); LARGE-SCALE DATASETS; MULTI-CLASS CLASSIFICATION; STATISTICAL SIGNIFICANCE;

CLASSIFICATION (OF INFORMATION);

ARTICLE; BRIGHT FIELD MICROSCOPY; CANCER SCREENING; CELL HETEROGENEITY; COMPARATIVE STUDY; CONTROLLED STUDY; CONVOLUTIONAL NEURAL NETWORK; DATA ACCURACY; DEEP LEARNING; DRUG IDENTIFICATION; EPIGENETICS; HUMAN; HUMAN CELL; INFORMATION PROCESSING; K NEAREST NEIGHBOR; LIVE CELL IMAGING; MATHEMATICAL MODEL; MATHEMATICAL PARAMETERS; MCF-7 CELL LINE; MDA-MB-231 CELL LINE; MEASUREMENT PRECISION; PERIPHERAL BLOOD MONONUCLEAR CELL; PHENOTYPE; SUPPORT VECTOR MACHINE; THP-1 CELL LINE; VALIDATION PROCESS; ALGORITHM; CELLS; CLASSIFICATION; CYTOLOGY; FACTUAL DATABASE; IMAGE PROCESSING; MICROSCOPY; PROCEDURES;

ALGORITHMS; CELLS; CYTOLOGICAL TECHNIQUES; DATABASES, FACTUAL; DEEP LEARNING; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MICROSCOPY;

EID: 85055863346     PISSN: 21682194     EISSN: 21682208     Source Type: Journal    
DOI: 10.1109/JBHI.2018.2878878     Document Type: Article

References (44)

1. J. C. Caicedo et al., "Data-analysis strategies for image-based cell profiling," Nat. Methods, vol. 14, no. 9, pp. 849-863, Sep. 2017.
2. M. Boutros, F. Heigwer, and C. Laufer, "Microscopy-based high-content screening," Cell, vol. 163, no. 6, pp. 1314-1325, Dec. 2015.
3. T. T. Wong et al., "Asymmetric-detection time-stretch optical microscopy (ATOM) for ultrafast high-contrast cellular imaging in flow," Sci. Rep., vol. 4, Jan. 2014, Art. no. 3656.
4. Q. T. K. Lai, K. C. M. Lee, A. H. L. Tang, K. K. Y. Wong, H. K.-H. So, and K. K. Tsia, "High-throughput time-stretch imaging flow cytometry for multi-class classification of phytoplankton," Opt. Express, vol. 24, no. 25, pp. 28170-28184, Dec. 2016.
5. A. C. Chan, H.-C. Ng, S. C. Bogaraju, H. K.-H. So, E. Y. Lam, and K. K. Tsia, "All-passive pixel super-resolution of time-stretch imaging," Sci. Rep., vol. 7, Mar. 2017, Art. no. 44608.
6. J.-L. Wu et al., "Ultrafast laser-scanning time-stretch imaging at visible wavelengths," Light: Sci. Appl., vol. 6, no. 9, Jan. 2017, Art. no. e16196.
7. O. Z. Kraus and B. J. Frey, "Computer vision for high content screening," Crit. Rev. Biochem. Mol. Biol., vol. 51, pp. 102-109, Jan. 2016.
8. O. Z. Kraus et al., "Automated analysis of high-content microscopy data with deep learning," Mol. Syst. Biol., vol. 13, Apr. 2017, Art. no. 924.
9. D. Fenistein, B. Lenseigne, T. Christophe, P. Brodin, and A. Genovesio, "A fast, fully automated cell segmentation algorithm for high-throughput and high-content screening," Cytometry Part A, vol. 73A, pp. 958-964, Aug. 2008.
10. P. Arora et al., "A rapid fluorescence-based assay for classification of iNKT cell activating glycolipids," J. Amer. Chem. Soc., vol. 133, pp. 5198-5201, Mar. 2011.
11. M. Henriksen, B. Miller, J. Newmark, Y. Al-Kofahi, and E. Holden, "Laser scanning cytometry and its applications: A pioneering technology in the field of quantitative imaging cytometry," Methods Cell Biol., vol. 102, pp. 159-205, 2011.
12. P. P. Laissue, R. A. Alghamdi, P. Tomancak, E. G. Reynaud, and H. Shroff, "Assessing phototoxicity in live fluorescence imaging," Nat. Methods, vol. 14, no. 7, pp. 657-661, 2017.
13. P. Soda and G. Iannello, "Aggregation of classifiers for staining pattern recognition in antinuclear autoantibodies analysis," IEEE Trans. Inf. Technol. Biomed., vol. 13, pp. 322-329, Jan. 2009.
14. R. Nosaka, Y. Ohkawa, and K. Fukui, "Feature extraction based on cooccurrence of adjacent local binary patterns," in Proc. Pacific-Rim Symp. Image Video Technol., 2011, pp. 82-91.
15. P. Foggia, G. Percannella, P. Soda, and M. Vento, "Benchmarking HEp-2 cells classification methods," IEEE Trans. Med. Imag., vol. 32, no. 10, pp. 1878-1889, Jun. 2013.
16. M. D. Zeiler and R. Fergus, "Visualizing and understanding convolutional networks," in Proc. Euro. Conf. Comput. Vision, 2014, pp. 818-833.
17. K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," in Proc. Comput. Vision Pattern Recognit., Jun. 2016, pp. 770-778.
18. S. Ren, K. He, R. Girshick, and S. Jian, "Faster R-CNN: Towards realtime object detection with region proposal networks," IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 6, pp. 1137-1149, Jun. 2016.
19. Z. Ren, Z. Xu, and E. Y. Lam, "Learning-based nonparametric autofocusing for digital holography," Optica, vol. 5, no. 4, pp. 337-344, Apr. 2018.
20. A. Esteva et al., "Dermatologist-level classification of skin cancer with deep neural networks," Nature, vol. 542, no. 7639, pp. 115-118, Feb. 2017.
21. H. Lei et al., "A deeply supervised residual network for HEp-2 cell classification via cross-modal transfer learning," Pattern Recognit., vol. 79, pp. 290-302, Jul. 2018.
22. P. Eulenberg et al., "Reconstructing cell cycle and disease progression using deep learning," Nat. Commun., vol. 8, no. 1, 2017, Art. no. 463.
23. D. Pischel, J. H. Buchbinder, K. Sundmacher, I. N. Lavrik, and R. J. Flassig, "A guide to automated apoptosis detection: How to make sense of imaging flow cytometry data," PLoS One, vol. 13, no. 5, 2018, Art. no. e0197208.
24. Y. Jiang et al., "Label-free detection of aggregated platelets in blood by machine-learning-aided optofluidic time-stretch microscopy," Lab Chip, vol. 17, no. 14, pp. 2426-2434, 2017.
25. A. S. Razavian, H. Azizpour, J. Sullivan, and S. Carlsson, "CNN features off-the-shelf: An astounding baseline for recognition," in Proc. Comput. Vision Pattern Recognit. Workshops, Jun. 2014, pp. 512-519.
26. N. Meng, H. K.-H. So, and E. Y. Lam, "Computational single-cell classification using deep learning on bright-field and phase images," in Proc. IAPR Conf. Mach. Vision Appl., May 2017, pp. 164-167.
27. M. Veta et al., "Assessment of algorithms for mitosis detection in breast cancer histopathology images," Med. Image Anal., vol. 20, no. 1, pp. 237-248, 2015.
28. Z. Gao, L. Wang, L. Zhou, and J. Zhang, "HEp-2 cell image classification with deep convolutional neural networks," IEEE J. Biomed. Health Inform., vol. 21, no. 2, pp. 416-428, Feb. 2017.
29. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
30. J. Liu, B. Xu, L. Shen, J. Garibaldi, and G. Qiu, "HEp-2 cell classification based on a deep autoencoding-classification convolutional neural network," in Proc. Int. Symp. Biomed. Imag., Jun. 2017, pp. 1019-1023.
31. O. Sandler, S. P. Mizrahi, N. Weiss, O. Agam, I. Simon, and N.Q. Balaban, "Lineage correlations of single cell division time as a probe of cell-cycle dynamics," Nature, vol. 519, pp. 468-471, Mar. 2015.
32. M. Wachsmuth et al., "High-throughput fluorescence correlation spectroscopy enables analysis of proteome dynamics in living cells," Nat. Biotechnol., vol. 33, pp. 384-389, Mar. 2015.
33. D. A. Van Valen et al., "Deep learning automates the quantitative analysis of individual cells in live-cell imaging experiments," PLoS Comput. Biol., vol. 12, Nov. 2016, Art. no. e1005177.
34. A. R. Cohen, F. L. A. F. G. Gomes, B. Roysam, and M. Cayouette, "Computational prediction of neural progenitor cell fates," Nat. Methods, vol. 7, no. 3, pp. 213-218, Feb. 2010.
35. N. Scherf et al., "Imaging, quantification and visualization of spatiotemporal patterning in mESC colonies under different culture conditions," Bioinformatics, vol. 28, pp. i556-i561, Sep. 2012.
36. J. Xie, X. Niu, A. K. S. Lau, K. K. Tsia, and H. K.-H. So, "Accelerated cell imaging and classification on fpgas for quantitative-phase asymmetricdetection time-stretch optical microscopy," in Proc. Int. Conf. Field Programmable Technol., Dec. 2015, pp. 1-8.
37. H. C. Ng et al., "High-throughput cellular imaging with high-speed asymmetric-detection time-stretch optical microscopy under FPGA platform," in Proc. Int. Conf. ReConFigurable Comput. FPGAs, Nov. 2016, pp. 1-6.
38. M. Wang et al., "Real-time object detection and classification for high-speed asymmetric-detection time-stretch optical microscopy on FPGA," in Proc. Int. Conf. Field-Programmable Technol., Dec. 2016, pp. 261-264.
39. R. Shi, A. C. Chan, E. Y. Lam, and H. K.-H. So, "Image super-resolution for ultrafast optical time-stretch imaging," in Proc. Congr. Int. Commission Opt., Aug. 2017, Paper W1F-08.
40. K. Li, J. Yin, Z. Lu, X. Kong, R. Zhang, and W. Liu, "Multiclass boosting SVM using different texture features in HEp-2 cell staining pattern classification," in Proc. Int. Conf. Pattern Recognit., Feb. 2012, pp. 170-173.
41. Y.-L. Boureau, J. Ponce, and Y. LeCun, "A theoretical analysis of feature pooling in visual recognition," in Proc. Int. Conf. Mach. Learn., Jul. 2010, pp. 111-118.
42. Z. Ren, Z. Xu, and E. Y. Lam, "Autofocusing in digital holography using deep learning," in Proc. SPIE Three-Dimensional Multidimensional Microsc.: Image Acquisition Process., Proc, Jan. 2018, p. 104991V.
43. D. P. Kingma and J. Ba, "Adam: A method for stochastic optimization," CoRR, vol. abs/1412.6980, 2014. [Online]. Available: http://arxiv.org/abs/1412.6980
44. M. Abadi et al., "Tensorflow: A system for large-scale machine learning," in Proc. 12th USENIX Symp. Operat. Syst. Des. Implementation, 2016, pp. 265-283.