A multi-scale convolutional neural network for phenotyping high-content cellular images

Bioinformatics

Volumn 33, Issue 13, 2017, Pages 2010-2019

  Godinez, William J ^a   Hossain, Imtiaz ^a   Lazic, Stanley E ^a   Davies, John W ^b   Zhang, Xian ^a  

^a Novartis Institute for BioMedical Research Basel   (Switzerland)

^b NOVARTIS INSTITUTES FOR BIOMEDICAL RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL NEURAL NETWORK; HUMAN; IMAGE PROCESSING; MICROSCOPY; PROCEDURES; SOFTWARE; TUMOR CELL LINE;

CELL LINE, TUMOR; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MICROSCOPY; NEURAL NETWORKS (COMPUTER); SOFTWARE;

EID: 85021826417     PISSN: 13674803     EISSN: 14602059     Source Type: Journal    
DOI: 10.1093/bioinformatics/btx069     Document Type: Article

References (62)

1. Alipanahi, B., et al. (2015) Predicting the sequence specificities of DNA-A nd RNA-binding proteins by deep learning. Nat. Biotechnol., 33, 831-838.
2. Arnett, C. D., et al. (1978) Synthesis and adrenergic activity of benzimidazole bioisosteres of norepinephrine and isoproterenol. J. Med. Chem., 21, 72-78.
3. Bakal, C., et al. (2007) Quantitative morphological signatures define local signaling networks regulating cell morphology. Science, 316, 1753-1756.
4. Banh, S., Hales, B. F. (2013) Hydroxyurea exposure triggers tissue-specific activation of p38 mitogen-activated protein kinase signaling and the DNA damage response in organogenesis-stage mouse embryos. Toxicol. Sci., 133, 208-298.
5. Barbe, L., et al. (2008) Toward a confocal subcellular atlas of the human proteome. Mol. Cell. Proteomics, 7, 499-508.
6. Boland, M. V., Murphy, R. F. (2001) A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of HeLa cells. Bioinformatics, 17, 1213-1223.
7. Boland, M. V., et al. (1998) Automated recognition of patterns characteristic of subcellular structures in fluorescence microscopy images. Cytometry, 33, 366-375.
8. Boutros, M., et al. (2015) Microscopy-based high-content screening. Cell, 163, 1314-1325.
9. Buyssens, P., et al. (2012) Multiscale convolutional neural networks for visionbased classification of cells. In Proc. Asian Conf. Comput. Vis, pages 342-352.
10. Caie, P. D., et al. (2010) High-content phenotypic profiling of drug response signatures across distinct cancer cells. Mol. Cancer. Ther., 9, 1913-1926.
11. Carpenter, A. E., et al. (2006) CellProfiler: Image analysis software for identifying and quantifying cell phenotypes. Genome Biol., 7, R100.
12. Chebira, A., et al. (2007) A multiresolution approach to automated classification of protein subcellular location images. BMC Bioinformatics, 8, 210.
13. Chen, Y., et al. (2016) Gene expression inference with deep learning. Bioinformatics, 32, 1832-1839.
14. Ciresan, D., et al. (2012a) Deep neural networks segment neuronal membranes in electron microscopy images. Proc. Advances in Neural Information Processing Systems, 25, 2843-2851.
15. Ciresan, D., et al. (2012b) Multi-column deep neural networks for image classification. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pages 3642-3649.
16. Coelho, L. P., et al. (2013) Determining the subcellular location of new proteins from microscope images using local features. Bioinformatics, 29, 2343-2349.
17. Dean, J., et al. (2012) Large scale distributed deep networks. Proc. Advances in Neural Information Processing Systems, 25, 1223-1231.
18. Farabet, C., et al. (2013) Learning hierarchical features for scene labeling. IEEE Trans. Pattern Anal. Mach. Intell., 35, 1915-1929.
19. Faria, C. C., et al. (2015) Identification of alsterpaullone as a novel small molecule inhibitor to target group 3 medulloblastoma. Oncotarget, 6, 21718-21729.
20. Finkbeiner, S., et al. (2015) Cell-based screening: Extracting meaning from complex data. Neuron, 86, 160-174.
21. Fuchs, F., et al. (2010) Clustering phenotype populations by genome-wide RNAi and multiparametric imaging. Mol. Syst. Biol., 6, 370.
22. Gao, Z., et al. (2016) HEp-2 cell image classification with deep convolutional neural networks. IEEE J. Biomed. Heal. Informatics, DOI: 10. 1109/JBHI. 2016. 2526603.
23. Gö tte, M., et al. (2010) An imaging assay to analyze primary neurons for cellular neurotoxicity. J. Neurosci. Methods, 192, 7-16.
24. Gut, G., et al. (2015) Trajectories of cell-cycle progression from fixed cell populations. Nat. Methods, 12, 951-954.
25. Haralick, R. M. (1979) Statistical and structural approaches to texture. Proc. IEEE, 786-804.
26. He, K., et al. (2016) Deep residual learning for image recognition. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'16), pp. 770-778.
27. Helmstaedter, M., et al. (2013) Connectomic reconstruction of the inner plexiform layer in the mouse retina. Nature, 500, 168-174.
28. Huang, K., Murphy, R. (2004) Automated classification of subcellular patterns in multicell images without segmentation into single cells. In Proc. IEEE Int. Symp. on Biomedical Imaging: From Nano to Macro (ISBI'04), pp. 1139-1142.
29. Kamnitsas, K., et al. (2017) Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med. Image Anal, 36, 61-78.
30. Kandaswamy, C., et al. (2016) High-content analysis of breast cancer using single-cell deep transfer learning. J. Biomol. Screen, 21, 252-259.
31. Kirk, K. L., et al. (1982) Syntheses and adrenergic agonist properties of ringfluorinated isoproterenols. J. Med. Chem., 25, 680-684.
32. Kiselyov, A. S., et al. (2010) Novel derivatives of 1, 3, 4-oxadiazoles are potent mitostatic agents featuring strong microtubule depolymerizing activity in the sea urchin embryo and cell culture assays. Eur. J. Med. Chem., 45, 1683-1697.
33. Kraus, O. Z., et al. (2016) Classifying and segmenting microscopy images with deep multiple instance learning. Bioinformatics, 32, i52-i59.
34. Krizhevsky, A., et al. (2012) ImageNet classification with deep convolutional neural networks. In Proc. Advances in Neural Information Processing Systems, 25, pp. 1097-1105.
35. Lahusen, T., et al. (2003) Alsterpaullone, a novel cyclin-dependent kinase inhibitor, induces apoptosis by activation of caspase-9 due to perturbation in mitochondrial membrane potential. Mol. Carcinog., 36, 183-194.
36. LeCun, Y., et al. (1998) Gradient based learning applied to document recognition. Proc. IEEE, 86, 2278-2324.
37. LeCun, Y., et al. (2015) Deep learning. Nature, 521, 436-444.
38. Li, J., et al. (2012) Automated analysis and reannotation of subcellular locations in confocal images from the human protein atlas. PLoS One, 7, e50514.
39. Liberali, P., et al. (2014) Single-cell and multivariate approaches in genetic perturbation screens. Nat. Rev. Genet., 16, 18-32.
40. Lindeberg, T. (1998) Feature detection with automatic scale selection. Int. J. Comput. Vis., 30, 79-116.
41. Ljosa, V., et al. (2012) Annotated high-throughput microscopy image sets for validation. Nat. Methods, 9, 637-637.
42. Ljosa, V., et al. (2013) Comparison of methods for image-based profiling of cellular morphological responses to small-molecule treatment. J. Biomol. Screen, 18, 1321-1329.
43. Loo, L. H., et al. (2007) Image-based multivariate profiling of drug responses from single cells. Nat. Methods, 4, 445-453.
44. Matula, P., et al. (2009) Single-cell-based image analysis of high-throughput cell array screens for quantification of viral infection. Cytometry A, 75A, 309-318.
45. Ning, F., et al. (2005) Toward automatic phenotyping of developing embryos from videos. IEEE Transs. Image Process., 14, 1360-1371.
46. Orlov, N., et al. (2008) WND-CHARM: Multi-purpose image classification using compound image transforms. Pattern Recognit. Lett., 29, 1684-1693.
47. Raic-Malic, S., et al. (2000) Synthesis and antitumor activities of novel pyrimidine derivatives of 2, 3-O, O-dibenzyl-6-deoxy-l-ascorbic acid and 4, 5-didehydro-5, 6-dideoxy-l-ascorbic acid. J. Med. Chem., 43, 4806-4811.
48. Ronneberger, O., et al. (2015) U-Net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention, volume 9350, pp. 238-245.
49. Sermanet, P., et al. (2014) OverFeat: Integrated recognition, localization and detection using convolutional networks. In Proc. International Conference on Learning Representations, Banff, AB, Canada.
50. Shamir, L. (2011) Assessing the efficacy of low-level image content descriptors for computer-based fluorescence microscopy image analysis. J. Microsc., 243, 284-292.
51. Simonyan, K., Zisserman, A. (2015) Very deep convolutional networks for large-scale image recognition. In Proc. International Conference on Learning Representations, San Diego, CA, USA.
52. Simonyan, K., et al. (2014) Deep inside convolutional networks: Visualising image classification models and saliency maps. In Proc. International Conferences on Learning RepresentationsWorkshop, Banff, AB, Canada.
53. Simunovic, M., et al. (2009) Urea and carbamate derivatives of primaquine: Synthesis, cytostatic and antioxidant activities. Bioorg. Med. Chem., 17, 5605-5613.
54. Sommer, C., Gerlich, D. W. (2013) Machine learning in cell biology-teaching computers to recognize phenotypes. J. Cell Sci., 126, 5529-5539.
55. Szegedy, C., et al. (2015) Going deeper with convolutions. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-9.
56. Uhlmann, V., et al. (2016) CP-CHARM: Segmentation-free image classification made accessible. BMC Bioinformatics, 17, 51.
57. Vlahos, C. J., et al. (1994) A specific inhibitor of phosphatidylinositol 3-kinase, 2-(4-morpholinyl)-8-phenyl-4H-1-benzopyran-4-one (LY294002). J. Biol. Chem., 269, 5241-5248.
58. Weisser, M., et al. (1998) Quantification of apoptotic and lytic cell death by video microscopy in combination with artificial neural networks. Cytometry, 31, 20-28.
59. Yosinski, J., et al. (2015) Understanding neural networks through deep visualization. In Proc. ICML Deep LearningWorkshop, Lille, France.
60. Zeiler, M. D., Fergus, R. (2014) Visualizing and understanding convolutional networks. In Proc. European Conference on Computer Vision, pp. 818-833.
61. Zhou, J., Troyanskaya, O. G. (2015) Predicting effects of noncoding variants with deep learning-based sequence model. Nat. Methods, 12, 931-934.
62. Zhou, J., et al. (2013) BIOCAT: A pattern recognition platform for customizable biological image classification and annotation. BMC Bioinformatics, 14, 291.