Accurate Prediction of Biological Assays with High-Throughput Microscopy Images and Convolutional Networks

Journal of Chemical Information and Modeling

Volumn 59, Issue 3, 2019, Pages 1163-1171

  Hofmarcher, Markus ^a   Rumetshofer, Elisabeth ^a   Clevert, Djork Arné ^b   Hochreiter, Sepp ^a   Klambauer, Günter ^a  

^a JOHANNES KEPLER UNIVERSITY LINZ   (Austria)

^b BAYER AG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CELLS; CONVOLUTION; CYTOLOGY; FORECASTING;

ACCURATE PREDICTION; BIOLOGICAL ASSAYS; CONVOLUTIONAL NETWORKS; FULLY CONNECTED NETWORKS; HIGH-THROUGHPUT IMAGING; MORPHOLOGICAL FEATURES; PREDICTIVE PERFORMANCE; VISUAL RECOGNITION;

CONVOLUTIONAL NEURAL NETWORKS;

BIOASSAY; BIOLOGY; IMAGE PROCESSING; MICROSCOPY; PROCEDURES;

BIOLOGICAL ASSAY; COMPUTATIONAL BIOLOGY; IMAGE PROCESSING, COMPUTER-ASSISTED; MICROSCOPY; NEURAL NETWORKS, COMPUTER;

EID: 85062832105     PISSN: 15499596     EISSN: 1549960X     Source Type: Journal    
DOI: 10.1021/acs.jcim.8b00670     Document Type: Article

References (33)

1. Pepperkok, R.; Ellenberg, J. High-throughput Fluorescence Microscopy for Systems Biology. Nat. Rev. Mol. Cell Biol. 2006, 7, 690-696, 10.1038/nrm1979
2. Starkuviene, V.; Pepperkok, R. The Potential of High-content High-throughput Microscopy in Drug Discovery. Br. J. Pharmacol. 2007, 152, 62-71, 10.1038/sj.bjp.0707346
3. Yarrow, J.; Feng, Y.; Perlman, Z.; Kirchhausen, T.; Mitchison, T. Phenotypic Screening of Small Molecule Libraries by High Throughput Cell Imaging. Comb. Chem. High Throughput Screening 2003, 6, 279-286, 10.2174/138620703106298527
4. Dorval, T.; Chanrion, B.; Cattin, M.-E.; Stephan, J. P. Filling the Drug Discovery Gap: Is High-content Screening the Missing Link?. Curr. Opin. Pharmacol. 2018, 42, 40-45, 10.1016/j.coph.2018.07.002
5. Simm, J.; Klambauer, G.; Arany, A.; Steijaert, M.; Wegner, J. K.; Gustin, E.; Chupakhin, V.; Chong, Y. T.; Vialard, J.; Buijnsters, P.; Velter, I.; Vapirev, A.; Singh, S.; Carpenter, A. E.; Wuyts, R.; Hochreiter, S.; Moreau, Y.; Ceulemans, H. Repurposing High-throughput Image Assays Enables Biological Activity Prediction for Drug Discovery. Cell Chem. Biol. 2018, 25, 611-618, 10.1016/j.chembiol.2018.01.015
6. Scheeder, C.; Heigwer, F.; Boutros, M. Machine Learning and Image-based Profiling in Drug Discovery. Curr. Opin. Syst. Biol. 2018, 10, 43-52, 10.1016/j.coisb.2018.05.004
7. Wawer, M. J.; Li, K.; Gustafsdottir, S. M.; Ljosa, V.; Bodycombe, N. E.; Marton, M. A.; Sokolnicki, K. L.; Bray, M.-A.; Kemp, M. M.; Winchester, E.; Taylor, B.; Grant, G. B.; Hon, C. S.-Y.; Duvall, J. R.; Wilson, J. A.; Bittker, J. A.; Dančík, V.; Narayan, R.; Subramanian, A.; Winckler, W.; Golub, T. R.; Carpenter, A. E.; Shamji, A. F.; Schreiber, S. L.; Clemons, P. A. Toward Performance-diverse Small-molecule Libraries for Cell-based Phenotypic Screening using Multiplexed High-dimensional Profiling. Proc. Natl. Acad. Sci. U. S. A. 2014, 111, 10911-10916, 10.1073/pnas.1410933111
8. Carpenter, A. E.; Jones, T. R.; Lamprecht, M. R.; Clarke, C.; Kang, I. H.; Friman, O.; Guertin, D. A.; Chang, J. H.; Lindquist, R. A.; Moffat, J.; Golland, P.; Sabatini, D. M. CellProfiler: Image Analysis Software for Identifying and Quantifying Cell Phenotypes. Genome Biol. 2006, 7, R100, 10.1186/gb-2006-7-10-r100
9. Finkbeiner, S.; Frumkin, M.; Kassner, P. Cell-Based Screening: Extracting Meaning from Complex Data. Neuron 2015, 86, 160-174, 10.1016/j.neuron.2015.02.023
10. Sommer, C.; Gerlich, D. W. Machine Learning in Cell Biology-Teaching Computers to Recognize Phenotypes. J. Cell Sci. 2013, 126, 5529-5539, 10.1242/jcs.123604
11. Krizhevsky, A.; Sutskever, I.; Hinton, G. E. ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the 25th International Conference on Neural Information Processing Systems (NeurIPS); USA, 2012; pp 1097-1105.
12. Simonyan, K.; Zisserman, A. Very Deep Convolutional Networks for Large-Scale Image Recognition. 2014, arXiv preprint arXiv:1409.1556. https://arxiv.org/abs/1409.1556 (accessed Feb 25, 2019).
13. He, K.; Zhang, X.; Ren, S.; Sun, J. Deep Residual Learning for Image Recognition. IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2015; 10.1109/CVPR.2016.90.
14. Ciresan, D.; Meier, U.; Schmidhuber, J. A Committee of Neural Networks for Traffic Sign Classification. Proceedings of the International Joint Conference on Neural Networks (IJCNN); 2011; pp 1918-1921, 10.1109/IJCNN.2011.6033458.
15. Long, J.; Shelhamer, E.; Darrell, T. Fully Convolutional Networks for Semantic Segmentation. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2015; pp 3431-3440.
16. Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention (MICCAI); 2015; pp 234-241, 10.1007/978-3-319-24574-4-28.
17. Everingham, M.; Van Gool, L.; Williams, C. K. I.; Winn, J.; Zisserman, A. The Pascal Visual Object Classes (VOC) Challenge. International Journal of Computer Vision 2010, 88, 303-338, 10.1007/s11263-009-0275-4
18. Lin, T.-Y.; Maire, M.; Belongie, S.; Hays, J.; Perona, P.; Ramanan, D.; Dollár, P.; Zitnick, C. L. Microsoft COCO: Common Objects in Context. European Conference on Computer Vision (ECCV); 2014; pp 740-755, 10.1007/978-3-319-10602-1-48.
19. Russakovsky, O.; Deng, J.; Su, H.; Krause, J.; Satheesh, S.; Ma, S.; Huang, Z.; Karpathy, A.; Khosla, A.; Bernstein, M.; Berg, A. C.; Fei-Fei, L. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision 2015, 115, 211-252, 10.1007/s11263-015-0816-y
20. Kraus, O. Z.; Ba, J. L.; Frey, B. J. Classifying and Segmenting Microscopy Images with Deep Multiple Instance Learning. Bioinformatics 2016, 32, i52-i59, 10.1093/bioinformatics/btw252
21. Godinez, W. J.; Hossain, I.; Lazic, S. E.; Davies, J. W.; Zhang, X. A Multi-scale Convolutional Neural Network for Phenotyping High-content Cellular Images. Bioinformatics 2017, 33, 2010-2019, 10.1093/bioinformatics/btx069
22. Bray, M.-A.; Gustafsdottir, S. M.; Rohban, M. H.; Singh, S.; Ljosa, V.; Sokolnicki, K. L.; Bittker, J. A.; Bodycombe, N. E.; Dančík, V.; Hasaka, T. P.; Hon, C. S.; Kemp, M. M.; Li, K.; Walpita, D.; Wawer, M. J.; Golub, T. R.; Schreiber, S. L.; Clemons, P. A.; Shamji, A. F.; Carpenter, A. E. A Dataset of Images and Morphological Profiles of 30 000 Small-molecule Treatments using the Cell Painting Assay. GigaScience 2017, 6, giw014, 10.1093/gigascience/giw014
23. Gaulton, A.; Hersey, A.; Nowotka, M.; Bento, A. P.; Chambers, J.; Mendez, D.; Mutowo, P.; Atkinson, F.; Bellis, L. J.; Cibrián-Uhalte, E.; Davies, M.; Dedman, N.; Karlsson, A.; Magarinos, M. P.; Overington, J. P.; Papadatos, G.; Smit, I.; Leach, A. R. The ChEMBL Database in 2017. Nucleic Acids Res. 2017, 45, D945-D954, 10.1093/nar/gkw1074
24. Heller, S.; McNaught, A.; Stein, S.; Tchekhovskoi, D.; Pletnev, I. InChI-The Worldwide Chemical Structure Identifier Standard. J. Cheminf. 2013, 5, 7, 10.1186/1758-2946-5-7
25. Cortés-Ciriano, I.; Bender, A. How Consistent are Publicly Reported Cytotoxicity Data? Large-Scale Statistical Analysis of the Concordance of Public Independent Cytotoxicity Measurements. ChemMedChem 2016, 11, 57-71, 10.1002/cmdc.201500424
26. Mayr, A.; Klambauer, G.; Unterthiner, T.; Steijaert, M.; Wegner, J. K.; Ceulemans, H.; Clevert, D.-A.; Hochreiter, S. Large-scale comparison of machine learning methods for drug target prediction on ChEMBL. Chem. Sci. 2018, 9, 5441-5451, 10.1039/C8SC00148K
27. Huang, G.; Liu, Z.; van der Maaten, L.; Weinberger, K. Q. Densely Connected Convolutional Networks. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2017; pp 2261-2269, 10.1109/CVPR.2017.243.
28. Chaudhari, P.; Soatto, S. Stochastic gradient descent performs variational inference, converges to limit cycles for deep networks. 2018 Information Theory and Applications Workshop (ITA); 2018; pp 1-10, 10.1109/ITA.2018.8503224.
29. Paszke, A.; Gross, S.; Chintala, S.; Chanan, G.; Yang, E.; DeVito, Z.; Lin, Z.; Desmaison, A.; Antiga, L.; Lerer, A. Automatic Differentiation in PyTorch. NeurIPS Autodiff Workshop; 2017.
30. Lin, T.-Y.; Dollár, P.; Girshick, R. B.; He, K.; Hariharan, B.; Belongie, S. J. Feature Pyramid Networks for Object Detection. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2017; pp 936-944, 10.1109/CVPR.2017.106.
31. Klambauer, G.; Unterthiner, T.; Mayr, A.; Hochreiter, S. Self-Normalizing Neural Networks. Advances in Neural Information Processing Systems (NeurIPS); 2017; pp 971-980.
32. Venkatraman, E. S.; Begg, C. B. A Distribution-free Procedure for Comparing Receiver Operating Characteristic Curves from a Paired Experiment. Biometrika 1996, 83, 835-848, 10.1093/biomet/83.4.835
33. Gal, Y.; Ghahramani, Z. Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. Proceedings of the 33rd International Conference on Machine Learning (ICML); 2016.