Computer vision for high content screening

Critical Reviews in Biochemistry and Molecular Biology

Volumn 51, Issue 2, 2016, Pages 102-109

  Kraus, Oren Z ^a,b   Frey, Brendan J ^a,b  

^a UNIVERSITY OF TORONTO   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Cells; classification; deep learning; high content screening; machine learning; microscopy; segmentation

Indexed keywords

ALGORITHM; COMPUTER; CYTOMETRY; DROSOPHILA MELANOGASTER; FLUORESCENCE IN SITU HYBRIDIZATION; FLUORESCENCE MICROSCOPY; GENE EXPRESSION; HIGH CONTENT SCREENING; HIGH THROUGHPUT SCREENING; HUMAN; IMAGE ANALYSIS; LEARNING ALGORITHM; NONHUMAN; PHENOTYPE; PRIORITY JOURNAL; PROBABILITY; REVIEW; VISION; BIOTECHNOLOGY; IMAGE PROCESSING; MACHINE LEARNING; SOFTWARE;

ALGORITHMS; BIOTECHNOLOGY; IMAGE PROCESSING, COMPUTER-ASSISTED; MACHINE LEARNING; MICROSCOPY, FLUORESCENCE; SOFTWARE; VISION, OCULAR;

EID: 84958048475     PISSN: 10409238     EISSN: 15497798     Source Type: Journal    
DOI: 10.3109/10409238.2015.1135868     Document Type: Review

References (98)

1. Alipanahi B, Delong A, Weirauch MT, Frey BJ. (2015). Predicting the sequence specificities of DNA-and RNA-binding proteins by deep learning. Nat Biotechnol 33: 831-8.
2. Alpaydin, E. (2010). Introduction to machine learning (2nd ed.). Cambridge, MA: MIT Press.
3. Altschuler SJ, Wu LF. (2010). Cellular heterogeneity: do differences make a difference? Cell 141: 559-63.
4. Amir ED, Davis KL, Tadmor MD, et al. (2013). viSNE enables visualization of high dimensional single-cell data and reveals phenotypic heterogeneity of leukemia. Nat Biotechnol 31: 545-52.
5. Amores J. (2013). Multiple instance classification: review, taxonomy and comparative study. Artif Intell 201: 81-105.
6. Bakal C, Aach J, Church G, Perrimon N. (2007). Quantitative morphological signatures define local signaling networks regulating cell morphology. Science 316: 1753-6.
7. Battich N, Stoeger T, Pelkmans L. (2013). Image-based transcriptomics in thousands of single human cells at single-molecule resolution. Nat Methods 10: 1127-33.
8. Bengtsson E, Wahlby C, Lindblad J. (2004). Robust cell image segmentation methods Pattern Recogn Image Anal 14: 157-67.
9. Bishop CM. (2006). Pattern recognition and machine learning. New York: Springer-Verlag Inc.
10. Boland MV, Markey MK, Murphy RF. (1998). Automated recognition of patterns characteristic of subcellular structures in fluorescence microscopy images. Cytometry 33: 366-75.
11. Boland MV, Murphy RF. (2001). A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of HeLa cells. Bioinformatics 17: 1213-23.
12. Boykov YY, Jolly MP. (2001). Interactive graph cuts for optimal boundary & region segmentation of objects in ND images.Proceedings IEEE International Conference on Computer Vision. ICCV 1: 105-12.
13. Breiman L. (2001). Random forests. Mach Learn 45: 5-32.
14. Breker M, Gymrek M, Schuldiner M. (2013). A novel single-cell screening platform reveals proteome plasticity during yeast stress responses. J Cell Biol 200: 839-50.
15. Caie PD, Walls RE, Ingleston-Orme A, et al. (2010). High-content phenotypic profiling of drug response signatures across distinct cancer cells. Mol Cancer Ther 9: 1913-26.
16. Carpenter AE, Jones TR, Lamprecht MR, et al. (2006). CellProfiler: image analysis software for identifying and quantifying cell phenotypes. Genome Biol 7: R100.
17. Carpenter AE, Sabatini DM. (2004). Systematic genome-wide screens of gene function. Nat Rev Genet 5: 11-22.
18. Caselles V, Kimmel R, Sapiro G. (1997). Geodesic active contours. Int J Comput Vis 22: 61-79.
19. Chen C, Li H, Zhou X, Wong STC. (2008). Constraint factor graph cut-based active contour method for automated cellular image segmentation in RNAi screening. J Microsc 230: 177-91.
20. Chen SC, Zhao T, Gordon GJ, Murphy RF. (2006). A novel graphical model approach to segmenting cell images. In: IEEE Symposium on Computational Intelligence and Bioinformatics and Computational Biology, Toronto (ON), Canada; 482-9.
21. Chen SC, Zhao T, Gordon GJ, Murphy RF. (2007). Automated image analysis of protein localization in budding yeast. Bioinformatics 23: i66-71.
22. Chong YT, Koh JLY, Friesen H, et al. (2015). Yeast proteome dynamics from single cell imaging and automated analysis. Cell 161: 1413-24.
23. Ciresan, D, Giusti, A, Gambardella, LM, Schmidhuber, J. (2012). Deep neural networks segment neuronal membranes in electron microscopy images. Adv Neural Inf Process Syst 2843-51.
24. Cortes C, Vapnik V. (1995). Support-vector networks. Mach Learn 20: 273-97.
25. Dempster A, Laird N, Rubin D. (1977). Maximum likelihood from incomplete data via the em algorithm. J R Stat Soc Series B 39: 1-38.
26. Dimopoulos S, Mayer CE, Rudolf F, Stelling J. (2014). Accurate cell segmentation in microscopy images using membrane patterns. Bioinformatics 30: 2644-51.
27. Eliceiri KW, Berthold MR, Goldberg IG, et al. (2012). Biological imaging software tools. Nat Methods 9: 697-710.
28. Felzenszwalb PF, Huttenlocher DP. (2004). Efficient graph-based image segmentation. Int J Comput Vis 59: 167-81
29. Freund Y, Schapire RRE. (1996). Experiments with a new boosting algorithm. International Conference on Machine Learning, Bari, Italy.
30. Frey BJ. (1998). Graphical models for machine learning and digital communication. Cambridge, MA: MIT Press.
31. Frey BJ, Dueck D. (2007). Clustering by passing messages between data points. Science 315: 972-6.
32. Fuchs F, Pau G, Kranz D, et al. (2010). Clustering phenotype populations by genome-wide RNAi and multiparametric imaging. Mol Syst Biol 6: 370.
33. Gabor D. (1946). Theory of communication. Part 1: the analysis of information. J Inst Electr Eng 3 93: 429-41.
34. Gentleman RC, Carey VJ, Bates DM, et al. (2004). Bioconductor: open software development for computational biology and bioinformatics. Genome Biol 5: R80.
35. Ghahramani Z. (2004). Unsupervised learning. Adv Lect Math 3176: 72-112.
36. Hannun A, Case C, Casper J, et al., (2014). Deep speech: scaling up end-to-end speech recognition. Comput Language. arXiv preprint. arXiv:1412.5567.
37. Haralick RM. (1979). Statistical and structural approaches to texture. Proc IEEE 67: 786-804.
38. Held M, Schmitz MHA, Fischer B, et al. (2010). CellCognition: time-resolved phenotype annotation in high-throughput live cell imaging. Nat Methods 7: 747-54.
39. Hinton G, Deng L, Yu D, et al. (2012). Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. In IEEE Signal Process Mag 29: 82-97.
40. Horvath P, Wild T, Kutay U, Csucs G. (2011). Machine learning improves the precision and robustness of high-content screens: using nonlinear multiparametric methods to analyze screening results. J Biomol Screen 16: 1059-67.
41. Houle D, Govindaraju DR, Omholt S. (2010). Phenomics: the next challenge. Nat Rev Genet 11: 855-66.
42. Jones TR, Carpenter AE, Lamprecht MR, et al. (2009). Scoring diverse cellular morphologies in image-based screens with iterative feedback and machine learning. Proc Natl Acad Sci USA 106: 1826-31.
43. Jones TR, Kang IH, Wheeler DB, et al. (2008). CellProfiler Analyst: data exploration and analysis software for complex image-based screens. BMC Bioinformatics 9: 482.
44. Kass M, Witkin A, Terzopoulos D. (1988). Snakes: active contour models. Int J Comput Vis 1: 321-31.
45. Kaynig V, Fuchs T, Buhmann JM. (2010). Neuron geometry extraction by perceptual grouping in ssTEM images. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco (CA): IEEE.
46. Kiddle SJ, Windram OPF, McHattie S, et al. (2010). Temporal clustering by affinity propagation reveals transcriptional modules in Arabidopsis thaliana. Bioinformatics 26: 355-62.
47. Krizhevsky A, Sutskever I, Hinton GE. (2012). ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, Lake Tahoe, NV; 1097-105.
48. Kurita KL, Glassey E, Linington RG. (2015). Integration of high-content screening and untargeted metabolomics for comprehensive functional annotation of natural product libraries. Proc Natl Acad Sci USA 112: 11999-2004.
49. Lang P, Yeow K, Nichols A, Scheer A. (2006). Cellular imaging in drug discovery. Nat Rev Drug Discov 5: 343-56.
50. LeCun Y, Bengio Y, Hinton G. (2015). Deep learning. Nature 521: 436-44.
51. LeCun Y, Bottou L, Bengio Y, Haffner P. (1998). Gradient-based learning applied to document recognition. Proc IEEE 86: 2278-324
52. Leone M, Sumedha, Weigt M. (2007). Clustering by soft-constraint affinity propagation: applications to gene-expression data. Bioinformatics 23: 2708-15.
53. Leung MK, Xiong HY, Lee LJ, Frey BJ. (2014). Deep learning of the tissue-regulated splicing code. Bioinformatics 30: i121-9.
54. Liberali P, Snijder B, Pelkmans L. (2014). Single-cell and multivariate approaches in genetic perturbation screens. Nat Rev Genet 16: 18-32.
55. Liu S, Mundra PA, Rajapakse JC. (2011). Features for cells and nuclei classification. Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Boston (MA): IEEE (EMBC)
56. Ljosa V, Caie PD, ter Horst R, et al. (2013). Comparison of methods for image-based profiling of cellular morphological responses to small-molecule treatment. J Biomol Screen 18: 1321-9.
57. Ljosa V, Sokolnicki KL, Carpenter AE. (2012). Annotated high-throughput microscopy image sets for validation. Nat Methods 9: 637.
58. Loo LH, Wu LF, Altschuler SJ. (2007). Image-based multivariate profiling of drug responses from single cells. Nat Methods 4: 445-53.
59. Ma J, Sheridan RP, Liaw A, et al. (2015). Deep neural nets as a method for quantitative structure-activity relationships. J Chem Inf Model 55: 263-74.
60. Maaten L, Van Der Hinton G. (2008). Visualizing data using t-SNE. J Mach Learn Res 9: 2579-605.
61. McInerney T, Terzopoulos D. (1996). Deformable models in medical image analysis: a survey. Med Image Anal 1: 91-108.
62. Meijering E. (2012). Cell segmentation: 50 years down the road. IEEE Signal Proc Mag 29: 140-5.
63. Moffat JG, Rudolph J, Bailey D. (2014). Phenotypic screening in cancer drug discovery-past, present and future. Nat Rev Drug Discov 13: 588-602.
64. Murphy RF. (2012). CellOrganizer: image-derived models of subcellular organization and protein distribution. Methods Cell Biol 110: 179-93.
65. Negishi T, Nogami S, Ohya Y. (2009). Multidimensional quantification of subcellular morphology of Saccharomyces cerevisiae using CalMorph, the high-throughput image-processing program. J Biotechnol 141: 109-17.
66. Ning F, Delhomme D, LeCun Y, et al. (2005). Toward automatic phenotyping of developing embryos from videos. IEEE Trans Image Process 14: 1360-71.
67. Otsu N. (1975). A threshold selection method from gray-level histograms. Automatica 11: 23-7.
68. Pachitariu M, Packer AM, Pettit N, et al. (2013). Extracting regions of interest from biological images with convolutional sparse block coding. In: Advances in Neural Information Processing Systems. Lake Tahoe, NV; 1745-53.
69. Perlman ZE, Slack MD, Feng Y, et al. (2004). Multidimensional drug profiling by automated microscopy. Science 306: 1194-8.
70. Rajaram S, Pavie B, Wu LF, Altschuler SJ. (2012). PhenoRipper: software for rapidly profiling microscopy images. Nat Methods 9: 635-7.
71. Rämö P, Sacher R, Snijder B, et al. (2009). CellClassifier: supervised learning of cellular phenotypes. Bioinformatics 25: 3028-30.
72. Ramsundar B, Kearnes S, Riley P, et al. (2015). Massively multitask networks for drug discovery. arXiv preprint. arXiv:1502.02072.
73. Rumelhart DE, Hinton GE, Williams RJ. (1986). Learning representations by back-propagating errors. Nature 323: 533-6.
74. Russakovsky O, Deng J, Su H, et al. (2014). Imagenet large scale visual recognition challenge. Int J Comput Vis 115: 211-52.
75. Saeys Y, Inza I, Larrañaga P. (2007). A review of feature selection techniques in bioinformatics. Bioinformatics 23: 2507-17.
76. Serge, B, Lantuéj, C. (1979). Use of watersheds in contour detection. In: Workshop on Image Processing, Real-time Edge and Motion Detection, Rennes, France.
77. Shalem O, Sanjana NE, Zhang F. (2015). High-throughput functional genomics using CRISPR-Cas9. Nat Rev Genet 16: 299-311.
78. Shamir L, Delaney JD, Orlov N, et al. (2010). Pattern recognition software and techniques for biological image analysis. PLoS Comput Biol 6: e1000974.
79. Shamir L, Orlov N, Eckley DM, et al. (2008). Wndchrm-an open source utility for biological image analysis. Source Code Biol Med 3: 13-17.
80. Shariff A, Kangas J, Coelho LP, et al. (2010). Automated image analysis for high-content screening and analysis. J Biomol Screen 15: 726-34.
81. Simonyan K, Zisserman A. (2014). Very deep convolutional networks for large-scale image recognition. In: International Conference on Learning Representations. Computer Vision and Pattern Recognition, Columbus, OH.
82. Singh DK, Ku CJ, Wichaidit C, et al. (2010). Patterns of basal signaling heterogeneity can distinguish cellular populations with different drug sensitivities. Mol Syst Biol 6: 369.
83. Singh S, Carpenter AE, Genovesio A. (2014). Increasing the content of high-content screening: an overview. J Biomol Screen 19: 640-50.
84. Snijder B, Pelkmans L. (2011). Origins of regulated cell-to-cell variability. Nat Rev 12: 119-25.
85. Sommer C, Gerlich DW. (2013). Machine learning in cell biology-teaching computers to recognize phenotypes. J Cell Sci 126: 5529-39.
86. Szegedy C, Liu W, Jia Y, et al. (2015). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA; 1-19.
87. Tkach JM, Yimit A, Lee AY, et al. (2012). Dissecting DNA damage response pathways by analysing protein localization and abundance changes during DNA replication stress. Nat Cell Biol 14: 966-76.
88. Tomanek K, Olsson F. (2009). A web survey on the use of active learning to support annotation of text data. In Proceedings of the NAACL HLT 2009 Workshop on Active Learning for Natural Language Processing, Boulder, CO.
89. Tong AHY, Evangelista M, Parsons AB, et al. (2001). Systematic genetic analysis with ordered arrays of yeast deletion mutants. Science 294: 2364-8.
90. Tong AHY, Lesage G, Bader GD, et al. (2004). Global mapping of the yeast genetic interaction network. Science 303: 808-13.
91. Vizeacoumar FJ, van Dyk N, S Vizeacoumar F, et al. (2010). Integrating high-throughput genetic interaction mapping and high-content screening to explore yeast spindle morphogenesis. J Cell Biol 188: 69-81.
92. Wahlby C, Kamentsky L, Liu ZH, et al. (2012). An image analysis toolbox for high-throughput C. Elegans assays. Nat Methods 9: 714-16.
93. Wählby, C, Sintorn, IM, Erlandsson, F, et al. (2004). Combining intensity, edge and shape information for 2D and 3D segmentation of cell nuclei in tissue sections. J Microsc 215: 67-76.
94. Xiong HY, Alipanahi B, Lee LJ, et al. (2015). RNA splicing. The human splicing code reveals new insights into the genetic determinants of disease. Science 347: 1254806.
95. Xu Y, Mo T, Feng Q, et al. (2014). Deep learning of feature representation with multiple instance learning for medical image analysis. 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy.
96. Yin Z, Sadok A, Sailem H, et al. (2013). A screen for morphological complexity identifies regulators of switch-like transitions between discrete cell shapes. Nat Cell Biol 15: 860-71.
97. Young DW, Bender A, Hoyt J, et al. (2008). Integrating high-content screening and ligand-target prediction to identify mechanism of action. Nat Chem Biol 4: 59-68.
98. Zhong Q, Busetto AG, Fededa JP, et al. (2012). Unsupervised modeling of cell morphology dynamics for time-lapse microscopy. Nat Methods 9: 711-13.