Large-scale image-based screening and profiling of cellular phenotypes

Cytometry Part A

Volumn 91, Issue 2, 2017, Pages 115-125

  Bougen Zhukov, Nicola ^a   Loh, Sheng Yang ^a   Lee, Hwee Kuan ^a   Loo, Lit Hsin ^a,b  

^a BIOINFORMATICS INSTITUTE   (Singapore)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

automated image analysis; cellular phenotypes; high content screening; high throughput microscopy; imaging based phenotypic screens; phenotypic profiling

Indexed keywords

CELL TRACKING; HIGH THROUGHPUT SCREENING; HUMAN; IMAGE PROCESSING; MOLECULAR IMAGING; PHENOTYPE; PROCEDURES;

CELL TRACKING; HIGH-THROUGHPUT SCREENING ASSAYS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MOLECULAR IMAGING; PHENOTYPE;

EID: 85013236905     PISSN: 15524922     EISSN: 15524930     Source Type: Journal    
DOI: 10.1002/cyto.a.22909     Document Type: Review

References (119)

1. Ohya Y, Sese J, Yukawa M, Sano F, Nakatani Y, Saito TL, Saka A, Fukuda T, Ishihara S, Oka S, et al. High-dimensional and large-scale phenotyping of yeast mutants. Proc Natl Acad Sci U S A 2005;102:19015–19020.
2. Huh W-K, Falvo JV, Gerke LC, Carroll AS, Howson RW, Weissman JS, O'Shea EK. Global analysis of protein localization in budding yeast. Nature 2003;425:686–691.
3. Loo L-H, Laksameethanasan D, Tung Y-L. Quantitative protein localization signatures reveal an association between spatial and functional divergences of proteins. PLoS Comput Biol 2014;10:e1003504.
4. Vazquez A, Flammini A, Maritan A, Vespignani A. Global protein function prediction from protein-protein interaction networks. Nat Biotechnol 2003;21:697–700.
5. Newman JRS, Ghaemmaghami S, Ihmels J, Breslow DK, Noble M, DeRisi JL, Weissman JS. Single-cell proteomic analysis of S. cerevisiae reveals the architecture of biological noise. Nature 2006;441:840–846.
6. Giepmans BNG, Adams SR, Ellisman MH, Tsien RY. The fluorescent toolbox for assessing protein location and function. Science 2006;312:217–224.
7. Uhlen M, Oksvold P, Fagerberg L, Lundberg E, Jonasson K, Forsberg M, Zwahlen M, Kampf C, Wester K, Hober S, et al. Towards a knowledge-based Human Protein Atlas. Nat Biotechnol 2010;28:1248–1250.
8. Buszczak M, Paterno S, Lighthouse D, Bachman J, Planck J, Owen S, Skora AD, Nystul TG, Ohlstein B, Allen A, et al. The Carnegie protein trap library: A versatile tool for drosophila developmental studies. Genetics 2007;175:1505–1531.
9. Cohen AA, Geva-Zatorsky N, Eden E, Frenkel-Morgenstern M, Issaeva I, Sigal A, Milo R, Cohen-Saidon C, Liron Y, Kam Z, et al. Dynamic proteomics of individual cancer cells in response to a drug. Science 2008;322:1511–1516.
10. Futcher B, Latter GI, Monardo P, McLaughlin CS, Garrels JI. A sampling of the yeast proteome. Mol Cell Biol 1999;19:7357–7368.
11. Lu P, Vogel C, Wang R, Yao X, Marcotte EM. Absolute protein expression profiling estimates the relative contributions of transcriptional and translational regulation. Nat Biotechnol 2007;25:117–124.
12. Levsky JM, Singer RH. Fluorescence in situ hybridization: past, present and future. J Cell Sci 2003;116:2833–2838.
13. Raj A, van den Bogaard P, Rifkin SA, van Oudenaarden A, Tyagi S. Imaging individual mRNA molecules using multiple singly labeled probes. Nat Methods 2008;5:877–879.
14. Femino AM, Fay FS, Fogarty K, Singer RH. Visualization of single RNA transcripts in situ. Science 1998;280:585–590.
15. Battich N, Stoeger T, Pelkmans L. Image-based transcriptomics in thousands of single human cells at single-molecule resolution. Nat Methods 2013;10:1127–1133.
16. Chen KH, Boettiger AN, Moffitt JR, Wang S, Zhuang X. Spatially resolved, highly multiplexed RNA profiling in single cells. Science 2015;348:aaa6090.
17. Cajigas IJ, Tushev G, Will TJ, tom Dieck S, Fuerst N, Schuman EM. The local transcriptome in the synaptic neuropil revealed by deep sequencing and high-resolution imaging. Neuron 2012;74:453–466.
18. Lécuyer E, Yoshida H, Parthasarathy N, Alm C, Babak T, Cerovina T, Hughes TR, Tomancak P, Krause HM. Global analysis of mRNA localization reveals a prominent role in organizing cellular architecture and function. Cell 2007;131:174–187.
19. Shankavaram UT, Reinhold WC, Nishizuka S, Major S, Morita D, Chary KK, Reimers MA, Scherf U, Kahn A, Dolginow D, et al. Transcript and protein expression profiles of the NCI-60 cancer cell panel: An integromic microarray study. Mol Cancer Ther 2007;6:820–832.
20. Schwanhäusser B, Busse D, Li N, Dittmar G, Schuchhardt J, Wolf J, Chen W, Selbach M. Global quantification of mammalian gene expression control. Nature 2011;473:337–342.
21. Niepel M, Hafner M, Pace EA, Chung M, Chai DH, Zhou L, Schoeberl B, Sorger PK. Profiles of Basal and stimulated receptor signaling networks predict drug response in breast cancer lines. Sci Signal 2013;6:ra84
22. Loo L-H, Wu LF, Altschuler SJ. Image-based multivariate profiling of drug responses from single cells. Nat Methods 2007;4:445–453.
23. Simpson JC, Joggerst B, Laketa V, Verissimo F, Cetin C, Erfle H, Bexiga MG, Singan VR, Hériché J-K, Neumann B, et al. Genome-wide RNAi screening identifies human proteins with a regulatory function in the early secretory pathway. Nat Cell Biol 2012;14:764–774.
24. Paige JS, Wu KY, Jaffrey SR. RNA mimics of green fluorescent protein. Science 2011;333:642–646.
25. Liu HS, Jan MS, Chou CK, Chen PH, Ke NJ. Is green fluorescent protein toxic to the living cells? Biochem Biophys Res Commun 1999;260:712–717.
26. Ratz M, Testa I, Hell SW, Jakobs S. CRISPR/Cas9-mediated endogenous protein tagging for RESOLFT super-resolution microscopy of living human cells. Sci Rep 2015;5:9592.
27. Nelles DA, Fang MY, O'Connell MR, Xu JL, Markmiller SJ, Doudna JA, Yeo GW. Programmable RNA tracking in live cells with CRISPR/Cas9. Cell 2016;165:488–496.
28. Lukinavičius G, Reymond L, D'Este E, Masharina A, Göttfert F, Ta H, Güther A, Fournier M, Rizzo S, Waldmann H, et al. Fluorogenic probes for live-cell imaging of the cytoskeleton. Nat Methods 2014;11:731–733.
29. Stockwell BR. Chemical genetics: Ligand-based discovery of gene function. Nat Rev Genet 2000;1:116–125.
30. Drews J. Drug discovery: A historical perspective. Science 2000;287:1960–1964.
31. Swinney DC, Anthony J. How were new medicines discovered? Nat Rev Drug Discov 2011;10:507–519.
32. Singh S, Carpenter AE, Genovesio A. Increasing the content of high-content screening: An overview. J Biomol Screen 2014;19:640–650.
33. Link W, Oyarzabal J, Serelde BG, Albarran MI, Rabal O, Cebriá A, Alfonso P, Fominaya J, Renner O, Peregrina S, et al. Chemical interrogation of FOXO3a nuclear translocation identifies potent and selective inhibitors of phosphoinositide 3-kinases. J Biol Chem 2009;284:28392–28400.
34. Tanaka M, Bateman R, Rauh D, Vaisberg E, Ramachandani S, Zhang C, Hansen KC, Burlingame AL, Trautman JK, Shokat KM, et al. An unbiased cell morphology-based screen for new, biologically active small molecules. PLoS Biol 2005;3:e128.
35. Mudhasani R, Kota KP, Retterer C, Tran JP, Whitehouse CA, Bavari S. High content image-based screening of a protease inhibitor library reveals compounds broadly active against rift valley fever virus and other highly pathogenic RNA viruses. PLoS Negl Trop Dis 2014;8:e3095.
36. Schulz MMP, Reisen F, Zgraggen S, Fischer S, Yuen D, Kang GJ, Chen L, Schneider G, Detmar M. Phenotype-based high-content chemical library screening identifies statins as inhibitors of in vivo lymphangiogenesis. Proc Natl Acad Sci 2012;109:E2665–E2674.
37. Perlman ZE, Slack MD, Feng Y, Mitchison TJ, Wu LF, Altschuler SJ. Multidimensional drug profiling by automated microscopy. Science 2004;306:1194–1198.
38. Kleinstreuer NC, Yang J, Berg EL, Knudsen TB, Richard AM, Martin MT, Reif DM, Judson RS, Polokoff M, Dix DJ, et al. Phenotypic screening of the ToxCast chemical library to classify toxic and therapeutic mechanisms. Nat Biotechnol 2014;32:583–591.
39. Cleuvers M. Mixture toxicity of the anti-inflammatory drugs diclofenac, ibuprofen, naproxen, and acetylsalicylic acid. Ecotoxicol Environ Saf 2004;59:309–315.
40. Su R, Xiong S, Zink D, Loo L-H. High-throughput imaging-based nephrotoxicity prediction for xenobiotics with diverse chemical structures. Arch Toxicol 2015;1–16.
41. Hamilton AJ, Baulcombe DC. A species of small antisense RNA in posttranscriptional gene silencing in plants. Science 1999;286:950–952.
42. Barrangou R, Fremaux C, Deveau H, Richards M, Boyaval P, Moineau S, Romero DA, Horvath P. CRISPR provides acquired resistance against viruses in prokaryotes. Science 2007;315:1709–1712.
43. Jinek M, Chylinski K, Fonfara I, Hauer M, Doudna JA, Charpentier E. A programmable dual-RNA–guided DNA endonuclease in adaptive bacterial immunity. Science 2012;337:816–821.
44. Kawasaki H, Taira K. Induction of DNA methylation and gene silencing by short interfering RNAs in human cells. Nature 2004;431:211–217.
45. Gilbert LA, Horlbeck MA, Adamson B, Villalta JE, Chen Y, Whitehead EH, Guimaraes C, Panning B, Ploegh HL, Bassik MC, et al. Genome-scale CRISPR-mediated control of gene repression and activation. Cell 2014;159:647–661.
46. Friedman A, Perrimon N. A functional RNAi screen for regulators of receptor tyrosine kinase and ERK signalling. Nature 2006;444:230–234.
47. Green RA, Kao H-L, Audhya A, Arur S, Mayers JR, Fridolfsson HN, Schulman M, Schloissnig S, Niessen S, Laband K, et al. A high-resolution C. elegans essential gene network based on phenotypic profiling of a complex tissue. Cell 2011;145:470–482.
48. Shalem O, Sanjana NE, Hartenian E, Shi X, Scott DA, Mikkelsen TS, Heckl D, Ebert BL, Root DE, Doench JG, Zhang F. Genome-scale CRISPR-Cas9 knockout screening in human cells. Science 2014;343:84–87.
49. Paddison PJ, Silva JM, Conklin DS, Schlabach M, Li M, Aruleba S, Balija V, O'Shaughnessy A, Gnoj L, Scobie K, et al. A resource for large-scale RNA-interference-based screens in mammals. Nature 2004;428:427–431.
50. Neumann B, Walter T, Hériché J-K, Bulkescher J, Erfle H, Conrad C, Rogers P, Poser I, Held M, Liebel U, et al. Phenotypic profiling of the human genome by time-lapse microscopy reveals cell division genes. Nature 2010;464:721–727.
51. Simpson KJ, Selfors LM, Bui J, Reynolds A, Leake D, Khvorova A, Brugge JS. Identification of genes that regulate epithelial cell migration using an siRNA screening approach. Nat Cell Biol 2008;10:1027–1038.
52. Pelkmans L, Fava E, Grabner H, Hannus M, Habermann B, Krausz E, Zerial M. Genome-wide analysis of human kinases in clathrin- and caveolae/raft-mediated endocytosis. Nature 2005;436:78–86.
53. Neumann B, Held M, Liebel U, Erfle H, Rogers P, Pepperkok R, Ellenberg J. High-throughput RNAi screening by time-lapse imaging of live human cells. Nat Methods 2006;3:385–390.
54. Morgens DW, Deans RM, Li A, Bassik MC. Systematic comparison of CRISPR/Cas9 and RNAi screens for essential genes. Nat Biotechnol 2016;34:634–636.
55. Raab RM, Stephanopoulos G. Dynamics of gene silencing by RNA interference. Biotechnol Bioeng 2004;88:121–132.
56. Jacobsen L, Calvin S, Lobenhofer E. Transcriptional effects of transfection: The potential for misinterpretation of gene expression data generated from transiently transfected cells. BioTechniques 2009;47:617–624.
57. Knight ZA, Lin H, Shokat KM. Targeting the cancer kinome through polypharmacology. Nat Rev Cancer 2010;10:130–137.
58. Conrad C, Gerlich DW. Automated microscopy for high-content RNAi screening. J Cell Biol 2010;188:453–461.
59. Michael S, Auld D, Klumpp C, Jadhav A, Zheng W, Thorne N, Austin CP, Inglese J, Simeonov A. A robotic platform for quantitative high-throughput screening. Assay Drug Dev Technol 2008;6:637–657.
60. Shen F, Hodgson L, Hahn K. Digital autofocus methods for automated microscopy. Methods Enzymol 2006;414:620–632.
61. Liron Y, Paran Y, Zatorsky NG, Geiger B, Kam Z. Laser autofocusing system for high-resolution cell biological imaging. J Microsc 2006;221:145–151.
62. Conrad C, Wünsche A, Tan TH, Bulkescher J, Sieckmann F, Verissimo F, Edelstein A, Walter T, Liebel U, Pepperkok R, et al. Micropilot: Automation of fluorescence microscopy-based imaging for systems biology. Nat Methods 2011;8:246–249.
63. Mathews LA, Keller JM, Goodwin BL, Guha R, Shinn P, Mull R, Thomas CJ, Kluyver RL, de Sayers TJ, Ferrer M. A 1536-well quantitative high-throughput screen to identify compounds targeting cancer stem cells. J Biomol Screen 2012;17:1231–1242.
64. Dittrich PS, Manz A. Lab-on-a-chip: Microfluidics in drug discovery. Nat Rev Drug Discov 2006;5:210–218.
65. Hong J, Edel JB, deMello AJ. Micro- and nanofluidic systems for high-throughput biological screening. Drug Discov Today 2009;14:134–146.
66. Waters JC. Accuracy and precision in quantitative fluorescence microscopy. J Cell Biol 2009;185:1135–1148.
67. Preibisch S, Saalfeld S, Tomancak P. Globally optimal stitching of tiled 3D microscopic image acquisitions. Bioinformatics 2009;25:1463–1465.
68. Meijering E. Cell segmentation: 50 years down the road [life sciences]. IEEE Signal Process Mag 2012;29:140–145.
69. Yu W, Lee HK, Hariharan S, Bu W, Ahmed S. Evolving generalized Voronoi diagrams for accurate cellular image segmentation. Cytom Part J Int Soc Anal Cytol 2010;77:379–386.
70. Yu W, Lee HK, Hariharan S, Bu W, Ahmed S. Quantitative neurite outgrowth measurement based on image segmentation with topological dependence. Cytometry Part A 2009;75A:289–297.
71. Yu W, Lee HK, Hariharan S, Bu W, Ahmed S. Level set segmentation of cellular images based on topological dependence. In: Bebis G, Boyle R, Parvin B, Koracin D, Remagnino P, Porikli F, Peters J, Klosowski J, Arns L, Chun YK, Rhyne T-M, Monroe L, editors. Advances in Visual Computing, Lecture Notes in Computer Science. Berlin-Heidelberg: Springer; 2008. pp 540–551.
72. Law YN, Lee HK, Liu C, Yip AM. A variational model for segmentation of overlapping objects with additive intensity value. IEEE Trans Image Process 2011;20:1495–1503.
73. Law YN, Yip AM, Lee HK. Automatic measurement of volume percentage stroma in endometrial images using texture segmentation. J Microsc 2011;241:171–178.
74. Law YN, Ogg S, Common J, Tan D, Lane EB, Yip AM, Lee HK. Automated protein distribution detection in high-throughput image-based siRNA library screens. J Signal Process Syst 2008;55:1–13.
75. Ledley RS. High-speed automatic analysis of biomedical pictures. Science 1964;146:216–223.
76. Belson M, Dudley AW Jr, Ledley RS. Automatic computer measurements of neurons. Pattern Recognit 1968;1:119–128.
77. Andrade R, Crisol L, Prado R, Boyano MD, Arluzea J, Aréchaga J. Plasma membrane and nuclear envelope integrity during the blebbing stage of apoptosis: A time-lapse study. Biol Cell Auspices Eur Cell Biol Organ 2010;102:25–35.
78. Matassov D, Kagan T, Leblanc J, Sikorska M, Zakeri Z. Measurement of apoptosis by DNA fragmentation. Methods Mol Biol Clifton NJ 2004;282:1–17.
79. Blaecke A, Delneste Y, Herbault N, Jeannin P, Bonnefoy J-Y, Beck A, Aubry J-P. Measurement of nuclear factor-kappa B translocation on lipopolysaccharide-activated human dendritic cells by confocal microscopy and flow cytometry. Cytometry 2002;48:71–79.
80. Giuliano KA, DeBiasio RL, Dunlay RT, Gough A, Volosky JM, Zock J, Pavlakis GN, Taylor DL. High-content screening: A new approach to easing key bottlenecks in the drug discovery process. J Biomol Screen 1997;2:249–259.
81. Schneider CA, Rasband WS, Eliceiri KW. NIH Image to ImageJ: 25 years of image analysis. Nat Methods 2012;9:671–675.
82. Allan C, Burel J-M, Moore J, Blackburn C, Linkert M, Loynton S, MacDonald D, Moore WJ, Neves C, Patterson A, et al. OMERO: Flexible, model-driven data management for experimental biology. Nat Methods 2012;9:245–253.
83. Carpenter AE, Jones TR, Lamprecht MR, Clarke C, Kang IH, Friman O, Guertin DA, Chang JH, Lindquist RA, Moffat J, Golland P, Sabatini DM. CellProfiler: Image analysis software for identifying and quantifying cell phenotypes. Genome Biol 2006;7:R100.
84. Laksameethanasan D, Tan RZ, Toh GW, Loo L-H. cellXpress: A fast and user-friendly software platform for profiling cellular phenotypes. BMC Bioinf 2013;14:S4.
85. Tarca AL, Carey VJ, Chen X, Romero R, Drăghici S. Machine learning and its applications to biology. PLoS Comput Biol 2007;3:e116.
86. Fuchs F, Pau G, Kranz D, Sklyar O, Budjan C, Steinbrink S, Horn T, Pedal A, Huber W, Boutros M. Clustering phenotype populations by genome-wide RNAi and multiparametric imaging. Mol Syst Biol 2010;6:370.
87. Zhong Q, Busetto AG, Fededa JP, Buhmann JM, Gerlich DW. Unsupervised modeling of cell morphology dynamics for time-lapse microscopy. Nat Methods 2012;9:711–713.
88. Boland MV, Murphy RF. A neural network classifier capable of recognizing the patterns of all major subcellular structures in fluorescence microscope images of HeLa cells. Bioinformatics 2001;17:1213–1223.
89. Coelho LP, Kangas JD, Naik AW, Osuna-Highley E, Glory-Afshar E, Fuhrman M, Simha R, Berget PB, Jarvik JW, Murphy RF. Determining the subcellular location of new proteins from microscope images using local features. Bioinformatics 2013;29:2343–2349.
90. Haralick RM, Shanmugam K, Dinstein I. Textural features for image classification. IEEE Trans Syst Man Cybern 1973;SMC-3:610–621.
91. Held M, Schmitz MHA, Fischer B, Walter T, Neumann B, Olma MH, Peter M, Ellenberg J, Gerlich DW. CellCognition: Time-resolved phenotype annotation in high-throughput live cell imaging. Nat Methods 2010;7:747–754.
92. Manjunath BS, Ma WY. Texture features for browsing and retrieval of image data. IEEE Trans Pattern Anal Mach Intell 1996;18:837–842.
93. Khotanzad A, Hong YH. Invariant image recognition by Zernike moments. IEEE Trans Pattern Anal Mach Intell 1990;12:489–497.
94. Shamir L, Orlov N, Eckley DM, Macura T, Johnston J, Goldberg IG. Wndchrm—An open source utility for biological image analysis. Source Code Biol. Med 2008;3:13.
95. Lowe DG. Object recognition from local scale-invariant features. In: Proceedings of Seventh International Conference on Computer Vision, Kerkyra, Greece. Vol 2. IEEE; 1999. pp 1150–1157.
96. Guyon I, Elisseeff A. An introduction to variable and feature selection. J Mach Learn Res 2003;3:1157–1182.
97. Huang K, Velliste M, Murphy RF. Feature reduction for improved recognition of subcellular location patterns in fluorescence microscope images. Proc SPIE 2003;4962:307–318.
98. Kira K, Rendell LA. A practical approach to feature selection. In: Proceedings of Ninth International Workshop on Machine Learning ML92. San Francisco, CA: Morgan Kaufmann Publishers Inc.; 1992. pp 249–256.
99. Guyon I, Weston J, Barnhill S, Vapnik V. Gene selection for cancer classification using support vector machines. Mach Learn 2002;46:389–422.
100. Pudil P, Novovičová J, Kittler J. Floating search methods in feature selection. Pattern Recognit Lett 1994;15:1119–1125.
101. Siedlecki W, Sklansky J. A note on genetic algorithms for large-scale feature selection. Pattern Recognit Lett 1989;10:335–347.
102. Hotelling H. Analysis of a complex of statistical variables into principal components. J Educ Psychol 1933;24:417–441.
103. Boulesteix A-L, Strimmer K. Partial least squares: A versatile tool for the analysis of high-dimensional genomic data. Brief Bioinform 2007;8:32–44.
104. Hunter LA, Krafft S, Stingo F, Choi H, Martel MK, Kry SF, Court LE. High quality machine-robust image features: Identification in nonsmall cell lung cancer computed tomography images. Med Phys 2013;40:121916.
105. Parmar C, Leijenaar RTH, Grossmann P, Rios Velazquez E, Bussink J, Rietveld D, Rietbergen MM, Haibe-Kains B, Lambin P, Aerts HJWL. Radiomic feature clusters and prognostic signatures specific for lung and head & neck cancer. Sci Rep 2015;5:11044.
106. Torgerson WS. Multidimensional scaling: I. Theory and method. Psychometrika 1952;17:401–419.
107. Schölkopf B, Smola A, Müller K-R. Nonlinear Component Analysis as a Kernel Eigenvalue Problem. Neural Comput 1998;10:1299–1319.
108. Hinton GE, Salakhutdinov RR. Reducing the dimensionality of data with neural networks. Science 2006;313:504–507.
109. Vincent P, Larochelle H, Bengio Y, Manzagol P-A. Extracting and composing robust features with denoising autoencoders. In: Proceedings of 25th International Conference on Machine Learning ICML'08. New York, NY: ACM; 2008. pp 1096–1103.
110. Slack MD, Martinez ED, Wu LF, Altschuler SJ. Characterizing heterogeneous cellular responses to perturbations. Proc Natl Acad Sci U S A 2008;105:19306–19311.
111. Snijder B, Sacher R, Rämö P, Damm E-M, Liberali P, Pelkmans L. Population context determines cell-to-cell variability in endocytosis and virus infection. Nature 2009;461:520–523.
112. Peng T, Murphy RF. Image-derived, three-dimensional generative models of cellular organization. Cytometry Part A 2011;79A:383–391.
113. Kang J, Hsu C-H, Wu Q, Liu S, Coster AD, Posner BA, Altschuler SJ, Wu LF. Improving drug discovery with high-content phenotypic screens by systematic selection of reporter cell lines. Nat Biotechnol 2016;34:70–77.
114. Breiman L. Random forests. Mach. Learn 2001;45:5–32.
115. Pyne S, Hu X, Wang K, Rossin E, Lin T-I, Maier LM, Baecher-Allan C, McLachlan GJ, Tamayo P, Hafler DA, et al. Automated high-dimensional flow cytometric data analysis. Proc Natl Acad Sci U S A 2009;106:8519–8524.
116. Qiu P, Simonds EF, Bendall SC, Gibbs KD Jr, Bruggner RV, Linderman MD, Sachs K, Nolan GP, Plevritis SK. Extracting a cellular hierarchy from high-dimensional cytometry data with SPADE. Nat Biotechnol 2011;29:886–891.
117. Warmuth MK, Liao J, Rätsch G, Mathieson M, Putta S, Lemmen C. Active learning with support vector machines in the drug discovery process. J Chem Inf Comput Sci 2003;43:667–673.
118. Naik AW, Kangas JD, Sullivan DP, Murphy RF. Active machine learning-driven experimentation to determine compound effects on protein patterns. eLife 2016;5:e10047.
119. Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH. The WEKA data mining software: An update. SIGKDD Explor Newsl 2009;11:10–18.