OpenCyto: An Open Source Infrastructure for Scalable, Robust, Reproducible, and Automated, End-to-End Flow Cytometry Data Analysis

PLoS Computational Biology

Volumn 10, Issue 8, 2014, Pages

  Finak, Greg ^a   Frelinger, Jacob ^a   Jiang, Wenxin ^a   Newell, Evan W ^b   Ramey, John ^a   Davis, Mark M ^c,d   Kalams, Spyros A ^e   De Rosa, Stephen C ^a,f   Gottardo, Raphael ^a,f  

^a Fred Hutchinson Cancer Research Center   (United States)

^b AGENCY FOR SCIENCE   (Singapore)

^c STANFORD UNIVERSITY   (United States)

^d STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^e VANDERBILT UNIVERSITY SCHOOL OF MEDICINE   (United States)

^f UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATION; CELL CULTURE; CLINICAL RESEARCH; DATA HANDLING; FLOW CYTOMETRY; INFORMATION ANALYSIS; INFORMATION MANAGEMENT; PIPELINES; POPULATION STATISTICS; T-CELLS;

BIOCONDUCTORS; CANCER IMMUNOLOGY; CANCER VACCINE; CELL POPULATIONS; CLINICAL RESEARCH; CYTOMETRY; DATA SET; END TO END; OPEN-SOURCE; TECHNOLOGICAL ADVANCES;

VACCINES;

CD57 ANTIGEN; GAG PROTEIN; GAMMA INTERFERON; GRANULOCYTE MACROPHAGE COLONY STIMULATING FACTOR; GRANZYME B; INTERLEUKIN 2; LYSOSOME ASSOCIATED MEMBRANE PROTEIN; MACROPHAGE INFLAMMATORY PROTEIN 1ALPHA; MACROPHAGE INFLAMMATORY PROTEIN 1BETA; PERFORIN; POL PROTEIN; TUMOR NECROSIS FACTOR ALPHA; VIRUS ENVELOPE PROTEIN;

ALGORITHM; ARTICLE; CD4+ T LYMPHOCYTE; CD8+ T LYMPHOCYTE; CELLULAR DISTRIBUTION; COMPUTER PROGRAM; CONTROLLED STUDY; CYTOKINE PRODUCTION; CYTOMETRY; CYTOMETRY BY TIME OF FLIGHT; DATA ANALYSIS; END TO END FLOW CYTOMETRY DATA ANALYSIS; IMMUNOSTIMULATION; MOLECULAR MODEL; PROTEIN EXPRESSION; T LYMPHOCYTE SUBPOPULATION; BIOLOGY; FACTUAL DATABASE; FLOW CYTOMETRY; HUMAN; PROCEDURES; REPRODUCIBILITY; SOFTWARE;

CD8-POSITIVE T-LYMPHOCYTES; COMPUTATIONAL BIOLOGY; DATABASES, FACTUAL; FLOW CYTOMETRY; HUMANS; REPRODUCIBILITY OF RESULTS; SOFTWARE;

EID: 84961288133     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1003806     Document Type: Article

References (50)

1. Benoist C, Hacohen N, (2011) Immunology. Flow cytometry, amped up. Science 332: 677–678 Available: http://www.sciencemag.org/content/332/6030/677.short. Accessed 28 October 2012.
2. Pedreira CE, Costa ES, Lecrevisse Q, van Dongen JJM, Orfao A, (2013) Overview of clinical flow cytometry data analysis: recent advances and future challenges. Trends Biotechnol 31 (7) 415–25 Available: http://dx.doi.org/10.1016/j.tibtech.2013.04.008. Accessed 17 June 2013.
3. Choi JH, Ogunniyi AO, Du M, Du M, Kretschmann M, et al. (n.d.) Development and optimization of a process for automated recovery of single cells identified by microengraving. Biotechnol Prog 26: 888–895 Available: http://www.ncbi.nlm.nih.gov/pubmed/20063389. Accessed 29 November 2012.
4. Ornatsky O, Bandura D, Baranov V, Nitz M, Winnik MA, et al. (2010) Highly multiparametric analysis by mass cytometry. J Immunol Methods 361: 1–20 Available: http://www.ncbi.nlm.nih.gov/pubmed/20655312.
5. Tanner SD, Bandura DR, Ornatsky O, Baranov VI, Nitz M, et al. (2008) Flow cytometer with mass spectrometer detection for massively multiplexed single-cell biomarker assay. Pure Appl Chem 80: 2627–2641.
6. Pieprzyk M, (2009) Fluidigm Dynamic Arrays provide a platform for single-cell gene expression analysis. Nat Methods 6: iv.
7. Maecker HT, Rinfret A, D'Souza P, Darden J, Roig E, et al. (2005) Standardization of cytokine flow cytometry assays. BMC Immunol 6: 13.
8. Maecker HT, McCoy JP, Nussenblatt R, (2012) Standardizing immunophenotyping for the Human Immunology Project. Nat Rev Immunol 12: 191–200 Available: http://dx.doi.org/10.1038/nri3158. Accessed 9 November 2012.
9. Pyne S, Hu X, Wang K, Rossin E, Lin T-II, et al. (2009) Automated high-dimensional flow cytometric data analysis. Proc Natl Acad Sci 106: 8519 doi:10.1073/pnas.0903028106
10. Finak G, Bashashati A, Brinkman R, Gottardo R, (2009) Merging mixture components for cell population identification in flow cytometry. Adv Bioinformatics 2009: 247646 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=2798116&tool=pmcentrez&rendertype=abstract. Accessed 22 June 2011.
11. Ge Y, Sealfon SC, (2012) flowPeaks: a fast unsupervised clustering for flow cytometry data via K-means and density peak finding. Bioinformatics 8: 2052–2058.
12. Aghaeepour N, Finak G, Hoos H, Mosmann TR, Brinkman R, et al. (2013) Critical assessment of automated flow cytometry data analysis techniques. Nat Methods 10: 445–445 Available: http://dx.doi.org/10.1038/nmeth0513-445c. Accessed 28 June 2013.
13. Naim I, Datta S, Sharma G, Cavenaugh J, Mosmann T, (2010) SWIFT: Scalable weighted iterative sampling for flow cytometry clustering. Proc IEEE Intl Conf Acoust Speech Sig Proc 509–512.
14. Qian Y, Wei C, Eun-Hyung Lee F, Campbell J, Halliley J, et al. (2010) Elucidation of seventeen human peripheral blood B-cell subsets and quantification of the tetanus response using a density-based method for the automated identification of cell populations in multidimensional flow cytometry data. Cytom Part B Clin Cytom 78: S69–S82 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3084630&tool=pmcentrez&rendertype=abstract. Accessed 8 November 2013.
15. Venkatesh V, (2000) Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model. Inf Syst Res 11: 342–365 Available: http://pubsonline.informs.org/doi/abs/10.1287/isre.11.4.342.11872?journalCode=isre. Accessed 14 January 2014.
16. Qiu P, Simonds EF, Bendall SC, Gibbs Jr KD, Bruggner R V, et al. (2011) Extracting a cellular hierarchy from high-dimensional cytometry data with SPADE. Nat Biotechnol 29 (10) 886–91 doi:10.1038/nbt.1991
17. Amir ED, Davis KL, Tadmor MD, Simonds EF, Levine JH, et al. (2013) viSNE enables visualization of high dimensional single-cell data and reveals phenotypic heterogeneity of leukemia. Nat Biotechnol 31: 545–552 Available: http://dx.doi.org/10.1038/nbt.2594. Accessed 14 November 2013.
18. Kotecha N, Krutzik PO, Irish JM, (2010) Web-based analysis and publication of flow cytometry experiments. Curr Protoc Cytom Chapter 10: Unit10.17 Available: http://www.ncbi.nlm.nih.gov/pubmed/20578106. Accessed 19 March 2014.
19. Hu X, Kim H, Brennan PJ, Han B, Baecher-Allan CM, et al. (2013) Application of user-guided automated cytometric data analysis to large-scale immunoprofiling of invariant natural killer T cells. Proc Natl Acad Sci U S A 110: 19030–19035 Available: http://www.ncbi.nlm.nih.gov/pubmed/24191009.
20. Cron A, Gouttefangeas C, Frelinger J, Lin L, Singh SK, et al. (2013) Hierarchical modeling for rare event detection and cell subset alignment across flow cytometry samples. PLoS Comput Biol 9: e1003130 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3708855&tool=pmcentrez&rendertype=abstract.
21. O'Neill K, Aghaeepour N, Špidlen J, Brinkman R, (2013) Flow Cytometry Bioinformatics. PLoS Comput Biol 9: e1003365 Available: http://dx.plos.org/10.1371/journal.pcbi.1003365. Accessed 7 December 2013.
22. Burd EM, (2010) Validation of laboratory-developed molecular assays for infectious diseases. Clin Microbiol Rev 23: 550–576 Available: http://cmr.asm.org/content/23/3/550.full. Accessed 28 May 2014.
23. Hahne F, LeMeur N, Brinkman R, Ellis B, Haaland P, et al. (2009) flowCore: a Bioconductor package for high throughput flow cytometry. BMC Bioinformatics 10: 106.
24. Sarkar D, Le Meur N, Gentleman R, (2008) Using flowViz to visualize flow cytometry data. Bioinformatics 24: 878–879 Available: http://bioinformatics.oxfordjournals.org/content/24/6/878.full. Accessed 7 November 2012.
25. Hahne F, Gopalakrishnan N, Khodabakhshi AH, Wong C-J, Lee K (2009) flowStats: Statistical methods for the analysis of flow cytometry data.
26. Finak G, Jiang W, Pardo J, Asare A, Gottardo R, (2012) QUAliFiER: An automated pipeline for quality assessment of gated flow cytometry data. BMC Bioinformatics 13: 252 Available: http://www.biomedcentral.com/1471-2105/13/252/abstract.
27. Rew R, Davis G, (1990) NetCDF: an interface for scientific data access. Comput Graph Appl IEEE 10: 76–82 doi:10.1109/38.56302
28. Finak G, McDavid A, Chattopadhyay P, Dominguez M, De Rosa S, et al. (2013) Mixture models for single-cell assays with applications to vaccine studies. Biostatistics 1–15 Available: http://www.ncbi.nlm.nih.gov/pubmed/23887981.
29. Finak G, Jiang W, Krouse K, Wei C, Sanz I, et al. (2013) High-throughput flow cytometry data normalization for clinical trials. Cytometry A 85: 277–86 Available: http://www.ncbi.nlm.nih.gov/pubmed/24382714. Accessed 13 January 2014.
30. Newell EW, Sigal N, Bendall SC, Nolan GP, Davis MM, (2012) Cytometry by Time-of-Flight Shows Combinatorial Cytokine Expression and Virus-Specific Cell Niches within a Continuum of CD8+ T Cell Phenotypes. Immunity 36 (1) 142–52.
31. Lo K, Hahne F, Brinkman R, Gottardo R, (2009) flowClust: a Bioconductor package for automated gating of flow cytometry data. BMC Bioinformatics 10: 145 Available: http://www.biomedcentral.com/1471-2105/10/145.
32. Kalams SA, Parker SD, Elizaga M, Metch B, Edupuganti S, et al. (2013) Safety and Comparative Immunogenicity of an HIV-1 DNA Vaccine in Combination with Plasmid Interleukin 12 and Impact of Intramuscular Electroporation for Delivery. J Infect Dis 208: 818–829 Available: http://jid.oxfordjournals.org/content/early/2013/07/01/infdis.jit236.abstract. Accessed 23 August 2013.
33. Horton H, Thomas EPE, Stucky JA, Frank I, Moodie Z, et al. (2007) Optimization and validation of an 8-color intracellular cytokine staining (ICS) assay to quantify antigen-specific T cells induced by vaccination. J Immunol Methods 323: 39–54 Available: http://www.ncbi.nlm.nih.gov/pubmed/17451739. Accessed 10 December 2012.
34. Lin LI, (1989) A concordance correlation coefficient to evaluate reproducibility. Biometrics 45: 255–268 doi:10.2307/2532051
35. Bland JM, Altman DG, (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1(8476): 307–10 doi:http://dx.doi.org/10.1016/S0140-6736(86)​90837-8
36. Millard BL, Niepel M, Menden MP, Muhlich JL, Sorger PK, (2011) Adaptive informatics for multifactorial and high-content biological data. Nat Methods 8: 487–493 Available: http://dx.doi.org/10.1038/nmeth.1600. Accessed 10 December 2012.
37. Mason CE, Zumbo P, Sanders S, Folk M, Robinson D, et al. (2010) Standardizing the next generation of bioinformatics software development with BioHDF (HDF5). Adv Exp Med Biol 680: 693–700 Available: http://www.ncbi.nlm.nih.gov/pubmed/20865556.
38. Folk M, Heber G, Koziol Q, Pourmal E, Robinson D, (2011) An overview of the HDF5 technology suite and its applications. Proc EDBTICDT 2011 Work Array Databases 36–47 Available: http://portal.acm.org/citation.cfm?doid=1966895.1966900.
39. Fletez-Brant K (n.d.) flowClean: flowClean.
40. Aghaeepour N, Chattopadhyay PK, Ganesan A, O'Neill K, Zare H, et al. (2012) Early immunologic correlates of HIV protection can be identified from computational analysis of complex multivariate T-cell flow cytometry assays. Bioinformatics 28: 1009–1016 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3315712&tool=pmcentrez&rendertype=abstract. Accessed 19 February 2014.
41. Bashashati A, Johnson NA, Khodabakhshi AH, Whiteside MD, Zare H, et al. (2012) B cells with high side scatter parameter by flow cytometry correlate with inferior survival in diffuse large B-cell lymphoma. Am J Clin Pathol 137: 805–814 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3718075&tool=pmcentrez&rendertype=abstract. Accessed 13 February 2014.
42. Behbehani GK, Bendall SC, Clutter MR, Fantl WJ, Nolan GP, (2012) Single-cell mass cytometry adapted to measurements of the cell cycle. Cytometry A 81: 552–566 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3667754&tool=pmcentrez&rendertype=abstract. Accessed 21 January 2014.
43. Bodenmiller B, Zunder ER, Finck R, Chen TJ, Savig ES, et al. (2012) Multiplexed mass cytometry profiling of cellular states perturbed by small-molecule regulators. Nat Biotechnol 30: 858–867 Available: http://dx.doi.org/10.1038/nbt.2317. Accessed 21 February 2014.
44. Denby CM, Im JH, Yu RC, Pesce CG, Brem RB, (2012) Negative feedback confers mutational robustness in yeast transcription factor regulation. Proc Natl Acad Sci U S A 109: 3874–3878 Available: http://www.pnas.org/content/109/10/3874.full. Accessed 7 February 2014.
45. Jeanblanc M, Ragu S, Gey C, Contrepois K, Courbeyrette R, et al. (2012) Parallel pathways in RAF-induced senescence and conditions for its reversion. Oncogene 31: 3072–3085 Available: http://dx.doi.org/10.1038/onc.2011.481. Accessed 25 February 2014.
46. Linderman MD, Bjornson Z, Simonds EF, Qiu P, Bruggner R V, et al. (2012) CytoSPADE: high-performance analysis and visualization of high-dimensional cytometry data. Bioinformatics 28: 2400–2401 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3436846&tool=pmcentrez&rendertype=abstract. Accessed 21 January 2014.
47. Osborne EA, Hiraoka Y, Rine J, (2011) Symmetry, asymmetry, and kinetics of silencing establishment in Saccharomyces cerevisiae revealed by single-cell optical assays. Proc Natl Acad Sci U S A 108: 1209–1216 Available: http://www.pnas.org/content/108/4/1209.full. Accessed 3 March 2014.
48. Quan S, Ray JCJ, Kwota Z, Duong T, Balázsi G, et al. (2012) Adaptive evolution of the lactose utilization network in experimentally evolved populations of Escherichia coli. PLoS Genet 8: e1002444 Available: http://www.plosgenetics.org/article/info:doi/10.1371/journal.pgen.1002444#pgen-1002444-g009. Accessed 20 January 2014.
49. Rugg-Gunn PJ, Cox BJ, Lanner F, Sharma P, Ignatchenko V, et al. (2012) Cell-surface proteomics identifies lineage-specific markers of embryo-derived stem cells. Dev Cell 22: 887–901 Available: http://www.sciencedirect.com/science/article/pii/S1534580712000391. Accessed 27 February 2014.
50. Waite AJ, Shou W, (2012) Adaptation to a new environment allows cooperators to purge cheaters stochastically. Proc Natl Acad Sci U S A 109: 19079–19086 Available: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3511115&tool=pmcentrez&rendertype=abstract. Accessed 22 January 2014.