Statistical methods for the assessment of EQAPOL proficiency testing: ELISpot, Luminex, and Flow Cytometry

Journal of Immunological Methods

Volumn 409, Issue , 2014, Pages 72-81

  Rountree, Wes ^a   Vandergrift, Nathan ^a   Bainbridge, John ^a   Sanchez, Ana M ^a   Denny, Thomas N ^a  

^a DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

ELISpot; Flow cytometry; Luminex; Mixed effects models; Poisson; Proficiency testing

Indexed keywords

CYTOKINE;

CLINICAL ASSESSMENT; CLINICAL RESEARCH; COMPUTER SIMULATION; CONFIDENCE INTERVAL; CONSENSUS; CORRELATION COEFFICIENT; DIAGNOSTIC ACCURACY; DIAGNOSTIC TEST ACCURACY STUDY; DISPERSION; ENZYME LINKED IMMUNOSPOT ASSAY; EXTERNAL QUALITY ASSURANCE PROGRAM OVERSIGHT LABORATORY; FLOW CYTOMETRY; HUMAN; LABORATORY TEST; LONGITUDINAL STUDY; PERIPHERAL BLOOD MONONUCLEAR CELL; POISSON DISTRIBUTION; PRIORITY JOURNAL; QUALITY CONTROL; REVIEW; STAINING; STATISTICAL ANALYSIS;

ELISPOT; FLOW CYTOMETRY; LUMINEX; MIXED EFFECTS MODELS; POISSON; PROFICIENCY TESTING;

BIOLOGICAL MARKERS; CYTOKINES; DATA INTERPRETATION, STATISTICAL; ENZYME-LINKED IMMUNOSPOT ASSAY; FLOW CYTOMETRY; GUIDELINE ADHERENCE; HUMANS; INTERFERON-GAMMA RELEASE TESTS; LABORATORIES; LABORATORY PROFICIENCY TESTING; MODELS, STATISTICAL; MONITORING, IMMUNOLOGIC; OBSERVER VARIATION; PRACTICE GUIDELINES AS TOPIC; PREDICTIVE VALUE OF TESTS; PROGRAM DEVELOPMENT; PROGRAM EVALUATION; QUALITY CONTROL; QUALITY INDICATORS, HEALTH CARE; REPRODUCIBILITY OF RESULTS; SPECIMEN HANDLING;

EID: 84906079884     PISSN: 00221759     EISSN: 18727905     Source Type: Journal    
DOI: 10.1016/j.jim.2014.01.007     Document Type: Review

References (26)

1. Belk W.P., Sunderman F.W. A survey of the accuracy of chemical analyses in clinical laboratories. Am. J. Clin. Pathol. 1947, 17:853.
2. Benjamini Y., Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Stat. Soc. B Methodol. 1995, 57:289.
3. Boaz M.J., Hayes P., Tarragona T., Seamons L., Cooper A., Birungi J., Kitandwe P., Semaganda A., Kaleebu P., Stevens G., Anzala O., Farah B., Ogola S., Indangasi J., Mhlanga P., Van Eeden M., Thakar M., Pujari A., Mishra S., Goonetilleke N., Moore S., Mahmoud A., Sathyamoorthy P., Mahalingam J., Narayanan P.R., Ramanathan V.D., Cox J.H., Dally L., Gill D.K., Gilmour J. Concordant proficiency in measurement of T-cell immunity in human immunodeficiency virus vaccine clinical trials by peripheral blood mononuclear cell and enzyme-linked immunospot assays in laboratories from three continents. Clin. Vaccine Immunol. 2009, 16:147.
4. Chaturvedi A.K., Kemp T.J., Pfeiffer R.M., Biancotto A., Williams M., Munuo S., Purdue M.P., Hsing A.W., Pinto L., McCoy J.P., Hildesheim A. Evaluation of multiplexed cytokine and inflammation marker measurements: a methodologic study. Cancer Epidemiol. Biomarkers Prev. 2011, 20:1902.
5. Clarke D.C., Morris M.K., Lauffenburger D.A. Normalization and statistical analysis of multiplexed bead-based immunoassay data using mixed-effects modeling. Mol. Cell. Proteomics 2013, 12:245.
6. Cox J.H., Ferrari G., Kalams S.A., Lopaczynski W., Oden N., D'Souza M.P., Elispot Collaborative Study, G. Results of an ELISPOT proficiency panel conducted in 11 laboratories participating in international human immunodeficiency virus type 1 vaccine trials. AIDS Res. Hum. Retroviruses 2005, 21:68.
7. Dossus L., Becker S., Achaintre D., Kaaks R., Rinaldi S. Validity of multiplex-based assays for cytokine measurements in serum and plasma from "non-diseased" subjects: comparison with ELISA. J. Immunol. Meth. 2009, 350:125.
8. Garwood F. Fiducial limits for the Poisson distribution. Biometrika 1936, 28:437.
9. Gill D.K., Huang Y., Levine G.L., Sambor A., Carter D.K., Sato A., Kopycinski J., Hayes P., Hahn B., Birungi J., Tarragona-Fiol T., Wan H., Randles M., Cooper A.R., Ssemaganda A., Clark L., Kaleebu P., Self S.G., Koup R., Wood B., McElrath M.J., Cox J.H., Hural J., Gilmour J. Equivalence of ELISpot assays demonstrated between major HIV network laboratories. PLoS ONE 2010, 5:e14330.
10. Gottschalk P.G., Dunn J.R. The five-parameter logistic: a characterization and comparison with the four-parameter logistic. Anal. Biochem. 2005, 343:54.
11. Gu Y., Zeleniuch-Jacquotte A., Linkov F., Koenig K.L., Liu M., Velikokhatnaya L., Shore R.E., Marrangoni A., Toniolo P., Lokshin A.E., Arslan A.A. Reproducibility of serum cytokines and growth factors. Cytokine 2009, 45:44.
12. Hoffman D. Negative binomial control limits for count data with extra-Poisson variation. Pharmaceutical Statistics 2003, 2:127-132.
13. Hudgens M.G., Self S.G., Chiu Y.L., Russell N.D., Horton H., McElrath M.J. Statistical considerations for the design and analysis of the ELISpot assay in HIV-1 vaccine trials. J. Immunol. Meth. 2004, 288:19.
14. Hultin L.E., M F.A., Hultin P.M., Jamieson B.D., O'Gorman M.R.G., Borowski L., Matud J.L., Denny T.N., Margolick J.B. Assessing immunophenotyping performance: proficiency-validation for adopting improved flow cytometry methods. Cytometry B Clin. Cytom. 2007, 72B:249.
15. Jaimes M.C., Maecker H.T., Yan M., Maino V.C., Hanley M.B., Greer A., Darden J.M., D'Souza M.P. Quality assurance of intracellular cytokine staining assays: analysis of multiple rounds of proficiency testing. J. Immunol. Meth. 2011, 363:143.
16. Moodie Z., Huang Y., Gu L., Hural J., Self S.G. Statistical positivity criteria for the analysis of ELISpot assay data in HIV-1 vaccine trials. J. Immunol. Meth. 2006, 315:121.
17. Moodie Z., Price L., Gouttefangeas C., Mander A., Janetzki S., Lower M., Welters M.J., Ottensmeier C., van der Burg S.H., Britten C.M. Response definition criteria for ELISPOT assays revisited. Cancer Immunol. Immunother. 2010, 59:1489.
18. Paxton H., Kidd P., Landay A., Giorgi J., Flomenberg N., Walker E., Valentine F., Fahey J., Gelman R. Results of the flow cytometry ACTG quality control program: analysis and findings. Clin. Immunol. Immunopathol. 1989, 52:68.
19. Polesky H.F., Hanson M.R. Human immunodeficiency virus type 1 proficiency testing. The American Association of Blood Banks/College of American Pathologists Program. Arch. Pathol. Lab. Med. 1990, 114:268.
20. Rodríguez G. Lecture Notes on Generalized Linear Models Available at. http://data.princeton.edu/wws509/notes/.
21. Sang-Ah Lee, A.K., Xiang Yong-Bing, et al. Intra-individual variation of plasma adipokine levels and utility of single measurement of these biomarkers in population-based studies. Cancer Epidemiol. Biomarkers Prev. 2007, 16:2464.
22. Scott M.E., Wilson S.S., Cosentino L.A., Richardson B.A., Moscicki A.B., Hillier S.L., Herold B.C. Interlaboratory reproducibility of female genital tract cytokine measurements by Luminex: implications for microbicide safety studies. Cytokine 2011, 56:430.
23. Taylor R.N., Przybyszewski V.A. Summary of the Centers for Disease Control human immunodeficiency virus (HIV) performance evaluation surveys for 1985 and 1986. Am. J. Clin. Pathol. 1988, 89:1.
24. Wong H.L., P.R., Fears T.R., Vermeulen R., Ji S., Rabkin C.S. Reproducibility and correlations of multiplex cytokine levels in asymptomatic persons. Cancer Epidemiol. Biomarkers Prev. 2008, 17:3450.
25. Wootton I.D., King E.J. Normal values for blood constituents; inter-hospital differences. Lancet 1953, 1:470.
26. Zeng C., Mawhinney S., Baron A.E., McFarland E.J. Evaluating ELISPOT summary measures with criteria for obtaining reliable estimates. J. Immunol. Meth. 2005, 297:97.