Validation of laboratory-developed molecular assays for infectious diseases

Clinical Microbiology Reviews

Volumn 23, Issue 3, 2010, Pages 550-576

  Burd, Eileen M ^a  

^a EMORY UNIVERSITY HOSPITAL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; CROSS REACTION; DATA ANALYSIS; FOOD AND DRUG ADMINISTRATION; INFECTION; LABORATORY TEST; LINEAR REGRESSION ANALYSIS; QUALITATIVE ANALYSIS; QUANTITATIVE ANALYSIS; REVIEW; SENSITIVITY ANALYSIS; VALIDATION PROCESS; COMMUNICABLE DISEASES; DIAGNOSTIC PROCEDURE; HUMAN; MOLECULAR DIAGNOSIS; PROCEDURES; STANDARDS; VALIDATION STUDY;

CLINICAL LABORATORY TECHNIQUES; COMMUNICABLE DISEASES; HUMANS; MOLECULAR DIAGNOSTIC TECHNIQUES; VALIDATION STUDIES AS TOPIC;

EID: 77954605045     PISSN: 08938512     EISSN: 10986618     Source Type: Journal    
DOI: 10.1128/CMR.00074-09     Document Type: Review

References (82)

1. Antwerpen, M. H., P. Zimmermann, K. Bewley, D. Frangoulidis, and H. Meyer. 2008. Real-time PCR system targeting a chromosomal marker specific for Bacillus anthracis. Mol. Cell Probes 22:313-315.
2. Ballagi-Pordany, A., and S. Belak. 1996. The use of mimics as internal standards to avoid false negatives in diagnostic PCR. Mol. Cell Probes 10:159-164.
3. Bland, J. M., and D. G. Altman. 1986. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet i:307-310.
4. Bolotin, S., C. De Lima, K. W. Choi, E. Lombos, L. Burton, T. Mazzulli, and S. J. Drews. 2009. Validation of the TaqMan Influenza A Detection Kit and a rapid automated total nucleic acid extraction method to detect influenza A virus in nasopharyngeal specimens. Ann. Clin. Lab. Sci. 39:155-159.
5. Cai, T., G. Lou, J. Yang, D. Xu, and Z. Meng. 2008. Development and evaluation of real-time loop-mediated isothermal amplification for hepatitis B virus DNA quantification: a new tool for HBV management. J. Clin. Virol. 41:270-276.
6. CLSI/NCCLS. 2006. Statistical quality control for quantitative measurement procedures: principles and definitions. Approved guideline, 3rd ed. CLSI document C24-A3. Clinical and Laboratory Standards Institute, Wayne, PA.
7. CLSI/NCCLS. 2008. Defining, establishing and verifying reference intervals in the clinical laboratory. Approved guideline, 3rd ed. CLSI document C28-A3. Clinical and Laboratory Standards Institute, Wayne, PA.
8. CLSI/NCCLS. 2004. Evaluation of precision performance of quantitative measurement methods. Approved guideline, 2nd ed. CLSI document EP5-A2. Clinical and Laboratory Standards Institute, Wayne, PA.
9. CLSI/NCCLS. 2003. Evaluation of the linearity of quantitative measurement procedures: a statistical approach. Approved guideline. CLSI document EP6-A. Clinical and Laboratory Standards Institute, Wayne, PA.
10. CLSI/NCCLS. 2005. Interference testing in clinical chemistry. Approved guideline. CLSI document EP7-A2. Clinical and Laboratory Standards Institute, Wayne, PA.
11. CLSI/NCCLS. 2002. Method comparison and bias estimation using patient samples. Approved guideline, 2nd ed. CLSI document EP9-A2. Clinical and Laboratory Standards Institute, Wayne, PA.
12. CLSI/NCCLS. 2008. User protocol for evaluation of qualitative test performance. Approved guideline, 2nd ed. CLSI document EP12-A2. Clinical and Laboratory Standards Institute, Wayne, PA.
13. CLSI/NCCLS. 2005. Evaluation of matrix effects. Approved guideline, 2nd ed. CLSI document EP14-A2. Clinical and Laboratory Standards Institute, Wayne, PA.
14. CLSI/NCCLS. 2005. User verification of performance for precision and trueness. Approved guideline, 2nd ed. CLSI document EP15-A2. Clinical and Laboratory Standards Institute, Wayne, PA.
15. CLSI/NCCLS. 2004. Protocols for determination for limits of detection and limits of quantitation. Approved guideline. CLSI document EP17-A. Clinical and Laboratory Standards Institute, Wayne, PA.
16. CLSI/NCCLS. 2006. Molecular diagnostic methods for infectious diseases. Approved guideline. CLSI document MM3-A2. Clinical and Laboratory Standards Institute, Wayne, PA.
17. CLSI/NCCLS. 2003. Quantitative molecular methods for infectious diseases. Approved guideline. CLSI document MM06-A. Clinical and Laboratory Standards Institute, Wayne, PA.
18. CLSI/NCCLS. 2005. Collection, transport, preparation, and storage of specimens for molecular methods. Approved guideline. CLSI document MM13-A. Clinical and Laboratory Standards Institute, Wayne, PA.
19. CLSI/NCCLS. 2008. Verification and validation of multiplex nucleic acid assays. Approved guideline. CLSI document MM17-A. Clinical and Laboratory Standards Institute, Wayne, PA.
20. Code of Federal Regulations. 2010. Title 21. Food and drugs, vol. 8, chapter 1. Food and Drug Administration, Department of Health and Human Services, part 56. Institutional review boards. U.S. Government Printing Office, Washington, DC.
21. Code of Federal Regulations. 2010. Title 21. Food and drugs, vol. 8, chapter 1. Food and Drug Administration, Department of Health and Human Services, part 807. Establishment registration and device listing for manufacturers and initial importers of devices. U.S. Government Printing Office, Washington, DC.
22. Code of Federal Regulations. 2010. Title 21. Food and drugs, vol. 8, chapter 1. Food and Drug Administration, Department of Health and Human Services, part 809. In vitro diagnostic products for human use, section 809.10. Labeling for in vitro diagnostic products. U.S. Government Printing Office, Washington, DC.
23. Code of Federal Regulations. 2010. Title 21. Food and drugs, vol. 8, chapter 1. Food and Drug Administration, Department of Health and Human Services, part 809. In vitro diagnostic products for human use, section 809.20. General requirements for manufacturers and producers of in vitro diagnostic products. U.S. Government Printing Office, Washington, DC.
24. Code of Federal Regulations. 2010. Title 21. Food and drugs, vol. 8, chapter 1. Food and Drug Administration, Department of Health and Human Services, part 809. In vitro diagnostic products for human use, section 809.30. Restrictions on the sale, distribution and use of analyte specific reagents. U.S. Government Printing Office, Washington, DC.
25. Code of Federal Regulations. 2010. Title 21. Food and drugs, vol. 8, chapter 1. Food and Drug Administration, Department of Health and Human Services, part 812. Investigational device exemptions. U.S. Government Printing Office, Washington, DC.
26. Code of Federal Regulations. 2010. Title 21. Food and drugs, vol. 8, chapter 1. Food and Drug Administration, Department of Health and Human Services, part 820. Quality system regulation. U.S. Government Printing Office, Washington, DC.
27. Code of Federal Regulations. 2010. Title 21. Food and drugs, vol. 8, chapter 1. Food and Drug Administration, Department of Health and Human Services, part 864. Hematology and pathology devices, section 864.4020. Analyte specific reagents. U.S. Government Printing Office, Washington, DC.
28. Code of Federal Regulations. 2009. Title 42. Public health, vol. 4, chapter V. Health Care Financing Administration, Department of Health and Human Services, part 493. Laboratory requirements, section 493.2. Definitions. U.S. Government Printing Office, Washington, DC.
29. Code of Federal Regulations. 2009. Title 42. Public health, vol. 4, chapter V. Health Care Financing Administration, Department of Health and Human Services, part 493. Laboratory requirements, section 493.1253. Standard: establishment and verification of performance specifications. U.S. Government Printing Office, Washington, DC.
30. Code of Federal Regulations. 2009. Title 42. Public health, vol. 4, chapter V. Health Care Financing Administration, Department of Health and Human Services, part 493. Laboratory requirements, section 493.1255. Standard: calibration and calibration verification procedures. U.S. Government Printing Office, Washington, DC.
31. Code of Federal Regulations. 2009. Title 42. Public health, vol. 4, chapter V. Health Care Financing Administration, Department of Health and Human Services, part 493. Laboratory requirements, section 493.1256. Standard: control Procedures. U.S. Government Printing Office, Washington, DC.
32. Code of Federal Regulations. 2009. Title 42. Public health, vol. 4, chapter V. Health Care Financing Administration, Department of Health and Human Services, part 493. Laboratory requirements, section 493.1282. Standard: corrective actions. U.S. Government Printing Office, Washington, DC.
33. Code of Federal Regulations. 2009. Title 42. Public health, vol. 4, chapter V. Health Care Financing Administration, Department of Health and Human Services, part 493. Laboratory requirements, section 493.1455. Standard: clinical consultant qualifications. U.S. Government Printing Office, Washington, DC.
34. College of American Pathologists, Commission on Laboratory Accreditation. 2009. Microbiology checklist. College of American Pathologists, North-field, IL.
35. College of American Pathologists, Commission on Laboratory Accreditation. 2009. Molecular pathology checklist. College of American Pathologists, Northfield, IL.
36. Dreier, J., M. Störmer, and K. Kleesiek. 2005. Use of bacteriophage MS2 as an internal control in viral reverse transcription-PCR assays. J. Clin. Microbiol. 43:4551-4557.
37. Dreier, J., M. Störmer, D. Mäde, S. Burkhardt, and K. Kleesiek. 2006. Enhanced reverse transcription-PCR assay for detection of norovirus genogroup I. J. Clin. Microbiol. 44:2714-2720.
38. Drosten, C., E. Seifried, and W. K. Roth. 2001. TaqMan 5′-nuclease human immunodeficiency virus type 1 PCR assay with phage-packaged competitive internal control for high-throughput blood donor screening. J. Clin. Microbiol. 39:4302-4308.
39. Drosten, C., M. Panning, J. F. Drexler, F. Hänsel, C. Pedroso, J. Yeats, L. K. de Souza Luna, M. Samuel, B. Liedigk, U. Lippert, M. Stürmer, H. W. Doerr, C. Brites, and W. Preiser. 2006. Ultrasensitive monitoring of HIV-1 viral load by a low-cost real-time reverse transcription-PCR assay with internal control for the 5′ long terminal repeat domain. Clin. Chem. 52:1258-1266.
40. Eis, P. S., M. C. Olson, T. Takova, M. L. Curtis, S. M. Olson, T. I. Vener, H. S. Ip, K. L. Vedvik, C. T. Bartholomay, H. T. Allawi, W. P. Ma, J. G. Hall, M. D. Morin, T. H. Rushmore, V. I. Lyamichev, and R. W. Kwiatkowski. 2001. An invasive cleavage assay for direct quantitation of specific RNAs. Nat. Biotechnol. 19:673-676.
41. Espy, M. J., J. R. Uhl, L. M. Sloan, S. P. Buckwalter, M. F. Jones, E. A. Vetter, J. D. C. Yao, N. L. Wengenack, J. E. Rosenblatt, F. R. Cockerill III, and T. F. Smith. 2006. Real-time PCR in clinical microbiology: applications for routine laboratory testing. Clin. Microbiol. Rev. 19:165-256.
42. Federal Food, Drug and Cosmetic Act. Section 201(h), now codified as Title 21, food and drugs, chapter 9, Federal Food, Drug, and Cosmetic Act, subchapter II definitions, section 321(h), U.S. Code. U.S. House of Representatives, Washington, DC.
43. Ferreira-Gonzalez, A., and A. M. Caliendo. 2007. Viral infections in transplant patients. In D. G. B. Leonard (ed.), Molecular pathology in clinical practice, Springer Science+Business Media, LLC, New York, N.
44. Food and Drug Administration. 2001. FDA guidance for industry: bioanalytical method validation. Center for Drug Evaluation and Research, U.S. Department of Health and Human Services, Rockville, MD.
45. Garson, J. A., P. R. Grant, U. Ayliffe, R. B. Ferns, and R. S. Tedder. 2005. Real-time PCR quantitation of hepatitis B virus DNA using automated sample preparation and murine cytomegalovirus internal control. J. Virol. Methods 126:207-213.
46. International Organization for Standardization. 2006. Statistics - vocabulary and symbols, part 1. Probability and general statistical terms. ISO 3534-1. International Organization for Standardization, Geneva, Switzerland.
47. International Organization for Standardization. 1993. International vocabulary of basic and general terms in metrology. International Organization for Standardization, Geneva, Switzerland.
48. International Organization for Standardization. 2007. Medical laboratories - particular requirements for quality and competence. ISO 15189, 2nd ed. International Organization for Standardization, Geneva, Switzerland.
49. International Organization for Standardization. 2003. In vitro diagnostic medical devices - measurement of quantities in biological samples. Metrological traceability of values assigned to calibrators and control materials. ISO 17511. International Organization for Standardization, Geneva, Switzerland.
50. Jennings, L., V. M. Van Deerlin, and M. L. Gulley. 2009. Recommended principles and practices for validating clinical molecular pathology tests. Arch. Pathol. Lab. Med. 133:743-755.
51. Johnson, R. 2008. Assessment of bias with emphasis on medical comparison. Clin. Biochem. Rev. 29:S37-S42.
52. Klee, S. R., J. Tyczka, H. Ellerbrok, T. Franz, S. Linke, G. Baljer, and B. Appel. 2006. Highly sensitive real-time PCR for specific detection and quantification of Coxiella burnetii. BMC Microbiol. 6:2.
53. Koch, D. D., and T. Peters. 1999. Selection and evaluation of methods In C. A. Burtis and E. R. Ashwood (ed.), Tietz textbook of clinical chemistry, 3rd ed. W. B. Saunders Co., Philadelphia, PA.
54. Kocjan, B. J., K. Seme, and M. Poljak. 2008. Detection and differentiation of human papillomavirus genotypes HPV-6 and HPV-11 by FRET-based real-time PCR. J. Virol. Methods 153:245-249.
55. Koidl, C., M. Bozic, A. Burmeister, M. Hess, E. Marth, and H. H. Kessler. 2007. Detection and differentiation of Bordetella spp. by real-time PCR. J. Clin. Microbiol. 45:347-350.
56. Linnet, K. 1999. Necessary sample size for method comparison studies based on regression analysis. Clin. Chem. 45:882-894.
57. Linnet, K., and J. C. Boyd. 2006. Selection and analytical evaluation of methods - with statistical techniques. In C. A. Burtis, E. R. Ashwood, and D. E. Bruns (ed.), Tietz textbook of clinical chemistry, 4th ed. Elsevier Saunders, Philadelphia, PA.
58. Maaroufi, Y., J. M. de Bruyne, V. Duchateau, R. Scheen, and F. Crokaert. 2006. Development of a multiple internal control for clinical diagnostic real-time amplification assays. FEMS Immunol. Med. Microbiol. 48:183-191.
59. Mahony, J. B., A. Petrich, L. Louie, X. Song, S. Chong, M. Smieja, M. Chernesky, M. Loeb, and S. Richardson. 2004. Performance and cost evaluation of one commercial and six in-house conventional and real-time reverse transcription-PCR assays for detection of severe acute respiratory syndrome coronavirus. J. Clin. Microbiol. 42:1471-1476.
60. Müller, J., A. M. Eis-Hübinger, M. Däumer, R. Kaiser, J. M. Rox, L. Gürtler, L. P. Hanfland, and B. Pötzsch. 2007. A novel internally controlled real-time reverse transcription-PCR assay for HIV-1 RNA targeting the pol integrase genomic region. J. Virol. Methods 142:127-135.
61. Nitsche, A., M. Büttner, S. Wilhelm, G. Pauli, and H. Meyer. 2006. Real-time PCR detection of parapoxvirus DNA. Clin. Chem. 52:316-319.
62. Olson, V. A., T. Laue, M. T. Laker, I. V. Babkin, C. Drosten, S. N. Shchelkunov, M. Niedrig, I. K. Damon, and H. Meyer. 2004. Real-time PCR system for detection of orthopoxviruses and simultaneous identification of smallpox virus. J. Clin. Microbiol. 42:1940-1946.
63. Panning, M., J. Kilwinski, S. Greiner-Fischer, M. Peters, S. Kramme, D. Frangoulidis, H. Meyer, K. Henning, and C. Drosten. 2008. High throughput detection of Coxiella burnetii by real-time PCR with internal control system and automated DNA preparation. BMC Microbiol. 8:77.
64. Saah, A. J., and D. R. Hoover. 1997. "Sensitivity" and "specificity" reconsidered: the meaning of these terms in analytical and diagnostic settings. Ann. Intern. Med. 126:91-94.
65. Saldanha, J. 1993. Assays for viral sequences and their value in validation of viral elimination. Dev. Biol. Stand. 81:231-236.
66. Sloan, L. M. 2007. Real-time PCR in clinical microbiology: verification, validation, and contamination control. Clin. Microbiol. Newsl. 29:87-95.
67. Social Security Act. Section 1862(a) (1), exclusions from coverage and Medicare as a second payer, now codified as Title 42, chapter 7, exclusions from coverage and Medicare as a second payer, U.S. Code. U.S. House of Representatives, Washington, DC.
68. Störmer, M., K. Kleesiek, and J. Dreier. 2007. High-volume extraction of nucleic acids by magnetic bead technology for ultrasensitive detection of bacteria in blood components. Clin. Chem. 53:104-110.
69. Tedder, R. S., U. Ayliffe, W. Preiser, N. S. Brink, P. R. Grant, K. S. Peggs, S. Mackinnon, F. Kreig-Schneider, S. Kirk, and J. A. Garson. 2002. Development and evaluation of an internally controlled semiautomated PCR assay for quantification of cell-free cytomegalovirus. J. Med. Virol. 66:518-523.
70. Thompson, R., S. L. R. Ellison, and R. Wood. 2002. Harmonized guidelines for single-laboratory validation of methods of analysis. Pure Appl. Chem. 74:835-855.
71. Reference deleted.
72. U.S. Department of Health and Human Services, Centers for Medicare and Medicaid Services. 1992. Clinical laboratory improvement amendments of 1988 (CLIA). Fed. Regist. 57:7002-7186.
73. U.S. Department of Health and Human Services, Centers for Medicare and Medicaid Services. 2003. Medicare, Medicaid and CLIA programs: laboratory requirements relating to quality systems and certain personnel qualifications. Final rule. Fed. Regist. 16:3640-3714.
74. Valenstein, P. N. 1990. Evaluating diagnostic tests with imperfect standards. Am. J. Clin. Pathol. 93:252-258.
75. Valle, L., D. Amicizia, S. Bacilieri, F. Banfi, R. Riente, P. Durando, L. Sticchi, R. Gasparini, C. Esposito, G. Icardi, and F. Ansaldi. 2006. Performance testing of two new one-step real time PCR assays for detection of human influenza and avian influenza viruses isolated in humans and respiratory syncytial virus. J. Prev. Med. Hyg. 47:127-133.
76. Welzel, T. M., W. J. Miley, T. L. Parks, J. J. Goedert, D. Whitby, and B. A. Ortiz-Conde. 2006. Real-time PCR assay for detection and quantification of hepatitis B virus genotypes A to G. J. Clin. Microbiol. 44:3325-3333.
77. Westgard, J. O. 2002. Basic QC practices, 2nd ed. Westgard QC, Inc., Madison, WI.
78. Westgard, J. O. 2008. Basic method validation, 3rd ed. Westgard QC, Inc., Madison, WI.
79. Wölfel, R., J. T. Paweska, N. Petersen, A. A. Grobbelaar, P. A. Leman, R. Hewson, M. C. Georges-Courbot, A. Papa, S. Günther, and C. Drosten. 2007. Virus detection and monitoring of viral load in Crimean-Congo hemorrhagic fever virus patients. Emerg. Infect. Dis. 13:1097-1100.
80. World Health Organization Expert Committee on Biological Standardization. 1995. Glossary of terms for biological substances used for texts of the requirements. WHO unpublished document BS/95.1793. World Health Organization, Geneva, Switzerland.
81. Zimmermann, B., A. El-Sheikhah, K. Nicolaides, W. Holzgreve, and S. Hahn. 2005. Optimized real-time quantitative PCR measurement of male fetal DNA in maternal plasma. Clin. Chem. 51:1598-1604.
82. Zimmermann, P., I. Thordsen, D. Frangoulidis, and H. Meyer. 2005. Real-time PCR assay for the detection of tanapox virus and yaba-like disease virus. J. Virol. Methods 130:149-153.