Validation and implementation of clinical laboratory improvements act-compliant whole-genome sequencing in the public health microbiology laboratory

Journal of Clinical Microbiology

Volumn 55, Issue 8, 2017, Pages 2502-2520

  Kozyreva, Varvara K ^a   Truong, Chau Linda ^a   Greninger, Alexander L ^a   Crandall, John ^a   Mukhopadhyay, Rituparna ^a   Chaturvedi, Vishnu ^a  

^a CALIFORNIA DEPARTMENT OF PUBLIC HEALTH   (United States)

Author keywords

Bacteria; Bioinformatics pipeline; CLIA; Laboratory developed test; Performance specifications; Public health; Quality management; Validation; WGS; Whole genome sequencing

Indexed keywords

ARTICLE; BACTERIAL GENOME; BACTERIUM ISOLATE; CLINICAL LABORATORY; CONTROLLED STUDY; ENTEROBACTERIACEAE; GRAM NEGATIVE BACTERIUM; GRAM POSITIVE BACTERIUM; LAW; LIMIT OF DETECTION; MEASUREMENT ACCURACY; MEASUREMENT REPEATABILITY; MULTILOCUS SEQUENCE TYPING; MYCOBACTERIUM TUBERCULOSIS; NONHUMAN; PHYLOGENY; PRIORITY JOURNAL; PUBLIC HEALTH MICROBIOLOGY LABORATORY; QUALITY CONTROL; REPRODUCIBILITY; SINGLE NUCLEOTIDE POLYMORPHISM; VALIDATION STUDY; WHOLE GENOME SEQUENCING; BACTERIAL INFECTION; HUMAN; MICROBIOLOGICAL EXAMINATION; MOLECULAR DIAGNOSIS; MOLECULAR EPIDEMIOLOGY; PROCEDURES; SENSITIVITY AND SPECIFICITY;

BACTERIAL INFECTIONS; BACTERIOLOGICAL TECHNIQUES; HUMANS; MOLECULAR DIAGNOSTIC TECHNIQUES; MOLECULAR EPIDEMIOLOGY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; WHOLE GENOME SEQUENCING;

EID: 85026266069     PISSN: 00951137     EISSN: 1098660X     Source Type: Journal    
DOI: 10.1128/JCM.00361-17     Document Type: Article

References (59)

1. Didelot X, Bowden R, Wilson DJ, Peto TEA, Crook DW. 2012. Transforming clinical microbiology with bacterial genome sequencing. Nat Rev Genet 13:601-612. https://doi.org/10.1038/nrg3226.
2. Köser CU, Ellington MJ, Cartwright EJ, Gillespie SH, Brown NM, Farrington M, Holden MT, Dougan G, Bentley SD, Parkhill J. 2012. Routine use of microbial whole genome sequencing in diagnostic and public health microbiology. PLoS Pathog 8:e1002824. https://doi.org/10.1371/ journal.ppat.1002824.
3. Grad YH, Lipsitch M, Feldgarden M, Arachchi HM, Cerqueira GC, FitzGerald M, Godfrey P, Haas BJ, Murphy CI, Russ C, Sykes S, Walker BJ, Wortman JR, Young S, Zeng Q, Abouelleil A, Bochicchio J, Chauvin S, DeSmet T, Gujja S, McCowan C, Montmayeur A, Steelman S, Frimodt-Møller J, Petersen AM, Struve C, Krogfelt KA, Bingen E, Weill F-X, Lander ES, Nusbaum C, Birren BW, Hung DT, Hanage WP. 2012. Genomic epidemiology of the Escherichia coli O104:H4 outbreaks in Europe, 2011. Proc Natl Acad Sci U S A 109:3065-3070. https://doi.org/ 10.1073/pnas.1121491109.
4. McGann P, Bunin JL, Snesrud E, Singh S, Maybank R, Ong AC, Kwak YI, Seronello S, Clifford RJ, Hinkle M, Yamada S, Barnhill J, Lesho E. 2016. Real time application of whole genome sequencing for outbreak investigation-what is an achievable turnaround time?. Diagn Microbiol Infect Dis 85:277-282. https://doi.org/10.1016/j.diagmicrobio.2016.04.020.
5. Gordon NC, Price JR, Cole K, Everitt R, Morgan M, Finney J, Kearns AM, Pichon B, Young B, Wilson DJ, Llewelyn MJ, Paul J, Peto TEA, Crook DW, Walker AS, Golubchik T. 2014. Prediction of Staphylococcus aureus antimicrobial resistance by whole-genome sequencing. J Clin Microbiol 52:1182-1191. https://doi.org/10.1128/JCM.03117-13.
6. Leopold SR, Goering RV, Witten A, Harmsen D, Mellmann A. 2014. Bacterial whole-genome sequencing revisited: portable, scalable, and standardized analysis for typing and detection of virulence and antibiotic resistance genes. J Clin Microbiol 52:2365-2370. https://doi.org/10 .1128/JCM.00262-14.
7. Goodwin S, McPherson JD, McCombie WR. 2016. Coming of age: ten years of next-generation sequencing technologies. Nat Rev Genet 17: 333-351. https://doi.org/10.1038/nrg.2016.49.
8. Roetzer A, Diel R, Kohl TA, Rückert C, Nübel U, Blom J, Wirth T, Jaenicke S, Schuback S, Rüsch-Gerdes S. 2013. Whole genome sequencing versus traditional genotyping for investigation of a Mycobacterium tuberculosis outbreak: a longitudinal molecular epidemiological study. PLoS Med 10:e1001387. https://doi.org/10.1371/journal.pmed.1001387.
9. Gardy JL, Johnston JC, Sui SJH, Cook VJ, Shah L, Brodkin E, Rempel S, Moore R, Zhao Y, Holt R, Varhol R, Birol I, Lem M, Sharma MK, Elwood K, Jones SJM, Brinkman FSL, Brunham RC, Tang P. 2011. Whole-genome sequencing and social-network analysis of a tuberculosis outbreak. N Engl J Med 364:730-739. https://doi.org/10.1056/NEJMoa1003176.
10. Eyre DW, Cule ML, Wilson DJ, Griffiths D, Vaughan A, O'Connor L, Ip CLC, Golubchik T, Batty EM, Finney JM, Wyllie DH, Didelot X, Piazza P, Bowden R, Dingle KE, Harding RM, Crook DW, Wilcox MH, Peto TEA, Walker AS. 2013. Diverse sources of C. difficile infection identified on whole-genome sequencing. N Engl J Med 369:1195-1205. https://doi.org/10.1056/ NEJMoa1216064.
11. Etienne KA, Roe CC, Smith RM, Vallabhaneni S, Duarte C, Escandón P, Castañeda E, Gómez BL, de Bedout C, López LF, Salas V, Hederra LM, Fernández J, Pidal P, Hormazabel JC, Otaíza-O'Ryan F, Vannberg FO, Gillece J, Lemmer D, Driebe EM, Engelthaler DM, Litvintseva AP. 2016. Whole-genome sequencing to determine origin of multinational outbreak of Sarocladium kiliense bloodstream infections. Emerg Infect Dis 22:476-481. https://doi.org/10.3201/eid2203.151193.
12. Pallen MJ. 2014. Diagnostic metagenomics: potential applications to bacterial, viral and parasitic infections. Parasitology 141:1856-1862. https://doi.org/10.1017/S0031182014000134.
13. Onderdonk AB, Delaney ML, Fichorova RN. 2016. The human microbiome during bacterial vaginosis. Clin Microbiol Rev 29:223-238. https:// doi.org/10.1128/CMR.00075-15.
14. Pearce MM, Hilt EE, Rosenfeld AB, Zilliox MJ, Thomas-White K, Fok C, Kliethermes S, Schreckenberger PC, Brubaker L, Gai X, Wolfe AJ. 2014. The female urinary microbiome: a comparison of women with and without urgency urinary incontinence. mBio 5:e01283-14. https://doi .org/10.1128/mBio.01283-14.
15. Schubert AM, Rogers MAM, Ring C, Mogle J, Petrosino JP, Young VB, Aronoff DM, Schloss PD. 2014. Microbiome data distinguish patients with Clostridium difficile infection and non-C. difficile-associated diarrhea from healthy controls. mBio 5:e01021-14. https://doi.org/10.1128/mBio .01021-14.
16. Naccache SN, Federman S, Veeraraghavan N, Zaharia M, Lee D, Samayoa E, Bouquet J, Greninger AL, Luk K-C, Enge B, Wadford DA, Messenger SL, Genrich GL, Pellegrino K, Grard G, Leroy E, Schneider BS, Fair JN, Martínez MA, Isa P, Crump JA, DeRisi JL, Sittler T, Hackett J, Miller S, Chiu CY. 2014. A cloud-compatible bioinformatics pipeline for ultrarapid pathogen identification from next-generation sequencing of clinical samples. Genome Res 24:1180-1192. https://doi.org/10.1101/gr.171934.113.
17. Hasman H, Saputra D, Sicheritz-Ponten T, Lund O, Svendsen CA, Frimodt-Møller N, Aarestrup FM. 2014. Rapid whole genome sequencing for the detection and characterization of microorganisms directly from clinical samples. J Clin Microbiol 52:139-146. https://doi.org/10.1128/JCM .02452-13.
18. Loman NJ, Constantinidou C, Christner M, Rohde H, Chan JZM, Quick J, Weir JC, Quince C, Smith GP, Betley JR, Aepfelbacher M. 2013. A cultureindependent sequence-based metagenomics approach to the investigation of an outbreak of Shiga-toxigenic Escherichia coli O104:H4. JAMA 309:1502-1510. https://doi.org/10.1001/jama.2013.3231.
19. Endrullat C, Glökler J, Franke P, Frohme M. 2016. Standardization and quality management in next-generation sequencing. Appl Transl Genom 10:2-9. https://doi.org/10.1016/j.atg.2016.06.001.
20. Salto-Tellez M, Gonzalez de Castro D. 2014. Next-generation sequencing: a change of paradigm in molecular diagnostic validation. J Pathol 234:5-10. https://doi.org/10.1002/path.4365.
21. Goldberg B, Sichtig H, Geyer C, Ledeboer N, Weinstock GM. 2015. Making the leap from research laboratory to clinic: challenges and opportunities for next-generation sequencing in infectious disease diagnostics. mBio 6:e01888-15. https://doi.org/10.1128/mBio.01888-15.
22. Kwong JC, McCallum N, Sintchenko V, Howden BP. 2015. Whole genome sequencing in clinical and public health microbiology. Pathology 47: 199-210. https://doi.org/10.1097/PAT.0000000000000235.
23. Luheshi LM, Raza S, Peacock SJ. 2015. Moving pathogen genomics out of the lab and into the clinic: what will it take?. Genome Med 7:132. https://doi.org/10.1186/s13073-015-0254-z.
24. Oliver GR, Hart SN, Klee EW. 2015. Bioinformatics for clinical next generation sequencing. Clin Chem 61:124-135. https://doi.org/10.1373/ clinchem.2014.224360.
25. Fricke WF, Rasko DA. 2014. Bacterial genome sequencing in the clinic: bioinformatic challenges and solutions. Nat Rev Genet 15:49-55. https:// doi.org/10.1038/nrg3624.
26. Wyres KL, Conway TC, Garg S, Queiroz C, Reumann M, Holt K, Rusu LI. 2014. WGS analysis and interpretation in clinical and public health microbiology laboratories: what are the requirements and how do existing tools compare?. Pathogens 3:437-458. https://doi.org/10 .3390/pathogens3020437.
27. Rhoads DD, Sintchenko V, Rauch CA, Pantanowitz L. 2014. Clinical microbiology informatics. Clin Microbiol Rev 27:1025-1047. https://doi .org/10.1128/CMR.00049-14.
28. Gargis AS, Kalman L, Lubin IM. 2016. Assuring the quality of nextgeneration sequencing in clinical microbiology and public health laboratories. J Clin Microbiol 54:2857-2865. https://doi.org/10.1128/JCM .00949-16.
29. Lefterova MI, Suarez CJ, Banaei N, Pinsky BA. 2015. Next-generation sequencing for infectious disease diagnosis and management: a report of the Association for Molecular Pathology. J Mol Diagn 17:623-634. https://doi.org/10.1016/j.jmoldx.2015.07.004.
30. Aziz N, Zhao Q, Bry L, Driscoll DK, Funke B, Gibson JS, Grody WW, Hegde MR, Hoeltge GA, Leonard DGB, Merker JD, Nagarajan R, Palicki LA, Robetorye RS, Schrijver I, Weck KE, Voelkerding KV. 2014. College of American Pathologists' laboratory standards for next-generation sequencing clinical tests. Arch Pathol Lab Med 139:481-493. https://doi .org/10.5858/arpa.2014-0250-CP.
31. Moran-Gilad J, Sintchenko V, Pedersen SK, Wolfgang WJ, Pettengill J, Strain E, Hendriksen RS. 2015. Proficiency testing for bacterial whole genome sequencing: an end-user survey of current capabilities, requirements and priorities. BMC Infect Dis 15:174. https://doi.org/10.1186/ s12879-015-0902-3.
32. Olson ND, Jackson SA, Lin NJ. 2015. Report from the Standards for Pathogen Identification via Next-Generation Sequencing (SPIN) Workshop. Stand Genomic Sci 10:119. https://doi.org/10.1186/s40793-015-0112-z.
33. Gargis AS, Kalman L, Berry MW, Bick DP, Dimmock DP, Hambuch T, Lu F, Lyon E, Voelkerding KV, Zehnbauer BA. 2012. Assuring the quality of next-generation sequencing in clinical laboratory practice. Nat Biotechnol 30:1033-1036. https://doi.org/10.1038/nbt.2403.
34. Gargis AS, Kalman L, Bick DP, da Silva C, Dimmock DP, Funke BH, Gowrisankar S, Hegde MR, Kulkarni S, Mason CE, Nagarajan R, Voelkerding KV, Worthey EA, Aziz N, Barnes J, Bennett SF, Bisht H, Church DM, Dimitrova Z, Gargis SR, Hafez N, Hambuch T, Hyland FC, Luna RA, MacCannell D, Mann T, McCluskey MR, McDaniel TK, Ganova-Raeva LM, Rehm HL, Reid J, Campo DS, Resnick RB, Ridge PG, Salit ML, Skums P, Wong LJ, Zehnbauer BA, Zook JM, Lubin IM. 2015. Good laboratory practice for clinical next-generation sequencing informatics pipelines. Nat Biotechnol 33:689-693. https://doi.org/10.1038/nbt.3237.
35. Duncavage EJ, Abel HJ, Merker JD, Bodner JB, Zhao Q, Voelkerding KV, Pfeifer JD. 2016. A model study of in silico proficiency testing for clinical next-generation sequencing. Arch Pathol Lab Med 140:1085-1091. https://doi.org/10.5858/arpa.2016-0194-CP.
36. Mellmann A, Andersen PS, Bletz S, Friedrich AW, Kohl TA, Lilje B, Niemann S, Prior K, Rossen JW, Harmsen D. 2017. High interlaboratory reproducibility and accuracy of next-generation-sequencing-based bacterial genotyping in a ring trial. J Clin Microbiol 55:908-913. https://doi .org/10.1128/JCM.02242-16.
37. CLSI. 2014. Nucleic acid sequencing methods in diagnostic laboratory medicine: approved guideline, 2nd ed. MM09-A2. CLSI, Wayne, PA.
38. Harris SR, Cartwright EJ, Torok ME, Holden MT, Brown NM, Ogilvy-Stuart AL, Ellington MJ, Quail MA, Bentley SD, Parkhill J, Peacock SJ. 2013. Whole-genome sequencing for analysis of an outbreak of meticillinresistant Staphylococcus aureus: a descriptive study. Lancet Infect Dis 13:130-136. https://doi.org/10.1016/S1473-3099(12)70268-2.
39. Leekitcharoenphon P, Nielsen EM, Kaas RS, Lund O, Aarestrup FM. 2014. Evaluation of whole genome sequencing for outbreak detection of Salmonella enterica. PLoS One 9:e87991. https://doi.org/10.1371/journal .pone.0087991.
40. Burd EM. 2010. Validation of laboratory-developed molecular assays for infectious diseases. Clin Microbiol Rev 23:550-576. https://doi.org/10 .1128/CMR.00074-09.
41. Richards S, Aziz N, Bale S, Bick D, Das S, Gastier-Foster J, Grody WW, Hegde M, Lyon E, Spector E, Voelkerding K, Rehm HL. 2015. Standards and guidelines for the interpretation of sequence variants: a joint consensus recommendation of the American College of Medical Genetics and Genomics and the Association for Molecular Pathology. Genet Med 17:405-423. https://doi.org/10.1038/gim.2015.30.
42. Lesho E, Clifford R, Onmus-Leone F, Appalla L, Snesrud E, Kwak Y, Ong A, Maybank R, Waterman P, Rohrbeck P, Julius M, Roth A, Martinez J, Nielsen L, Steele E, McGann P, Hinkle M. 2016. The challenges of implementing next generation sequencing across a large healthcare system, and the molecular epidemiology and antibiotic susceptibilities of carbapenemase-producing bacteria in the healthcare system of the U.S. Department of Defense. PLoS One 11:e0155770. https://doi.org/10.1371/ journal.pone.0155770.
43. Kalman LV, Datta V, Williams M, Zook JM, Salit ML, Han J-Y. 2016. Development and characterization of reference materials for genetic testing: focus on public partnerships. Ann Lab Med 36:513-520. https:// doi.org/10.3343/alm.2016.36.6.513.
44. Lindsey RL, Pouseele H, Chen JC, Strockbine NA, Carleton HA. 2016. Implementation of whole genome sequencing (WGS) for identification and characterization of Shiga toxin-producing Escherichia coli (STEC) in the United States. Front Microbiol 7:766. https://doi.org/10.3389/fmicb .2016.00766.
45. Pankhurst LJ, del Ojo Elias C, Votintseva AA, Walker TM, Cole K, Davies J, Fermont JM, Gascoyne-Binzi DM, Kohl TA, Kong C, Lemaitre N, Niemann S, Paul J, Rogers TR, Roycroft E, Smith EG, Supply P, Tang P, Wilcox MH, Wordsworth S, Wyllie D, Xu L, Crook DW. 2016. Rapid, comprehensive, and affordable mycobacterial diagnosis with whole-genome sequencing: a prospective study. Lancet Respir Med 4:49-58. https://doi .org/10.1016/S2213-2600(15)00466-X.
46. Walker TM, Kohl TA, Omar SV, Hedge J, Del Ojo Elias C, Bradley P, Iqbal Z, Feuerriegel S, Niehaus KE, Wilson DJ, Clifton DA, Kapatai G, Ip CLC, Bowden R, Drobniewski FA, Allix-Béguec C, Gaudin C, Parkhill J, Diel R, Supply P, Crook DW, Smith EG, Walker AS, Ismail N, Niemann S, Peto TEA. 2015. Whole-genome sequencing for prediction of Mycobacterium tuberculosis drug susceptibility and resistance: a retrospective cohort study. Lancet Infect Dis 15:1193-1202. https://doi.org/10.1016/S1473-3099(15)00062-6.
47. Zankari E, Hasman H, Cosentino S, Vestergaard M, Rasmussen S, Lund O, Aarestrup FM, Larsen MV. 2012. Identification of acquired antimicrobial resistance genes. J Antimicrob Chemother 67:2640-2644. https://doi .org/10.1093/jac/dks261.
48. Arnold C. 2016. Considerations in centralizing whole genome sequencing for microbiology in a public health setting. Expert Rev Mol Diagn 16:619-621. https://doi.org/10.1586/14737159.2016.1164039.
49. Auffray C, Caulfield T, Griffin JL, Khoury MJ, Lupski JR, Schwab M. 2016. From genomic medicine to precision medicine: highlights of 2015. Genome Med 8:12. https://doi.org/10.1186/s13073-016-0265-4.
50. Allard MW, Strain E, Melka D, Bunning K, Musser SM, Brown EW, Timme R. 2016. Practical value of food pathogen traceability through building a whole-genome sequencing network and database. J Clin Microbiol 54: 1975-1983. https://doi.org/10.1128/JCM.00081-16.
51. Robilotti E, Kamboj M. 2015. Integration of whole-genome sequencing into infection control practices: the potential and the hurdles. J Clin Microbiol 53:1054-1055. https://doi.org/10.1128/JCM.00349-15.
52. Li H, Handsaker B, Wysoker A, Fennell T, Ruan J, Homer N, Marth G, Abecasis G, Durbin R, Genome Project Data Processing Subgroup. 2009. The Sequence Alignment/Map format and SAMtools. Bioinformatics 25: 2078-2079. https://doi.org/10.1093/bioinformatics/btp352.
53. Danecek P, Auton A, Abecasis G, Albers CA, Banks E, DePristo MA, Handsaker RE, Lunter G, Marth GT, Sherry ST, McVean G, Durbin R, Genomes Project Analysis Group. 2011. The variant call format and VCFtools. Bioinformatics 27:2156-2158. https://doi.org/10.1093/ bioinformatics/btr330.
54. Seemann T. 2014. Prokka: rapid prokaryotic genome annotation. Bioinformatics 30:2068-2069. https://doi.org/10.1093/bioinformatics/btu153.
55. Cole JR, Wang Q, Fish JA, Chai B, McGarrell DM, Sun Y, Brown CT, Porras-Alfaro A, Kuske CR, Tiedje JM. 2014. Ribosomal Database Project: data and tools for high throughput rRNA analysis. Nucleic Acids Res 42:D633-D642. https://doi.org/10.1093/nar/gkt1244.
56. Larsen MV, Cosentino S, Rasmussen S, Friis C, Hasman H, Marvig RL, Jelsbak L, Sicheritz-Ponten T, Ussery DW, Aarestrup FM, Lund O. 2012. Multilocus sequence typing of total-genome-sequenced bacteria. J Clin Microbiol 50:1355-1361. https://doi.org/10.1128/JCM.06094-11.
57. Joensen KG, Scheutz F, Lund O, Hasman H, Kaas RS, Nielsen EM, Aarestrup FM. 2014. Real-time whole-genome sequencing for routine typing, surveillance, and outbreak detection of verotoxigenic Escherichia coli. J Clin Microbiol 52:1501-1510. https://doi.org/10.1128/ JCM.03617-13.
58. CLSI. 2015. Performance standards for antimicrobial susceptibility testing; twenty-fifth informational supplement. CLSI document M100-S25. CLSI, Wayne, PA.
59. CLSI. 2007. Molecular methods for bacterial strain typing; approved guideline, MM11-A. CLSI, Wayne, PA.