Validation of high throughput sequencing and microbial forensics applications

Investigative Genetics

Volumn 5, Issue 1, 2014, Pages

  Budowle, Bruce ^a,b   Connell, Nancy D ^c   Bielecka Oder, Anna ^d   Colwell, Rita R ^e,f,g,h   Corbett, Cindi R ^i,j   Fletcher, Jacqueline ^k   Forsman, Mats ^l   Kadavy, Dana R ^m   Markotic, Alemka ⁿ   Morse, Stephen A ^o   Murch, Randall S ^p   Sajantila, Antti ^a,q   Schmedes, Sarah E ^a   Ternus, Krista L ^c   Turner, Stephen D ^r   Minot, Samuel ^m  

^a UNIVERSITY OF NORTH TEXAS HEALTH SCIENCE CENTER   (United States)

^b KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

^c RUTGERS NEW JERSEY MEDICAL SCHOOL   (United States)

^d MILITARY INSTITUTE OF HYGIENE AND EPIDEMIOLOGY   (Poland)

^e CosmosID ^*  (United States)

^f Bldg 142   (United States)

^g UNIVERSITY OF MARYLAND   (United States)

^h JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

ⁱ PUBLIC HEALTH AGENCY OF CANADA   (Canada)

^j UNIVERSITY OF MANITOBA   (Canada)

^k OKLAHOMA STATE UNIVERSITY   (United States)

^l SWEDISH DEFENCE RESEARCH AGENCY   (Sweden)

^m Signature Science LLC   (United States)

ⁿ Croatia   (Croatia)

^o NATIONAL CENTER FOR EMERGING AND ZOONOTIC INFECTIOUS DISEASES   (United States)

^p VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^q UNIVERSITY OF HELSINKI   (Finland)

^r UNIVERSITY OF VIRGINIA   (United States)

more..

Author keywords

Bioinformatics; High throughput sequencing; Library preparation; Microbial forensics; Sample preparation; Validation

Indexed keywords

BIOCHEMISTRY; BIOINFORMATICS; FALSE NEGATIVE RESULT; FALSE POSITIVE RESULT; FORENSIC SCIENCE; HIGH THROUGHPUT SEQUENCING; HUMAN; LIMIT OF DETECTION; MEASUREMENT ACCURACY; MEASUREMENT PRECISION; MEASUREMENT REPEATABILITY; MICROBIAL FORENSICS; NONHUMAN; PRIORITY JOURNAL; REFERENCE DATABASE; REPRODUCIBILITY; REVIEW; SENSITIVITY AND SPECIFICITY; SINGLE NUCLEOTIDE POLYMORPHISM; STATISTICAL ANALYSIS; VALIDATION PROCESS; COMMUNITY STRUCTURE; COMPUTER PROGRAM; DATA ANALYSIS; GENE SEQUENCE; INFORMATION PROCESSING; MICROBIAL FORENSIC; MICROBIAL GENOME; MICROBIOLOGY; NUCLEIC ACID ANALYSIS; POLYMERASE CHAIN REACTION; POPULATION ABUNDANCE; SAMPLING; TAXONOMY;

EID: 84904841142     PISSN: None     EISSN: 20412223     Source Type: Journal    
DOI: 10.1186/2041-2223-5-9     Document Type: Review

References (139)

1. Bush LM, Abrams BH, Beall A, Johnson CC. Index case of fatal inhalational anthrax due to bioterrorism in the United States. N Engl J Med 2001, 345:1607-1610.
2. Traeger MS, Wiersma ST, Rosenstein NE, Malecki JM, Shepard CW, Raghunathan PL, Pillai SP, Popovic T, Quinn CP, Meyer RF, Zaki SR, Kumar S, Bruce SM, Sejvar JJ, Dull PM, Tierney BC, Jones JD, Perkins BA, Team FI. First case of bioterrorism-related inhalational anthrax in the United States, Palm Beach County, Florida, 2001. Emerg Infect Dis 2002, 8:1029-1034.
3. Jernigan JA, Stephens DS, Ashford DA, Omenaca C, Topiel MS, Galbraith M, Tapper M, Fisk TL, Zaki S, Popovic T, Meyer RF, Quinn CP, Harper SA, Fridkin SK, Sejvar JJ, Shepard CW, McConnell M, Guarner J, Shieh WJ, Malecki JM, Gerberding JL, Hughes JM, Perkins BA. Anthrax Bioterrorism Investigation Team: Bioterrorism-related inhalational anthrax: the first 10 cases reported in the United States. Emerg Infect Dis 2001, 7:933-944.
4. Hsu VP, Lukacs SL, Handzel T, Hayslett J, Harper S, Hales T, Semenova VA, Romero-Steiner S, Elie C, Quinn CP, Khabbaz R, Khan AS, Martin G, Eisold J, Schuchat A, Hajjeh RA. Opening a bacillus anthracis-containing envelope, Capitol Hill, Washington, D.C.: the public health response. Emerg Infect Dis 2002, 8:1039-1043.
5. Murch RS. Forensic perspective on bioterrorism and bioproliferation. Firepower in the Laboratory. Proceedings of the Symposium on Research Needs for Laboratory Automation and Bioterrorism 2001, 203-214. Washington DC: National Academy of Sciences Press.
6. Murch RS. Microbial forensics: building a national capacity to investigate bioterrorism. Biosecur Bioterror 2003, 1:117-122.
7. Budowle B, Schutzer SE, Einseln A, Kelley LC, Walsh AC, Smith JA, Marrone BL, Robertson J, Campos J. Public health. Building microbial forensics as a response to bioterrorism. Science 2003, 301:1852-1853.
8. Morse SA, Budowle B. Microbial forensics: application to bioterrorism preparedness and response. Infect Dis Clin North Am 2006, 20:455-473.
9. Flowers LK, Mothershead JL, Blackwell TH. Bioterrorism preparedness. II: the community and emergency medical services systems. Emerg Med Clin North Am 2002, 20:457-476.
10. Morse SA, Kellogg RB, Perry S, Meyer RF, Bray D, Nichelson D, Miller JM. Detecting biothreat agents: the Laboratory Response Network. ASM News 2003, 69:433-437.
11. Fletcher J. The need for forensic tools in a balanced national agricultural security program. Crop Biosecurity: Assuring Our Global Food Supply 2008, 93-101. Springer Science + Business Media B.V, Gullino M, Fletcher J, Gamliel A, Stacks J.
12. Fletcher J, Barnaby N, Burans J, Melcher U, Ochoa Corona F. Forensic plant pathology. Microbial Forensics 2010, 89-105. Elsevier Inc, Budowle B, Schutzer SE, Breeze RG, Keim PS, Morse SA.
13. Fletcher J, Bender C, Budowle B, Cobb WT, Gold SE, Ishimaru CA, Luster D, Melcher U, Murch R, Scherm H, Seem RC, Sherwood JL, Sobral BW, Tolin SA. Plant pathogen forensics: capabilities, needs, and recommendations. Microbiol Mol Biol Rev 2006, 70:450-471.
14. Harmon R. Admissibility standards for scientific evidence. Microbial Forensics 2005, 382-392. Academic Press, Budowle B, Schutzer SE, Breeze RG.
15. Fleischmann RD, Adams MD, White O, Clayton RA, Kirkness EF, Kerlavage AR, Bult CJ, Tomb JF, Dougherty BA, Merrick JM, McKenney K, Sutton G, FitzHugh W, Fields C, Gocayne JD, Scott J, Shirley R, Liu LI, Glodek A, Kelley JM, Weidman JF, Phillips CA, Spriggs T, Hedblom E, Cotton MD, Utterback TR, Hanna MC, Nguyen DT, Saudek DM, Brandon RC, et al. Whole-genome random sequencing and assembly of Haemophilus influenzae Rd. Science 1995, 269:496-512.
16. Fraser CM, Gocayne JD, White O, Adams MD, Clayton RA, Fleischmann RD, Bult CJ, Kerlavage AR, Sutton G, Kelley JM, Fritchman RD, Weidman JF, Small KV, Sandusky M, Fuhrmann J, Nguyen D, Utterback TR, Saudek DM, Phillips CA, Merrick JM, Tomb JF, Dougherty BA, Bott KF, Hu PC, Lucier TS, Peterson SN, Smith HO, Hutchison CA, Venter JC. The minimal gene complement of Mycoplasma genitalium. Science 1995, 270:397-403.
17. Venter JC, Adams MD, Myers EW, Li PW, Mural RJ, Sutton GG, Smith HO, Yandell M, Evans CA, Holt RA, Gocayne JD, Amanatides P, Ballew RM, Huson DH, Wortman JR, Zhang Q, Kodira CD, Zheng XH, Chen L, Skupski M, Subramanian G, Thomas PD, Zhang J, Gabor Miklos GL, Nelson C, Broder S, Clark AG, Nadeau J, McKusick VA, Zinder N. The sequence of the human genome. Science 2001, 291:1304-1351.
18. Lander ES, Linton LM, Birren B, Nusbaum C, Zody MC, Baldwin J, Devon K, Dewar K, Doyle M, FitzHugh W, Funke R, Gage D, Harris K, Heaford A, Howland J, Kann L, Lehoczky J, LeVine R, McEwan P, McKernan K, Meldrim J, Mesirov JP, Miranda C, Morris W, Naylor J, Raymond C, Rosetti M, Santos R, Sheridan A, Sougnez C, et al. Initial sequencing and analysis of the human genome. Nature 2001, 409:860-921.
19. Wheeler DA, Srinivasan M, Egholm M, Shen Y, Chen L, McGuire A, He W, Chen YJ, Makhijani V, Roth GT, Gomes X, Tartaro K, Niazi F, Turcotte CL, Irzyk GP, Lupski JR, Chinault C, Song XZ, Liu Y, Yuan Y, Nazareth L, Qin X, Muzny DM, Margulies M, Weinstock GM, Gibbs RA, Rothberg JM. The complete genome of an individual by massively parallel DNA sequencing. Nature 2008, 452:872-876.
20. Brzuszkiewicz E, Thürmer A, Schuldes J, Leimbach A, Liesegang H, Meyer FD, Boelter J, Petersen H, Gottschalk G, Daniel R. Genome sequence analyses of two isolates from the recent Escherichia coli outbreak in Germany reveal the emergence of a new pathotype: Entero-Aggregative-Haemorrhagic Escherichia coli (EAHEC). Arch Microbiol 2011, 193:883-891.
21. Chin CS, Sorenson J, Harris JB, Robins WP, Charles RC, Jean-Charles RR, Bullard J, Webster DR, Kasarskis A, Peluso P, Paxinos EE, Yamaichi Y, Calderwood SB, Mekalanos JJ, Schadt EE, Waldor MK. The origin of the Haitian cholera outbreak strain. N Engl J Med 2011, 364:33-42.
22. Cummings CA, Bormann Chung CA, Fang R, Barker M, Brzoska P, Williamson PC, Beaudry J, Matthews M, Schupp J, Wagner DM, Birdsell D, Vogler AJ, Furtado MR, Keim P, Budowle B. Accurate, rapid and high-throughput detection of strain-specific polymorphisms in Bacillus anthracis and Yersinia pestis by next-generation sequencing. Investig Genet 2010, 1:5.
23. Grad YH, Lipsitch M, Feldgarden M, Arachchi HM, Cerqueira GC, Fitzgerald M, Godfrey P, Haas BJ, Murphy CI, Russ C, Sykes S, Walker BJ, Wortman JR, Young S, Zeng Q, Abouelleil A, Bochicchio J, Chauvin S, Desmet T, Gujja S, McCowan C, Montmayeur A, Steelman S, Frimodt-Møller J, Petersen AM, Struve C, Krogfelt KA, Bingen E, Weill FX, Lander ES, et al. Genomic epidemiology of the Escherichia coli O104:H4 outbreaks in Europe, 2011. Proc Natl Acad Sci U S A 2012, 109:3065-3070.
24. Eisen JA. Environmental shotgun sequencing: its potential and challenges for studying the hidden world of microbes. PLoS Biol 2007, 5:e82.
25. Hasan NA, Choi SY, Eppinger M, Clark PW, Chen A, Alam M, Haley BJ, Taviani E, Hine E, Su Q, Tallon LJ, Prosper JB, Furth K, Hoq MM, Li H, Fraser-Liggett CM, Cravioto A, Huq A, Ravel J, Cebula TA, Colwell RR. Genomic diversity of 2010 Haitian cholera outbreak strains. Proc Natl Acad Sci U S A 2012, 109:E2010-E2017.
26. Hendriksen RS, Price LB, Schupp JM, Gillece JD, Kaas RS, Engelthaler DM, Bortolaia V, Pearson T, Waters AE, Upadhyay BP, Shrestha SD, Adhikari S, Shakya G, Keim PS, Aarestrup FM. Population genetics of Vibrio cholerae from Nepal in 2010: evidence on the origin of the Haitian outbreak. MBio 2011, 2:e00157-11.
27. Holt KE, Parkhill J, Mazzoni CJ, Roumagnac P, Weill FX, Goodhead I, Rance R, Baker S, Maskell DJ, Wain J, Dolecek C, Achtman M, Dougan G. High-throughput sequencing provides insights into genome variation and evolution in Salmonella Typhi. Nat Genet 2008, 40:987-993.
28. Hornstra HM, Priestley RA, Georgia SM, Kachur S, Birdsell DN, Hilsabeck R, Gates LT, Samuel JE, Heinzen RA, Kersh GJ, Keim P, Massung RF, Pearson T. Rapid typing of Coxiella burnetii. PLoS One 2011, 6:e26201.
29. Howden BP, McEvoy CR, Allen DL, Chua K, Gao W, Harrison PF, Bell J, Coombs G, Bennett-Wood V, Porter JL, Robins-Browne R, Davies JK, Seemann T, Stinear TP. Evolution of multidrug resistance during Staphylococcus aureus infection involves mutation of the essential two component regulator WalKR. PLoS Pathog 2011, 7:e1002359.
30. Köser CU, Ellington MJ, Cartwright EJ, Gillespie SH, Brown NM, Farrington M, Holden MT, Dougan G, Bentley SD, Parkhill J, Peacock SJ. Routine use of microbial whole genome sequencing in diagnostic and public health microbiology. PLoS Pathog 2012, 8:e1002824.
31. MacLean D, Jones JD, Studholme DJ. Application of " next-generation" sequencing technologies to microbial genetics. Nat Rev Microbiol 2009, 7:287-296.
32. Mellmann A, Harmsen D, Cummings CA, Zentz EB, Leopold SR, Rico A, Prior K, Szczepanowski R, Ji Y, Zhang W, McLaughlin SF, Henkhaus JK, Leopold B, Bielaszewska M, Prager R, Brzoska PM, Moore RL, Guenther S, Rothberg JM, Karch H. Prospective genomic characterization of the German enterohemorrhagic Escherichia coli O104:H4 outbreak by rapid next generation sequencing technology. PLoS One 2011, 6:e22751.
33. Rasko DA, Webster DR, Sahl JW, Bashir A, Boisen N, Scheutz F, Paxinos EE, Sebra R, Chin CS, Iliopoulos D, Klammer A, Peluso P, Lee L, Kislyuk AO, Bullard J, Kasarskis A, Wang S, Eid J, Rank D, Redman JC, Steyert SR, Frimodt-Møller J, Struve C, Petersen AM, Krogfelt KA, Nataro JP, Schadt EE, Waldor MK. Origins of the E. coli strain causing an outbreak of hemolytic-uremic syndrome in Germany. N Engl J Med 2011, 365:709-717.
34. Rohde H, Qin J, Cui Y, Li D, Loman NJ, Hentschke M, Chen W, Pu F, Peng Y, Li J, Xi F, Li S, Li Y, Zhang Z, Yang X, Zhao M, Wang P, Guan Y, Cen Z, Zhao X, Christner M, Kobbe R, Loos S, Oh J, Yang L, Danchin A, Gao GF, Song Y, Li Y, Yang H, et al. Open-source genomic analysis of Shiga-toxin-producing E. coli O104:H4. N Engl J Med 2011, 365:718-724.
35. Gardy JL, Johnston JC, Ho Sui SJ, Cook VJ, Shah L, Brodkin E, Rempel S, Moore R, Zhao Y, Holt R, Varhol R, Birol I, Lem M, Sharma MK, Elwood K, Jones SJ, Brinkman FS, Brunham RC, Tang P. Whole-genome sequencing and social-network analysis of a tuberculosis outbreak. N Engl J Med 2011, 364:730-739.
36. Harris SR, Feil EJ, Holden MT, Quail MA, Nickerson EK, Chantratita N, Gardete S, Tavares A, Day N, Lindsay JA, Edgeworth JD, de Lencastre H, Parkhill J, Peacock SJ, Bentley SD. Evolution of MRSA during hospital transmission and intercontinental spread. Science 2010, 327:469-474.
37. Harris SR, Cartwright EJ, Török ME, Holden MT, Brown NM, Ogilvy-Stuart AL, Ellington MJ, Quail MA, Bentley SD, Parkhill J, Peacock SJ. Whole-genome sequencing for analysis of an outbreak of meticillin-resistant Staphylococcus aureus: a descriptive study. Lancet Infect Dis 2013, 13:130-136.
38. Roetzer A, Diel R, Kohl TA, Rückert C, Nübel U, Blom J, Wirth T, Jaenicke S, Schuback S, Rüsch-Gerdes S, Supply P, Kalinowski J, Niemann S. Whole genome sequencing versus traditional genotyping for investigation of a Mycobacterium tuberculosis outbreak: a longitudinal molecular epidemiological study. PLoS Med 2013, 10:e1001387.
39. Walker TM, Ip CL, Harrell RH, Evans JT, Kapatai G, Dedicoat MJ, Eyre DW, Wilson DJ, Hawkey PM, Crook DW, Parkhill J, Harris D, Walker AS, Bowden R, Monk P, Smith EG, Peto TE. Whole-genome sequencing to delineate Mycobacterium tuberculosis outbreaks: a retrospective observational study. Lancet Infect Dis 2013, 13:137-146.
40. Loman NJ, Constantinidou C, Christner M, Rohde H, Chan JZ, Quick J, Weir JC, Quince C, Smith GP, Betley JR, Aepfelbacher M, Pallen MJ. A culture-independent sequence-based metagenomics approach to the investigation of an outbreak of Shiga-toxigenic Escherichia coli O104:H4. JAMA 2013, 309:1502-1510.
41. Stobbe AH, Daniels J, Espindola AS, Verma R, Melcher U, Ochoa-Corona F, Garzon C, Fletcher J, Schneider W. E-probe Diagnostic Nucleic acid Analysis (EDNA): a theoretical approach for handling of next generation sequencing data for diagnostics. J Microbiol Methods 2013, 94:356-366.
42. Stobbe AH, Schneider W, Hoyt P, Melcher U. Screening metagenomic data for viruses using the e-probe diagnostic nucleic acid assay (EDNA). Phytopathology in press.
43. Breeze RG, Budowle B, Schutzer SE. (Eds): Microbial Forensics 2005, Amsterdam: Academic Press.
44. Budowle B, Schutzer SE, Breeze RG, Keim PS, Morse SA. (Eds): Microbial Forensics 2011, Amsterdam: Academic Press, 2.
45. Budowle B, Schmedes S, Murch RS. The microbial forensics pathway for use of massively-parallel sequencing technologies. The Science and Applications of Microbial Genomics 2013, 117-133. Washington DC: The National Academies Press.
46. Sanger F, Nicklen S, Coulson AR. DNA sequencing with chain-terminating inhibitors. Proc Natl Acad Sci U S A 1977, 74:5463-5467.
47. Wetterstrand KS. DNA sequencing costs: data from the NHGRI Large-Scale Genome Sequencing Program 2013, Available at: https://www.genome.gov/sequencingcosts/.
48. Brenner S, Williams SR, Vermaas EH, Storck T, Moon K, McCollum C, Mao JI, Luo S, Kirchner JJ, Eletr S, DuBridge RB, Burcham T, Albrecht G. In vitro cloning of complex mixtures of DNA on microbeads: physical separation of differentially expressed cDNAs Proc Natl Acad Sci U S A 2000, 97:1665-1670.
49. Margulies M, Egholm M, Altman WE, Attiya S, Bader JS, Bemben LA, Berka J, Braverman MS, Chen YJ, Chen Z, Dewell SB, Du L, Fierro JM, Gomes XV, Godwin BC, He W, Helgesen S, Ho CH, Irzyk GP, Jando SC, Alenquer ML, Jarvie TP, Jirage KB, Kim JB, Knight JR, Lanza JR, Leamon JH, Lefkowitz SM, Lei M, Li J, et al. Genome sequencing in microfabricated high-density picolitre reactors. Nature 2005, 437:376-380.
50. Merriman B, Rothberg JM. Progress in ion torrent semiconductor chip based sequencing. Electrophoresis 2012, 33:3397-3417.
51. Metzker ML. Sequencing technologies - the next generation. Nat Rev Genet 2010, 11:31-46.
52. Quail MA, Kozarewa I, Smith F, Scally A, Stephens PJ, Durbin R, Swerdlow H, Turner DJ. A large genome center's improvements to the Illumina sequencing system. Nat Methods 2008, 5:1005-1010.
53. Shendure J, Ji H. Next-generation DNA sequencing. Nat Biotechnol 2008, 26:1135-1145.
54. Roberts RJ, Carneiro MO, Schatz MC. The advantages of SMRT sequencing. Genome Biol 2013, 14:405.
55. Flusberg BA, Webster DR, Lee JH, Travers KJ, Olivares EC, Clark TA, Korlach J, Turner SW. Direct detection of DNA methylation during single-molecule, real-time sequencing. Nat Methods 2010, 7:461-465.
56. Eisenstein M. Oxford Nanopore announcement sets sequencing sector abuzz. Nat Biotechnol 2012, 30:295-296.
57. Didelot X, Bowden R, Wilson DJ, Peto TE, Crook DW. Transforming clinical microbiology with bacterial genome sequencing. Nat Rev Genet 2012, 13:601-612.
58. Budowle B, Schutzer SE, Morse SA, Martinez KF, Chakraborty R, Marrone BL, Messenger SL, Murch RS, Jackson PJ, Williamson P, Harmon R, Velsko SP. Criteria for validation of methods in microbial forensics. Appl Environ Microbiol 2008, 74:5599-5607.
59. Rehm HL, Bale SJ, Bayrak-Toydemir P, Berg JS, Brown KK, Deignan JL, Friez MJ, Funke BH, Hegde MR, Lyon E. Working Group of the American College of Medical Genetics and Genomics Laboratory Quality Assurance Committee: ACMG clinical laboratory standards for next-generation sequencing. Genet Med 2013, 15:733-747.
60. Gargis AS, Kalman L, Berry MW, Bick DP, Dimmock DP, Hambuch T, Lu F, Lyon E, Voelkerding KV, Zehnbauer BA, Agarwala R, Bennett SF, Chen B, Chin EL, Compton JG, Das S, Farkas DH, Ferber MJ, Funke BH, Furtado MR, Ganova-Raeva LM, Geigenmüller U, Gunselman SJ, Hegde MR, Johnson PL, Kasarskis A, Kulkarni S, Lenk T, Liu CS, Manion M, et al. Assuring the quality of next-generation sequencing in clinical laboratory practice. Nat Biotechnol 2012, 30:1033-1036.
61. Pont-Kingdon G, Gedge F, Wooderchak-Donahue W, Schrijver I, Weck KE, Kant JA, Oglesbee D, Bayrak-Toydemir P, Lyon E. Biochemical and Molecular Genetic Resource Committee of the College of American Pathologists: Design and analytical validation of clinical DNA sequencing assays. Arch Pathol Lab Med 2012, 136:41-46.
62. SWGDAM Validation guidelines for DNA analysis methods. 2012, Available at: http://swgdam.org/SWGDAM_Validation_Guidelines_APPROVED_Dec_2012.pdf, SWGDAM.
63. Wu GD, Lewis JD, Hoffmann C, Chen YY, Knight R, Bittinger K, Hwang J, Chen J, Berkowsky R, Nessel L, Li H, Bushman FD. Sampling and pyrosequencing methods for characterizing bacterial communities in the human gut using 16S sequence tags. BMC Microbiol 2010, 10:206.
64. Kuczynski J, Lauber CL, Walters WA, Parfrey LW, Clemente JC, Gevers D, Knight R. Experimental and analytical tools for studying the human microbiome. Nat Rev Genet 2012, 13:47-58.
65. Daniel R. The metagenomics of soil. Nat Rev Microbiol 2005, 3:470-478.
66. DeLong EF. Microbial community genomics in the ocean. Nat Rev Microbiol 2005, 3:459-469.
67. Rusch DB, Halpern AL, Sutton G, Heidelberg KB, Williamson S, Yooseph S, Wu D, Eisen JA, Hoffman JM, Remington K, Beeson K, Tran B, Smith H, Baden-Tillson H, Stewart C, Thorpe J, Freeman J, Andrews-Pfannkoch C, Venter JE, Li K, Kravitz S, Heidelberg JF, Utterback T, Rogers YH, Falcón LI, Souza V, Bonilla-Rosso G, Eguiarte LE, Karl DM, Sathyendranath S, et al. The Sorcerer II Global Ocean Sampling expedition: northwest Atlantic through eastern tropical Pacific. PLoS Biol 2007, 5:e77.
68. Kembel SW, Jones E, Kline J, Northcutt D, Stenson J, Womack AM, Bohannan BJ, Brown GZ, Green JL. Architectural design influences the diversity and structure of the built environment microbiome. ISME J 2012, 6:1469-1479.
69. Human Microbiome Project Consortium Structure, function and diversity of the healthy human microbiome. Nature 2012, 486:207-214. Human Microbiome Project Consortium.
70. Human Microbiome Project Consortium A framework for human microbiome research. Nature 2012, 486:215-221. Human Microbiome Project Consortium.
71. Thomas T, Gilbert J, Meyer F. Metagenomics - a guide from sampling to data analysis. Microb Inform Exp 2012, 2:3.
72. Keim P, Price LB, Klevytska AM, Smith KL, Schupp JM, Okinaka R, Jackson PJ, Hugh-Jones ME. Multiple-locus variable-number tandem repeat analysis reveals genetic relationships within Bacillus anthracis. J Bacteriol 2000, 182:2928-2936.
73. Hoffmaster AR, Fitzgerald CC, Ribot E, Mayer LW, Popovic T. Molecular subtyping of Bacillus anthracis and the 2001 bioterrorism-associated anthrax outbreak, United States. Emerg Infect Dis 2002, 8:1111-1116.
74. Schutzer SE, Keim P, Czerwinski K, Budowle B. Use of forensic methods under exigent circumstances without full validation. Sci Transl Med 2009, 1:8cm7.
75. Budowle B, Schutzer SE, Burans JP, Beecher DJ, Cebula TA, Chakraborty R, Cobb WT, Fletcher J, Hale ML, Harris RB, Heitkamp MA, Keller FP, Kuske C, Leclerc JE, Marrone BL, McKenna TS, Morse SA, Rodriguez LL, Valentine NB, Yadev J. Quality sample collection, handling, and preservation for an effective microbial forensics program. Appl Environ Microbiol 2006, 72:6431-6438.
76. Ellard S, Charlton R, Lindsay H, Camm N, Watson C, Abb S. Mattocks C 2012, Practice Guidelines for Targeted Next Generation Sequencing Analysis and Interpretation. Clinical Molecular GeneticsSociety: Taylor GR, Available at: http://cmgsweb.shared.hosting.zen.co.uk/BPGs/BPG%20for%20targeted%20next%20generation%20sequencing%20final.pdf.
77. Illumina PCR-free sample preparation kits for whole genome DNA sequencing. 2013, Available at: http://www.illumina.com/products/truseq-dna-pcr-free-sample-prep-kits.ilmn, Illumina.
78. Agilent HaloPlex target enrichment system-ILM. 2013, Available at: http://www.chem.agilent.com/Library/usermanuals/Public/G9900-90001.pdf, Agilent.
79. Illumina Nextera XT DNA sample preparation kit. 2013, Available at: http://www.illumina.com/products/nextera_xt_dna_sample_prep_kit.ilmn, Illumina.
80. Thurber RV, Haynes M, Breitbart M, Wegley L, Rohwer F. Laboratory procedures to generate viral metagenomes. Nat Protoc 2009, 4:470-483.
81. Feehery G, Yigit E, Oyola S, Langhorst B, Schmidt V, Stewart FJ, Dimalanta ET, Amaral-Zettler LA, Davis T, Quail MA, Pradhan S. A method for selectively enriching microbial DNA from contaminating vertebrate host DNA. PLoS One 2013, 8:e76096.
82. Telenius H, Carter NP, Bebb CE, Nordenskjöld M, Ponder BA, Tunnacliffe A. Degenerate oligonucleotide-primed PCR: general amplification of target DNA by a single degenerate primer. Genomics 1992, 13:718-725.
83. Cheung VG, Nelson SF. Whole genome amplification using a degenerate oligonucleotide primer allows hundreds of genotypes to be performed on less than one nanogram of genomic DNA. Proc Natl Acad Sci U S A 1996, 93:14676-14679.
84. Dean FB, Hosono S, Fang L, Wu X, Faruqi AF, Bray-Ward P, Sun Z, Zong Q, Du Y, Du J, Driscoll M, Song W, Kingsmore SF, Egholm M, Lasken RS. Comprehensive human genome amplification using multiple displacement amplification. Proc Natl Acad Sci U S A 2002, 99:5261-5266.
85. Syed F, Gruenwald H, Caruccio N. Next-generation sequencing library preparation: simultaneous fragmentation and tagging using in vitro transposition. Nat Methods 2009, Available at: http://www.nature.com/nmeth/journal/v6/n11/full/nmeth.f.272.html.
86. Knapp M, Stiller M, Meyer M. Generating barcoded libraries for multiplex high-throughput sequencing. Methods Mol Biol 2012, 840:155-170.
87. Hamady M, Walker JJ, Harris JK, Gold NJ, Knight R. Error-correcting barcoded primers allow hundreds of samples to be pyrosequenced in multiplex. Nat Methods 2012, 5:235-237.
88. Caporaso JG, Lauber CL, Walters WA, Berg-Lyons D, Huntley J, Fierer N, Owens SM, Betley J, Fraser L, Bauer M, Gormley N, Gilbert JA, Smith G, Knight R. Ultra-high-throughput microbial community analysis on the Illumina HiSeq and MiSeq platforms. ISME J 2012, 6:1621-1624.
89. Berglund EC, Kiialainen A, Syvänen AC. Next-generation sequencing technologies and applications for human genetic history and forensics. Investig Genet 2011, 2:23.
90. Jünemann S, Sedlazeck FJ, Prior K, Albersmeier A, John U, Kalinowski J, Mellmann A, Goesmann A, von Haeseler A, Stoye J, Harmsen D. Updating benchtop sequencing performance comparison. Nat Biotechnol 2013, 31:294-296.
91. Loman NJ, Constantinidou C, Chan JZ, Halachev M, Sergeant M, Penn CW, Robinson ER, Pallen MJ. High-throughput bacterial genome sequencing: an embarrassment of choice, a world of opportunity. Nat Rev Microbiol 2012, 10:599-606.
92. Quail MA, Smith M, Coupland P, Otto TD, Harris SR, Connor TR, Bertoni A, Swerdlow HP, Gu Y. A tale of three next generation sequencing platforms: comparison of Ion Torrent. Pacific Biosciences and Illumina MiSeq sequencers. BMC Genomics 2012, 13:341.
93. Lam H, Clark M, Chen R, Natsoulis G, O'Huallachain M, Dewey FE, Habegger L, Ashley EA, Gerstein MB, Butte AJ, Ji HP, Snyder M. Performance comparison of whole-genome sequencing platforms. Nat Biotechnol 2011, 30:78-82.
94. Harismendy O, Ng P, Strausberg R, Wang X, Stockwell T, Beeson KY, Schork NJ, Murray SS, Topol EJ, Levy S, Frazer KA. Evaluation of next generation sequencing platforms for population targeted sequencing studies. Genome Biol 2009, 10:R32.
95. Ewing B, Green P. Base-calling of automated sequencer traces using phred. II. Error probabilities. Genome Res 1998, 8:186-194.
96. Hasan NA, Young BA, Minard-Smith EM, McMillan NJ, Isom R, Abdullah AS, Bornman DM, Faith SA, Choi SY, Longmire G, Dickens ML, Cebula TA, Colwell RR. Microbial community profiling of human saliva using shotgun metagenomic sequencing. PLoS One in press.
97. Ames SK, Hysom DA, Gardner SN, Lloyd GS, Gokhale MB, Allen JE. Scalable metagenomic taxonomy classification using a reference genome database. Bioinformatics 2013, 29:2253-2260.
98. Minot S, Turner SD, Ternus KL, Kadavy DR. SIANN: Strain identification by alignment to near neighbors 2014, Available at: http://biorxiv.org/lookup/doi/10.1101/001727.
99. Wood DE, Salzberg SL. Kraken: ultrafast metagenomic sequence classification using exact alignments. Genome Biol 2014, 15:R46.
100. Keim P, Kalif A, Schupp J, Hill K, Travis SE, Richmond K, Adair DM, Hugh-Jones M, Kuske CR, Jackson P. Molecular evolution and diversity in Bacillus anthracis as detected by amplified fragment length polymorphism markers. J Bacteriol 1997, 179:818-824.
101. Nocq J, Celton M, Gendron P, Lemieux S, Wilhelm BT. Harnessing virtual machines to simplify next-generation DNA sequencing analysis. Bioinformatics 2013, 29:2075-2083.
102. Board IS IEEE Standard 610.12 Glossary of software engineering terminology. 1990, Available at: http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?reload=true&punumber=2238, Board IS.
103. Crumpler S, Cheng J, Tillman DB, Benesch B, Sawyer D, Murray J, Press H, Snipes C, Godziemski A, Bergeson D, Loreng J. General principles of software validation; Final guidance for industry and FDA staff 2002, Available at: http://www.fda.gov/medicaldevices/deviceregulationandguidance/guidancedocuments/ucm085281.htm.
104. Deorowicz S, Grabowski S. Compression of DNA sequence reads in FASTQ format. Bioinformatics 2011, 27:860-862.
105. Bonfield J, Mahoney M. Compression of FASTQ and SAM format sequencing data. PLoS One 2013, 8:e59190.
106. Buckley M, Roberts RJ. Reconciling Microbial Systematics and Genomics 2007, Washington DC: American Academy of Microbiology, Available at: http://academy.asm.org/index.php/genetics-genomics-molecular-microbiology/454-reconciling-microbial-systematics-and-genomics.
107. Gonzalez-Candelas F, Bracho M, Wrobel B, Moya A. Molecular evolution in court analysis of a large hepatitis C virus outbreak from an evolving source. BMC Biol 2013, 11:76.
108. Treangen TJ, Koren S, Sommer DD, Liu B, Astrovskaya I, Ondov B, Darling AE, Phillippy AM, Pop M. MetAMOS: a modular and open source metagenomic assemblyand analysis pipeline. Genome Biol 2013, 14:R2.
109. Zerbino DR, Birney E. Velvet: algorithms for de novo short read assembly using de Bruijn graphs. Genome Res 2008, 18:821-829.
110. Narzisi G, Mishra B. Comparing de novo genome assembly: the long and short of it. PLoS One 2011, 6:e19175.
111. Hernandez D, François P, Farinelli L, Osterås M, Schrenzel J. De novo bacterial genome sequencing: millions of very short reads assembled on a desktop computer. Genome Res 2008, 18:802-809.
112. Chaisson MJ, Pevzner PA. Short read fragment assembly of bacterial genomes. Genome Res 2008, 18:324-330.
113. Bradnam KR, Fass JN, Alexandrov A, Baranay P, Bechner M, Birol I, Boisvert S, Chapman JA, Chapuis G, Chikhi R, Chitsaz H, Chou WC, Corbeil J, Del Fabbro C, Docking TR, Durbin R, Earl D, Emrich S, Fedotov P, Fonseca NA, Ganapathy G, Gibbs RA, Gnerre S, Godzaridis E, Goldstein S, Haimel M, Hall G, Haussler D, Hiatt JB, Ho IY, et al. Assemblathon 2: evaluating de novo methods of genome assembly in three vertebrate species. Gigascience 2013, 2:10.
114. Gurevich A, Saveliev V, Vyahhi N, Tesler G. QUAST: quality assessment tool for genome assemblies. Bioinformatics 2013, 29:1072-1075.
115. Hatem A, Bozdaǧ D, Toland AE, Çatalyürek T. Benchmarking short sequence mapping tools. BMC Bioinformatics 2013, 14:184.
116. Langmead B, Salzberg SL. Fast gapped-read alignment with Bowtie 2. Nat Methods 2012, 9:357-359.
117. Delcher AL, Phillippy A, Carlton J, Salzberg SL. Fast algorithms for large-scale genome alignment and comparison. Nucleic Acids Res 2002, 30:2478-2483.
118. McHardy AC, Martín HG, Tsirigos A, Hugenholtz P, Rigoutsos I. Accurate phylogenetic classification of variable-length DNA fragments. Nat Methods 2007, 4:63-72.
119. Patil KR, Roune L, McHardy AC. The PhyloPythiaS web server for taxonomic assignment of metagenome sequences. PLoS One 2012, 7:e38581.
120. Brady A, Salzberg SL. Phymm and PhymmBL: metagenomic phylogenetic classification with interpolated Markov models. Nat Methods 2009, 6:673-676.
121. Rosen GL, Reichenberger ER, Rosenfeld AM. NBC: the Naive Bayes Classification tool webserver for taxonomic classification of metagenomic reads. Bioinformatics 2011, 27:127-129.
122. Berendzen J, Bruno WJ, Cohn JD, Hengartner NW, Kuske R, McMahon BH, Wolinsky MA, Xie G. Rapid phylogenetic and functional classification of short genomic fragments with signature peptides. BMC Res Notes 2012, 5:460.
123. Huson DH, Auch AF, Qi J, Schuster SC. MEGAN analysis of metagenomic data. Genome Res 2007, 17:377-386.
124. Davenport CF, Neugebauer J, Beckmann N, Friedrich B, Kameri B, Kokott S, Paetow M, Siekmann B, Wieding-Drewes M, Wienhöfer M, Wolf S, Tümmler B, Ahlers V, Sprengel F. Genometa-a fast and accurate classifier for short metagenomic shotgun reads. PLoS One 2012, 7:e41224.
125. Sharma VK, Kumar N, Prakash T, Taylor TD. Fast and accurate taxonomic assignments of metagenomic sequences using MetaBin. PLoS One 2012, 7:e34030.
126. Liu B, Gibbons T, Ghodsi M, Treangen T, Pop M. Accurate and fast estimation of taxonomic profiles from metagenomic shotgun sequences. BMC Genomics 2011, 12(Suppl 2):S4.
127. Segata N, Waldron L, Ballarini A, Narasimhan V, Jousson O, Huttenhower C. Metagenomic microbial community profiling using unique clade-specific marker genes. Nat Methods 2012, 9:811-814.
128. Haft DH, Tovchigrechko A. High-speed microbial community profiling. Nat Methods 2012, 9:793-794.
129. Krause L, Diaz NN, Goesmann A, Kelley S, Nattkemper TW, Rohwer F, Edwards RA, Stoye J. Phylogenetic classification of short environmental DNA fragments. Nucleic Acids Res 2008, 36:2230-2239.
130. Gerlach W, Jünemann S, Tille F, Goesmann A, Stoye J. WebCARMA: a web application for the functional and taxonomic classification of unassembled metagenomic reads. BMC Bioinformatics 2009, 10:430.
131. Markowitz VM, Chen IM, Chu K, Szeto E, Palaniappan K, Grechkin Y, Ratner A, Jacob B, Pati A, Huntemann M, Liolios K, Pagani I, Anderson I, Mavromatis K, Ivanova NN, Kyrpides NC. IMG/M: the integrated metagenome data management and comparative analysis system. Nucleic Acids Res 2012, 40:D123-D129.
132. Meyer F, Paarmann D, D'Souza M, Olson R, Glass EM, Kubal M, Paczian T, Rodriguez A, Stevens R, Wilke A, Wilkening J, Edwards RA. The metagenomics RAST server - a public resource for the automatic phylogenetic and functional analysis of metagenomes. BMC Bioinformatics 2008, 9:386.
133. Wang Y, Leung HC, Yiu SM, Chin FY. MetaCluster 4.0: a novel binning algorithm for NGS reads and huge number of species. J Comput Biol 2012, 19:241-249.
134. MacDonald NJ, Parks DH, Beiko RG. Rapid identification of high-confidence taxonomic assignments for metagenomic data. Nucleic Acids Res 2012, 40:e111.
135. Brady A, Salzberg S. PhymmBL expanded: confidence scores, custom databases, parallelization and more. Nat Methods 2011, 8:367.
136. Bazinet A, Cummings M. A comparative evaluation of sequence classification programs. BMC Bioinformatics 2012, 13:1-13.
137. Fierer N, Lauber CL, Zhou N, Mcdonald D, Costello EK, Knight R. Forensic identification using skin bacterial communities. Proc Natl Acad Sci U S A 2010, 107:6477-6481.
138. Whittaker RH. Evolution and measurement of species diversity. Taxon 1972, 21:213-251.
139. Fricke WF, Rasko DA. Bacterial genome sequencing in the clinic: bioinformatic challenges and solutions. Nat Rev Genet 2013, 15:49-55.