Limits to robustness and reproducibility in the demarcation of operational taxonomic units

Environmental Microbiology

Volumn 17, Issue 5, 2015, Pages 1689-1706

  Schmidt, Thomas S B ^a   Matias Rodrigues, João F ^a   von Mering, Christian ^a  

^a UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

BACTERIA (MICROORGANISMS); OTUS;

RNA 16S;

ALGORITHM; CLUSTER ANALYSIS; GENETICS; HIGH THROUGHPUT SEQUENCING; HUMAN; MICROBIOLOGY; MICROFLORA; NUCLEOTIDE SEQUENCE; PROCEDURES; REPRODUCIBILITY; SEQUENCE ANALYSIS; SKIN;

ALGORITHMS; BASE SEQUENCE; CLUSTER ANALYSIS; HIGH-THROUGHPUT NUCLEOTIDE SEQUENCING; HUMANS; MICROBIOTA; REPRODUCIBILITY OF RESULTS; RNA, RIBOSOMAL, 16S; SEQUENCE ANALYSIS; SKIN;

EID: 84928253083     PISSN: 14622912     EISSN: 14622920     Source Type: Journal    
DOI: 10.1111/1462-2920.12610     Document Type: Article

References (66)

1. Achtman, M., and Wagner, M. (2008) Microbial diversity and the genetic nature of microbial species. Nat Rev Microbiol 6: 431-440.
2. Barriuso, J., Valverde, J.R., and Mellado, R.P. (2011) Estimation of bacterial diversity using next generation sequencing of 16S rDNA: a comparison of different workflows. BMC Bioinformatics 12: 473.
3. Benson, D.A., Cavanaugh, M., Clark, K., Karsch-Mizrachi, I., Lipman, D.J., Ostell, J., and Sayers, E.W. (2013) GenBank. Nucleic Acids Res 41: D36-D42.
4. Bonder, M.J., Abeln, S., Zaura, E., and Brandt, B.W. (2012) Comparing clustering and pre-processing in taxonomy analysis. Bioinformatics 28: 2891-2897.
5. Bray, J.R., and Curtis, J.T. (1957) An ordination of the upland forest communities of southern Wisconsin. Ecol Monogr 27: 325-349.
6. Cai, Y., and Sun, Y. (2011) ESPRIT-Tree: hierarchical clustering analysis of millions of 16S rRNA pyrosequences in quasilinear computational time. Nucleic Acids Res 39: e95.
7. Caporaso, J.G., Kuczynski, J., Stombaugh, J., Bittinger, K., Bushman, F.D., Costello, E.K., etal. (2010) QIIME allows analysis of high-throughput community sequencing data. Nat Methods 7: 335-336.
8. Casadevall, A., and Fang, F.C. (2010) Reproducible science. Infect Immun 78: 4972-4975.
9. Chao, A. (1984) Nonparametric estimation of the number of classes in a population. Scand J Stat 11: 265-270.
10. Chao, A., Chazdon, R.L., Colwell, R.K., and Shen, T.-J. (2004) A new statistical approach for assessing similarity of species composition with incidence and abundance data. Ecol Lett 8: 148-159.
11. Chen, W., Cheng, Y., Zhang, C., Zhang, S., and Zhao, H. (2013) MSClust: a multi-seeds based clustering algorithm for microbiome profiling using 16S rRNA sequence. J Microbiol Methods 94: 347-355.
12. Chen, W., Zhang, C.K., Cheng, Y., Zhang, S., and Zhao, H. (2013) A comparison of methods for clustering 16S rRNA sequences into OTUs. PLoS ONE 8: e70837.
13. Cheng, L., Walker, A.W., and Corander, J. (2012) Bayesian estimation of bacterial community composition from 454 sequencing data. Nucleic Acids Res 40: 5240-5249.
14. Cohan, F.M. (2006) Towards a conceptual and operational union of bacterial systematics, ecology, and evolution. Philos Trans R Soc Lond B Biol Sci 361: 1985-1996.
15. Cole, J.R., Wang, Q., Fish, J.A., Chai, B., McGarrell, D.M., Sun, Y., etal. (2013) Ribosomal Database Project: data and tools for high throughput rRNA analysis. Nucleic Acids Res 42: D633-D642.
16. DeSantis, T.Z., Hugenholtz, P., Larsen, N., Rojas, M., Brodie, E.L., Keller, K., etal. (2006) Greengenes, a chimera-checked 16S rRNA gene database and workbench compatible with ARB. Appl Environ Microbiol 72: 5069-5072.
17. Dice, L.R. (1945) Measures of the amount of ecologic association between species. Ecology 26: 297-302.
18. Doolittle, W.F., and Papke, R.T. (2006) Genomics and the bacterial species problem. Genome Biol 7: 116.
19. Doolittle, W.F., and Zhaxybayeva, O. (2009) On the origin of prokaryotic species. Genome Res 19: 744-756.
20. Drummond, C. (2009) Replicability is Not Reproducibility: Nor is It Good Science. Proc Eval Meth Mach Learn Workshop 26th ICML. Montreal, Quebec, Canada.
21. Edgar, R.C. (2010) Search and clustering orders of magnitude faster than BLAST. Bioinformatics 26: 2460-2461.
22. Edgar, R.C. (2013) UPARSE: highly accurate OTU sequences from microbial amplicon reads. Nat Methods 10: 996-998.
23. Edgar, R.C., Haas, B.J., Clemente, J.C., Quince, C., and Knight, R. (2011) UCHIME improves sensitivity and speed of chimera detection. Bioinformatics 27: 2194-2200.
24. Fred, A., and Jain, A.K. (2003) Robust data clustering. In Proc IEEE Conference Comp Vision Pattern Recognition. Madison, WI, USA: IEEE Computer Society, pp. II/128-II/133.
25. Fu, L., Niu, B., Zhu, Z., Wu, S., and Li, W. (2012) CD-HIT: accelerated for clustering the next-generation sequencing data. Bioinformatics 28: 3150-3152.
26. Gevers, D., Cohan, F.M., Lawrence, J.G., Spratt, B.G., Coenye, T., Feil, E.J., etal. (2005) Re-evaluating prokaryotic species. Nat Rev Microbiol 3: 733-739.
27. Gilbert, J., Meyer, F., Antonopoulos, D.A., Balaji, P., Brown, C.T., Brown, C.T., etal. (2010) Meeting report: the terabase metagenomics workshop and the vision of an Earth microbiome project. Stand Genomic Sci 3: 243-248.
28. Grice, E.A., Kong, H.H., Conlan, S., Deming, C.B., Davis, J., Young, A.C., etal. (2009) Topographical and temporal diversity of the human skin microbiome. Science 324: 1190-1192.
29. Hao, X., Jiang, R., and Chen, T. (2011) Clustering 16S rRNA for OTU prediction: a method of unsupervised Bayesian clustering. Bioinformatics 27: 611-618.
30. Horn, H.S. (1966) Measurement of 'overlap' in comparative ecological studies. Amer Naturalist 100: 419-424.
31. Hubert, L., and Arabie, P. (1985) Comparing partitions. J Classification 2: 193-218.
32. Huse, S.M., Welch, D.M., Morrison, H.G., and Sogin, M.L. (2010) Ironing out the wrinkles in the rare biosphere through improved OTU clustering. Environ Microbiol 12: 1889-1898.
33. Kim, M., Morrison, M., and Yu, Z. (2011) Evaluation of different partial 16S rRNA gene sequence regions for phylogenetic analysis of microbiomes. J Microbiol Methods 84: 81-87.
34. Koeppel, A., Perry, E.B., Sikorski, J., Krizanc, D., Warner, A., Ward, D.M., etal. (2008) Identifying the fundamental units of bacterial diversity: a paradigm shift to incorporate ecology into bacterial systematics. Proc Natl Acad Sci USA 105: 2504-2509.
35. Koeppel, A.F., and Wu, M. (2013) Surprisingly extensive mixed phylogenetic and ecological signals among bacterial Operational Taxonomic Units. Nucleic Acids Res 41: 5175-5188.
36. Lane, D.J., Pace, B., Olsen, G.J., Stahl, D.A., Sogin, M.L., and Pace, N.R. (1985) Rapid determination of 16S ribosomal RNA sequences for phylogenetic analyses. Proc Natl Acad Sci USA 82: 6955-6959.
37. Li, W., and Godzik, A. (2006) Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequences. Bioinformatics 22: 1658-1659.
38. Li, W., Fu, L., Niu, B., Wu, S., and Wooley, J. (2012) Ultrafast clustering algorithms for metagenomic sequence analysis. Brief Bioinform 13: 656-668.
39. Matias Rodrigues, J.F., and von Mering, C. (2014) HPC-CLUST: distributed hierarchical clustering for large sets of nucleotide sequences. Bioinformatics 30: 287-288.
40. Nawrocki, E.P. (2009) Structural RNA homology search and alignment using covariance models. PhD Thesis. St Louis, USA: Washington University School of Medicine.
41. Nawrocki, E.P., Kolbe, D.L., and Eddy, S.R. (2009) Infernal 1.0: inference of RNA alignments. Bioinformatics 25: 1335-1337.
42. Olsen, G.J., Lane, D.J., Giovannoni, S.J., Pace, N.R., and Stahl, D.A. (1986) Microbial ecology and evolution: a ribosomal RNA approach. Annu Rev Microbiol 40: 337-365.
43. Pagani, I., Liolios, K., Jansson, J., Chen, I.-M.A., Smirnova, T., Nosrat, B., etal. (2012) The Genomes OnLine Database (GOLD) v.4: status of genomic and metagenomic projects and their associated metadata. Nucleic Acids Res 40: D571-D579.
44. Preheim, S.P., Perrotta, A.R., Martin-Platero, A.M., Gupta, A., and Alm, E.J. (2013) Distribution-based clustering: using ecology to refine the Operational Taxonomic Unit. Appl Environ Microbiol 79: 6593-6603.
45. Pruitt, K.D., Tatusova, T., Brown, G.R., and Maglott, D.R. (2011) NCBI Reference Sequences (RefSeq): current status, new features and genome annotation policy. Nucleic Acids Res 40: D130-D135.
46. Rasheed, Z., Rangwala, H., and Barbará, D. (2013) 16S rRNA metagenome clustering and diversity estimation using locality sensitive hashing. BMC Syst Biol 7 (Suppl. 4): S11.
47. Schloss, P.D. (2010) The effects of alignment quality, distance calculation method, sequence filtering, and region on the analysis of 16S rRNA gene-based studies. PLoS Comput Biol 6: e1000844.
48. Schloss, P.D. (2012) Secondary structure improves OTU assignments of 16S rRNA gene sequences. ISME J 7 (Suppl. 4): 511.
49. Schloss, P.D., and Westcott, S.L. (2011) Assessing and improving methods used in Operational Taxonomic Unit-based approaches for 16S rRNA gene sequence analysis. Appl Environ Microbiol 77: 3219-3226.
50. Schloss, P.D., Westcott, S.L., Rabyn, T., Hall, J.R., Hartmann, M., Hollister, E.B., etal. (2009) Introducing mothur: open-source, platform-independent, community-supported software for describing and comparing microbial communities. Appl Environ Microbiol 75: 7537-7541.
51. Schloss, P.D., Gevers, D., and Westcott, S.L. (2011) Reducing the effects of PCR amplification and sequencing artifacts on 16S rRNA-based studies. PLoS ONE 6: e27310.
52. Schmidt, T.S.B., Matias Rodrigues, J.F., and von Mering, C. (2014) Ecological consistency of SSU rRNA-based Operational Taxonomic Units at a global scale. PLoS Comput Biol 10: e1003594.
53. Shannon, C.E. (1948) A mathematical theory of communication. AT&T Tech J 27: 623-656.
54. Simpson, E.H. (1949) Measurement of diversity. Nature 163: 688-688.
55. Sun, Y., Cai, Y., Liu, L., Yu, F., Farrell, M.L., McKendree, W., and Farmerie, W. (2009) ESPRIT: estimating species richness using large collections of 16S rRNA pyrosequences. Nucleic Acids Res 37: e76.
56. Sun, Y., Cai, Y., Huse, S.M., Knight, R., Farmerie, W.G., Wang, X., and Mai, V. (2011) A large-scale benchmark study of existing algorithms for taxonomy-independent microbial community analysis. Brief Bioinform 13: 107-121.
57. The Human Microbiome Project Consortium (2012a) A framework for human microbiome research. Nature 486: 215-221.
58. The Human Microbiome Project Consortium (2012b) Structure, function and diversity of the healthy human microbiome. Nature 486: 207-214.
59. Vinh, N.X., Epps, J., and Bailey, J. (2010) Information theoretic measures for clustering comparison: variants, properties, normalization and correction for chance. J Mach Learn Res 11: 2837-2854.
60. Wang, X., Cai, Y., Sun, Y., Knight, R., and Mai, V. (2011) Secondary structure information does not improve OTU assignment for partial 16S rRNA sequences. ISME J 6: 1277-1280.
61. Wang, X., Yao, J., Sun, Y., and Mai, V. (2013) M-pick, a modularity-based method for OTU picking of 16S rRNA sequences. BMC Bioinformatics 14: 43.
62. Wei, D., Jiang, Q., Wei, Y., and Wang, S. (2012) A novel hierarchical clustering algorithm for gene sequences. BMC Bioinformatics 13: 174.
63. White, J.R., Navlakha, S., Nagarajan, N., Ghodsi, M.-R., Kingsford, C., and Pop, M. (2010) Alignment and clustering of phylogenetic markers - implications for microbial diversity studies. BMC Bioinformatics 11: 152.
64. Yilmaz, P., Parfrey, L.W., Yarza, P., Gerken, J., Pruesse, E., Quast, C., etal. (2013) The SILVA and 'All-species Living Tree Project (LTP)' taxonomic frameworks. Nucleic Acids Res 42: D643-D648.
65. Zhang, J., Kapli, P., Pavlidis, P., and Stamatakis, A. (2013) A general species delimitation method with applications to phylogenetic placements. Bioinformatics 29: 2869-2876.
66. Zheng, Z., Kramer, S., and Schmidt, B. (2012) DySC: software for greedy clustering of 16S rRNA reads. Bioinformatics 28: 2182-2183.