Clustering huge protein sequence sets in linear time

Nature Communications

Volumn 9, Issue 1, 2018, Pages

  Steinegger, Martin ^a,b,c   Söding, Johannes ^a  

^a MAX PLANCK INSTITUTE FOR BIOPHYSICAL CHEMISTRY   (Germany)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^c Seoul National University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; CLUSTER ANALYSIS; DATA SET; DATABASE; GENOMICS; MEMORY; PROTEIN;

AMINO ACID SEQUENCE; ARTICLE; IDENTITY; MEMORY; METAGENOMICS; SEQUENCE DATABASE; ALGORITHM; ANIMAL; BIOLOGY; CHEMISTRY; CLUSTER ANALYSIS; DNA SEQUENCE; GENOME; HUMAN; INFORMATION PROCESSING; NUCLEIC ACID DATABASE; PROCEDURES; PROKARYOTIC CELL; PROTEIN DATABASE;

DNA; PROTEIN;

ALGORITHMS; ANIMALS; CLUSTER ANALYSIS; COMPUTATIONAL BIOLOGY; DATABASES, NUCLEIC ACID; DATABASES, PROTEIN; DATASETS AS TOPIC; DNA; GENOME; HUMANS; METAGENOMICS; PROKARYOTIC CELLS; PROTEINS; SEQUENCE ANALYSIS, DNA;

EID: 85049336634     PISSN: None     EISSN: 20411723     Source Type: Journal    
DOI: 10.1038/s41467-018-04964-5     Document Type: Article

References (33)

1. Rappe, M. S. & Giovannoni, S. J. The uncultured microbial majority. Ann. Rev. Microbiol. 57, 369-394 (2003).
2. Wilke, A. et al. The MG-RAST metagenomics database and portal in 2015. Nucleic Acids Res. 44, D590-D594 (2016).
3. Markowitz, V. M. et al. IMG/M 4 version of the integrated metagenome comparative analysis system. Nucleic Acids Res. 42, D568-D573 (2014).
4. Scholz, M. B., Lo, C.-C. & Chain, P. S. Next generation sequencing and bioinformatic bottlenecks: The current state of metagenomic data analysis. Curr. Opin. Biotechnol. 23, 9-15 (2012).
5. Desai, N., Antonopoulos, D., Gilbert, J. A., Glass, E. M. & Meyer, F. From genomics to metagenomics. Curr. Opin. Biotechnol. 23 72-76 (2012).
6. Prakash, T. & Taylor, T. D. Functional assignment of metagenomic data: challenges and applications. Brief. Bioinform. 13, 711-727 (2012).
7. Fu, L., Niu, B., Zhu, Z., Wu, S. & Li, W. CD-HIT: Accelerated for clustering the next-generation sequencing data. Bioinformatics 28, 3150-3152 (2012).
8. Edgar, R. C. Search and clustering orders of magnitude faster than BLAST. Bioinformatics 26, 2460-2461 (2010).
9. Li, W., Fu, L., Niu, B., Wu, S. & Wooley, J. Ultrafast clustering algorithms for metagenomic sequence analysis. Brief. Bioinform. 13, 656-668 (2012).
10. Steinegger, M. & Söding, J. MMseqs2 enables sensitive protein sequence searching for the analysis of massive data sets. Nat. Biotechnol. 35, 1026-1028 (2017).
11. Hauser, M., Steinegger, M. & Söding, J. MMseqs software suite for fast and deep clustering and searching of large protein sequence sets. Bioinformatics 32, 1323-1330 (2016).
12. Buchfink, B., Xie, C. & Huson, D. H. Fast and sensitive protein alignment using diamond. Nat. Methods 12, 59-60 (2015).
13. Ondov, B. D. et al. Mash: fast genome and metagenome distance estimation using minhash. Genome Biol. 17, 132 (2016).
14. Zhao, Y., Tang, H. & Ye, Y. RAPSearch2: A fast and memory-efficient protein similarity search tool for next-generation sequencing data. Bioinformatics 28, 125-126 (2012).
15. Altschul, S. F., Gish, W., Miller, W., Myers, E. W. & Lipman, D. J. Basic local alignment search tool. J. Mol. Biol. 215, 403-410 (1990).
16. Mirdita, M. et al. Uniclust databases of clustered and deeply annotated protein sequences and alignments. Nucleic Acids Res. 45, D170-D176 (2017).
17. Gene Ontology Consortium. Gene ontology consortium: going forward. Nucleic Acids Res. 43, D1049-D1056 (2015).
18. Finn, R. D. et al. The pfam protein families database: Towards a more sustainable future. Nucleic Acids Res. 44, D279-D285 (2016).
19. Hyatt, D. et al. Prodigal: prokaryotic gene recognition and translation initiation site identification. BMC Bioinforma. 11, 119 (2010).
20. Kodama, Y., Shumway, M. & Leinonen, R. The sequence read archive: explosive growth of sequencing data. Nucleic Acids Res. 40, D54-D56 (2012).
21. Sunagawa, S. et al., Structure and function of the global ocean microbiome, Science, 348, no. 6237, pp. 1261359-1-9, (2015).
22. Ovchinnikov, S. et al. Protein structure determination using metagenome sequence data. Science 355, 294-298 (2017).
23. Hopf, T. A. et al. Mutation effects predicted from sequence co-variation. Nat. Biotechnol. 35, 128-135 (2017).
24. Day, W. H. & Edelsbrunner, H. Efficient algorithms for agglomerative hierarchical clustering methods,. J. Classif. 1, 7-24 (1984).
25. McCallum, A. Nigam, K. & Ungar, L. H. Efficient clustering of high-dimensional data sets with application to reference matching. In Proc. 6th ACM SIGKDD International Conference on Knowledge Discovery and Data mining. 169-178 (ACM, 2000).
26. Li, W. & Godzik, A. Cd-hit: A fast program for clustering and comparing large sets of protein or nucleotide sequences. Bioinformatics 22, 1658-1659 (2006).
27. Hauser, M., Mayer, C. & Soding, J. kClust: fast and sensitive clustering of large protein sequence databases. BMC Bioinforma. 14, 248 (2013).
28. Marshall J. A. & Rafsky L. C. Exact clustering in linear time. Preprint at https://arxiv.org/abs/1702.05425 (2017).
29. Wang, J. Shen, H. T., Song, J. & Ji., J. Hashing for similarity search: A survey. Preprint at https://arxiv.org/abs/1408.2927 (2014).
30. Albertsen, M. et al. Genome sequences of rare, uncultured bacteria obtained by differential coverage binning of multiple metagenomes. Nat. Biotechnol. 31, 533-538 (2013).
31. Bairoch, A. et al. The Universal Protein Resource (UniProt). Nucleic Acids Res. 33(Suppl. 1), D154-D159 (2005).
32. Zhao, M. Lee, W.-P. Garrison, E. P. & Marth, G. T. SSW Library: An SIMD Smith-Waterman C/C++ library for use in genomic applications. PLoS ONE 8, e82138 (2013).
33. Sheetlin, S., Park, Y., Frith, M. C. & Spouge, J. L. ALP & FALP: C++ libraries for pairwise local alignment E-values. Bioinformatics 32, 304-305 (2015).