Tentacle: Distributed quantification of genes in metagenomes

GigaScience

Volumn 4, Issue 1, 2015, Pages

  Boulund, Fredrik ^a   Sjögren, Anders ^a   Kristiansson, Erik ^a  

^a CHALMERS UNIVERSITY OF TECHNOLOGY   (Sweden)

Author keywords

Distributed computing; DNA sequence analysis; DNA sequencing; Gene quantification; Master worker; Metagenomics; Next generation sequencing; Read mapping

Indexed keywords

DNA FRAGMENT;

ARTICLE; DATA PROCESSING; DNA SEQUENCE; GENE; MATHEMATICAL COMPUTING; METAGENOME; METAGENOMICS; NEXT GENERATION SEQUENCING; NONHUMAN; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; SEQUENCE ALIGNMENT; BIOLOGY;

COMPUTATIONAL BIOLOGY; METAGENOME;

EID: 84979530154     PISSN: None     EISSN: 2047217X     Source Type: Journal    
DOI: 10.1186/s13742-015-0078-1     Document Type: Article

References (53)

1. Baker M. Next-generation sequencing: adjusting to data overload. Nature Methods. 2010; 7. Available from: http://dx.doi.org/10.1038/nmeth0710-495
2. Cochrane G, Alako B, Amid C, Bower L, Ana C, Cleland I, et al. Facing growth in the European Nucleotide Archive. Nucleic Acids Res. 2013;41(Database issue):D30-D35. Available from: http://dx.doi.org/10.1093/nar/gks1175
3. Scholz M, Lo C, Chain P. Next generation sequencing and bioinformatic bottlenecks: the current state of metagenomic data analysis. Curr Opin Biotechnol. 2012;23(1):9-15. Available from: http://dx.doi.org/10.1016/j.copbio.2011.11.013
4. Handelsman J. Metagenomics: application of genomics to uncultured microorganisms. Microbiol Mol Biol Rev: MMBR. 2004;68(4):669-85. Available from: http://dx.doi.org/10.1128/MMBR.68.4.669-685.2004
5. Gilbert J, Dupont C. Microbial metagenomics: beyond the genome. Ann Rev Mar Sci. 2011;3:347-71. Available from: http://dx.doi.org/10.1146/annurev-marine-120709-142811
6. Qin J, Li R, Raes J, Arumugam M, Burgdorf K, Manichanh C, et al. A human gut microbial gene catalogue established by metagenomic sequencing. Nature. 2010;464(7285):59-65. Available from: http://dx.doi.org/10.1038/nature08821
7. Turnbaugh P, Ley R, Hamady M, Claire F, Knight R, Gordon J. The human microbiome project. Nature. 2007;449(7164):804-810. Available from: http://dx.doi.org/10.1038/nature06244
8. Gilbert JA, Bailey M, Field D, Fierer N, Fuhrman JA, Hu B, et al. The Earth Microbiome Project: The meeting report for the 1st International Earth Microbiome Project Conference, Shenzhen, China, June 13th-15th 2011. Stand Genomic Sci. 2011;5(2):243
9. Gilbert J, Jansson J, Knight R. The Earth Microbiome project: successes and aspirations. BMC Biology. 2014;12(1):69
10. Reddy TBK, Thomas AD, Stamatis D, Bertsch J, Isbandi M, Jansson J, et al. The Genomes OnLine Database (GOLD) v.5: a metadata management system based on a four level (meta)genome project classification. Nucleic Acids Res. 2014. Available from: http://dx.doi.org/10.1093/nar/gku950
11. Curtis T, Sloan W, Scannell J. Estimating prokaryotic diversity and its limits. Proc Natl Acad Sci USAs. 2002;99(16):10494-9. Available from: http://dx.doi.org/10.1073/pnas.142680199
12. Li H, Homer N. A survey of sequence alignment algorithms for next-generation sequencing. Brief Bioinform. 2010;11(5):473-83. Available from: http://dx.doi.org/10.1093/bib/bbq015
13. Hatem A, Bozdag D, Toland A, çatalyürek UV. Benchmarking short sequence mapping tools. BMC Bioinforma. 2013;14(1):184. Available from: http://dx.doi.org/10.1186/1471-2105-14-184
14. Altschul S, Madden T, Schäffer A, Zhang J, Zhang Z, Miller W, et al. Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res. 1997;25(17):3389-402. Available from: http://dx.doi.org/10.1093/nar/25.17.3389
15. Grant J, Dunbrack R, Manion F, Ochs M. BeoBLAST: distributed BLAST and PSI-BLAST on a Beowulf cluster. Bioinformatics (Oxford, England). 2002;18(5):765-6. Available from: http://dx.doi.org/10.1093/bioinformatics/18.5.765
16. Carvalho P, Glória R, de Miranda A, Degrave W. Squid-a simple bioinformatics grid. BMC bioinforma. 2005;6(1):197. Available from: http://dx.doi.org/10.1186/1471-2105-6-197
17. Yang C, Han T, Kan H. G-BLAST: a Grid-based solution for mpiBLAST on computational Grids. Concurr Comput: Pract Exper. 2009;21(2):225-55. Available from: http://dx.doi.org/10.1002/cpe.1346
18. Darling A, Carey L, Feng WC. The design, implementation, and evaluation of mpiBLAST (Best Paper: Applications Track). 4th International Conference on Linux Clusters: The HPC Revolution 2003 in conjunction with ClusterWorld Conference & Expo. 2003:14
19. Wang J, Mu Q. Soap-HT-BLAST: high throughput BLAST based on Web services. Bioinformatics (Oxford, England). 2003;19(14):1863-4. Available from: http://dx.doi.org/10.1093/bioinformatics/btg244
20. Dowd S, Zaragoza J, Rodriguez J, Oliver M, Payton P. Windows .NET network distributed basic local alignment search toolkit (W.ND-BLAST). BMC bioinformatics. 2005;6(1):93. Available from: http://dx.doi.org/10.1186/1471-2105-6-93
21. Angiuoli SV, Matalka M, Gussman A, Galens K, Vangala M, Riley DR, et al. CloVR: a virtual machine for automated and portable sequence analysis from the desktop using cloud computing. BMC bioinformatics. 2011;12(1):356
22. Pandey RV, Schlötterer C. DistMap: A toolkit for distributed short read mapping on a hadoop cluster. PLoS ONE. 2013 08;8(8):e72614. Available from: http://dx.doi.org/10.1371/journal.pone.0072614
23. Schatz M. CloudBurst: highly sensitive read mapping with MapReduce. Bioinformatics (Oxford, England). 2009;25(11):1363-9. Available from: http://dx.doi.org/10.1093/bioinformatics/btp236
24. Nguyen T, Shi W, Ruden D. CloudAligner: A fast and full-featured MapReduce based tool for sequence mapping. BMC research notes. 2011;4(1):171. Available from: http://dx.doi.org/10.1186/1756-0500-4-171
25. Karczewski KJ, Fernald GH, Martin AR, Snyder M, Tatonetti NP, Dudley JT. STORMSeq: an open-source, user-friendly pipeline for processing personal genomics data in the cloud. PLoS ONE. 2014 01;9(1):e84860. Available from:http://dx.doi.org/10.1371/journal.pone.0084860
26. Caporaso JG, Kuczynski J, Stombaugh J, Bittinger K, Bushman FD, Costello EK, et al. QIIME allows analysis of high-throughput community sequencing data. Nat Methods. 2010;7(5):335-6
27. iMatix Corporation. ZeroMQ. 2014. Available from: http://www.zeromq. org/.Accessed 22 Aug 2015
28. Hannon lab. FASTX-Toolkit. 2014. Available from: http://hannonlab.cshl.edu/fastx_toolkit. Accessed 22 Aug 2015
29. Langmead B, Salzberg S. Fast gapped-read alignment with Bowtie 2. Nat methods. 2012;9(4):357-359. Available from: http://dx.doi.org/10.1038/nmeth.1923
30. Kent W. BLAT-the BLAST-like alignment tool. Genome res. 2002;12(4): 656-664. Available from: http://dx.doi.org/10.1101/gr.229202
31. Meng W. Pblat-blat with multi-threads support. 2015. Available from: http://icebert.github.io/pblat/. Accessed 22 Aug 2015
32. Santiago M, Sammeth M, Guigó R, Ribeca P. The GEM mapper: fast, accurate and versatile alignment by filtration. Nat methods. 2012;9(12): 1185-8. Available from: http://dx.doi.org/10.1038/nmeth.2221
33. Weese D, Holtgrewe M, Reinert K. RazerS 3 faster, fully sensitive read mapping. Bioinformatics (Oxford, England). 2012;28(20):2592-9. Available from: http://dx.doi.org/10.1093/bioinformatics/bts505
34. Edgar RC. Search and clustering orders of magnitude faster than BLAST. Bioinformatics. 2010;26(19):2460-1
35. Boulund F, Sjögren A, Kristiansson E. Tentacle. 2014. Available from: http://bioinformatics.math.chalmers.se/tentacle/. Accessed 22 Aug 2015
36. Sched MD. Slurm. 2014. Available from: http://slurm.schedmd.com/. Accessed 22 Aug 2015
37. Pérez F, Granger BE. IPython: a System for Interactive Scientific Computing. Comput Sci Eng. 2007 May;9(3):21-9. Available from: http://ipython.org. Accessed 22 Aug 2015
38. Boulund F, Sjögren A, Kristiansson E. Tentacle scaling benchmark. 2015. Available from: http://dx.doi.org/10.6084/m9.figshare.1403608
39. Atallah MJ. Algorithms and theory of computation handbook: Danvers, MA: CRC press; 1998
40. Forum MPI. MPI: A message-passing interface standard. Version 3.0. 2012. Available from: http://www.mpi-forum.org/docs/mpi-3.0/mpi30-report.pdf
41. Gottumukkala N, Nassar R, Paun M, Leangsuksun C, Scott S. Reliability of a System of k Nodes for High Performance Computing Applications. IEEE Trans Reliab. 2010;59(1):162-9. Available from: http://dx.doi.org/10.1109/TR.2009.2034291
42. Armbrust M, Fox A, Griffith R, Joseph AD, Katz R, Konwinski A, et al. A view of cloud computing. Commun ACM. 2010;53(4):50-8
43. Dean J, Ghemawat S. MapReduce: simplified data processing on large clusters. Commun ACM. 2008;51(1):107-13
44. White T. Hadoop: The definitive guide. Sebastobol, California: O'Reilly Media, Inc; 2012
45. Mande S, Mohammed M, Ghosh T. Classification of metagenomic sequences: methods and challenges. Brief Bioinform. 2012;13(6):669-81. Available from: http://dx.doi.org/10.1093/bib/bbs054
46. Schbath S, Martin V, Zytnicki M, Fayolle J, Loux V, Gibrat J. Mapping reads on a genomic sequence: an algorithmic overview and a practical comparative analysis. J Comput Biol: J Mol Cell Biol. 2012;19(6):796-813. Available from: http://dx.doi.org/10.1089/cmb.2012.0022
47. Roguski L, Deorowicz S. DSRC 2-Industry-oriented compression of FASTQ files. Bioinformatics. 2014;30(15):2213-5. Available from: http://dx.doi.org/10.1093/bioinformatics/btu208
48. Rodgers DP. Improvements in Multiprocessor System Design. SIGARCH Comput Archit News. 1985 Jun;13(3):225-31. Available from: http://doi.acm.org/10.1145/327070.327215
49. Meyer F, Paarmann D, D'Souza M, Olson R, Glass E, Kubal M, et al. The metagenomics RAST server-a public resource for the automatic phylogenetic and functional analysis of metagenomes. BMC Bioinformatics. 2008;9:386
50. Langmead B, Trapnell C, Pop M, Salzberg S. Ultrafast and memory-efficient alignment of short DNA sequences to the human genome. Genome Biol. 2009;10(3):R25. Available from: http://genomebiology.com/2009/10/3/R25
51. Boulund F, Sjögren A, Kristiansson E. Tentacle open source repository at Bitbucket. 2014. Available from: http://www.bitbucket.org/chalmersmathbioinformatics/tentacle. Accessed 22 Aug 2015
52. Boulund F, Sjögren A, Kristiansson E. Supporting materials and software for "Tentacle: distributed quantification of genes in metagenomes". 2015. Available from: http://dx.doi.org/10.5524/100152
53. Kristiansson E. 1928 Diagnostics. Resqu. 2014. Available from: http://www.1928diagnostics.com/resdb/. Accessed 22 Aug 2015