Large-scale DNA sequence analysis in the cloud: A stream-based approach

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7156 LNCS, Issue PART 2, 2012, Pages 467-476

  Kienzler, Romeo ^a   Bruggmann, Rémy ^b   Ranganathan, Anand ^c   Tatbul, Nesime ^a  

^a ETH ZURICH   (Switzerland)

^b UNIVERSITY OF BERN   (Switzerland)

^c IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

cloud computing; data stream processing; DNA sequence analysis; incremental data processing; Next Generation Sequencing (NGS); NGS read alignment

Indexed keywords

CLOUD COMPUTING; COST EFFECTIVENESS; DATA STREAMS; DATA TRANSFER; DIGITAL STORAGE; DNA; DNA SEQUENCES; GENE ENCODING; HPSS; INFORMATION MANAGEMENT; PETROLEUM RESERVOIR EVALUATION; SCALABILITY;

CLOUD COMPUTING TECHNOLOGIES; DATA STREAM PROCESSING; DNA SEQUENCE ANALYSIS; IBM INFOSPHERE STREAMS; INCREMENTAL DATA; LARGE AMOUNTS OF DATA; NEXT-GENERATION SEQUENCING; PERFORMANCE PROBLEMS;

COST BENEFIT ANALYSIS;

EID: 84863480885     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-29740-3_52     Document Type: Conference Paper

References (27)

1. Amazon Elastic Compute Cloud, http://aws. amazon. com/ec2/
2. Apache Hadoop, http://hadoop. apache. org/
3. Functional Genomics Center Zurich, http://www. fgcz. ch/
4. Google MapReduce, http://labs. google. com/papers/mapreduce. html
5. IBM InfoSphere Streams, http://www. ibm. com/software/data/infosphere/ streams
6. The SAM Format Specification, samtools. sourceforge. net/SAM1. pdf
7. Abadi, D., Ahmad, Y., Balazinska, M., Cetintemel, U., Cherniack, M., Hwang, J., Lindner, W., Maskey, A., Rasin, A., Ryvkina, E., Tatbul, N., Xing, Y., Zdonik, S. : The Design of the Borealis Stream Processing Engine. In: Conference on Innovative Data Systems Research (CIDR 2005), Asilomar, CA (January 2005)
8. Altschul, S. F., Gish,W., Miller, W., Myers, E. W., Lipman, D. J. : Basic Local Alignment Search Tool. Journal of Molecular Biology 215(3) (October 1990)
9. Collins, F. S., Guyer, M., Chakravarti, A. : Variations on a Theme: Cataloging Human DNA Sequence Variation. Science 278(5343) (November 1997)
10. Deelman, E., Mehta, G., Singh, G., Su, M., Vahi, K. : Pegasus: mapping large-scale workflows to distributed resources. In: Workflows for e-Science, pp. 376-394 (2007)
11. Dudley, J. T., Butte, A. J. : In Silico Research in the Era of Cloud Computing. Nature Biotechnology 28(11) (2010)
12. Fernald, G. H., Capriotti, E., Daneshjou, R., Karczewski, K. J., Altman, R. B. : Bioinformatics Challenges for Personalized Medicine. Bioinformatics 27(13) (July 2011)
13. Gedik, B., Andrade, H., Wu, K. L., Yu, P. S., Doo, M. : SPADE: The System S Declarative Stream Processing Engine. In: ACM SIGMOD Conference, Vancouver, BC, Canada (June 2008)
14. Goecks, J., Nekrutenko, A., Taylor, J., Team, G. : Galaxy: A Comprehensive Approach for Supporting Accessible, Reproducible, and Transparent Computational Research in the Life Sciences. Genome Biology 11(8) (2010)
15. Graefe, G. : Query Evaluation Techniques for Large Databases. ACM Computing Surveys 25(2) (June 1993)
16. Keich, U., Ming, L., Ma, B., Tromp, J. : On Spaced Seeds for Similarity Search. Discrete Applied Mathematics 138(3) (April 2004)
17. Langmead, B., Schatz, M. C., Lin, J., Pop, M., Salzberg, S. L. : Searching for SNPs with Cloud Computing. Genome Biology 10(11) (2009)
18. Langmead, B., Trapnell, C., Pop, M., Salzberg, S. L. : Ultrafast and Memory-efficient Alignment of Short DNA Sequences to the Human Genome. Genome Biology 10(3) (2009)
19. Li, H., Homer, N. : A Survey of Sequence Alignment Algorithms for Next-Generation Sequencing. Briefings in Bioinformatics 11(5) (September 2010)
20. Li, R., Li, Y., Fang, X., Yang, H., Wang, J., Kristiansen, K., Wang, J. : SNP Detection for Massively Parallel Whole-Genome Resequencing. Genome Research 19(6) (June 2009)
21. Rumble, S. M., Lacroute, P., Dalca, A. V., Fiume, M., Sidow, A., Brudno, M. : SHRiMP: Accurate Mapping of Short Color-space Reads. PLOS Computational Biology 5(5) (May 2009)
22. Sanger, F., Coulson, A. R. : A Rapid Method for Determining Sequences in DNA by Primed Synthesis with DNA Polymerase. Journal of Mol. Biol. 94(3) (May 1975)
23. Schatz, M., Delcher, A., Salzberg, S. : Assembly of large genomes using secondgeneration sequencing. Genome Research 20(9), 1165 (2010)
24. Schatz, M. C. : CloudBurst: Highly Sensitive Read Mapping with MapReduce. Bioinformatics 25(11) (June 2009)
25. Stein, L. D. : The Case for Cloud Computing in Genome Informatics. Genome Biology 11(5) (2010)
26. Viedma, G., Olias, A., Parsons, P. : Genomics Processing in the Cloud. International Science Grid This Week (February 2011), http://www. isgtw. org/feature/genomics-processing-cloud
27. Voelkerding, K. V., Dames, S. A., Durtschi, J. D. : Next-Generation Sequencing: From Basic Research to Diagnostics. Clinical Chemistry 55(4) (February 2009)