Understanding MapReduce-based next-generation sequencing alignment on distributed cyberinfrastructure

ECMLS 2012 - 3rd International Emerging Computational Methods for the Life Sciences Workshop

Volumn , Issue , 2012, Pages 3-11

  Mantha, Pradeep Kumar ^a   Kim, Nayong ^a   Luckow, Andre ^a   Kim, Joohyun ^a   Jha, Shantenu ^b  

^a LOUISIANA STATE UNIVERSITY   (United States)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

bowtie; bwa; distributed computing; genome sequence alignment; human genome; mapreduce; pilot job and data; rna seq data; simple api for grid applications (saga)

Indexed keywords

BOW TIE; BWA; GENOME SEQUENCES; GRID APPLICATIONS; HUMAN GENOMES; MAP-REDUCE; PILOT JOB AND DATA;

COMPUTATIONAL METHODS; DISTRIBUTED COMPUTER SYSTEMS; INFORMATION MANAGEMENT;

ALIGNMENT;

EID: 84878488348     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2483954.2483957     Document Type: Conference Paper

References (32)

1. M. L. Metzker. Sequencing technologies - the next generation. Nat. Rev. Genet., 11(1):31-46, 2010.
2. The 1000 Genomes Project Consortium. A map of human genome variation from population-scale sequencing. Nature, 467:1061-1073, 2010.
3. Z. Wang, M. Gerstein, and M. Snyder. RNA-seq : a revolutionary tool for transcriptomics. Nat. Rev. Genet., 10(1):57-63, 2009.
4. A. Bateman and J. Quackenbush. Editorial -Bioinformatics for Next Generation Sequencing. Bioinformatics, 25:429, 2009.
5. J. D. McPherson. Next-Generation Gap. Nature Methods, 6:s2-s5, 2009.
6. Michael C. Schatz, Ben Langmead, and L. Salzberg, Steven. Cloud computing and the DNA data race. Nature Biotechnology, 28:691-693, 2010.
7. M. C. Schatz. CloudBurst: highly highly sensitive read mapping with MapReduce. Bioinformatics, 25(11):1363-1369, 2009.
8. A. McKenna, M. Hanna, E. Banks, and et al. analyzing next-generation DNA sequencing dataThe Genome Analysis Toolkit: A MapReduce framework for . Genome Res., 20:1297-1303, 2010.
9. B. Langmead, M. C. Schatz, J. Lin, M. Pop, and S. L. Salzberg. Searching for SNPs with cloud computing. Genome Biol., 19(11):R134, 2009.
10. L. Pireddu, Leo S., and G. Zanetti. SEAL: a distributed short read mapping and duplicate removal tool. Bioinformatics, 27(15):2159-2160, 2011.
11. B. Langmead and et al. Cloud-scale RNA-sequencing differential expression analysis with Myrna. Genome Biol., 11(8):R83, 2010.
12. R. C. Taylor. An overview of the Hadoop/MapReduce/H-Base framework and its current applications in bioinformatics. BMC Bioinformatics, 11:S1, 2010.
13. Jeffrey Dean and Sanjay Ghemawat. Mapreduce: simplified data processing on large clusters. In Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6, pages 10-10, Berkeley, CA, USA, 2004. USENIX Association.
14. Andrew Thrasher, Rory Carmichael, Peter Bui, Li Yu, Douglas Thain, and Scott Emrich. Taming complex bioinformatics workflows with weaver, makeflow, and starch. Workshop on Workflows in Support of Large Scale Science, pages 1-6, 2010.
15. J. Goecks, A. Nekrutenko, J. Taylor, and et al. A Comprehensive Approach for Supporting Accessible, Reproducible, and Transparent Computational Research in the Life Sciences. Genome Biol., 11(8):R86, 2010.
16. http://www.saga-project.org/.
17. Saurabh Sehgal, Miklos Erdelyi, Andre Merzky, and Shantenu Jha. Understanding application-level interoperability: Scaling-out mapreduce over high-performance grids and clouds. Future Generation Computer Systems, 27(5):590-599, 2011.
18. Pradeep Mantha, Andre Luckow, and Shantenu Jha. Pilot-MapReduce: An Extensible and Flexible MapReduce Implementation for Distributed Data, 2012. Accepted to MapReduce workshop 2012 (HPDC12).
19. Andre Luckow, Mark Santcroos, Sharath Maddineni, Andre Merzky, and Shantenu Jha. P*: An Extensible Model of Pilot-Abstractions for Dynamic Execution. In under review, 2011.
20. Yuan Luo, Zhenhua Guo, Yiming Sun, Beth Plale, Judy Qiu, and Wilfred W. Li. A hierarchical framework for cross-domain MapReduce execution. In Proceedings of the second international workshop on Emerging computational methods for the life sciences, ECMLS '11, pages 15-22, New York, NY, USA, 2011. ACM.
21. http://hadoop.apache.org/.
22. Luca Pireddu, Simone Leo, and Gianluigi Zanetti. Mapreducing a genomic sequencing workflow. In Proceedings of the second international workshop on MapReduce and its applications, MapReduce '11, pages 67-74, New York, NY, USA, 2011. ACM.
23. Z. Lin, G. Xu, N. Deng, C. Taylor, D. Zhu, and E. K. Flemington. Quantitative and qualitative RNA-Seq-based evaluation of Epstein-Barr virus transcription in type 1 latency Burkitt's lymphoma cells. J. Virol., 24:13053-8, 2010.
24. H. Li, B. Handsaker, A. Wysoker, T. Fennell, J. Ruan, N. Home, G. Marth, G. Abecasis, R. Durbin, and 1000 Genome Project Data Processing Subgroup. The Sequence alignment/map (SAM) format and SAMtools. Bioinformatics, 25:2078-2079, 2009.
25. FutureGrid. http://www.futuregrid.org.
26. S. Pepke, B.Wold, and A. Mortazavi. Computation for ChIP-seq and RNA-seq studies. Nature Methods, 6:S22-S32, 2009.
27. http://www.novocraft.com/.
28. H. Li and N. Homer. A survey of sequence alignment algorithms for next-generation sequencing. Briefings in Bioinformatics, 11(5):473-483, 2010.
29. A. Luckow, S. Jha, J. Kim, A. Merzky, and B. Schnor. Adaptive Replica-Exchange Simulations. Royal Society Philosophical Transactions A, pages 2595-2606, June 2009.
30. Michael Cardosa, Chenyu Wang, Anshuman Nangia, Abhishek Chandra, and Jon Weissman. Exploring MapReduce efficiency with highly-distributed data. In Proceedings of the second international workshop on MapReduce and its applications, MapReduce '11, pages 27-34, New York, NY, USA, 2011. ACM.
31. Joohyun Kim, Sharath Maddineni, and Shantenu Jha. Building Gateways for Life-Science Applications using the Dynamic Application Runtime Environment (DARE) Framework. In Proceedings of the 2011 TeraGrid Conference: Extreme Digital Discovery, TG '11, pages 38:1-38:8, New York, NY, USA, 2011. ACM.
32. Joohyun Kim, Sharath Maddineni, and Shantenu Jha. Characterizing deep sequencing analytics using bfast: towards a scalable distributed architecture for next-generation sequencing data. In Proceedings of the second international workshop on Emerging computational methods for the life sciences, ECMLS '11, pages 23-32, New York, NY, USA, 2011. ACM.