Distributed workflow-driven analysis of large-scale biological data using biokepler

PDAC'11 - Proceedings of the 2011 International Workshop on Petascal Data Analytics: Challenges and Opportunities, Co-located with SC'11

Volumn , Issue , 2011, Pages 41-42

  Altintas, Ilkay ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Bioinformatics; Computational biology; Distributed execution patterns; Scientific workflow systems

Indexed keywords

BIOINFORMATICS APPLICATIONS; BIOLOGICAL DATA; COMPUTATIONAL BIOLOGY; DATA-INTENSIVE COMPUTING; DISTRIBUTED ENVIRONMENTS; DISTRIBUTED EXECUTION; DNA SEQUENCING; INVITED TALK; RAPID ANALYSIS; SCIENTIFIC WORKFLOWS; SEQUENCE DATA; UNPRECEDENTED DEMAND; WORK-FLOWS;

BIOINFORMATICS;

EID: 84857938329     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2110205.2110215     Document Type: Conference Paper

References (16)

1. Taylor, I. J., Deelman, E., Gannon, D. B., and Shields, M., Eds., Workflows for e-Science. Springer, 2007.
2. Gorton, I., Greenfield, P., Szalay, A.S., and Williams, R., Data-intensive computing in the 21st Century. IEEE Computer, vol. 41, no. 4, pp. 30-32, 2008.
3. Schatz, M., Cloudburst: Highly sensitive read mapping with MapReduce. Bioinformatics, vol. 25, no. 11, pp. 1363-1369, April 2009.
4. Dean, J. and Ghemawat, S., MapReduce: Simplified data processing on large clusters. Communications of the ACM, vol. 51, no. 1, pp. 107-113, 2008.
5. Smith, A.D., Xuan, Z., and Zhang, M. Q., Using quality scores and longer reads improves accuracy of Solexa read mapping. BMC Bioinformatics, vol. 9, no. 128, February 2008.
6. Fei, X., Lu, S., and Lin, C., A MapReduce-enabled scientific workflow composition framework. In ICWS '09: Proceedings of the 2009 IEEE International Conference on Web Services. Washington, DC, USA: IEEE Computer Society, 2009, pp. 663-670.
7. Goodman, D. J., Introduction and evaluation of Martlet: a scientific workflow language for abstracted parallelization. In WWW '07: Proceedings of the 16th international conference on World Wide Web. New York, NY, USA: ACM, 2007, pp. 983-992. (Pubitemid 47582328)
8. Wang, J., Crawl, D., and Altintas, I., Kepler + Hadoop: A general architecture facilitating data-intensive applications in scientific workflow systems. In WORKS '09: Proceedings of the 4th Workshop on Workflows in Support of Large-Scale Science. Portland, Oregon: ACM New York, NY, USA, 2009, pp. 1-8.
9. Ludaescher, B., Altintas, I., Berkley, C., Higgins, D., Jaeger-Frank, E., Jones, M.J., Lee, E., and Zhao, Y., Scientific workflow management and the Kepler system. Concurrency and Computation: Practice & Experience, Special Issue on Scientific Workflows, vol. 18, no. 10, pp. 1039-1065, 2006. (Pubitemid 44258497)
10. Oinn, T., Greenwood, M., Addis, M., Alpdemir, N., Ferris, J., Glover, K., Goble, C., Goderis, A., Hull, D., Marvin, D., Li, P., Lord, P., Pocock, M., Senger, M., Stevens, R., Wipat, A., and Wroe, C., Taverna: lessons in creating a workflow environment for the life sciences. Concurrency and Computation: Practice and Experience, vol. 18, iss. 10, pp. 1067-1100, 2006. (Pubitemid 44258498)
11. Wang, J., Altintas, I., Hosseini, P. R., Barseghian, D., Crawl, D., Berkley, C., and Jones, M. B., Accelerating parameter sweep workflows by utilizing ad-hoc network computing resources: An ecological example. In Services, IEEE Congress on. IEEE Computer Society, 2009, pp. 267-274.
12. Taylor, I., Shields, M., Wang, I., and Rana, O., Triana applications within grid computing and peer to peer environments. Journal of Grid Computing, vol. 1, 2003.
13. Deelman, E., Mehta, G., Singh, G., Su, M.H., and Vahi, K., Pegasus: Mapping large-scale workflows to distributed resources. In Workflows for e-Science, I. J. Taylor, E. Deelman, D. B. Gannon, and M. Shields, Eds. Springer London, 2007, pp. 376-394.
14. Zhao, Y., Hategan, M., Clifford, B., Foster, I., Laszewski, G. V., Raicu, I., Stefpraun, Y., and Wilde, M., Swift: Fast, reliable, loosely coupled parallel computation. In Services, 2007 IEEE Congress on. IEEE Press, 2007, pp. 199-206.
15. J. Qin and T. Fahringer, "Advanced data flow support for scientific grid workflow applications," in SC '07: Proceedings of the 2007 ACM/IEEE conference on Supercomputing. New York, NY, USA: ACM, 2007, pp. 1-12.
16. Langmead, B., Schatz, M. C., Lin, J., Pop, M., and Salzberg, S. L., Searching for SNPs with cloud computing. Genome Biology, vol. 10, no. 134, November 2009.