Improving scientific workflow performance using policy based data placement

Proceedings - 2012 IEEE International Symposium on Policies for Distributed Systems and Networks, POLICY 2012

Volumn , Issue , 2012, Pages 86-93

  Amer, Muhammad Ali ^a   Chervenak, Ann ^b   Chen, Weiwei ^b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Distributed data management; Policy; Workflows

Indexed keywords

ASYNCHRONOUS DATA; COMPUTATIONAL TASK; DATA CHARACTERISTICS; DATA PLACEMENT; DATA STAGING; DISTRIBUTED DATA; MANAGEMENT OPERATION; PEGASUS; RUNTIMES; SCIENTIFIC WORKFLOWS; WORK-FLOWS; WORKFLOW EXECUTION; WORKFLOW MANAGEMENT SYSTEMS;

INFORMATION MANAGEMENT; PUBLIC POLICY; SCHEDULING;

DATA FLOW ANALYSIS;

EID: 84866757816     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/POLICY.2012.8     Document Type: Conference Paper

References (18)

1. E. Deelman, G. Singh, M. Su, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, G. Berriman, J. Good et al., "Pegasus: A framework for mapping complex scientific workflows onto distributed systems," Scientific Programming, vol. 13, no. 3, pp. 219-237, 2005.
2. T. Kosar and M. Livny, "Stork: Making data placement a first class citizen in the grid," in Distributed Computing Systems, 2004. Proceedings. 24th International Conference on. IEEE, 2004, pp. 342-349.
3. G. Berriman, E. Deelman, J. Good, J. Jacob, D. Katz, C. Kesselman, A. Laity, T. Prince, G. Singh, and M. Su, "Montage: a grid-enabled engine for delivering custom science-grade mosaics on demand," in Proceedings of SPIE, vol. 5493, 2004, pp. 221-232.
4. Condor, "http://www.cs.wisc.edu/condor."
5. DAGMAN, "http://research.cs.wisc.edu/condor/dagman/."
6. Drools, "http://www.jboss.org/drools," 2011.
7. M. Bali, Drools JBoss Rules 5.0 Developer's Guide. Packt Publishing, 2009.
8. C. Documentation, "The rule language," 2012. [Online]. Available: http://docs.jboss.org/drools/release/5.2.0.Final/drools-expert-docs/ html/ch05.html
9. M. Amer, "Policy based data placement in high performance scientific computing," in Parallel and Distributed Processing Workshops and Phd Forum (IPDPSW), 2011 IEEE International Symposium on. IEEE, 2011, pp. 2085-2088.
10. W. Allcock, J. Bresnahan, R. Kettimuthu, M. Link, C. Dumitrescu, I. Raicu, and I. Foster, "The globus striped gridftp framework and server," in Proceedings of the 2005 ACM/IEEE conference on Supercomputing. IEEE Computer Society, 2005, p. 54.
11. A. Chervenak, R. Schuler, M. Ripeanu, M. Ali Amer, S. Bharathi, I. Foster, A. Iamnitchi, and C. Kesselman, "The globus replica location service: design and experience," Parallel and Distributed Systems, IEEE Transactions on, vol. 20, no. 9, pp. 1260-1272, 2009.
12. "Montage: An astronomical image mosiac engine, http://montage.ipac. caltech.edu."
13. A. Rajasekar, R. Moore, C. Y. Hou, C. A. Lee, R. Marciano, A. de Torcy, M. Wan, W. Schroeder, S. Y. Chen, L. Gilbert et al., "irods primer: Integrated rule-oriented data system," Synthesis Lectures on Information Concepts, Retrieval, and Services, vol. 2, no. 1, pp. 1-143, 2010.
14. A. Chervenak, E. Deelman, M. Livny, M. Su, R. Schuler, S. Bharathi, G. Mehta, and K. Vahi, "Data placement for scientific applications in distributed environments," in Grid Computing, 2007 8th IEEE/ACM International Conference on. IEEE, 2007, pp. 267-274.
15. A. Ramakrishnan, G. Singh, H. Zhao, E. Deelman, R. Sakellariou, K. Vahi, K. Blackburn, D. Meyers, and M. Samidi, "Scheduling data-intensive workflows onto storage-constrained distributed resources," 2007.
16. T. Kosar and M. Balman, "A new paradigm: Data-aware scheduling in grid computing," Future Generation Computer Systems, vol. 25, no. 4, pp. 406-413, 2009.
17. L. Canon, E. Jeannot, R. Sakellariou, and W. Zheng, "Comparative evaluation of the robustness of dag scheduling heuristics," in Grid Computing. Springer, 2008, pp. 73-84.
18. G. Juve, E. Deelman, K. Vahi, G. Mehta, B. Berriman, B. Berman, and P. Maechling, "Scientific workflow applications on amazon ec2," in E-Science Workshops, 2009 5th IEEE International Conference on. Ieee, 2009, pp. 59-66.