Community resources for enabling research in distributed scientific workflows

Proceedings - 2014 IEEE 10th International Conference on eScience, eScience 2014

Volumn 1, Issue , 2014, Pages 177-184

  Da Silva, Rafael Ferreira ^a   Chen, Weiwei ^a   Juve, Gideon ^a   Vahi, Karan ^a   Deelman, Ewa ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Scientific Workflows; Workflow Simulation; Workload Archive; Workload Profiling and Characterization

Indexed keywords

WORK SIMPLIFICATION;

DISTRIBUTED INFRASTRUCTURE; PHYSICAL EXPERIMENTS; SCIENTIFIC WORKFLOWS; SYSTEM CHARACTERISTICS; WORKFLOW APPLICATIONS; WORKFLOW MANAGEMENT SYSTEMS; WORKFLOW SIMULATION; WORKLOAD ARCHIVE;

E-SCIENCE;

EID: 84919499464     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/eScience.2014.44     Document Type: Conference Paper

References (40)

1. I. Taylor, E. Deelman, D. Gannon, and M. Shields, Workflows for e-Science. Springer, 2007.
2. A. Hirales-Carbajal, A. Tchernykh, T. Roblitz, and R. Yahyapour, "A grid simulation framework to study advance scheduling strategies for complex workflow applications," in Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW), 2010 IEEE International Symposium on. IEEE, 2010, pp. 1-8.
3. R. N. Calheiros, R. Ranjan, A. Beloglazov, C. A. F. De Rose, and R. Buyya, "CloudSim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms," Software: Practice and Experience, vol. 41, no. 1, 2011.
4. F. Jrad, J. Tao, and A. Streit, "A broker-based framework for multicloud workflows," in 2013 international workshop on Multi-cloud applications and federated clouds, 2013, pp. 61-68.
5. E. Watanabe, P. P. V. Campos, K. Braghetto, and D. Batista, "Algoritmos para economia de energia no escalonamento de workflows em nuvens computacionais," in 32nd Brazilian Symposium on Computer Networks and Distributed Systems, Florianopolis, Brazil, 2014.
6. E. Deelman, G. Singh, M.-H. Su, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, G. B. Berriman, J. Good, A. Laity, J. C. Jacob, and D. S. Katz, "Pegasus: A framework for mapping complex scientific workflows onto distributed systems," Sci. Program., vol. 13, no. 3, pp. 219-237, 2005.
7. E. Deelman, K. Vahi, G. Juve, M. Rynge, S. Callaghan, P. Maechling, R. Mayani, W. Chen, R. Ferreira da Silva, M. Livny, and K. Wenger, "Pegasus, a workflow management system for science automation," submitted to Future Generation Computer Systems, 2014.
8. "Workflow gallery," http://pegasus. isi. edu/workflow gallery.
9. "Workflow generator," http://confluence. pegasus. isi. edu/display/pegasus/ WorkflowGenerator.
10. W. Chen and E. Deelman, "Workflowsim: A toolkit for simulating scientific workflows in distributed environments," in 2012 IEEE 8th International Conference on E-Science, ser. eScience, 2012, pp. 1-8. Available: https://github. com/WorkflowSim
11. M. McLennan, S. Clark, F. McKenna, E. Deelman, M. Rynge, K. Vahi, D. Kearney, and C. Song, "Bringing scientific workflow to the masses via pegasus and hubzero," in IWSG, 2013.
12. J. S. Vockler, G. Mehta, Y. Zhao, E. Deelman, and M. Wilde, "Kickstarting remote applications," in 2nd International Workshop on Grid Computing Environments, 2006.
13. G. B. Berriman, E. Deelman, J. C. Good, J. C. Jacob, D. S. Katz, C. Kesselman, A. C. Laity, T. A. Prince, G. Singh, and M. Su, "Montage: A grid-enabled engine for delivering custom science-grade mosaics on demand," in SPIE Conference on Astronomical Telescopes and Instrumentation, vol. 5493, 2004, pp. 221-232.
14. S. Bharathi, A. Chervenak, E. Deelman, G. Mehta, M.-H. Su, and K. Vahi, "Characterization of scientific workflows," in 3rd Workshop on Workflows in Support of Large-Scale Science (WORKS), 2008.
15. G. Juve, A. Chervenak, E. Deelman, S. Bharathi, G. Mehta, and K. Vahi, "Characterizing and profiling scientific workflows," Future Generation Computer Systems, vol. 29, no. 3, pp. 682-692, 2013.
16. R. Ferreira da Silva, G. Juve, E. Deelman, T. Glatard, F. Desprez, D. Thain, B. Tovar, and M. Livny, "Toward fine-grained online task characteristics estimation in scientific workflows," in 8th Workshop on Workflows in Support of Large-Scale Science, ser. WORKS '13, 2013, pp. 58-67.
17. "Laser Interferometer Gravitational Wave Observatory (LIGO)," http://www. ligo. caltech. edu.
18. R. Graves, T. Jordan, S. Callaghan, E. Deelman, E. Field, G. Juve, C. Kesselman, P. Maechling, G. Mehta, K. Milner, D. Okaya, P. Small, and K. Vahi, "Cybershake: A physics-based seismic hazard model for southern california," Pure and Applied Geophysics, vol. 168, no. 3-4, pp. 367-381, 2011.
19. "USC Epigenome Center," http://epigenome. usc. edu.
20. "SIPHT," http://pegasus. isi. edu/applications/sipht.
21. H. Topcuoglu, S. Hariri, and M.-y. Wu, "Performance-effective and lowcomplexity task scheduling for heterogeneous computing," IEEE Trans. on Parallel and Distributed Systems, vol. 13, no. 3, pp. 260-274, 2002.
22. W. Chen and E. Deelman, "Workflow overhead analysis and optimizations," in The 6th Workshop on Workflows in Support of Large-Scale Science, Nov. 2011.
23. E. Deelman, D. Gannon, M. Shields, and I. Taylor, "Workflows and e-science: An overview of workflow system features and capabilities," Future Generation Computer Systems, vol. 25, no. 5, pp. 528-540, 2009.
24. W. Chen, R. Ferreira da Silva, E. Deelman, and R. Sakellariou, "Balanced task clustering in scientific workflows," in 2013 IEEE 9th International Conference on eScience (eScience), 2013, pp. 188-195.
25. R. Ferreira da Silva, T. Fahringer, J. J. Durillo, and E. Deelman, "A unified approach for modeling and optimization of energy, makespan and reliability for scientific workflows on large-scale computing infrastructures," in Workshop on Modeling & Simulation of Systems and Applications, 2014, p. To appear.
26. W. Chen, E. Deelman, and R. Sakellariou, "Imbalance optimization in scientific workflows," in 27th International ACM Conference on International Conference on Supercomputing, ser. ICS '13, 2013, pp. 461-462.
27. W. Chen and E. Deelman, "Fault tolerant clustering in scientific workflows," in IEEE 8th World Congress on Services, 2012, pp. 9-16.
28. P. Kumari and N. Kumari, "Performance evaluation of cost-time based workflow scheduling algorithms in cloud computing," International Journal of Advanced Research in Computer Science and Software Engineering, vol. 3, no. 9, 2013.
29. S. Prathibha, B. Latha, and G. Sumathi, "Monitoring the performance analysis of executing workflow applications with different resource types in a cloud environment," in 1st International Symposium on Big Data and Cloud Computing Challenges, 2014, pp. 27-28.
30. A. Iosup, H. Li, M. Jan, S. Anoep, C. Dumitrescu, L. Wolters, and D. H. Epema, "The grid workloads archive," Future Generation Computer Systems, vol. 24, no. 7, pp. 672-686, 2008.
31. D. Kondo, B. Javadi, A. Iosup, and D. Epema, "The failure trace archive: Enabling comparative analysis of failures in diverse distributed systems," in Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on, 2010, pp. 398-407.
32. R. Ferreira da Silva and T. Glatard, "A science-gateway workload archive to study pilot jobs, user activity, bag of tasks, task substeps, and workflow executions," in Euro-Par 2012: Parallel Processing Workshops, 2013, vol. 7640, pp. 79-88.
33. J. Stoyanovich, B. Taskar, and S. Davidson, "Exploring repositories of scientific workflows," in 1st International Workshop on Workflow Approaches to New Data-centric Science, 2010, p. 7.
34. V. Korkhov, D. Krefting, T. Kukla, G. Z. Terstyanszky, M. W. Caan, and S. D. Olabarriaga, "Exploring workflow interoperability for neuroimage analysis on the shiwa platform," Journal of grid computing, vol. 11, no. 3, pp. 505-522, 2013.
35. S. Holl and et al., "On specifying and sharing scientific workflow optimization results using research objects," in 8th Workshop on Workflows in Support of Large-Scale Science, 2013, pp. 28-37.
36. M. Rahman, S. Venugopal, and R. Buyya, "A dynamic critical path algorithm for scheduling scientific workflow applications on global grids," in IEEE International Conference on e-Science and Grid Computing, 2007, pp. 35-42.
37. M. Naseri and S. Ludwig, "Evaluating workflow trust using hidden markov modeling and provenance data," in Data Provenance and Data Management in eScience, ser. Studies in Computational Intelligence. Springer Berlin Heidelberg, 2013, vol. 426, pp. 35-58.
38. M. Amer and R. Lucas, "Evaluating workflow tools with sdag," in High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion:, 2012, pp. 54-63.
39. S. Camarasu-Pop, T. Glatard, and H. Benoit-Cattin, "Simulating application workflows and services deployed on the european grid infrastructure," in Cluster, Cloud and Grid Computing (CCGrid), 2013 13th IEEE/ACM International Symposium on, May 2013, pp. 18-25.
40. M. Bux and U. Leser, "Dynamiccloudsim: Simulating heterogeneity in computational clouds," in 2Nd ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies, ser. SWEET '13. New York, NY, USA: ACM, 2013, pp. 1:1-1:12.