Scheduling data-intensive scientific workflows with reduced communication

ACM International Conference Proceeding Series

Volumn , Issue , 2018, Pages

  Pietri, Ilia ^a   Sakellariou, Rizos ^b  

^a UNIVERSITY OF ATHENS   (Greece)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Communication; Data intensive workflows; Workflow scheduling

Indexed keywords

COMMUNICATION; DATA TRANSFER; DIRECTED GRAPHS; MANAGEMENT INFORMATION SYSTEMS; SCALES (WEIGHING INSTRUMENTS);

COMMUNICATION COST; COMPUTATIONAL NODES; DIRECTED ACYCLIC GRAPH (DAG); INTER-DEPENDENT TASKS; LARGE DATA TRANSFERS; SCIENTIFIC WORKFLOWS; WORK-FLOWS; WORKFLOW SCHEDULING;

SCHEDULING;

EID: 85054936559     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3221269.3221298     Document Type: Conference Paper

References (16)

1. Piotr Bryk, Maciej Malawski, Gideon Juve, and Ewa Deelman. 2016. Storage-aware Algorithms for Scheduling of Workflow Ensembles in Clouds. Journal of Grid Computing 14, 2 (2016), 359–378.
2. Louis-Claude Canon, Emmanuel Jeannot, Rizos Sakellariou, and Wei Zheng. 2008. Comparative evaluation of the robustness of DAG scheduling heuristics. In Grid Computing: Achievements and Prospects. Springer.
3. Ümit V. Çatalyürek, Kamer Kaya, and Bora Uçar. 2011. Integrated Data Placement and Task Assignment for Scientific Workflows in Clouds. In Proceedings of the 4th International Workshop on Data-intensive Distributed Computing. ACM, 45–54.
4. Ann Chervenak, Ewa Deelman, Miron Livny, Mei-Hui Su, Rob Schuler, Shishir Bharathi, Gaurang Mehta, and Karan Vahi. 2007. Data placement for scientific applications in distributed environments. In Proceedings of the 8th IEEE/ACM International Conference on Grid Computing. IEEE, 267–274.
5. D. S. Katz, J. C. Jacob, E. Deelman, C. Kesselman, G. Singh, M.-H. Su, G. B. Berriman, J. Good, A. C. Laity, and T. A. Prince. 2005. A Comparison of Two Methods for Building Astronomical Image Mosaics on a Grid. In Proceedings of the IEEE International Conference on Parallel Processing Workshops. IEEE, 85–94.
6. LIGO project, Laser interferometer gravitational wave observatory. 2017. (2017). http://www.ligo.caltech.edu/
7. S. Pandey, L. Wu, S. M. Guru, and R. Buyya. 2010. A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments. In Proceedings of the 24th International Conference on Advanced Information Networking and Applications. IEEE, 400–407.
8. A. Ramakrishnan, G. Singh, H. Zhao, E. Deelman, R. Sakellariou, K. Vahi, K. Blackburn, D. Meyers, and M. Samidi. 2007. Scheduling Data-Intensive Workflows onto Storage-Constrained Distributed Resources. In Proceedings of the 7th IEEE International Symposium on Cluster Computing and the Grid. IEEE, 401–409.
9. Daniel A. Reed and Jack Dongarra. 2015. Exascale Computing and Big Data. Commun. ACM 58, 7 (2015), 56–68.
10. M. A. Rodriguez and R. Buyya. 2017. A taxonomy and survey on scheduling algorithms for scientific workflows in IaaS cloud computing environments. Concurrency and Computation: Practice and Experience 29, 8 (2017).
11. Cloud Workflow Simulator. 2013. (2013). https://github.com/malawski/ cloudworkflowsimulator
12. Ian J. Taylor, Ewa Deelman, Dennis Gannon, and Matthew Shields. 2007. Workflows for e-Science. Springer.
13. H. Topcuoglu, S. Hariri, and Min-You Wu. 2002. Performance-Effective and Low-complexity Task Scheduling for Heterogeneous Computing. IEEE Transactions on Parallel and Distributed Systems 13, 3 (2002), 260–274.
14. USC Epigenome Center. 2017. (2017). http://epigenome.usc.edu
15. Workflow Generator. 2013. (2013). https://confluence.pegasus.isi.edu/display/pegasus/WorkflowGenerator
16. D. Yuan, Y. Yang, X. Liu, and J. Chen. 2010. A Data Placement Strategy in Scientific Cloud Workflows. Future Generation Computer Systems 26, 8 (2010).