Meeting deadlines of scientific workflows in public clouds with tasks replication

IEEE Transactions on Parallel and Distributed Systems

Volumn 25, Issue 7, 2014, Pages 1787-1796

  Calheiros, Rodrigo N ^a   Buyya, Rajkumar ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Cloud computing; scientific workflows; soft deadline; task replication

Indexed keywords

CLOUD COMPUTING; HARDWARE; SIGNAL PROCESSING;

CLOUD INFRASTRUCTURES; MINIMIZATION OF COSTS; PERFORMANCE VARIATIONS; SCIENTIFIC WORKFLOWS; SOFT DEADLINES; TASK REPLICATIONS; WORKFLOW APPLICATIONS; WORKFLOW EXECUTION;

BUDGET CONTROL;

EID: 84903146693     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2013.238     Document Type: Article

References (25)

1. G. Juve, A. Chervenak, E. Deelman, S. Bharathi, G. Mehta, and K. Vahi, "Characterizing and Profiling Scientific Workflows, " Future Gener. Comput. Syst., vol. 29, no. 3, pp. 682-692, Mar. 2013.
2. R. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, and I. Brandic, "Cloud Computing and Emerging IT Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility, " Future Gener. Comput. Syst., vol. 25, no. 6, pp. 599-616, June 2009.
3. R. Abbott and H. Garcia-Molina, "Scheduling Real-Time Transactions, " ACM SIGMOD Rec., vol. 17, no. 1, pp. 71-81, Mar. 1988.
4. K. R. Jackson, L. Ramakrishnan, K. Muriki, S. Canon, S. Cholia, J. Shalf, H. J. Wasserman, and N. J. Wright, "Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud, " in Proc. 2nd Int'l Conf. CloudCom, 2010, pp. 159-168.
5. Y. -K. Kwok and I. Ahmad, "Static Scheduling Algorithms for Allocating Directed Task Graphs to Multiprocessors, " ACM Comput. Surveys, vol. 31, no. 4, pp. 406-471, Dec. 1999.
6. Z. Shi and J. J. Dongarra, "Scheduling Workflow Applications on Processors with Different Capabilities, " Future Gener. Comput. Syst., vol. 22, no. 6, pp. 665-675, May 2006.
7. J. Yu, R. Buyya, and K. Ramamohanarao, "Workflow Scheduling Algorithms for Grid Computing, " in Metaheuristics for Scheduling in Distributed Computing Environments, F. Xhafa and A. Abraham, Eds. New York, NY, USA: Springer-Verlag, 2008.
8. A. Hirales-Carbajal, A. Tchernykh, R. Yahyapour, J. L. González-García, T. Rö blitz, and J. M. Ramírez- Alcaraz, "Multiple Workflow Scheduling Strategies with User Run Time Estimates on a Grid, " J. Grid Comput., vol. 10, no. 2, pp. 325-346, June 2012.
9. C. Lin and S. Lu, "SCPOR: An Elastic Workflow Scheduling Algorithm for Services Computing, " in Proc. Int'l Conf. SOCA, 2011, pp. 1-8.
10. C. J. Reynolds, S. Winter, G. Z. Terstyanszky, T. Kiss, P. Greenwell, S. Acs, and P. Kacsuk, "Scientific Workflow Makespan Reduction through Cloud Augmented Desktop Grids, " in Proc. 3rd Int'l Conf. CloudCom, 2011, pp. 18-23.
11. M. Xu, L. Cui, H. Wang, and Y. Bi, "AMultiple QoS Constrained Scheduling Strategy of Multiple Workflows for Cloud Computing, " in Proc. Int'l Symp. ISPA, 2009, pp. 629-634.
12. M. Mao and M. Humphrey, "Auto-Scaling to Minimize Cost and Meet Application Deadlines in Cloud Workflows, " in Proc. Int'l Conf. High Perform. Comput., Netw., Storage Anal. (SC), 2011, p. 49.
13. M. Rahman, X. Li, and H. Palit, "Hybrid Heuristic for Scheduling Data Analytics Workflow Applications in Hybrid Cloud Environment, " in Proc. IPDPSW, 2011, pp. 966-974.
14. E. -K. Byun, Y. -S. Kee, J. -S. Kim, and S. Maeng, "Cost Optimized Provisioning of Elastic Resources for Application Workflows, " Future Gener. Comput. Syst., vol. 27, no. 8, pp. 1011-1026, Oct. 2011.
15. S. Abrishami, M. Naghibzadeh, and D. Epema, "Deadline- ConstrainedWorkflow Scheduling Algorithms for IaaS Clouds, " Future Gener. Comput. Syst., vol. 29, no. 1, pp. 158-169, Jan. 2013.
16. W. Cirne, F. Brasileiro, D. Paranhos, L. F. W. Góes, and W. Voorsluys, "On the Efficacy, Efficiency and Emergent Behavior of Task Replication in Large Distributed Systems, " Parallel Comput., vol. 33, no. 3, pp. 213-234, Apr. 2007. (Pubitemid 46428453)
17. G. Kandaswamy, A. Mandal, and D. A. Reed, "Fault Tolerance and Recovery of Scientific Workflows on Computational Grids, " in Proc. 8th Int'l Symp. CCGrid, 2008, pp. 777-782.
18. R. Sirvent, R. M. Badia, and J. Labarta, "Graph-Based Task Replication for Workflow Applications, " in Proc. 11th Int'l Conf. HPCC, 2009, pp. 20-28.
19. M. Dobber, R. van der Mei, and G. Koole, "Dynamic Load Balancing and Job Replication in a Global-Scale Grid Environment: A Comparison, " IEEE Trans. Parallel Distrib. Syst., vol. 20, no. 2, pp. 207-218, Feb. 2009.
20. X. Tang, K. Li, G. Liao, and R. Li, "List Scheduling with Duplication for Heterogeneous Computing Systems, " J. Parallel Distrib. Comput., vol. 70, no. 4, pp. 323-329, Apr. 2010.
21. K. Plankensteiner and R. Prodan, "Meeting Soft Deadlines in Scientific Workflows Using Resubmission Impact, " IEEE Trans. Parallel Distrib. Syst., vol. 23, no. 5, pp. 890-901, May 2012.
22. R. Prodan and T. Fahringer, "Overhead Analysis of Scientific Workflows in Grid Environments, " IEEE Trans. Parallel Distrib. Syst., vol. 19, no. 3, pp. 378-393, Mar. 2008. (Pubitemid 351344283)
23. W. Chen and E. Deelman, "WorkflowSim: A Toolkit for Simulating Scientific Workflows in Distributed Environments, " in Proc. 8th Int'l Conf. E-Science, 2012, pp. 1-8.
24. P. Chevochot and I. Puaut, "Scheduling Fault-Tolerant Distributed Hard Real-Time Tasks Independently of the Replication Strategies, " in Proc. 6th Int'l Conf. RTCSA, 1999, p. 356.
25. R. N. Calheiros, R. Ranjan, A. Beloglazov, C. A. F. D. Rose, and R. Buyya, "CloudSim: A Toolkit for Modeling and Simulation of Cloud Computing Environments and Evaluation of Resource Provisioning Algorithms, " Softw., Pract. Exper., vol. 41, no. 1, pp. 23-50, Jan. 2011.