Handling uncertainty: Pareto-Efficient BoT scheduling on hybrid clouds

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2013, Pages 419-428

  Hoseiny Farahabady, M Reza ^a,b   Samani, Hamid R D ^a   Leslie, Luke M ^a   Lee, Young Choon ^a   Zomaya, Albert Y ^a  

^a UNIVERSITY OF SYDNEY   (Australia)

^b CSIRO   (Australia)

Author keywords

Bag of tasks applications; Cloud bursting; Cost efficiency; Pareto frontier; Resource allocation; Uncertainty

Indexed keywords

ADAPTIVE CONTROL SYSTEMS; BUDGET CONTROL; COSTS; FEEDBACK CONTROL; RESOURCE ALLOCATION; SCHEDULING; UNCERTAINTY ANALYSIS;

BAG-OF-TASKS APPLICATIONS; COST EFFICIENCY; DYNAMIC RESOURCE ALLOCATIONS; PARETO FRONTIERS; PARETO OPTIMAL SCHEDULE; RESOURCE MANAGEMENT SYSTEMS; SCIENCE AND ENGINEERING; UNCERTAINTY;

PARETO PRINCIPLE;

EID: 84893260586     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2013.51     Document Type: Conference Paper

References (29)

1. U. Dayal, M. Hsu, and R. Ladin, "A transactional model for long-running activities, " in Proc. of Intl. Conf. on Very Large Data Bases, VLDB '91, USA, 1991, pp. 113-122.
2. J. Tang and S.-Y. Hwang, "Handling uncertainties in workflow applications, " in Proc. of Intl. Conf. on Information & Knowledge Management, CIKM '96, USA, 1996, pp. 269-276.
3. M. Berlingerio, F. Pinelli, M. Nanni, and F. Giannotti, "Temporal mining for interactive workflow data analysis, " in Proc. of Intl. Conf. on Knowledge discovery & Data Mining, KDD '09, France, 2009, pp. 109-118.
4. R. B. V. Subramanyam, A. Goswami, and B. Prasad, "Mining fuzzy temporal patterns from process instances with weighted temporal graphs, " Int. J. Data Anal. Tech. Strateg., vol. 1, no. 1, pp. 60-77, 2008.
5. W. Alsabhan, "Normalised support: A virtual angle of measurement of interestingness, " Int. J. Data Anal. Tech. Strateg., vol. 4, no. 1, pp. 101-114, 2012.
6. P. Papapetrou, G. Kollios, S. Sclaroff, and D. Gunopulos, "Mining frequent arrangements of temporal intervals, " Knowledge Information System, vol. 21, no. 2, pp. 133-171, 2009.
7. S. Abrishami, M. Naghibzadeh, and D. H. Epema, "Costdriven scheduling of grid workflows using partial critical paths, " IEEE Trans. on Parallel and Distributed Systems, vol. 23, no. 8, pp. 1400-1414, 2012.
8. Y. C. Lee, R. Subrata, and A. Y. Zomaya, "On the performance of a dual-objective optimization model for workflow applications on grid platforms, " IEEE Trans. on Parallel and Distributed Systems, vol. 20, no. 9, pp. 1273-1284, 2009.
9. A. Iosup, M. Jan, O. O. Sonmez, and D. Epema, "The characteristics and performance of groups of jobs in grids, " in In Euro-Par, volume 4641 of LNCS, 2007, pp. 382-393.
10. T. N. Minh, L. Wolters, and D. H. J. Epema, "A realistic integrated model of parallel system workloads, " in Proc. of Intl. Symp. on Cluster, Cloud the Grid, CCGRID '10, USA, 2010, pp. 464-473.
11. O. A. Bar-Yehuda, M. Silberstein, A. Sharov, A. Iosup, and A. Schuster, "Expert: Pareto-efficient task replication on grids and a cloud, " in Proc. of Intl. Parallel & Distributed Processing Symp., IPDPS '12, China, 2012, pp. 167-178.
12. M. Silberstein, A. Sharov, D. Geiger, and A. Schuster, "Gridbot: execution of bags of tasks in multiple grids, " in Proc. of the Intl. Conf. on High Performance Computing Networking, Storage and Analysis, SC '09, USA, 2009, pp. 11:1-11:12.
13. M. HoseinyFarahabady, Y. C. Lee, and A. Y. Zomaya, "Non-clairvoyant assignment of bag-of-tasks applications across multiple clouds, " in Proc. of 13th IEEE Intl. Conf. on Parallel & Distributed Computing, Applications & Technologies, PDCAT'12, China, 2012, pp. 423-428.
14. T. G. Armstrong, Z. Zhang, D. S. Katz, M. Wilde, and I. T. Foster, "Scheduling many-task workloads on supercomputers: Dealing with trailing tasks, " in Proc. of Workshop on Many-Task Computing on Grids & Supercomputers, MTAGS '10, USA, 2010, pp. 1-10.
15. N. Fujimoto and K. Hagihara, "Near-optimal dynamic task scheduling of precedence constrained coarse-grained tasks onto a computational grid, " in Proc. of Intl. Conf. on Parallel & Distributed Computing, ISPDC '03, USA, 2003, pp. 80-87.
16. C.-Z. Xu, L. Y. Wang, and N.-T. Fong, "Stochastic prediction of execution time for dynamic bulk synchronous computations, " J. Supercomput., vol. 21, no. 1, pp. 91-103, 2002.
17. J. B. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction, " Science, vol. 5500, no. 290, pp. 2319-2323, 2000.
18. A. Srivastava and A. Eustace, "Atom: A system for building customized program analysis tools, " SIGPLAN Not., vol. 29, no. 6, pp. 196-205, 1994.
19. C.-K. Luk, R. Cohn, R. Muth, H. Patil, A. Klauser, G. Lowney, S. Wallace, V. J. Reddi, and K. Hazelwood, "Pin: building customized program analysis tools with dynamic instrumentation, " in Proc. of Intl. Conf. on Programming Language Design and Implementation, PLDI '05, USA, 2005, pp. 190-200.
20. N. Nethercote and J. Seward, "Valgrind: A framework for heavyweight dynamic binary instrumentation, " SIGPLAN Not., vol. 42, no. 6, pp. 89-100, 2007.
21. G. Dosa, "The tight bound of first fit decreasing bin-packing algorithm is ffd(i)=(11/9)opt(i)+6/9, " in ESCAPE, volume 4614 of LNCS, 2007, pp. 1-11.
22. A. Iosup, O. Sonmez, S. Anoep, and D. Epema, "The performance of bags-of-tasks in large-scale distributed systems, " in Proc. of Intl. Symp. on High Performance Distributed Computing, HPDC '08, USA, 2008, pp. 97-108.
23. N. M. Tran and L. Wolters, "Towards a profound analysis of bbots in parallel systems & their performance impact, " in Proc. of Intl. Symp. on High Performance Distributed Computing, HPDC '11, USA, 2011, pp. 111-122.
24. H. Casanova, M. Gallet, and F. Vivien, "Non-clairvoyant scheduling of multiple bag-of-tasks applications, " in Proc. of Intl. Euro-Par Conf. on Parallel Processing: Part I, EuroPar '10, Italy, 2010, pp. 168-179.
25. Y. C. Lee and A. Y. Zomaya, "Practical scheduling of bag-of-tasks applications on grids with dynamic resilience, " IEEE Trans. on Computers, vol. 56, pp. 815-825, 2007.
26. H. Herodotou, F. Dong, and S. Babu, "No one (cluster) size fits all: Automatic cluster sizing for data-intensive analytics, " in Proc. of the Symp. on Cloud Computing, SOCC '11, Portugal, 2011, pp. 18:1-18:14.
27. N. Jain, I. Menache, S. Naor, and J. Yaniv, "Near-optimal scheduling mechanisms for deadline-sensitive jobs, " in Proc. of Symp. on Parallelism in Algorithms & Architectures, SPAA '12, USA, 2012, pp. 255-266.
28. K. Tsakalozos, H. Kllapi, E. Sitaridi, M. Roussopoulos, D. Paparas, and A. Delis, "Flexible use of cloud resources through profit maximization and price discrimination, " in Proc. of Intl. Conf. on Data Engineering, ICDE '11, USA, 2011, pp. 75-86.
29. Y. Chen and R. Sion, "To cloud or not to cloud?: musings on costs and viability, " in Proc. of Symp. on Cloud Computing, SOCC '11, Portugal, 2011, pp. 29:1-29:7.