Robust sequential resource allocation in heterogeneous distributed systems with random compute node failures

IPDPS 2009 - Proceedings of the 2009 IEEE International Parallel and Distributed Processing Symposium

Volumn , Issue , 2009, Pages

  Shestak, Vladimir ^a   Chong, Edwin K P ^b,c   Maciejewski, Anthony A ^b   Siegel, Howard Jay ^b,d  

^a InfoPrint Solutions Company   (United States)

^b Engineering Research Center and Hydraulics Laboratory   (United States)

^c Colorado State University   (United States)

^d Department of Environmental and Radiological Health Sciences   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALLOCATION POLICIES; DEDICATED SYSTEMS; FAILURE RATE; HETEROGENEOUS DISTRIBUTED SYSTEMS; NODE FAILURE; WEB SERVERS; WORK-LOAD DISTRIBUTION;

DISTRIBUTED PARAMETER NETWORKS; MARKUP LANGUAGES; RESOURCE ALLOCATION; SERVERS;

COMPUTER RESOURCE MANAGEMENT;

EID: 70450001349     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2009.5160916     Document Type: Conference Paper

References (49)

1. S. C. Albright, "Optimal sequential assignments with random arrival times," Management Science, vol. 21, no. 1, pp. 60-67, Sep. 1974.
2. -, "A Bayesian approach to a generalized house selling problem," Management Science, vol. 24, no. 4, pp. 432-440, Dec. 1977.
3. S. C. Albright and C. Derman, "Asymptotic optimal policies for the stochastic sequential assignment problem," Management Science, vol. 19, no. 1, pp. 46-51, Sep. 1972.
4. S. Ali, T. D. Braun, H. J. Siegel, A. A. Maciejewski, N. Beck, L. Boloni, M. Maheswaran, A. I. Reuther, J. P. Robertson, M. D. Theys, and B. Yao, "Characterizing resource allocation heuristics for heterogeneous computing systems," in Advances in Computers, A. R. Hurson, Ed. Amsterdam, the Netherlands: Elsevier, 2005, vol. 63: Parallel, Distributed, and Pervasive Computing, pp. 91-128.
5. S. Ali, J.-K. Kim, H. J. Siegel, and A. A. Maciejewski, "Static heuristics for robust resource allocation to continuously executing applications," Journal of Parallel and Distributed Computing, vol. 68, no. 8, pp. 1070-1080, Apr. 2008.
6. S. Ali, A. A. Maciejewski, and H. J. Siegel, "Perspectives on robust resource allocation for heterogeneous parallel systems," in Handbook of Parallel Computing: Models, Algorithms, and Applications, S. Rajasekaran and J. Reif, Eds. Boca Raton, FL: Chapman & Hall, 2008, pp. 41-1-41-30.
7. S. Ali, A. A. Maciejewski, H. J. Siegel, and J.-K. Kim, "Measuring the robustness of a resource allocation," IEEE Transactions on Parallel and Distributed Systems, vol. 15, no. 7, pp. 630-641, Jul. 2004.
8. D. P. Anderson, J. Cobb, E. Korpela, M. Lebofsky, and D. Werthimer, "SETI at home: An experiment in publicresource computing," Communications of the ACM, vol. 45, no. 11, pp. 56-61, Nov. 2002.
9. H. Barada, S. M. Sait, and N. Baig, "Task matching and scheduling in heterogeneous systems using simulated evolution," in Heterogeneous Computing Workshop, Apr. 2001, pp. 875-882.
10. K. Birman, Reliable Distributed Systems. New York, NY: Springer-Verlag, 2005.
11. T. D. Braun, H. J. Siegel, N. Beck, L. Bölöni, R. F. Freund, D. Hensgen, M. Maheswaran, A. I. Reuther, J. P. Robertson, M. D. Theys, and B. Yao, "A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems," Journal of Parallel and Distributed Computing, vol. 61, no. 6, pp. 810-837, Jun. 2001.
12. I. David and U. Yechiali, "A time-dependent stopping problem with application to live organ transplants," Operations Research, vol. 33, no. 3, pp. 491-504, Jun. 1985.
13. C. Derman, G. J. Lieberman, and S. M. Ross, "A sequential stochastic assignment problem," Management Science, vol. 18, no. 7, pp. 349-355, Mar. 1972.
14. J. L. Devore, Probability and Statistics for Engineering and Sciences, 5th ed. Los Angeles, CA: Duxbury Press, 1999.
15. S. Dhakal, M. M. Hayat, J. E. Pezoa, C. T. Abdallah, J. D. Birdwell, and J. Chiasson, "Load balancing in the presence of random node failure and recovery," in The 20th International Parallel and Distributed Processing Symposium (IPDPS 2006), 2006, pp. 25-29.
16. M. K. Dhodhi, I. Ahmad, and A. Yatama, "An integrated technique for task matching and scheduling onto distributed heterogeneous computing systems," Journal of Parallel and Distributed Computing, vol. 62, no. 2, pp. 1338-1361, Sep. 2002.
17. R. F. Freund and H. J. Siegel, "Heterogeneous processing," IEEE Computer, vol. 26, no. 6, pp. 13-17, Jun. 1993.
18. S. Garg, A. Moorsel, K. Vaidyanathan, and K. S. Trivedi, "A methodology for detection and estimation of software aging," in The Ninth International Symposium on Software Reliability Engineering, Nov. 1998, pp. 283-292.
19. A. Ghafoor and J. Yang, "A distributed heterogeneous supercomputing management system," IEEE Computer, vol. 26, no. 6, pp. 78-86, Jun. 1993.
20. J. L. Hennessy and D. A. Patterson, Computer Architecture: A Quantitative Approach, 3rd ed. San Francisco, CA: Morgan Kaufmann, 2003, ch. 8.
21. O. H. Ibarra and C. E. Kim, "Heuristic algorithms for scheduling independent tasks on non-identical processors," Journal of the ACM, vol. 24, no. 2, pp. 280-289, Apr. 1977.
22. J.Yang, A. Khokhar, S. Sheikh, and A. Ghafoor, "Estimating execution time for parallel tasks in heterogeneous processing (HP) environment," in Heterogeneous Computing Workshop, Apr. 1994, pp. 23-28.
23. M. Kafil and I. Ahmad, "Optimal task assignment in heterogeneous distributed computing systems," IEEE Concurrency, vol. 6, no. 3, pp. 42-51, Jul. 1998.
24. A. Khokhar, V. K. Prasanna, M. E. Shaaban, and C.Wang, "Heterogeneous processing: Challenges and opportunities," IEEE Computer, vol. 26, no. 6, pp. 18-27, Jun. 1993.
25. J.-K. Kim, S. Shivle, H. J. Siegel, A. A. Maciejewski, T. Braun, M. Schneider, S. Tideman, R. Chitta, R. B. Dilmaghani, R. Joshi, A. Kaul, A. Sharma, S. Sripada, P. Vangari, and S. S. Yellampalli, "Dynamically mapping tasks with priorities and multiple deadlines in a heterogeneous environment," Journal of Parallel and Distributed Computing, vol. 67, no. 2, pp. 154-169, Feb. 2007.
26. D. Knuth, The Art of Computer Programming. Reading, MA: Addison-Wesley, 1997.
27. C. Leangsuksun, J. Potter, and S. Scott, "Dynamic task mapping algorithms for a distributed heterogeneous computing environment," in 4th IEEE Heterogeneous Computing Workshop (HCW '95), Apr. 1995, pp. 30-34.
28. th IEEE International Symposium on Cluster Computing and the Grid, 2004.
29. L. Li, K. Vaidyanathan, and K. Trivedi, "An approach for estimation of software aging in a web server," in The 2002 International Symposium on Empirical Software Engineering (ISESE'02), 2002, pp. 91-100.
30. M. Maheswaran, T. D. Braun, and H. J. Siegel, "Heterogeneous distributed computing," in Encyclopedia of Electrical and Electronics Engineering, J. Webster, Ed. New York, NY: John Wiley, 1999, vol. 8, pp. 679-690.
31. A. M. Mehta, J. Smith, H. J. Siegel, A. A. Maciejewski, A. Jayaseelan, and B. Ye, "Dynamic resource allocation heuristics that manage tradeoff between makespan and robustness," Journal of Supercomputing, Special Issue on Grid Technology, vol. 42, no. 1, pp. 33-58, 2007.
32. T. Nakai, "A sequential stochastic assignment problem in a partially observable Markov chain," Mathematics of Operations Research, vol. 11, no. 2, pp. 230-240, May 1986.
33. S. I. Park, V. Raghunathan, and M. B. Srivastava, "Energy efficiency and fairness tradeoffs in multi-resource, multi-tasking embedded systems," in The 2003 International Symposium on Low Power Electronics and Design (ISLPED'03), Aug. 2003, pp. 2-13.
34. R. Righter, "Stochastically maximizing the number of successes in a sequential assignment problem," Journal of Applied Probability, vol. 27, no. 2, pp. 351-364, Jun. 1990.
35. V. Saario, "Limiting properties of the discounted house-selling problem," European Journal of Operational Research, vol. 20, no. 2, pp. 206-210, May 1985.
36. K. Sakaguchi, "A sequential stochastic assignment problem associated with a non-homogeneous markov process," Japanese Journal of Mathematics, vol. 29, pp. 13-22, 1984.
37. -, "Best choice problems for randomly arriving offers during a random lifetime," Japanese Journal of Mathematics, vol. 31, pp. 107-117, 1986.
38. V. Shestak, E. K. P. Chong, A. A. Maciejewski, H. J. Siegel, L. Benmohamed, I.-J. Wang, and R. Daley, "A hybrid branchand- bound and evolutionary approach for allocating strings of applications to heterogeneous distributed computing systems," Journal of Parallel and Distributed Computing, vol. 68, no. 4, pp. 410-426, Apr. 2008.
39. V. Shestak, J. Smith, A. A. Maciejewski, and H. J. Siegel, "Stochastic robustness metric and its use for static resource allocations," Journal of Parallel and Distributed Computing, vol. 68, no. 8, pp. 1157-1173, Aug. 2008.
40. th IEEE Real-Time System Symposium (RTSS 2003), Dec. 2003, pp. 469-474.
41. th IEEE Heterogeneous Computing Workshop (HCW '96), 1996, pp. 86-97.
42. J. Smith, L. D. Briceño, A. A. Maciejewski, and H. J. Siegel, "Measuring the robustness of resource allocations in a stochastic dynamic environment," in 21st International Parallel and Distributed Processing Symposium (IPDPS 2007), Mar. 2007.
43. J. Smith, H. J. Siegel, and A. A. Maciejewski, "Robust resource llocation in heterogeneous parallel and distributed computing ystems," in Wiley Encyclopedia of Computing, B. Wah, Ed. New York, NY: John Wiley & Sons, 2009, vol. 4, pp. 2461-2470.
44. P. Sugavanam, H. J. Siegel, A. A. Maciejewski, M. Oltikar, A. Mehta, R. Pichel, A. Horiuchi, V. Shestak, M. Al-Otaibi, Y. Krishnamurthy, S. Ali, J. Zhang, M. Aydin, P. Lee, K. Guru, M. Raskey, and A. Pippin, "Robust static allocation of resources for independent tasks under makespan and dollar cost constraints," Journal of Parallel and Distributed Computing, vol. 67, no. 4, pp. 400-416, Apr. 2007.
45. T. Tannenbaum, D. Wright, K. Miller, and M. Livny, Condor - A Distributed Job Scheduler, ser. Beowulf Cluster Computing with Linux, T. Sterling, Ed. Cambridge, MA: The MIT Press, 2002.
46. L. Wang, H. J. Siegel, V. P. Roychowdhury, and A. A. Maciejewski, "Task matching and scheduling in heterogeneous computing environments using a genetic-algorithm-based approach," Journal of Parallel and Distributed Computing, vol. 47, no. 1, pp. 8-22, Nov. 1997.
47. D. Xu, K. Nahrstedt, and D. Wichadakul, "QoS and contentionaware multi-resource reservation," Cluster Computing, vol. 4, no. 2, pp. 95-107, Apr. 2001.
48. J. Yang, I. Ahmad, and A. Ghafoor, "Estimation of execution times on heterogeneous supercomputer architectures," in International Conference on Parallel Processing, vol. 1, Aug. 1993, pp. 219-225.
49. st International Parallel and Distributed Processing Symposium (IPDPS 2006), Apr. 2006, pp. 21-27.