Market-based resource allocation using price prediction in a high performance computing grid for scientific applications

Proceedings of the IEEE International Symposium on High Performance Distributed Computing

Volumn 2006, Issue , 2006, Pages 132-143

  Sandholm, Thomas ^a   Lai, Kevin ^b   Ortíz, Jorge Andrade ^c   Odeberg, Jacob ^c,d  

^a Parallelldatorcentrum   (Sweden)

^b HEWLETT PACKARD LABORATORIES   (United States)

^c ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^d KAROLINSKA UNIVERSITY HOSPITAL   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL METHODS; MARKETING; MULTIPLEXING; QUALITY OF SERVICE; RESOURCE ALLOCATION; STATISTICAL METHODS;

COMPUTATIONAL MARKET; COMPUTING GRID; MARKET BASED RESOURCE ALLOCATION SYSTEM; QUANTITY OF SERVICE;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 33845897137     PISSN: 10828907     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (43)

1. Yellow dog Updater, Modified, http://linux.duke.edu/projects/yum/.
2. SUN, Queen's Univ, First Derivatives to Speed Bank Risk Analysis. GRID today, 3(30), July 2004.
3. The Grid for the Video Industry. GRIDSTART Business Newsletter, (2):4, April 2004.
4. EGEE. Enabling Grids for ESciencE. http://egee-intranet.web.cem.ch/egee- intranet/gateway.html, 2005.
5. ESG. Earth System Grid, http://www.earthsystemgrid.org, 2005.
6. NEESit. http://it.nees.org/, 2005.
7. OSG. Open Science Grid, http://www.opensciencegrid.org, 2005.
8. TeraGrid. http://www.teragrid.org, 2005.
9. J. Andrade and J. Odeberg. HapGrid: a resource for haplotype reconstruction and analysis using the computational Grid power in Nordugrid. HGM2004: New Technologies in Haplo-typing and Genotyping, April 2004.
10. D. Bosio, J. Casey, A. Frohner, L. Guy, P. Kunszt, E. Laure, S. Lemaitre, L. Lucio, H. Stockinger, K. Stockinger, W. Bell, D. Cameron, G. McCance, P. Millar, J. Hahkala, N. Karlsson, V. Nenonen, M. Silander, O. Mulmo, G.-L. Volpato, G. Andronico, F. DiCarlo, L. Salconi, A. Domenici, R. Carvajal-Schiaffino, and F. Zini. Next-generation eu datagrid data management services. In Proceedings of Computing in High Energy and Nuclear Physics, La Jolla, CA, USA, March 2003.
11. Brent N. Chun and Philip Buonadonna and Chaki Ng. Computational Risk Management for Building Highly Reliable Network Services. In Proceedings of the 1st Workshop on Hot Topics in System Dependability, 2005.
12. R. Buyya, D. Abramson, and S. Venugopal. The Grid Economy. Proceedings of the IEEE, Special Issue on Grid Computing, 93(3):479-484, March 2005.
13. R. Buyya, M. Murshed, D. Abramson, and S. Venugopal. Scheduling Parameter Sweep Applications on Global Grids: A Deadline and Budget Constrained Cost-Time Optimisation Algorithm. Software: Practice and Experience (SPE) Journal, 35(5):491-512, April 2005.
14. G. Caronni, T. Curry, P. S. Pierre, and G. Scott. Supernets and snHubs: A Foundation for Public Utility Computing. Technical Report TR-2004-129, Sun Microsystems, 2004.
15. A. Chavez, A. Moukas, and P. Maes. Challenger: a multi-agent system for distributed resource allocation. In AGENTS '97: Proceedings of the first international conference on Autonomous agents, pages 323-331, New York, NY, USA, 1997. ACM Press.
16. B. N. Chun, P. Buonadonna, and C. Ng. Computational Risk Management for Building Highly Reliable Network Services. In Proceedings of the IEEE First Workshop on Hot Topics in System Dependability, 2005.
17. L. ChunLin and L. Layuan. A two level market model for resource allocation optimization in computational grid. In CF '05: Proceedings of the 2nd conference on Computing frontiers, pages 66-71, New York, NY, USA, 2005. ACM Press.
18. S. Clearwater and B. A. Huberman. Swing Options. In Proceedings of 11th International Conference on Computing in Economics, June 2005.
19. B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, I. Pratt, A. Warfield, P. Barham, and R. Neugebauer. Xen and the Art of Virtualization. In Proceedings of the ACM Symposium on Operating Systems Principles, 2003.
20. M. Feldman, K. Lai, and L. Zhang. A Price-Anticipating Resource Allocation Mechanism for Distributed Shared Clusters. In Proceedings of the ACM Conference on Electronic Commerce, 2005.
21. I. Foster. Globus toolkit version 4: Software for service-oriented systems. In IFIP'05: Proceedings of International Conference on Network and Parallel Computing, volume 3799, pages 2-13. LNCS, Springer-Verlag GmbH, 2005.
22. I. Foster and C. Kessleman, editors. The Grid 2: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, 2003.
23. The Future and Emerging Technologies Global Computing Initiative. Technical report, European Commision, DG Information Society, July 2005.
24. S. Graupner, J. Pruyne, and S. Sherad. Making the Utility Data Center a Power Station for the Enterprise Grid. Technical Report HPL-2003-53, Hewlett-Packard Laboratories, 2003.
25. L. J. Halliwell. Mean-Variance Analysis and the Diversification of Risk, Casualty Actuarial Society, St. Louis, Missouri, USA, May 1995.
26. J. Hellerstein, K. Katricioglu, and M. Surendra. An Online, Business-Oriented Optimization of Performance and Availability for Utility Computing. Technical Report RC23325, IBM, December 2003.
27. L. V. Kale, S. Kumar, M. Potnuru, J. DeSouza, and S. Bandhakavi. Faucets: Efficient resource allocation on the computational grid. In ICPP '04: Proceedings of the 2004 International Conference on Parallel Processing (ICPP'04), pages 396-05, Washington, DC, USA, 2004. IEEE Computer Society.
28. G. Kan. Peer-to-Peer: Harnessing the Power of Disruptive Technologies, chapter Gnutella, pages 94-122. O'Reilly & Associates, Inc., 1st edition, March 2001.
29. K. Lai. Markets are Dead, Long Live Markets. SIGecom Exchanges, 5(4):1-10, July 2005.
30. K. Lai, B. A. Huberman, and L. Fine. Tycoon: A Distributed Market-based Resource Allocation System. Technical report, arXiv, 2004. http://arxiv.org/abs/ cs.DC/0404013.
31. K. Lai, L. Rasmusson, E. Adar, S. Sorkin, L. Zhang, and B. A. Huberman. Tycoon: an Implemention of a Distributed Market-Based Resource Allocation System. Technical Report arXiv:cs.DC/0412038, HP Labs, Palo Alto, CA, USA, Dec. 2004.
32. L. Ljung. System Identification: Theory for the User. Prentice Hall, December 1998.
33. T. W. Malone, R. E. Fikes, K. R. Grant, and M. T. Howard. Enterprise: A Market-like Task Scheduler for Distributed Computing Environments. In B. A. Huberman, editor, The Ecology of Computation, number 2 in Studies in Computer Science and Artificial Intelligence, pages 177-205. Elsevier Science Publishers B.V., 1988.
34. H. M. Markowitz. Portfolio Selection. Journal of Finance, 7(1), March 1952.
35. O. Regev and N. Nisan. The Popcorn Market: Online Markets for Computational Resources. In Proceedings of 1st International Conference on Information and Computation Economies, pages 148-157, 1998.
36. T. Sandholm, emediator: a next generation electronic commerce server. In AGENTS '00: Proceedings of the fourth international conference on Autonomous agents, pages 341-348, New York, NY, USA, 2000. ACM Press.
37. T. Sandholm, P. Gardfjell, E. Elmroth, L. Johnsson, and O. Mulmo. An ogsa-based accounting system for allocation enforcement across hpc centers. In ICSOC '04: Proceedings of the 2nd international conference on Service oriented computing, pages 279-288, New York, NY, USA, 2004. ACM Press.
38. O. Smimova, P. Erola, T. Ekelöf, M. Ellert, J. Hansen, A. Konsantinov, B. Konya, J. Nielsen, F. Ould-Saada, and A. Wäänä nen. The NorduGrid Architecture and Middleware for Scientific Applications. Lecture Notes in Computer Science, 267:264-273, 2003.
39. M. Stonebraker, P. M. Aoki, W. Litwin, A. Pfeffer, A. Sah, J. Sidell, C. Staelin, and A. Yu. Mariposa: a wide-area distributed database system. The VLDB Journal, 5(1):048-063, 1996.
40. C. A. Waldspurger, T. Hogg, B. A. Huberman, J. O. Kephart, and W. S. Stometta. Spawn: A Distributed Computational Economy. Software Engineering, 18(2): 103-117, 1992.
41. R. Wolski, J. S. Plank, T. Bryan, and J. Brevik. G-commerce: Market formulations controlling resource allocation on the computational grid. In IPDPS '01: Proceedings of the 15th International Parallel and Distributed Processing Symposium (IPDPS'01), page 10046.2, Washington, DC, USA, 2001. IEEE Computer Society.
42. F. Wu, L. Zhang, and B. A. Huberman. Truth-telling Reservations. http://arxiv.org/abs/cs/0508028, 2005.
43. L. Xiao, Y. Zhu, L. M. Ni, and Z. Xu. Gridis: An incentive-based grid scheduling. In IPDPS '05: Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers, page 65.2, Washington, DC, USA, 2005. IEEE Computer Society.