Using reinforcement learning for controlling an elastic web application hosting platform

Proceedings of the 8th ACM International Conference on Autonomic Computing, ICAC 2011 and Co-located Workshops

Volumn , Issue , 2011, Pages 205-208

  Li, Han ^a   Venugopal, Srikumar ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

elastic computing; provisioning; reinforcement learning

Indexed keywords

AMAZON EC2; CONTROL ACTIONS; CONTROL MECHANISM; ELASTIC COMPUTING; PERFORMANCE REQUIREMENTS; PROVISIONING; WEB APPLICATION;

COBALT COMPOUNDS; REINFORCEMENT LEARNING; USER INTERFACES; WORLD WIDE WEB;

CLOUD COMPUTING;

EID: 79960187762     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1998582.1998630     Document Type: Conference Paper

References (10)

1. D. Chess et al. Unity: experiences with a prototype autonomic computing system. In Proc. ICAC '04, pages 140-147, 2004.
2. A. Karve et al. Dynamic placement for clustered web applications. In Proc. WWW '06, pages 595-604, Edinburgh, Scotland, 2006. ACM.
3. H. Li and S. Venugopal. Using reinforcement learning for controlling an elastic web application hosting platform. Technical Report UNSW-CSE-TR-1104, CSE,UNSW, 2011.
4. P. Maymounkov and D. MaziŔres. Kademlia: A peer-to-peer information system based on the xor metric. In P. Druschel, F. Kaashoek, and A. Rowstron, editors, Peer-to-Peer Systems, volume 2429 of Lecture Notes in Computer Science, pages 53-65. Springer Berlin / Heidelberg, 2002.
5. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, USA, 1st edition, 1998.
6. G. Tesauro. Reinforcement learning in autonomic computing: A manifesto and case studies. IEEE Internet Computing, 11(1):22-30, 2007. (Pubitemid 46335538)
7. G. Tesauro et al. Utility-Function-Driven resource allocation in autonomic systems. In Proc. ICAC '05, pages 342-343, 2005.
8. B. Urgaonkar et al. An analytical model for multi-tier internet services and its applications. In Proc. SIGMETRICS '05, pages 291-302, New York, NY, USA, 2005. ACM.
9. B. Urgaonkar et al. Dynamic provisioning of multi-tier internet applications. In Proc. ICAC '05, pages 217-228, 2005.
10. C. J. C. H. Watkins and P. Dayan. Q-learning. Machine Learning, 8:279-292, 1992.