Bidding strategies in QoS-Aware cloud systems based on N-Armed bandit problems

Proceedings - IEEE 3rd Symposium on Network Cloud Computing and Applications, NCCA 2014

Volumn , Issue , 2014, Pages 38-45

  Abundo, Marco ^a   Valerio, Valerio Di ^a   Cardellini, Valeria ^a   Presti, Francesco Lo ^a  

^a UNIVERSITY OF ROME TOR VERGATA   (Italy)

Author keywords

auctions; Cloud computing; N armed bandit problems; provisioning; QoS; SLA

Indexed keywords

CLOUD COMPUTING; PROBABILITY; QUALITY OF SERVICE; SOFTWARE AS A SERVICE (SAAS); STAGES; WEB SERVICES;

AUCTIONS; BANDIT PROBLEMS; EXPLORATION AND EXPLOITATION; NUMERICAL EXPERIMENTS; PROVISIONING; PROVISIONING SCHEMES; SLA; STANDARD OPTIMIZATION;

INFRASTRUCTURE AS A SERVICE (IAAS);

EID: 84899445746     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/NCCA.2014.15     Document Type: Conference Paper

References (22)

1. Amazon, "AWS EC2 pricing," 2013. [Online]. Available: http://aws. amazon. com/ec2/pricing/
2. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge Univ. Press, 1998
3. N. H. Mastronarde and M. van der Schaar, "Automated bidding for media services at the edge of a content delivery network," IEEE Trans. on Multimedia, vol. 11, no. 3, 2009
4. K. Song, Y. Yao, and L. Golubchik, "Improving the revenue, efficiency and reliability in data center spot market: A truthful mechanism," in Proc. of IEEE MASCOTS 2013, 2013
5. W. Wang, B. Liang, and B. Li, "Revenue maximization with dynamic auctions in IaaS cloud markets," in Proc. of IWQoS 2013, 2013
6. M. P. Wellman and J. Hu, "Conjectural equilibrium in multiagent learning," Mach. Learn., vol. 33, no. 2-3, pp. 179-200, Dec. 1998
7. N. H. Mastronarde, V. Patel, J. Xu, and M. van der Schaar, "To relay or not to relay: Learning relaying strategies in cellular device-to-device networks," CoRR, 2013, abs/1308. 3185
8. F. Fu and M. van der Schaar, "Learning to compete for resources in wireless stochastic games," IEEE Trans. Vehicular Technology, vol. 58, no. 4, pp. 1904-1919, 2009
9. M. Couceiro, P. Romano, and L. Rodrigues, "Polycert: Polymorphic self-optimizing replication for in-memory transactional grids," in Proc. of 12th ACM/IFIP/USENIX Int'l Conf. on Middleware, 2011, pp. 309-328
10. P. Romano and M. Leonetti, "Self-tuning batching in total order broadcast protocols via analytical modelling and reinforcement learning," in Proc. of 12th IEEE Int'l Conf. on Computing, Networking and Communications, 2012
11. O. Agmon Ben-Yehuda, M. Ben-Yehuda, A. Schuster, and D. Tsafrir, "Deconstructing Amazon EC2 spot instance pricing," ACM Trans. Econ. Comput., vol. 1, no. 3, Sep. 2013
12. Q. Zhang, E. G̈urses, R. Boutaba, and J. Xiao, "Dynamic resource allocation for spot markets in clouds," in Proc. of USENIX Hot-ICE 2011, 2011
13. J. Chen, C. Wang, B. B. Zhou, L. Sun, Y. C. Lee, and A. Y. Zomaya, "Tradeoffs between profit and customer atisfaction for service provisioning in the cloud," in Proc. of 20th Int'l Symp. on High Performance Distributed Computing, 2011, pp. 229-238
14. H. Robbins, "Some aspects of the sequential design of experiments," Bull. of American Mathematical Society, vol. 58, no. 5, pp. 527-535, 1952
15. T. Lai and H. Robbins, "Asymptotically efficient adaptive allocation rules," Advances in Appl. Mathematics, vol. 6, no. 1, pp. 4-22, 1985
16. D. Kalathil, N. Nayyar, and R. Jain, "Decentralized learning for multi-player multi-armed bandits," in Proc. of IEEE 51st Conf. on Decision and Control, 2012, pp. 3960-3965
17. M. Babaioff, Y. Sharma, and A. Slivkins, "Characterizing truthful multi-armed bandit mechanisms," Proc, of ACM EC 2009 (2013's version on arXiv), 2009-2013
18. R. Gonen and E. Pavlov, "An incentive-compatible multiarmed bandit mechanism," in Proc. of 26th ACM Symposium on Principles of Distributed Computing, 2007, pp. 362-363
19. P. Rusmevichientong and D. P. Williamson, "An adaptive algorithm for selecting profitable keywords for search-based advertising services," in Proc. of 7th ACM Conf. on Electronic Commerce, ser. EC '06, 2006, pp. 260-269
20. D. Ardagna, B. Panicucci, and M. Passacantando, "Generalized Nash equilibria for the service provisioning problem in cloud systems," IEEE Trans. Serv. Comput., no. 4, pp. 429-442, 2013
21. V. Di Valerio, V. Cardellini, and F. Lo Presti, "Optimal pricing and service provisioning strategies in cloud systems: a Stackelberg game approach," in Proc. of IEEE 6th Int'l Conf. on Cloud Computing, ser. Cloud '13, 2013, pp. 115-122
22. P. Auer, N. Cesa-Bianchi, and P. Fischer, "Finite-time analysis of the multiarmed bandit problem," Mach. Learn., vol. 47, no. 2, pp. 235-256, 2002.