A middleware for autonomic QoS management based on learning

SEM 2005 - Proceedings of the 5th International Workshop on Software Engineering and Middleware

Volumn , Issue , 2005, Pages 1-8

  Vienne, Patrice ^a   Sourrouille, Jean Louis ^a  

^a UNIVERSITÉ DE LYON   (France)

Author keywords

middleware; QoS Management; QoS management; reinforcement learning

Indexed keywords

BEST EFFORT; CONTROL MECHANISM; DEGREES OF FREEDOM; DYNAMIC ENVIRONMENTS; EXECUTION CONTEXT; GLOBAL VIEW; QOS MANAGEMENT; REINFORCEMENT LEARNING TECHNIQUES; RESOURCE SHARING;

LEARNING ALGORITHMS; MIDDLEWARE; QUALITY OF SERVICE; REINFORCEMENT; REINFORCEMENT LEARNING; SOFTWARE ENGINEERING;

MANAGEMENT;

EID: 50149097487     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1108473.1108475     Document Type: Conference Paper

References (24)

1. T. F. Abdelzaher. QoS Adaptation in Real-Time Systems. PhD thesis, University of Michigan, Aug. 1999.
2. T. F. Abdelzaher, E. M. Atkins, and K. G. Shin. QoS Negotiation in Real-Time Systems and Its Application to Automated Flight Control. IEEE Transactions on Computers, 49(11):1170-1183, 2000.
3. T. F. Abdelzaher, K. G. Shin, and N. Bhatti. Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach. IEEE Transactions on Parallel and Distributed Systems, 13(1):80-96, 2002.
4. S. Brandt, G. Nutt, T. Berk, and J. Mankovich. A dynamic Quality Of Service Middleware Agent for Mediating Application Resource Usage. In Real-Time Systems Symposium, pages 307-317. IEEE Computer Society, 1998.
5. I. Cardei, R. Jha, M. Cardei, and A. Pavani. Hierarchical Architecture for Real-Time Adaptive Resource Management. In Middleware 2000, volume 1795 of Lecture Notes in Computer Science, pages 415-434, 2000.
6. F. Chang and V. Karamcheti. Automatic Configuration and Run-time Adaptation of Distributed Applications. In High Performance Distributed Computing, pages 11-20. IEEE Computer Society, 2000.
7. H. Domjan and T. R. Gross. Extending a Best-Effort Operating System to provide QoS Processor management. In IWQoS 2001, pages 92-106, 2001.
8. T. Fitzpatrick, G. Blair, G. Coulson, N. Davies, and P. Robin. Supporting Adaptive Multimedia Applications through Open Bindings. In CDS '98: Proceedings of the International Conference on Configurable Distributed Systems, page 128, Washington, DC, USA, 1998. IEEE Computer Society.
9. C. Gaskett. Reinforcement learning under circumstances beyond its control. In International Conference on Computational Intelligence for Modelling Control and Automation, 2003.
10. M. Heger. Consideration of risk in reinforcement learning. In Proc. 11th International Conference on Machine Learning, pages 105-111. Morgan Kaufmann, 1994.
11. G. Huang, T. Liu, H. Mei, Z. Zheng, Z. Liu, and G. Fan. Towards Autonomic Computing Middleware via Reflection. In COMPSAC, pages 135-140, 2004.
12. T. Jaakkola, S. P. Singh, and M. I. Jordan. Reinforcement Learning Algorithm for Partially Observable Markov Decision Problems. In G. Tesauro, D. Touretzky, and T. Leen, editors, Advances in Neural Information Processing Systems, volume 7, pages 345-352. MIT Press, 1995.
13. J. O. Kephart and D. M. Chess. The vision of autonomic computing. IEEE Computer Society, 36(1):41-50, 2003.
14. R. Laddaga, P. Robertson, and H. E. Shrobe. Introduction to Self-adaptive Software: Applications. In IWSAS 2001, pages 1-5. Springer, 2003.
15. C. Lee, J. Lehoczky, R. Rajkumar, and D. Siewiorek. On Quality of Service Optimization with Discrete QoS Options. In Real Time Technology and Applications Symposium, pages 276-286. IEEE Computer Society, 1999.
16. C. Lee and D. Siewiorek. An Approach for Quality of Service Management. Technical Report CMU-CS-98-165, Computer Science Department, Carnegie Mellon University, Oct. 1998.
17. B. Li and K. Nahrstedt. QualProbes: Middleware QoS Profiling Services for Configuring Adaptive Applications. In Middleware 2000: IFIP/ACM International Conference on Distributed Systems Platforms, volume 1795 of Lecture Notes in Computer Science, pages 256-272. Springer-Verlag, 2000.
18. J. Peng and R. J. Williams. Incremental Multi-Step Q-Learning. In International Conference on Machine Learning, pages 226-232, 1994.
19. R. Rajkumar, C. Lee, J. P. Lehoczky, and D. P. Siewiorek. A Resource Allocation Model for QoS Management. In Real-Time Systems Symposium, pages 298-307. IEEE Computer Society, 1997.
20. P. Stefán and L. Monostori. On the relationship between learning capability and the boltzmann-formula. In Engineering of Intelligent Systems, 14th International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems, IEA/AIE 2001, volume 2070 of Lecture Notes in Computer Science, pages 227-236, 2001.
21. R. S. Sutton and A. G. Barto. Reinforcement Learning: an Introduction. MIT Press, 1998.
22. P. Vienne, J.-L. Sourrouille, and M. Maranzana. Modeling Distributed Applictions for QoS Management. In Software Engineering and Middleware : 4th International Workshop, SEM 2004, volume 3437 of Lecture Notes in Computer Science, pages 170-184, 2005.
23. C. J. C. H. Watkins and P. Dayan. Q-Learning. Machine Learning, 8:279-292, 1992.
24. S. Whiteson and P. Stone. Towards Autonomic Computing: Adaptive Network Routing and Scheduling. In International Conference on Autonomic Computing (ICAC), pages 286-287. IEEE Computer Society, 2004.