Reinforcement learning-based dynamic adaptation planning method for architecture-based self-managed software

Proceedings of the 2009 ICSE Workshop on Software Engineering for Adaptive and Self-Managing Systems, SEAMS 2009

Volumn , Issue , 2009, Pages 76-85

  Kim, Dongsun ^a   Park, Sooyong ^a  

^a Sogang University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

CHANGING ENVIRONMENT; DYNAMIC ADAPTATIONS; DYNAMIC ENVIRONMENTS; ENVIRONMENTAL CHANGE; IS PLANNING; KEY ISSUES; OFF-LINE PLANNING; ON-LINE PLANNING; PLANNING METHOD; PRIOR EXPERIENCE; RUNTIMES; SELF MANAGEMENT; SOFTWARE CONFIGURATION; SOFTWARE SYSTEMS;

EDUCATION; PLANNING; REINFORCEMENT; REINFORCEMENT LEARNING; SOFTWARE ARCHITECTURE;

COMPUTER SOFTWARE;

EID: 70349912234     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SEAMS.2009.5069076     Document Type: Conference Paper

References (23)

1. T. Bäck. Adaptive business intelligence based on evolution strategies: some application examples of self-adaptive software. Inf. Sci., 148(1-4):113-121, 2002.
2. P. Bertoli, A. Cimatti, M. Pistore, M. Roveri, and P. Traverso. Mbp: a model based planner. In IJCAI'01 Workshop on Planning Under Uncertainty and Incomplete Information, 2001.
3. C. J. C. Burges. A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Discov., 2(2):121-167, 1998.
4. J. Floch, S. O. Hallsteinsen, E. Stav, F. Eliassen, K. Lund, and E. Gjørven. Using architecture models for runtime adaptability. IEEE Software, 23(2):62-70, 2006.
5. D. Garlan, S.-W. Cheng, A.-C. Huang, B. R. Schmerl, and P. Steenkiste. Rainbow: Architecture-based self-adaptation with reusable infrastructure. IEEE Computer, 37(10):46-54, 2004.
6. H. Gomaa and M. Hussein. Software reconfiguration patterns for dynamic evolution of software architectures. In 4th Working IEEE / IFIP Conference on Software Architecture (WICSA 2004), 12-15 June 2004, Oslo, Norway, pages 79-88, 2004.
7. M. Harman and B. F. Jones. Search-based software engineering. Information & Software Technology, 43(14):833-839, 2001.
8. IBM. Robocode, http://robocode.alphaworks.ibm.com/home/ home.html, 2004.
9. G. Klein. Flexecution as a paradigm for replanning, part 1. IEEE Intelligent Systems, 22(5):79-83, 2007.
10. G. Klein. Flexecution, part 2: Understanding and supporting flexible execution. IEEE Intelligent Systems, 22(6):108-112, 2007.
11. J. Kramer and J. Magee. Self-managed systems: an architectural challenge. In FOSE '07: 2007 Future of Software Engineering, pages 259-268, Washington, DC, USA, 2007. IEEE Computer Society.
12. R. Laddaga. Active software. In P. Robertson, H. E. Shrobe, and R. Laddaga, editors, Proceedings of the First International Workshop on Self-Adaptive Software, IWSAS 2000, volume 1936 of Lecture Notes in Computer Science, pages 11-26. Springer, 2000.
13. J. Mylopoulos. Goal-oriented requirements engineering. In 12th Asia-Pacific Software Engineering Conference (APSEC 2005), 15-17 December 2005, Taipei, Taiwan, page 3, 2005.
14. P. Oreizy, N. Medvidovic, and R. N. Taylor. Architecture-based runtime software evolution. In ICSE '98: Proceedings of the 20th international conference on Software engineering, pages 177-186, Washington, DC, USA, 1998. IEEE Computer Society.
15. C. Rolland, C. Souveyet, and C. B. Achour. Guiding goal modeling using scenarios. IEEE Trans. Software Eng., 24(12):1055-1071, 1998.
16. F. Rosenblatt. The perception: a probabilistic model for information storage and organization in the brain. Neurocomputing: foundations of research, pages 89-114, 1988.
17. A. G. Sutcliffe, N. A. M. Maiden, S. Minocha, and D. Manuel. Supporting scenario-based requirements engineering. IEEE Trans. Software Eng., 24(12):1072-1088, 1998.
18. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. Cambridge, Massachusetts, The MIT Press, 1998.
19. D. Sykes, W. Heaven, J. Magee, and J. Kramer. From goals to components: a combined approach to self-management. In SEAMS '08: Proceedings of the 2008 international workshop on Software engineering for adaptive and self-managing systems, pages 1-8, New York, NY, USA, 2008. ACM.
20. A. van Lamsweerde. Goal-oriented requirements engineering: A guided tour. In 5th IEEE International Symposium on Requirements Engineering (RE 2001), 27-31 August 2001, Toronto, Canada, page 249, 2001.
21. A. van Lamsweerde and L. Willemet. Inferring declarative requirements specifications from operational scenarios. IEEE Trans. Software Eng., 24(12):1089-1114, 1998.
22. V. N. Vapnik. The Nature of Statistical Learning Theory. Springer-Verlag, New York., 1995.
23. C. J. C. H. Watkins. Learning from Delayed Rewards. PhD thesis, Cambridge University, 1989.