A dynamic checkpointing scheme based on reinforcement learning

Proceedings - IEEE Pacific Rim International Symposium on Dependable Computing

Volumn , Issue , 2004, Pages 151-158

  Okamura, Hiroyuki ^a   Nishimura, Yuki ^a   Dohi, Tadashi ^a  

^a HIROSHIMA UNIVERSITY   (Japan)

Author keywords

Dynamic checkpointing; Q learning; Reinforcement learning; Semi Markov decision process; Uniprocess application

Indexed keywords

DYNAMIC CHECKPOINT; Q-LEARNING; REINFORCEMENT LEARNING; SEMI-MARKOV DECISION PROCESS; UNIPROCESS APPLICATION;

COMPUTER SYSTEM RECOVERY; FAULT TOLERANT COMPUTER SYSTEMS; LEARNING ALGORITHMS; MARKOV PROCESSES; MATHEMATICAL MODELS; POISSON DISTRIBUTION; PROBLEM SOLVING;

LEARNING SYSTEMS;

EID: 2642553870     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PRDC.2004.1276566     Document Type: Conference Paper

References (19)

1. Young, J. W. (1974), A first order approximation to the optimum checkpoint interval, Comm. of the ACM, 17 (9), 530-531.
2. Chandy, K. M. (1975), A survey of analytic models of roll-back and recovery strategies, Computer, 8 (5), 40-47.
3. Chandy, K. M., Browne, J. C., Dissly, C. W. and Uhrig, W. R. (1975), Analytic models for rollback and recovery strategies in database systems, IEEE Trans. Software Eng., SE-1 (1), 100-110.
4. Gelenbe, E. and Derochette, D. (1978), Performance of rollback recovery systems under intermittent failures, Comm. of the ACM, 21 (6), 493-499.
5. Gelenbe, E. (1979), On the optimum checkpoint interval, J. of the ACM, 26 (2), 259-270.
6. Sumita, U., Kaio, N. and Goes, P. B. (1989), Analysis of effective service time with age dependent interruptions and its application to optimal rollback policy for database management, Queueing Systems, 4, 193-212.
7. Nicola, V. F. and Van Spanje, J. M. (1990), Comparative analysis of different models of checkpointing and recovery, IEEE Trans. Software Eng., SE-16 (8), 807-821.
8. Goes, P. B. and Sumita, U. (1995), Stochastic models for performance analysis of database recovery control, IEEE Trans. Computer, C-44 (4), 561-576.
9. Goes, P. B. (1997), A stochastic model for performance evaluation of main memory resident database systems, ORSA J. of Computing, 7 (3), 269-282.
10. Dohi, T., Kaio, N. and Osaki, S. (1999), Optimal checkpointing and rollback strategies with media failures: statistical estimation algorithms, Proc. 1999 Pacific Rim Int. Sympo. on Dependable Comput., 161-168, IEEE CS Press, Los Alamitos.
11. Grassi, V., Donatiello, L. and Tucci, S. (1992), On the optimal checkpointing of critical tasks and transaction-oriented systems, IEEE Trans. Software Eng., SE-18(1), 72-77.
12. Ziv, A. and Bruck, J. (1997), An on-line algorithm for checkpoint placement, IEEE Trans. Computer, C-46 (9), 976-985.
13. Vaidya, N. H. (1997), Impact of checkpoint latency on overhead ratio of a checkpointing scheme, IEEE Trans. Computer, C-46 (8), 942-947.
14. Toueg, S. and Babaoglu, Ö. (1984), On the optimum checkpoint selection problem, SIAM J. Comput., 13 (3), 630-649.
15. L'Ecuyer, P. and Malenfant, J. (1988), Computing optimal checkpointing strategies for rollback and recovery systems, IEEE Trans. Computer, C-37 (4), 491-496.
16. Sutton, R. S. and Barto, A. G. (1998), Reinforcement Learning: An Introduction, MIT Press, Cambridge.
17. Watkins, C. J. C. H. and Dayan, P. (1992), Technical note: Q-Learning, Machine Leaning, 8, 279-292.
18. Bradtke, S. J. and Duff, M. O. (1994), Reinforcement learning method for continuous-time Markov decision problems, Advances in Neural Information Processing Systems, 7, 393-400.
19. Puterman, M. (1994), Markov Decision Processes, John Wiley & Sons, New York.