Using reinforcement learning for proactive network fault management

International Conference on Communication Technology Proceedings, ICCT

Volumn 1, Issue , 2000, Pages 515-521

  He, Qiming ^a   Shayman, Mark A ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

ATM.; Intelligent agents; Network fault management; POMDP; Proactive diagnosis; Reinforcement learning

Indexed keywords

AUTOMATIC TELLER MACHINES; FAILURE ANALYSIS; HIGH SPEED NETWORKS; INFORMATION MANAGEMENT; INTELLIGENT AGENTS; MARKOV PROCESSES; NETWORK PERFORMANCE; REINFORCEMENT LEARNING; SWITCHING CIRCUITS;

DISTRIBUTED INTELLIGENT AGENT; FAULT DETECTION AND DIAGNOSIS; NETWORK FAULT MANAGEMENT; NETWORK SIMULATORS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; POMDP; PROACTIVE FAULT MANAGEMENTS; PROACTIVE NETWORKS;

FAULT DETECTION;

EID: 84950144430     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCT.2000.889257     Document Type: Conference Paper

References (27)

1. Baras J., Li H., Mykoniatis G. (1998), Integrated, Distributed Fault Management for Communication Networks, ISR technical report TR 98-21.
2. Bellman R. E., (1,957), Dynamic Programming, Princeton University Press.
3. Bertsekas, D. P., (1995), Dynamic Programming and Optimal Control, Athena Scientific.
4. Cassandra, A. R., Exact and Approximate Algorithms for Partially Observable Markov Decision Processes http://www.cs.brown.edu/research/ai/pomdp/index.htm Ph.D. Thesis. Brown University, Department of Computer Science. 1998.
5. Cassandra A. R. A Survey of POMDP Applications, 1998. http://www.cs.duke.edu/mlittman/talks/fs98-pomdp/working-notes.html
6. Goldszmidt G., Yemini, (1995), Distributed management by delegation, 15th International Conference on Distributed Computing.
7. Hauskrecht M., Fraser H. (1998), Modeling Treatment of Ischemic Heart Disease with Partially Observable Markov Decision Processes, In Proceedings of American Medical Informatics Association annual symposium on Computer Applications in Health Care, Orlando, Florida, pp. 538-542.
8. He Q., Shayman M. A., (1999), Using POMDP as Modeling Framework for Network Fault Management, ISR Technical Report, TR99-67.
9. He Q., Shayman M. A., (1999), Solving POMDP by On-line Linear Approximate Learning Algorithm, ISR Technical Report, TR99-68.
10. Hood C.S., Ji Chuanyi, (1997), Automated Proactive Anomaly Detection, Integrated Network Management V, Proceedings of the Fifth IFIP/IEEE international Symposium on Integrated Network Management, p. 688-699.
11. HP Solution Note (1997), Testing Operation and Maintenance Implementation for ATM, ATM/Broadband Testing seminar, Hewlett-Packard.
12. Huard J. F, Lazar A. A., (1996), Fault Isolation based on Decision-Theoretic Troubleshooting, TR442-96-08, COMET, Columbia University.
13. ITU-T Recommendation, (1995), 1.610 B-ISDN Operation and Maintenance.
14. Kaelbling L. P., Littman M. L. Moore, A. W., (1996), Reinforcement Learning: A Survey, Journal of Artificial Intelligence Research, Volume 4.
15. Kaelbling L. P., Littman M. L., Cassandra, A. R. (1998), Planning and Acting in Partially Observable Stochastic Domains, Artificial Intelligence, Vol. 101.
16. Kimura, H., Miyazaki, K., and Kobayashi, S., Reinforcement Learning in POMDPs with Function Approximation, Proceedings of the 14th International Conference on Machine Learning, pp. 152-160. 1997.
17. Littman, M. L., Cassandra, A. R., Kaelbling L. P., (1998), Learning policies for partially observable environments: Scaling up, Proceedings of the Twelfth International Conference on Machine Learning, p362-370.
18. Loch J, Singh S., Using Eligibility Traces to Find the Best Memoryless Policy in Partially Observable Markov Decision Processes, ICML98.
19. MIL3 Inc. (1998) OPNET 4.0 User-Manual.
20. Nygate Y. A., (1995), Event Correlation using Rule Based and Object Based Techniques, Proceedings of fourth international symposium on integrated network management, ed. by A.S. Sethi.
21. Sondik E. J. (1971), The optimal control of partially observable Markov Processes, Ph.D. Thesis Stanford University.
22. Stuart J. Russell, Peter Norvig, Artifical Intelligence: A Modern Appraoch, Prentice-Hall, Engle-wood Cliffs, New Jersey. 1994.
23. Sutton R, S., (1998), Reinforcement Learning: An introduction, MIT Press.
24. Thottan M., Ji Chuanyi, (1998), Proactive Anomaly Detection Using Distributed Intelligent Agents, IEEE Networks Sept/Oct p 21-27.
25. Watkins C. J. C. H., Dayan P. (1992), Technical note: Q-learning, Machine Learning, 8(3/4) p. 272-292.
26. Yemini, A., et al. (1996) High Speed and Robust Event Correlation, IEEE Communication Magazine, p 82-90, May 1996.
27. Zhang N., Liu W., (1997), A Model Approximate Scheme for Planning in Partially Observable Stochastic Domains, Journal of Artificial Intelligence, 7, p. 199-230.