Multiple perspective dynamic decision making

Artificial Intelligence

Volumn 105, Issue 1-2, 1998, Pages 209-261

  Leong, Tze Yun ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Decision making; Knowledge representation; Multiple perspective reasoning; Probabilistic reasoning; Semi Markov decision processes; Temporal reasoning

Indexed keywords

COMPUTER SIMULATION LANGUAGES; DECISION THEORY; KNOWLEDGE ACQUISITION; KNOWLEDGE REPRESENTATION; MARKOV PROCESSES; PROBABILISTIC LOGICS; PROBLEM SOLVING;

DYNAMIC DECISION MODELING LANGUAGE (DYNAMOL) PROGRAMMING LANGUAGE; MULTIPLE PERSPECTIVE DYNAMIC DECISION MAKING; SEMI-MARKOV DECISION PROCESSES;

DECISION MAKING;

EID: 0032179510     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0004-3702(98)00082-4     Document Type: Article

References (78)

1. A.G. Barto, S.J. Bradtke, S.P. Singh, Learning to act using real-time dynamic programming, Artificial Intelligence 72 (1-2) (1995) 81-138.
2. J.R. Beck and S.G. Pauker, The Markov process in medical prognosis, Medical Decision Making 3 (1983) 419-458.
3. R.A. Bellman, Dynamic Programming, Princeton University Press, Princeton, NJ, 1957.
4. D.P. Bertsekas, Dynamic Programming: Deterministic and Stochastic Models, Prentice-Hall, Englewood Cliffs, NJ, 1987.
5. C. Berzuini, R. Bellazzi, S. Quaglini, Temporal reasoning with probabilities, in: Proceedings 5th Workshop on Uncertainty in Artificial Intelligence, Association for Uncertainty in Artificial Intelligence, 1989, pp. 14-21.
6. C. Boutilier, R.I. Brafman, C. Geib, Prioritized goal decomposition of Markov decision processes: toward a synthesis of classical and decision theoretic planning, in: Proceedings 15th International Joint Conference on Artificial Intelligence (IJCAI-97), Nagoya, Japan, 1997.
7. C. Boutilier, R. Dearden, M. Goldszmidt, Exploiting structure in policy construction, in: Proceedings 14th International Joint Conference on Artificial Intelligence (IJCAI-95), Montreal, Quebec, 1995, pp. 1104-1111.
8. J.S. Breese, Construction of belief and decision networks, Computational Intelligence 8 (1992) 624-647.
9. C. Cao, T.Y. Leong, Learning conditional probabilities for influence views, in: Working Notes IJCAI Workshop on Intelligent Data Analysis in Medicine and Pharmacology (IDAMAP-97), 1997, pp. 11-19.
10. C. Cao, T.Y. Leong, A. Peng Kiong Leong, F. Choen Seow, Dynamic decision analysis in medicine: a data-driven approach, Internat. J. Medical Informatics, to appear.
11. B.Y. Chan, R.D. Shachter, Structural controllability and observability in influence diagrams, in: D. Dubois, M.P. Wellman, B.D. D'Ambrosio, P. Smets (Eds.), Proceedings 8th Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, San Mateo, CA, 1992, pp. 25-32.
12. D. Chapman, Planning for conjunctive goals, Artificial Intelligence 32 (1987) 333-377.
13. K. Currie, A. Tate, O-Plan: the open planning architecture, Artificial Intelligence 51 (1) (1991) 49-86.
14. P. Dagum, A. Galper, Forecasting sleep apnea with dynamic network models, in: D. Heckerman, A. Mamdami (Eds.), Proceedings 9th Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, San Mateo, CA, 1993, pp. 64-71.
15. P. Dagum, A. Galper, E. Horvitz, Dynamic network models for forecasting, in: D. Dubois, M.P. Wellman, B.D. D'Ambrosio, P. Smets (Eds.), Proceedings 8th Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, San Mateo, CA, 1992, pp. 41-48.
16. T. Dean, Decision-theoretic planning and Markov decision processes. Tutorial presented at the Summer Institute on Probability and Artificial Intelligence, Corvalis, OR, 1994.
17. T. Dean, R. Givan, S. Leach, Model reduction techniques for computing approximately optimal solutions for Markov decision processes, in: Proceedings 13th Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, San Mateo, CA, 1997, pp. 124-131.
18. T. Dean, L.P. Kaelbling, J. Kirman, A. Nicholson, Deliberation scheduling for time-critical sequential decision making, in: D. Heckerman, A. Mamdami (Eds.), Proceedings 9th Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, San Mateo, CA, 1993, pp. 309-316.
19. T. Dean, L.P. Kaelbling, J. Kirman, A. Nicholson, Planning with deadlines in stochastic domains, in: Proceedings 11th National Conference on Artificial Intelligence (AAAI-93), Washington, DC, 1993, pp. 574-579.
20. T. Dean, S. Kambhampati, Planning and scheduling, in: A.B. Tucker (Ed.), The Computer Science and Engineering Handbook, CRC Press, Rockville, MD, 1997, pp. 614-636.
21. T. Dean, J. Kriman, K. Kanazawa, Probabilistic network representations of continuous-time stochastic processes for applications in planning and control, in: Proceedings 1st International Conference on AI Planning Systems, 1992.
22. R. Dearden, C. Boutilier, Abstraction and approximate decision-theoretic planning, Artificial Intelligence 89 (1-2) (1997) 219-283.
23. M. Drummond, J. Bresina, Ayntime synthetic projection: maximizing the probability of goal satisfaction, in: Proceedings 8th National Conference on Artificial Intelligence (AAAI-90), Boston, MA, 1990, 138-144.
24. J.W. Egar, M.A. Musen, Graph-grammar assistance for automated generation of influence diagrams, in: D. Heckerman, A. Mamdami (Eds.), Proceedings 9th Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, San Mateo, CA, 1993, pp. 235-242.
25. K. Erol, J. Hendler, D.S. Nau, HTN planning: complexity and expressitivity, in: Proceedings 12th National Conference on Artificial Intelligence (AAA1-94), Seattle, WA, 1994.
26. R.E. Fikes, N.J. Nilsson, STRIPS: a new approach to the application of theorem proving to problem solving, Artificial Intelligence 2 (1971) 189-208.
27. M.R. Genesereth, N.J. Nilsson, Logical Foundations of Artificial Intelligence, Morgan Kaufmann, San Mateo, CA, 1987.
28. R.P. Goldman, E. Charniak, Dynamic construction of belief networks, in: Proceedings 6th Conference on Uncertainty in Artificial Intelligence, 1990, pp. 90-97.
29. V. Ha, P. Haddawy, Theoretical foundations of abstraction-based probabilistic planning, in: Proceedings 12th Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, San Mateo, CA, 1996, pp. 291-298.
30. P. Haddawy, A.H. Doan, R. Goodwin, Efficient decision-theoretic planning: techniques and empirical analysis, in: P. Besnard, S. Hanks (Eds.), Proceedings 11th Conference on Uncertainty in Artificial Intelligence, 1995, pp. 229-236.
31. M. Hauskrecht, N. Meuleau, C. Boutilier, L.P. Kaelbling, T. Dean, Hierarchical solution of markov decision processes using macro-actions, in: Proceedings 14th Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, San Mateo, CA, 1998.
32. G.B. Hazen, Stochastic trees: a new technique for temporal medical decision modeling, Medical Decision Making 12 (1992) 163-178.
33. J.P. Hollenberg, Markov cycle trees: a new representation for complex Markov processes, Medical Decision Making 4 (4) (1984). Abstract from the 6th Annual Meeting of the Society for Medical Decision Making.
34. R.A. Howard, Dynamic Programming and Markov Processes, MIT Press, Cambridge, MA, 1960.
35. R.A. Howard, Dynamic Probabilistic Systems, Vol. 1-2, Wiley, New York, 1971.
36. R.A. Howard, Decision analysis: practice and promise, Management Science 34 (1988) 679-695.
37. R.A. Howard, J.E. Matheson, Influence diagrams, in: R.A. Howard, I.E. Matheson (Eds.), The Principles and Applications of Decision Analysis, Vol. 2, Strategic Decisions Group, Menlo Park, CA, 1984, pp. 719-762.
38. J. Janssen (Ed.), Semi-Markov Models: Theory and Applications, Plenum Press, New York, 1986.
39. W.S. Jewell, Markov renewal programming: I. formulations, finite return models II. infinite return models example, Operations Research 11 (1963) 938-971.
40. J.P. Kassirer, A.J. Moskowitz, J. Lau, S.G. Pauker, Decision analysis: a progress report, Annals of Internal Medicine 106 (1987) 275-291.
41. C.A. Knoblock, Search reduction in hierarchical problem solving, in: Proceedings 9th National Conference on Artificial Intelligence (AAAI-91), Anaheim, CA, 1991, pp. 686-691.
42. R.E. Korf, Planning as search: a quantitative approach, Artificial Intelligence 33 (1987) 65-88.
43. N. Kushmerick, S. Hanks, D. Weld, An algorithm for probabilistic least-commitment planning, in: Proceedings 12th National Conference on Artificial Intelligence (AAAI-94), Seattle, WA, 1994, pp. 1073-1078.
44. T.Y. Leong, Dynamic decision modeling in medicine: a critique of existing formalisms, in: Proceedings 17th Annual Symposium on Computer Applications in Medical Care, IEEE, November 1993, pp. 478-484.
45. T.Y. Leong, An integrated approach to dynamic decision making under uncertainty, Technical Report TR 631, MIT Laboratory for Computer Science, Cambridge, MA, 1994.
46. P. Magni, R. Bellazzi, DT-Planner: an environment for managing dynamic decision problems, Computer Methods and Programs in Biomedicine 54 (1997) 183-200.
47. D. McAllester, D. Roseblitt, Systematic nonlinear planning, in: Proceedings 9th National Conference on Artificial Intelligence (AAAI-91), Anaheim, CA, 1991, pp. 634-639.
48. D. McDermott, J. Hendler, Planning: What it is, What it could be, An introduction to the Special Issue on Planning and Scheduling, Artificial Intelligence 76 (1-2) (1995) 1-16.
49. B.A. Myers, D.A. Giuse, B. Vander Zanden Dannenberg, D.S. Koshie, E. Pervin, A. Mickish, P. Marchai, Garnet: comprehensive support for graphical, highly-interactive user interfaces, IEEE Computer 23 (11) (1990) 71-85.
50. R.E. Neapolitan, Computing the confidence in a medical decision obtained from an influence diagram, Artificial Intelligence in Medicine 5 (1993) 341-363.
51. A. Newell, J.C. Shaw, H.A. Simon, Report on a general problem-solving program, in: Proceedings International Conference on Information Processing, UNESCO, 1960, pp. 256-264.
52. A. Newell, H.A. Simon, Human Problem Solving, Prentice-Hall, Englewood Cliffs, NJ, 1972.
53. M.C. Ng, A solution suite for a dynamic decision modeling system, National University of Singapore, Department of Information Systems and Computer Science, Honours Year Project Report, 1997.
54. S.G. Pauker, J.P. Kassirer, Medical progress: decision analysis, New England Journal of Medicine 316 (1987) 250-258.
55. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann, San Mateo, CA, 1988.
56. G.M. Provan, Modeling the evolution of acute abdominal pain using temporal influence diagrams, Technical Report MIS-CS-92-69, University of Pennsylvania, Department of Computer and Information Science, Philadelphia, PA, 1992.
57. G.M. Provan, J.R. Clarke, Dynamic network construction and updating techniques for the diagnosis of acute abdominal pain, IEEE Trans. Pattern Analysis and Machine Intelligence 15 (3) (1993) 299-307.
58. G.M. Provan, D. Poole, A utility-based analysis of consistency-based diagnosis, in: J. Allen, R. Fikes, E. Sandewall (Eds.), Principles of Knowledge Representation and Reasoning: Proceedings 2nd International Conference (KR-91), Morgan Kaufmann, San Mateo, CA, 1991, pp. 461-472.
59. M.L. Puterman, Markov decision processes, in: D.P. Heyman, M.J. Sobel (Eds.), Handbooks in Operations Research and Management Science, Vol. 2, Elsevier, North-Holland, Amsterdam, 1990, pp. 331-434.
60. H. Raiffa, Decision Analysis: Introductory Lectures on Choices Under Uncertainty, Addison-Wesley, Reading, MA, 1968.
61. E.D. Sacerdoti, Planning in a hierarchy of abstraction spaces, Artificial Intelligence 5 (1974) 115-135.
62. R.D. Shachter, Evaluating influence diagrams, Operations Research 34 (1986) 871-882.
63. R.D. Shachter, M.A. Peot, Decision making using probabilistic inference methods, in: D. Dubois, M.P. Wellman, B.D. D'Ambrosio, P. Smets (Eds.), Proceedings 8th Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, San Mateo, CA, 1992, pp. 276-283.
64. L.S. Shapley, Stochastic games, Proceedings National Academy of Science 39 (1953) 1095-1100.
65. S. Srinivas, Generalizing the noisy or model to n-ary variables, Technical Memorandum 79, Rockwell International Science Center, Palo Alto Laboratory, Palo Alto, CA, April 1992.
66. M. Stefik, Planning with constraints (MOLGEN: Part 1), Artificial Intelligence 16 (1981) 111-139.
67. J. Tash, S. Russell, Control strategies for a stochastic planner, in: Proceedings 12th National Conference on Artificial Intelligence (AAAI-94), Seattle, WA, 1994, pp. 1079-1085.
68. A. Tate, Generating project networks, in: Proceedings 5th International Joint Conference on Artificial Intelligence (IJCAI-77), Cambridge, MA, 1977, pp. 888-893.
69. A. Tate, J. Hendler, M. Drummond, A review of ai planning techniques, in: J. Allen, J. Hendler, A. Tate, (Eds.), Readings in Planning, Morgan Kaufmann, San Mateo, CA, 1990, pp. 26-49.
70. J.A. Tatman, R.D. Shachter, Dynamic programming and influence diagrams, IEEE Trans. Systems Man Cybernet. 20 (2) (1990) 365-379.
71. C. Wang, Knowledge-based formulation of dynamic decision models in medicine, M.Sc. Thesis, National University of Singapore, Department of Information Systems and Computer Science.
72. M.P. Wellman, Formulation of Tradeoffs in Planning under Uncertainty, Pitman, London/Morgan Kaufmann, San Mateo, CA, 1990.
73. M.P. Wellman, J.S. Breese, R.P. Goldman, From knowledge bases to decision models, The Knowledge Engineering Review 7 (1) (1992) 35-53.
74. M.P. Wellman, J. Doyle, Modular utility representation for decision-theoretic planning, in: Proceedings 1st International Conference on AI Planning Systems, 1992.
75. D.E. Wilkins, Practical Planning: Extending the Classical Planning Paradigm, Morgan Kaufmann, San Mateo, CA, 1988.
76. K.E. Willard, G.C. Critchfield, Probabilistic analysis of decision trees using symbolic algebra, Medical Decision Making 6 (1986).
77. S.S. Yeh, T.Y. Leong, Automatic generation of transition probabilities in dynamic decision modeling: a case study, in: Proceedings AAAI Spring Symposium on Artificial Intelligence in Medicine, 1994.
78. J. Zheng, Consistency management in multiple-perspective dynamic decision modeling, M.Sc. Thesis, National University of Singapore, Department of Information Systems and Computer Science.