Structure-based validation of rule-based systems

Data and Knowledge Engineering

Volumn 26, Issue 2, 1998, Pages 161-189

  Preece, A D ^a   Grossner, C ^b   Chander, P G ^b   Radhakrishnan, T ^b  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b Civil and Environmental Engineering   (Canada)

Author keywords

Knowledge based systems; Rule based systems; Software engineering; Structural analysis; Testing; Validation tools

Indexed keywords

ALGORITHMS; COMPUTER SOFTWARE; PROBLEM SOLVING; SOFTWARE ENGINEERING; TESTING;

STRUCTURE BASED VALIDATION; VALIDATION TOOLS;

KNOWLEDGE BASED SYSTEMS;

EID: 0032094977     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0169-023X(97)00019-0     Document Type: Article

References (45)

1. Leonard Adelman, Experiments, quasi-experiments and case studies: A review of empirical methods for evaluating decision support systems, IEEE Transactions on Systems, Man and Cybernetics 21(2) (March/April 1991) 293-301.
2. W. Richards Adrion, Martha A. Branstad and John C. Cherniavsky, Validation, verification and testing of computer of software, ACM Computing Surveys 14(2) (June 1982) 159-192.
3. Marc Ayel and Jean-Pierre Laurent, SACCO-SYCOJET: Two different ways of verifying knowledge-based systems, in Marc Ayel and Jean-Pierre Laurent (ed.), Verification, Validation and Test of Knowledge-based Systems (John Wiley and Sons, 1991).
4. Marc Ayel and Jean-Pierre Laurent (eds.), Verification, Validation and Test of Knowledge-based Systems (John Wiley and Sons, 1991).
5. Aïda Batarekh, Alun D. Preece, Anne Bennett and Peter Grogono, Specifying an expert system, Expert Systems with Applications 2(4) (1991) 285-303.
6. Bruce G. Buchanan and Edward H. Shortliffe, The problem of evaluation, in Bruce G. Buchanan and Edward H. Shortliffe (eds.), Rule-Based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project, Chap. 30 (Addison-Wesley, Reading MA, 1984) pp. 571-588.
7. C.L. Chang, J.B. Combs and R.A. Stachowitz, A report on the expert systems validation associate (EVA), Expert Systems with Applicatiaons (US) 1(3) (1990) 217-230.
8. Brian J. Cragun and Harold J. Steudel, A decision-table-based processor for checking completeness and consistency in rule-based expert systems, International Journal of Man-Machine Studies 26(5) (May 1987) 633-648.
9. John Gaschnig, Philip Klahr, Harry Pople, Edward Shortliffe and Allan Terry, Evaluation of expert systems: Issues and case studies, in Frederick Hayes-Roth, Donald A. Waterman and Douglas B. Lenat (eds.), Building Expert Systems, Chap. 8 (Addison-Wesley, Reading MA, 1983) pp. 241-280.
10. Carlo Ghezzi, Mehdi Jazayeri and Dino Mandrioli, Fundamentals of Software Engineering (Prentice Hall, New York, 1991).
11. J. Giarratano and G. Riley, Expert Systems: Principles and Programming (PWS-Kent, New York, 1989).
12. Allen Ginsberg, Knowledge-base reduction: A new approach to checking knowledge bases for inconsistency and redundancy, in Proceedings of the 7th National Conference on Artificial Intelligence (AAAI 88), Vol. 2, St Paul, MN (August 1988) pp. 585-589.
13. C. Grossner, P. Gokulchander, A. Preece and T. Radhakrishnan, Data distribution in organizations of cooperating expert systems, in 12th International Workshop on Distributed Artificial Intelligence, May 1993.
14. C. Grossner, J. Lyons and T. Radhakrishnan, Validation of an expert system intended for reserach in distributed artificial intelligence, in 2nd CLIPS Conference, Johnson Space Center, September 1991.
15. C. Grossner, A. Preece, Gokulchander, T. Radhakrishnan and C.Y. Suen, Exploring the structure of rule based systems, in Proceedings of the 11th National Conference on Artificial Intelligence (AAAI 93), Washington DC, 1993, pp. 704-709.
16. C. Grossner and T. Radhakrishnan, Organizations for cooperating expert systems, in 22nd Southeastern Symposium on System Theory, March 1990.
17. Uma G. Gupta, Validating and Verifying Knowledge-based Sysems (IEEE Press, Los Alamitos, CA, 1990).
18. David Hamilton, Keith Kelley and Chris Culbert, State-of-the-practice in knowledge-based system verification and validation, Expert Systems with Applications, 3 (1991) 403-410.
19. Frederick Hayes-Roth, Rule-based systems, Communications of the ACM 28(9) (September 1985) 921-932.
20. James D. Kiper, Structural testing of rule-based expert systems, ACM Transactions on Software Engineering and Methodology 1(2) (April 1992) 168-187.
21. Shekhar Kirani, Imran A. Zualkernan and Wei-Tek Tsai, Comparative evaluation of expert system testing methods, Technical Report TR 92-30 (University of Minnesota, Department of Computer Science, 1992).
22. Christopher Landauer, Correctness principles for rule-based expert systems, Expert Systems with Applications 1(3) (1990) 291-316.
23. Nicolaas J.I. Mars and Perry L. Miller, Knowledge acquisition and verification tools for medical expert systems, Medical Decision Making 7 (1987) 6-11.
24. Pedro Meseguer, Incremental verification of rule-based expert sysems, in Bernd Neumann (Ed.), Proceedings of the 10th European Conference on Artificial Intelligence (ECAI 92), New York, 1992 (John Wiley).
25. Derek L. Nazareth, Investigating the applicability of Petri nets for rule-based system verification, IEEE Transactions on Knowledge and Data Engineering, 4(3) (1993) 402-415.
26. Robert M. O'Keefe, Osman Balci and Eric P. Smith, Validating expert system performance, IEEE Expert (US), 2(4) (Winter 1987) 81-90.
27. Thomas J. Ostrnad and Marc J. Balcer, The category-partition method for specifying and generating functional tests, Communications of ACM, 31(6) (June 1988) 676-686.
28. A. Preece, C. Grossner and T. Radhakrishnan, Validating dynamic properties of rule-based systems, in Twelveth National Conference on Artificial Intelligence (AAAI 94): Workshop on Validation and Verification of Knowledge-Based Systems, July 1994.
29. Alun Preece and Rajjan Shinghal, Verifying knowledge bases by anomaly detection: An experience report, In Proceedings of 1992 European Conference on Artificial Intelligence (ECAI-92) (1992).
30. Alun D. Preece, Rajjan Shinghal and Aïda Batarekh. Principles and practice in verifying rule-based systems, Knowledge Engineering Review 7(2) (1992) 115-141.
31. Alun D. Preece, Rajjan Shinghal, and Aïda Batarekh, Verifying expert systems: A logical framework and a practical tool, Expert Systems with Applications 3(2/3) (1992).
32. Alun D. Preece and Ching Y. Suen, Special issue on verification and validation, International Journal of Expert: Research and Applications 6(2/3) (1993).
33. Sandra Rapps and Elaine J. Weyuker, Selecting software test data using a data flow information, IEEE Transactions on Softwaree Engineering SE-11(4) (1985) 367-375.
34. Elaine Rich, Artificial Intelligence, (McGraw Hill, New York, 1983).
35. Marie-Christine Rousset, On the consistency of knowledge bases: The COVADIS system, Computational Intelligence (Canada), 4(2) (May 1988) 166-170. Also in ECAI 88, Proc. European Conference on AI (Munich, August 1-5, 1988), pp. 79-84.
36. Marie-Christine Rousset, On the consistency of knowledge bases: The COVADIS system, Computational Intelligence (Canada), 4(2) (May 1988) 166-170. Also in ECAI 88, Proc. European Conference on AI (Munich, August 1-5, 1988), pp. 79-84.
37. John Rushby, Quality measures and assurance for AI software, NASA Contractor Report CR-4187 (SRI International, Menlo Park, CA, October 1988) 137 pp.
38. John Rushby and Judith Crow, Evaluation of an expert system for fault detection, isolation and recovery in the mannered maneuvering unit, NASA Contractor Report CR-187466 (SRI International, Menlo Park, CA, February 1990) 93 pp.
39. M.A. Shwe, S.W. Tu and L.M. Fagan, Validating the knowledge base of a therapy planning system, Methods of Information in Medicine (Germany) 28(1) (January 1989) 36-50.
40. Herbert A. Simon, The structure of ill-structured problems, Artificial Intelligence 4 (1973) 181-201.
41. Software Engineering Technical Committee of the IEEE Computer Society, IEEE Standard for Software Verification and Validation Plans (The Institute of Electrical and Electronics Engineers, New York, November 14, 1986) IEEE Std 1012-1986.
42. Motoi Suwa, A. Carlisle Scott and Edward H. Shortliffe, An approach to verifying completeness and consistency in a rule-based expert system, AI Magazine 3(4) (Fall 1982) 16-23.
43. Elaine J. Weyuker and Thomas J. Ostrand, Theories of program testing and the application of revealing subdomains, IEEE Transactions on Software Engineering, SE-6(3) (1980) 236-246.
44. B.J. Wielinga, A. Th. Schreiber and J.A. Breuker, KADS: A modelling approach to knowledge engineering, Knowledge Acquisition 4(1) (1992) 5-54.
45. Neli Zlatareva and Alun Preece, An effective logical framework for knowledge-based systems verification, In Proc. 193 Florida AI Research Symposium (FLAIRS 93), 1993.