Quantitative evaluation of clinical software, exemplified by decision support systems

International Journal of Medical Informatics

Volumn 47, Issue 3, 1997, Pages 165-173

  Wyatt, Jeremy ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Clinical software; Decision support systems; Rigorous evaluation programme

Indexed keywords

COMPUTER SOFTWARE SELECTION AND EVALUATION; DECISION SUPPORT SYSTEMS;

RIGOROUS EVALUATION PROGRAM;

MEDICAL COMPUTING;

CLINICAL PRACTICE; COMPUTER PROGRAM; COMPUTER SYSTEM; DECISION MAKING; PRIORITY JOURNAL; REVIEW;

EID: 0031423474     PISSN: 13865056     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1386-5056(97)00100-7     Document Type: Article

References (33)

1. Wyatt J. Use and sources of medical knowledge. Lancet. 338:1991;1368-1373.
2. Johnston M.E., Langton K.B., Haynes R.B., Matthieu D. A critical appraisal of research on the effects of computer-based decision support systems on clinician performance and patient outcomes. Ann. Intern. Med. 120:1994;135-142.
3. Wyatt J. Computer-based knowledge systems. Lancet. 338:1991;1431-1436.
4. J. Wyatt, Computer-assisted decision support, in: M. Sosa-Iudicissa et al. (Eds.), Internet, Telematics and Health, IOS Press, Amsterdam, 1997, pp. 229-237.
5. Tierney W.M., Miller M.E., Overhage J.M., McDonald C.J. Physician order writing on microcomputer workstations. J. Am. Med. Assoc. 269:1993;379-383.
6. Brahams D., Wyatt J. Decision-aids and the law. Lancet. 2:1989;632-634.
7. Heathfield H., Wyatt J.C. The road to professionalism in medical informatics: a proposal for debate. Methods Inf. Med. 34:1995;426-433.
8. Wyatt J.C. Medical informatics: artefacts or science? Methods Inf. Med. 35(3):1996;197-200.
9. C. Friedman, J. Wyatt, Evaluation Methods in Medical Informatics, Springer, New York, 1997 (ISBN 0-387-94228-9).
10. A. Newell, The knowledge level, AI Mag, 1981, pp. 1-20, 33.
11. Antman E.M., Lau J., Kupelnick B., Mosteller F., Chalmers T.C. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. J. Am. Med. Assoc. 268:1992;240-248.
12. Chalmers I., Dickersin K., Chalmers T.C. Getting to grips with Archie Cochrane's agenda. Br. Med. J. 305:1992;786-787.
13. Hammond P., Harris A.L., Das S.K., Wyatt J.C. Safety and Decision Support in Oncology. Methods Inf. Med. 33:1994;371-381.
14. Musen M.A., Fagan L.M., Combs D.M., Shortliffe E.H. Use of a domain model to drive an interactive knowledge editing tool. Int. J. Man-Mach. Stud. 26:1987;105-121.
15. E. Coiera, OSMOTIC user manual and technical notes, Technical report, Advanced Computation Laboratory, ICRF, PO Box 123, London WC2A 3PX, 1991.
16. Rothschild M.A., Swett H.A., Fisher P.R., Weltin G.G., Miller P.L. Exploring subjective vs. objective issues in the validation of computer-based critiquing advice. Comp. Meth. Prog. Biomed. 31:1990;11-18.
17. Wyatt J. Gold standards: questions and answers. J. Health Serv. Res. Policy. 2(1):1997;60-61.
18. Wasson J.H., Sox H.C., Neff R.K., Goldman L. Clinical prediction rules: applications and methodological standards. N. Eng. J. Med. 313:1985;793-799.
19. Wyatt J., Spiegelhalter D. Evaluating medical expert systems: what to test and how? Med. Inform. 15:1990;205-217.
20. J. Wyatt, Lessons learned from the field trial of ACORN, an expert system to advise on chest pain, in: B. Barber, D. Cao, D. Qin, G. Wagner (Eds.), Proceedings of Sixth World Conference on Medical Informatics, Singapore, North Holland, Amsterdam, 1989, pp. 111-115.
21. Heathfield H.A., Wyatt J. Philosophies for the design and development of clinical decision-support systems. Meth. Inform. Med. 32:1993;1-8.
22. Emerson P.A., Russell N.R., Wyatt J.C. et al. An audit of the management of patients attending an accident and emergency department with chest pain. Q. J. Med. 70:1989;213-220.
23. Suermondt H.J., Cooper G.F. An evaluation of explanations of probabilistic inference. Comput. Biomed. Res. 26:1993;242-254.
24. Kent D., Shortliffe E., Bischoff M., Scott A., Jacobs C. Improvements in data collection through physician use of a computer-based cancer chemotherapy protocol advisor. J. Clin. Oncol. 3:1985;1409-1417.
25. Donabedian A. The quality of medical care. Science. 200:1978;856-864.
26. Mant J., Hicks N. Detecting differences in quality of care: the sensitivity of measures of process and outcome in treating acute myocardial infarction. Br. Med. J. 311:1995;793796.
27. W.M. Tierney, J.M. Overhage, C.J. McDonald, A plea for controlled trials in medical informatics, J. Am. Med. Inform. Assoc. (1994) 353-355.
28. Peto R., Collins R., Gray R. Large-scale randomised evidence: large, simple trials and overviews of trials. Annals N.Y. Acad. Sci. 703:1993;314-340.
29. Adams I.D., Chan M., Clifford P.C. et al. Computer aided diagnosis of acute abdominal pain: a multicentre study. Br. Med. J. 293:1986;800-804.
30. Diwan V.K., Eriksson B., Sterky G., Tomson G. Randomization by group in studying the effect of drug information in primary care. Int. J. Epidemiol. 21:1992;124-130.
31. Wyatt J.C. Clinical data systems, Part III: Developing and evaluating clinical data systems. Lancet. 344:1994;1682-1688.
32. J. Wyatt, S. Paterson-Brown, R. Johanson, D.G. Altman, N. Fisk, A randomised trial of educational outreach visits to assist uptake of CCPC in 25 obstetric units. Br. Med. J. (submitted, October 1997).
33. Wyatt J.C. Telemedicine trials: clinical pull or technology push (commentary). Br. Med. J. 313:1996;1380-1381.