Evaluation of a cardiac diagnostic program in a typical clinical setting

Journal of the American Medical Informatics Association

Volumn 10, Issue 4, 2003, Pages 373-381

  Fraser, Hamish S F ^a,b,d   Long, William J ^b   Naimi, Shapur ^c  

^a BOSTON CHILDREN S HOSPITAL   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c TUFTS MEDICAL CENTER   (United States)

^d HARVARD MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AGED; ARTICLE; AUTOMATION; CARDIOVASCULAR SYSTEM; COMPUTER PROGRAM; DIAGNOSTIC VALUE; DIFFERENTIAL DIAGNOSIS; FEMALE; FOLLOW UP; HEART DISEASE; HUMAN; MAJOR CLINICAL STUDY; MALE; OBSERVATION; PERFORMANCE; RECEIVER OPERATING CHARACTERISTIC;

EID: 0038309917     PISSN: 10675027     EISSN: None     Source Type: Journal    
DOI: 10.1197/jamia.M1184     Document Type: Article

References (44)

1. Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998;280:1339-46.
2. McDonald CJ, Hui SL, Smith DM, et al. Reminders to physicians from an introspective computer medical record. A two-year randomized trial. Ann Intern Med. 1984;100:130-138.
3. Safran C, Rind DM, Davis RB, et al. Guidelines for management of HIV infection with computer-based patient's record. Lancet. 1995;346:341-6.
4. Overhage JM, Tierney WM, Zhou XH, McDonald CJ. A randomized trial of "corollary orders" to prevent errors of omission. J Am Med Inform Assoc. 1997;4:364-75.
5. Walton RT, Gierl C, Yudkin P, Mistry H, Vessey MP, Fox J. Evaluation of computer support for prescribing (CAPSULE) using simulated cases. BMJ. 1997;315:791-5.
6. Rind DM, Safran C, Phillips RS, et al. Effect of computer-based alerts on the treatment and outcomes of hospitalized patients. Arch Intern Med. 1994;154:1511-7.
7. Cohen SN, Armstrong MF, Briggs RL, et al. A computer-based system for the study and control of drug interactions in hospitalized patients. In: Morselli PL, Feinberg LS, Mannigan JF, et al. (eds). Drug Interactions. New York: Raven Press, 1974, pp 363-74.
8. Evans RS, Pestotnik SL, Classen DC, et al. A computer-assisted management program for antibiotics and other antiinfective agents. N Engl J Med. 1998;338:232-8.
9. Bates DW, Leape LL, Cullen DJ, et al. Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA. 1998;280:1311-6.
10. Tierney WM, Miller ME, Overhage JM, McDonald CJ. Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. JAMA. 1993;269:379-83.
11. Heckerman DE, Nathwani BN. An evaluation of the diagnostic accuracy of Pathfinder. Comput Biomed Res. 19920;25(1):56-74.
12. Selker HP, Beshansky JR, Griffith JL, et al. Use of the acute cardiac ischemia time-insensitive predictive instrument (ACI-TIPI) to assist with triage of patients with chest pain or other symptoms suggestive of acute cardiac ischemia. A multicenter, controlled clinical trial. Ann Intern Med. 1998;129:845-55.
13. Willems JL, Abreu-Lima C, Arnaud P, et al. The diagnostic performance of computer programs for the interpretation of electrocardiograms. N Engl J Med. 1991;325:1767-73.
14. Elstein AS, Friedman CP, Wolf FM, et al. Effects of a decision support system on the diagnostic accuracy of users: a preliminary report. J Am Med Inform Assoc. 1996;3:422-8.
15. Wyatt J. Lessons learned from the field trial of ACORN, an expert system to advise on chest pain. Medinfo. 1989;6:864-8.
16. Wyatt J, Spiegelhalter D. Evaluating medical expert systems: what to test and how? Med Inform (Lond). 1990;15:205-17.
17. Friedman C, Wyatt J. Evaluation Methods in Medical Informatics. New York: Springer-Verlag, 1996.
18. Berner ES, Webster GD, Shugerman AA, et al. Performance of four computer-based diagnostic systems. N Engl J Med. 1994;330:1792-6.
19. Moens HJB. Validation of Al/Rheum knowledge base with data from consecutive rheumatological outpatients. Methods Inf Med. 1992;31:175-81.
20. Kohane I. Getting the data in: three year experience with a pediatric electronic medical record system. Proc Annu Symp Comput Appl Med Care. 1994:457-61.
21. Miller RA, Masarie FE Jr. The demise of the "Greek Oracle" model for medical diagnostic systems. Methods Inf Med. 1990;29:1-2.
22. Montironi R, Whimster WF, Collan Y, Hamilton PW, Thompson D, Bartels PH. How to develop and use a Bayesian Belief Network. J Clin Pathol. 1996;49:194-201.
23. Long WJ, Fraser H, Naimi S. Reasoning requirements for diagnosis of heart disease. Artif Intell Med. 1997;10(1):5-24.
24. Long W. Medical diagnosis using a probabilistic causal network. Appl Artif Intell. 1989;3:367-83.
25. Long WJ, Naimi S, Criscitiello MG. Development of a knowledge base for diagnostic reasoning in cardiology. Comput Biomed Res. 1992;25:292-311.
26. Long WJ, Naimi S, Criscitiello MG. Evaluation of a new method for cardiovascular reasoning. J Am Med Inform Assoc. 1994;1:127-41.
27. Long WJ, Fraser H, Naimi S. Web interface for the Heart Disease Program. Proc AMIA Annu Fall Symp. 1996:762-6.
28. Fraser HS, Kohane IS, Long WJ. Using the technology of the World Wide Web to manage clinical information. BMJ. 1997;314:1600-3.
29. Stead WW, Haynes RB, Fuller S, et al. Designing medical informatics research and library-resource projects to increase what is learned. J Am Med Inform Assoc. 1994;1:28-33.
30. Miller RA, Pople HE Jr, Myers JD. Internist-1, an experimental computer-based diagnostic consultant for general internal medicine. N Engl J Med. 1982;307:468-76.
31. Bankowitz RA, McNeil MA, Challinor SM, Parker RC, Kapoor WN, Miller RA. A computer-assisted medical diagnostic consultation service Implementation and prospective evaluation of a prototype. Ann Intern Med. 1989;110:824-32.
32. Fraser H, Long W, Naimi S. New approaches to measuring the performance of programs that generate differential diagnoses using ROC curves and other metrics. Proc AMIA Fall Symp. 2000:255-9.
33. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29-36.
34. Miller RA. Evaluating evaluations of medical diagnostic systems. J Am Med Inform Assoc. 1996;3:429-31.
35. Fraser H, Long W, Naimi S. Differential diagnoses of the Heart Disease Program have better sensitivity than resident physicians. Proc AMIA Fall Symp. 1998:622-6.
36. Friedman C, Elstein A, Wolf F, et al. Measuring the quality of diagnostic hypothesis sets for studies of decision support. Medinfo. 1998;9(pt 2):864-8.
37. Friedman CP, Elstein AS, Wolf FM, et al. Enhancement of clinicians' diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. JAMA. 1999;282:1851-6.
38. Szolovits P, Patil RS, Schwartz WB. Artificial intelligence in medical diagnosis. Ann Intern Med. 1988;108:80-7.
39. Suermondt HJ, Cooper GF. An evaluation of explanations of probabilistic inference. Comput Biomed Res. 1993;26:242-54.
40. Li YC, Haug PJ, Lincoln MJ, Turner CW, Pryor TA, Warner HH. Assessing the behavioral impact of a diagnostic decision support system. Proc Annu Symp Comput Appl Med Care. 1995:805-9.
41. Forsythe DE, Buchanan BG. Broadening our approach to evaluating medical information systems. Proc Annu Symp Comput Appl Med Care. 1991:8-12.
42. Wolfram DA. An appraisal of INTERNIST-I. Artif Intell Med. 1995;7(2):93-116.
43. Fraser H, Long W, Naimi S. Comparing complex diagnoses: a formative evaluation of the Heart Disease Program. Proc AMIA Annu Fall Symp. 1997:853.
44. Fraser H, Long W, Naimi S. CompareDx: a software toolkit for measuring the performance of programs that generate multiple diagnoses. Proc AMIA Annu Fall Symp. 1999:1060.