Measuring the Impact of Diagnostic Decision Support on the Quality of Clinical Decision Making: Development of a Reliable and Valid Composite Score

Journal of the American Medical Informatics Association

Volumn 10, Issue 6, 2003, Pages 563-572

  Ramnarayan, Padmanabhan ^a   Kapoor, Ritika R ^b   Coren, Michael ^a   Nanduri, Vasantha ^c   Tomlinson, Amanda L ^d   Taylor, Paul M ^e   Wyatt, Jeremy C ^f   Britto, Joseph F ^a  

^a ST MARY S HOSPITAL   (United Kingdom)

^b PRINCESS ALEXANDRA HOSPITAL   (United Kingdom)

^c WATFORD GENERAL HOSPITAL   (United Kingdom)

^d ISABEL Medical Charity   (United Kingdom)

^e Ctr Hlth Info/Multiprof Educ   (United Kingdom)

^f ACADEMIC MEDICAL CENTER   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COMPREHENSION; CONSULTATION; DECISION SUPPORT SYSTEM; DIFFERENTIAL DIAGNOSIS; FIRST AID; HEALTH CARE QUALITY; MEDICAL DECISION MAKING; MEDICAL STUDENT; OBSERVER VARIATION; PHYSICIAN ATTITUDE; QUALITY CONTROL; RELIABILITY; SCORING SYSTEM; TREATMENT PLANNING; VALIDATION PROCESS;

EID: 0242664263     PISSN: 10675027     EISSN: None     Source Type: Journal    
DOI: 10.1197/jamia.M1338     Document Type: Article

References (40)

1. De Dombal FT, Leaper DJ, Staniland JR, McCann AP, Horrocks JC. Computer-aided diagnosis of acute abdominal pain. Br Med J. 1972;2:9-13.
2. Barnett GO, Cimino JJ, Hupp JA, Hoffer EP. DXplain: an evolving diagnostic decision-support system. JAMA. 1987;258: 67-74.
3. Miller R, Masarie FE, Myers JD. Quick medical reference (QMR) for diagnostic assistance. MD Comput. 1986;3(5):34-48.
4. Rubeck RF. ILIAD: a medical diagnostic expert system. Teach Learn Med. 1989;1:221-2.
5. Warner HR, Haug P, Bouhaddou O, et al. ILIAD as an expert consultant to teach differential diagnosis. In: Proc Annu Symp Comput Appl Med Care. 1988:371-6.
6. Nelson SJ, Blois MS, Tuttle MS, et al. Evaluating Reconsider: a computer program for diagnostic prompting. J Med Syst. 1985;9:379-88.
7. Bankowitz RA, McNeil MA, Challinor SM, Parker RC, Kapoor WN, Miller RA. A computer-assisted medical diagnostic consultation service. Implementation and prospective evaluation of a prototype. Ann Intern Med. 1989;110:824-32.
8. Bankowitz RA, McNeil MA, Challinor SM, Miller RA. Effect of a computer-assisted general medicine diagnostic consultation service on housestaff diagnostic strategy. Methods Inf Med. 1989;28:352-6.
9. Wexler JR, Swender PT, Tunnussen WW, Oski FA. Impact of a system of computer-assisted diagnosis: initial evaluation of the hospitalized patient. Am J Dis Child. 1975;129:203-5.
10. Wellwood J, Johannessen S, Spiegelhalter DJ. How does computer-aided diagnosis improve the management of acute abdominal pain? Ann R Coll Surg Engl. 1992;74:40-6.
11. Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computer-based clinical decision-support systems on physician performance and patient outcomes. JAMA. 1998;280:1339-46.
12. Miller RA. Medical diagnostic decision support systems-past, present and future: a threaded bibliography and brief commentary. J Am Med Inform Assoc. 1994;1:8-27.
13. Lemaire JB, Schaefer JP, Martin LA, Faris P, Ainslie MD, Hull RD. Effectiveness of the Quick Medical Reference as a diagnostic tool. Can Med Assoc J. 1999;161:725-8.
14. Berner ES, Webster GD, Shugerman AA, et al. Performance of four computer-based diagnostic systems. N Engl J Med. 1994; 330:1792-6.
15. Friedman CP, Elstein AS, Wolf FM, et al. Enhancement of clinicians' diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. JAMA. 1999;282:1851-6.
16. Adams ID, Chan M, Clifford PC, et al. Computer-aided diagnosis of acute abdominal pain: a multicentre study. Br Med J (Clin Res Educ). 1986;293:800-4.
17. Pozen MW, D'Agostino RB, Selker HP, Sytkowski PA, Hood WB. A predictive instrument to improve coronary-care-unit admission practices in acute ischemic heart disease: a prospective multicenter clinical trial. N Engl J Med. 1984;310:1273-8.
18. Bankowitz RA, Lave JR, McNeil MA. A method for assessing the impact of a computer-based decision support system on health care outcomes. Methods Inf Med. 1992;31(1):3-10.
19. Warner HR, Toronto AF, Veasey LG, Stephenson R. A mathematical approach to medical diagnosis: application to congenital heart disease. JAMA. 1961;177:75-81.
20. Miller RA, Masarie FE. The demise of the "Greek Oracle" model for medical diagnostic systems. Methods Inf Med. 1990;29:1-2.
21. Miller RA, Pople HE Jr, Myers JD. Intemist-1, an experimental computer-based diagnostic consultant for general internal medicine. N Engl J Med. 1982;307:468-76.
22. Berner ES, Maisiak RS, Cobbs CG, Taunton OD. Effects of a decision support system on physicians' diagnostic performance. J Am Med Inform Assoc. 1999;6:420-7.
23. Elstein AS, Friedman CP, Wolf FM, et al. Effects of a decision support system on the diagnostic accuracy of users: a preliminary report. J Am Med Inform Assoc. 1996;3:422-8.
24. Friedman C, Elstein A, Wolf F, et al. Measuring the quality of diagnostic hypothesis sets for studies of decision support. Medinfo. 1998;9 pt 2:864-8.
25. Greenough A. Help from ISABEL for paediatric diagnoses. Lancet. 2002;360:1259.
26. Thomas NJ. ISABEL. Crit Care. 2002;7(1):99-100.
27. McKenna C. New online diagnostic tool launched to help doctors. BMJ 2002;324:1478.
28. Ramnarayan P, Britto J. Paediatric clinical decision support systems. Arch Dis Child. 2002;87:361-2.
29. Ramnarayan P, Tomlinson A, Rao A, Coren M, Winrow A, Britto J. ISABEL: a web-based differential diagnostic aid for paediatrics: results from an initial performance evaluation. Arch Dis Child. 2003;88:408-13.
30. Kent DL, Shortliffe EH, Carlson RW, Bischoff MB, Jacobs CD. Improvements in data collection through physician use of a computer-based chemotherapy treatment consultant. J Clin Oncol. 1985;3:1409-17.
31. Wraith SM, Aikins JS, Buchanan BG, et al. Computerized consultation system for selection of antimicrobial therapy. Am J Hosp Pharm. 1976;33:1304-8.
32. van der Lei J, Musen MA, van der Does E, Man in 't Veld AJ, van Bemmel JH. Comparison of computer-aided and human review of general practitioners' management of hypertension. Lancet. 1991;338:1504-8.
33. Miller PL. Extending computer-based critiquing to a new domain: ATTENDING, ESSENTIAL-ATTENDING, and VQ-ATTENDING. Int J Clin Monit Comput. 1986;2:135-42.
34. Haug PJ, Gardner RM, Tate KE, et al. Decision support in medicine: examples from the HELP system. Comput Biomed Res. 1994;27:396-418.
35. Bankowitz RA, McNeil MA, Challimor SM, Miller RA. Effect of a computer-assisted general medicine diagnostic consultation service on housestaff diagnostic strategy. Methods Inf Med. 1989;28:352-6.
36. Miller RA. Reference standards in evaluating system performance. J Am Med Inform Assoc. 2002;9:87-8.
37. Hripcsak G, Wilcox A. Reference standards, judges, and comparison subjects: roles for experts in evaluating system performance. J Am Med Inform Assoc. 2002;9:1-15.
38. Dawson NV, Arkes HR, Siciliano C, Blinkhorn R, Lakshmanan M, Petrelli M. Hindsight bias: an impediment to accurate probability estimation in clinicopathologic conferences. Med Decis Making. 1988;8:259-64.
39. Bindels R, Hasman A, van Wersch JW, Pop P, Winkens RA. The reliability of assessing the appropriateness of requested diagnostic tests. Med Decis Making. 2003;100:254-5.
40. Friedman CP, Gatti GG, Murphy GC, et al. Exploring the boundaries of plausibility: empirical study of a key problem in the design of computer-based clinical simulations. Proc AMIA Symp. 2002:275-9.