Inter-rater agreement in judging errors in diagnostic reasoning

Medical Education

Volumn 38, Issue 6, 2004, Pages 609-616

  Hasnain, Memoona ^a   Onishi, Hirotaka ^a   Elstein, Arthur S ^a  

^a UNIVERSITY OF ILLINOIS   (United States)

Author keywords

*Decision making; Clinical competence *standards; Computers methods; Diagnostic errors *standards; Educational measurement; Health personnel *standards; Reproducibility of results

Indexed keywords

ARTICLE; COMPUTER SYSTEM; CONTROLLED STUDY; DECISION MAKING; DIAGNOSTIC ERROR; DIAGNOSTIC PROCEDURE; HUMAN; HYPOTHESIS; OBSERVATION; PHYSICIAN; WORK; CLINICAL COMPETENCE; COMPUTER ASSISTED DIAGNOSIS; METHODOLOGY; OBSERVER VARIATION; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STANDARD;

CLINICAL COMPETENCE; DECISION MAKING; DIAGNOSIS, COMPUTER-ASSISTED; DIAGNOSTIC ERRORS; HUMANS; OBSERVER VARIATION; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 3042677363     PISSN: 03080110     EISSN: None     Source Type: Journal    
DOI: 10.1046/j.1365-2923.2004.01789.x     Document Type: Article

References (15)

1. Van der Vleuten CPM, Swanson DB. Assessment of clinical skills with standardised patients: state of the art. Teach Learn Med 1990;2:58-76.
2. Elstein AS, Shulman LS, Sprafka SA. Medical Problem Solving: an Analysis of Clinical Reasoning. Cambridge, Massachusetts: Harvard University Press 1978.
3. Kassirer JP, Gorry GA. Clinical problem solving: a behavioural analysis. Ann Intern Med 1978;89 (2):245-55.
4. Patel VL, Groen GJ. Knowledge-based solution strategies in medical reasoning. Cognit Sci 1986;10:91-116.
5. Schmidt HG, Norman GR, Boshuizen HP. A cognitive perspective on medical expertise: theory and implication. [Published erratum appears in Acad Med 1992;67 (4):287.] Acad Med 1990;65 (10):611-21.
6. Bordage G, Lemieux M. Semantic structures and diagnostic thinking of experts and novices. Acad Med 1991;66 (9):70-2.
7. Feltovich PJ, Johnson PE, Moller JH, Swanson DB. LCS: the role and development of medical knowledge in diagnostic expertise. In: Clancey WJ, Shortliffe EH, eds. Readings in Medical Artificial Intelligence: the First Decade. Reading, Massachusetts: Addison-Wesley 1984;275-319.
8. Cohen JA. A coefficient of agreement for nominal scales. Educ Psychol Meas 1960;20:37-46.
9. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33 (1):159-74.
10. Friedman CP, Elstein AS, Wolf FM, Murphy GC, Franz TM, Heckerling PS, Fine PL, Miller TM, Abraham V. Enhancement of clinicians' diagnostic reasoning by computer-based consultation, a multisite study of 2 systems. [Published erratum appears in JAMA 2001;285 (23):2979.] JAMA 1999;282 (19):1851-6.
11. Berner ES, Webster GD, Shugerman AA et al. Performance of four computer-based diagnostic systems. N Engl J Med 1994;330 (25):1792-6.
12. Bordage G. Why did I miss the diagnosis? Some cognitive explanations and educational implications. Acad Med 1999;74 (10):138-43.
13. Kassirer JP, Kopelman RI. Learning Clinical Reasoning. Baltimore, Maryland: Williams & Wilkins 1991.
14. Feinstem AR, Cicchetti DV. High agreement but low kappa. I. The problems of two paradoxes. J Clin Epidemiol 1990;43 (6):543-9.
15. Cicchetti DV, Feinstein AR. High agreement but low kappa. II. Resolving the paradoxes. J Clin Epidemiol 1990;43 (6):551-8.