How well do health professionals interpret diagnostic information? A systematic review

BMJ Open

Volumn 5, Issue 7, 2015, Pages

  Whiting, Penny F ^a,b   Davenport, Clare ^c   Jameson, Catherine ^a   Burke, Margaret ^a   Sterne, Jonathan A C ^a   Hyde, Chris ^d   Ben Shlomo, Yoav ^a  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b UNIVERSITY HOSPITALS BRISTOL NHS FOUNDATION TRUST   (United Kingdom)

^c UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^d PLYMOUTH UNIVERSITY PENINSULA SCHOOLS OF MEDICINE AND DENTISTRY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BAYES THEOREM; CLINICAL EVALUATION; COMPREHENSION; DIAGNOSIS; DIAGNOSTIC ACCURACY; DIAGNOSTIC TEST; FREQUENCY; HEALTH PRACTITIONER; HUMAN; JOB EXPERIENCE; MEDICAL EDUCATION; MEDICAL INFORMATION; METRIC SYSTEM; PHYSICIAN ATTITUDE; PROBABILITY; PROFESSIONAL COMPETENCE; RANDOMIZED CONTROLLED TRIAL (TOPIC); REVIEW; SELF REPORT; SENSITIVITY AND SPECIFICITY; SYSTEMATIC REVIEW; CLINICAL COMPETENCE; DIAGNOSTIC PROCEDURE; HEALTH CARE PERSONNEL; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICS AND NUMERICAL DATA;

BAYES THEOREM; CLINICAL COMPETENCE; DATA INTERPRETATION, STATISTICAL; DIAGNOSTIC TECHNIQUES AND PROCEDURES; HEALTH PERSONNEL; HUMANS; LIKELIHOOD FUNCTIONS; SENSITIVITY AND SPECIFICITY;

EID: 84941585050     PISSN: None     EISSN: 20446055     Source Type: Journal    
DOI: 10.1136/bmjopen-2015-008155     Document Type: Review

References (53)

1. Kostopoulou O, Oudhoff J, Nath R, et al. Predictors of diagnostic accuracy and safe management in difficult diagnostic problems in family medicine. Med Decis Making 2008;28:668-80.
2. Heneghan C, Glasziou P, Thompson M, et al. Diagnostic strategies used in primary care. BMJ 2009;338:b946.
3. Eddy D, Clanton C. The art of diagnosis: solving and clinicopathological exercise. In: Dowie J, Elstein A, eds. Professional judgment: a reader in clinical decision making. Cambridge: Cambridge University Press, 1988:200-11.
4. Falk G, Fahey T. Clinical prediction rules. BMJ 2009;339:b2899.
5. Knottnerus JA. Interpretation of diagnostic data: an unexplored field in general practice. J R Coll Gen Pract 1985;35:270-4.
6. Stengel D, Bauwens K, Sehouli J, et al. A likelihood ratio approach to meta-analysis of diagnostic studies. JMedScreen2003;10:47-51.
7. Moons KG, Harrell FE. Sensitivity and specificity should be de-emphasized in diagnostic accuracy studies. Acad Radiol 2003;10:670-2.
8. Sackett DL, Straus S. On some clinically useful measures of the accuracy of diagnostic tests. ACP J Club 1998;129:A17-19.
9. Dujardin B, Van den Ende J, Van Gompel A, et al. Likelihood ratios: a real improvement for clinical decision making? Eur J Epidemiol 1994;10:29-36.
10. Grimes DA, Schulz KF. Refining clinical diagnosis with likelihood ratios. Lancet 2005;365:1500-5.
11. Hayward RS, Wilson MC, Tunis SR, et al. Users' guides to the medical literature. VIII. How to use clinical practice guidelines. A. Are the recommendations valid? The Evidence-Based Medicine Working Group. JAMA 1995;274:570-4.
12. Wilson MC, Hayward RS, Tunis SR, et al. Users' guides to the medical literature. VIII. How to use clinical practice guidelines. B. what are the recommendations and will they help you in caring for your patients? The Evidence-Based Medicine Working Group. JAMA 1995;274:1630-2.
13. Gill CJ, Sabin L, Schmid CH. Why clinicians are natural Bayesians. BMJ 2005;330:1080-3.
14. Cochrane AJ. Effectiveness and efficiency: random reflections on health services. The Nuffield Provincial Hospitals Trust. London: The Royal Society of Medicine Press Ltd, 1972.
15. Knottnerus JA. Evidence base of clinical diagnosis. Wiley, 2002.
16. Centre for Reviews and Dissemination. Systematic reviews: CRD's guidance for undertaking reviews in health care [Internet]. York: University of York, 2009. (accessed 23 Mar 2011).
17. Casscells W, Schoenberger A, Graboys TB. Interpretation by physicians of clinical laboratory results. N Engl J Med 1978;299:999-1001.
18. Gigerenzer G, Hoffrage U. How to improve Bayesian reasoning without instruction: frequency formats. Psychol Rev 1995;102:684-704.
19. Hoffrage U, Lindsey S, Hertwig R, et al. Medicine. Communicating statistical information. Science 2000;290:2261-2.
20. Steurer J, Fischer JE, Bachmann LM, et al. Communicating accuracy of tests to general practitioners: a controlled study. [Erratum appears in BMJ 2002 Jun 8;324(7350):1391]. BMJ 2002;324:824-6.
21. Argimon-Pallas JM, Flores-Mateo G, Jimenez-Villa J, et al. Effectiveness of a short-course in improving knowledge and skills on evidence-based practice. BMC Fam Pract 2011;12:64.
22. Agoritsas T, Courvoisier DS, Combescure C, et al. Does prevalence matter to physicians in estimating post-test probability of disease? A randomized trial. J Gen Intern Med 2011;26:373-8.
23. Bergus G, Vogelgesang S, Tansey J, et al. Appraising and applying evidence about a diagnostic test during a performance-based assessment. BMC Med Educ 2004;4:20.
24. Berwick DM, Fineberg HV, Weinstein MC. When doctors meet numbers. Am J Med 1981;71:991-8.
25. Borak J, Veilleux S. Errors of intuitive logic among physicians. Soc Sci Med 1982;16:1939-44.
26. Bramwell R, West H, Salmon P. Health professionals' and service users' interpretation of screening test results: experimental study. BMJ 2006;333:284.
27. Chernushkin K, Loewen P, De Lemos J, et al. Diagnostic reasoning by hospital pharmacists: assessment of attitudes, knowledge, and skills. Can J Hosp Pharm 2012;65:258-64.
28. Curley SP, Yates JF, Young MJ. Seeking and applying diagnostic information in a health care setting. Acta Psychol (Amst) 1990;73:211-23.
29. Eddy DM. Probabilistic reasoning in clinical medicine: problems and opportunities. In: Kahneman D, Slovic P, Tversky A, eds. Judgement under uncertainty: heuristics and biases. Cambridge: Cambridge University Press, 1982:249-67.
30. Estellat C, Faisy C, Colombet I, et al. French academic physicians had a poor knowledge of terms used in clinical epidemiology. J Clin Epidemiol 2006;59:1009-14.
31. Garcia-Retamero R, Hoffrage U. Visual representation of statistical information improves diagnostic inferences in doctors and their patients. Soc Sci Med 2013;83:27-33.
32. Hoffrage U, Gigerenzer G. Using natural frequencies to improve diagnostic inferences. Acad Med 1998;73:538-40.
33. Gigerenzer G. The psychology of good judgment: frequency formats and simple algorithms. Med Decis Making 1996;16:273-80.
34. Gigerenzer G. Reckoning with risk: learning to live with uncertainty. UK: Penguin, 2003.
35. Hoffrage U, Gigerenzer G. How to improve the diagnostic inferences of medical experts. In Kurz-Milcke E, Gigerenzer G, eds. Experts in science and society. New York: Kluwer Academic/Plenum Publishers, 2004:249-268.
36. Lyman GH, Balducci L. Overestimation of test effects in clinical judgment. J Cancer Educ 1993;8:297-307.
37. Lyman GH, Balducci L. The effect of changing disease risk on clinical reasoning. J Gen Intern Med 1994;9:488-95.
38. Moreira J, Bisoffi Z, Narvaez A, et al. Bayesian clinical reasoning: does intuitive estimation of likelihood ratios on an ordinal scale outperform estimation of sensitivities and specificities? J Eval Clin Pract 2008;14:934-40.
39. Noguchi Y, Matsui K, Imura H, et al. Quantitative evaluation of the diagnostic thinking process in medical students. J Gen Intern Med 2002;17:848-53.
40. Puhan MA, Steurer J, Bachmann LM, et al. A randomized trial of ways to describe test accuracy: the effect on physicians' post-test probability estimates. Ann Intern Med 2005;143:184-9.
41. Reid MC, Lane DA, Feinstein AR. Academic calculations versus clinical judgments: practicing physicians' use of quantitative measures of test accuracy. Am J Med 1998;104:374-80.
42. Sox CM, Doctor JN, Koepsell TD, et al. The influence of types of decision support on physicians' decision making. Arch Dis Child 2009;94:185-90.
43. Bachmann LM, Steurer J, ter Riet G. Simple presentation of test accuracy may lead to inflated disease probabilities. BMJ 2003;326:393.
44. Vermeersch P, Bossuyt X. Comparative analysis of different approaches to report diagnostic accuracy. Arch Intern Med 2010;170:734-5.
45. Young JM, Glasziou P, Ward JE. General practitioners' self ratings of skills in evidence based medicine: validation study. BMJ 2002;324:950-1.
46. Sassi F, McKee M. Do clinicians always maximize patient outcomes? A conjoint analysis of preferences for carotid artery testing. J Health Serv Res Policy 2008;13:61-6.
47. Gigerenzer G. What are natural frequencies? 2011;343:d6386.
48. Gigerenzer G, Edwards A. Simple tools for understanding risks: from innumeracy to insight. BMJ 2003;327:741-4.
49. Hoffrage U, Gigerenzer G, Krauss S, et al. Representation facilitates reasoning: what natural frequencies are and what they are not. Cognition 2002;84:343-52.
50. Edwards W. 25. Conservatism in human information processing. In: Kahneman D, Slovic P, Tversky A, eds. Judgement under uncertainty: heuristics and biases. Cambridge: Cambridge University Press, 1982:359-69.
51. Zhelev Z, Garside R, Hyde C. A qualitative study into the difficulties experienced by healthcare decision-makers when reading a Cochrane diagnostic test accuracy review. Syst Rev 2013;2:32.
52. Cochrane Diagnostic Test Accuracy Working Group. Handbook for DTA reviews [Internet]. The Cochrane Collaboration, 2013 (accessed 13 Oct 2014).
53. GRADE working group [Internet]. Secondary GRADE working group [Internet]. 2014, (accessed 27 Mar 2014). http://www. gradeworkinggroup.org/index.htm