Combining ratings from multiple physician reviewers helped to overcome the uncertainty associated with adverse event classification

Journal of Clinical Epidemiology

Volumn 60, Issue 9, 2007, Pages 892-901

  Forster, Alan J ^a,b   O'Rourke, Keith ^b   Shojania, Kaveh G ^a,b   van Walraven, Carl ^a,b,c  

^a UNIVERSITY OF OTTAWA   (Canada)

^b OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

^c INSTITUTE FOR CLINICAL EVALUATIVE SCIENCES   (Canada)

Author keywords

Adverse events; Diagnostic tests; Latent class analysis; Medical error; Patient safety; Physician peer review

Indexed keywords

ADVERSE DRUG REACTION; ARTICLE; DATA ANALYSIS; DIAGNOSTIC TEST; DISEASE CLASSIFICATION; MATHEMATICAL MODEL; MEDICAL CARE; MEDICAL ERROR; OUTCOME ASSESSMENT; PATIENT SAFETY; PREDICTIVE VALIDITY; PRIORITY JOURNAL; PROBABILITY; RATING SCALE; SCORING SYSTEM; SENSITIVITY AND SPECIFICITY; SIMULATION; STATISTICAL ANALYSIS;

DATA INTERPRETATION, STATISTICAL; DIAGNOSTIC TESTS, ROUTINE; EFFECT MODIFIERS (EPIDEMIOLOGY); HUMANS; PEER REVIEW, HEALTH CARE; PHYSICIANS; SENSITIVITY AND SPECIFICITY; UNCERTAINTY;

EID: 34547606153     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2006.11.019     Document Type: Article

References (39)

1. The Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century (2001), National Academy Press, Washington, DC
2. Baker G.R., Norton P.G., Flintoft V., Blais R., Brown A., Cox J., et al. The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ 170 (2004) 1678-1686
3. Bates D.W., Cullen D.J., Laird N., Petersen L.A., Small S.D., Servi D., et al. Incidence of adverse drug events and potential adverse drug events. Implications for prevention. ADE Prevention Study Group. JAMA 274 (1995) 29-34
4. Brennan T.A., Leape L.L., Laird N.M., Hebert L., Localio A.R., Lawthers A.G., et al. Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med 324 6 (1991) 370-376
5. Davis P., Lay-Yee R., Briant R., Ali W., Scott A., and Schug S. Adverse events in New Zealand public hospitals I: occurrence and impact. N Z Med J 115 1167 (2002) U271
6. Forster A.J., Murff H.J., Peterson J.F., Gandhi T.K., and Bates D.W. The incidence and severity of adverse events affecting patients following discharge from the hospital. Ann Intern Med 138 3 (2003) 161-167
7. Forster A.J., Clark H.D., Menard A., Dupuis N., Chernish R., Chandok N., et al. Adverse events affecting medical patients following discharge from hospital. CMAJ 170 (2004) 345-349
8. Forster A.J., Asmis T.R., Clark H.D., Al Saied G., Code C.C., Caughey S.C., et al. Ottawa Hospital Patient Safety Study: incidence and timing of adverse events in patients admitted to a Canadian teaching hospital. CMAJ 170 (2004) 1235-1240
9. Michel P., Quenon J.L., de Sarasqueta A.M., and Scemama O. Comparison of three methods for estimating rates of adverse events and rates of preventable adverse events in acute care hospitals. BMJ 328 7433 (2004) 199-203
10. Thomas E.J., Studdert D.M., Burstin H.R., Orav E.J., Zeena T., Williams E.J., et al. Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care 38 3 (2000) 261-271
11. Vincent C., Neale G., and Woloshynowych M. Adverse events in British hospitals: preliminary retrospective record review. BMJ 322 7285 (2001) 517-519
12. Gandhi T.K., Weingart S.N., Borus J., Seger A.C., Peterson J., Burdick E., et al. Adverse drug events in ambulatory care. N Engl J Med 348 16 (2003) 1556-1564
13. Gurwitz J.H., Field T.S., Avorn J., McCormick D., Jain S., Eckler M., et al. Incidence and preventability of adverse drug events in nursing homes. Am J Med 109 2 (2000) 87-94
14. Gurwitz J.H., Field T.S., Harrold L.R., Rothschild J., Debellis K., Seger A.C., et al. Incidence and preventability of adverse drug events among older persons in the ambulatory setting. JAMA 289 9 (2003) 1107-1116
15. Brennan T.A., Localio R.J., and Laird N.L. Reliability and validity of judgments concerning adverse events suffered by hospitalized patients. Med Care 27 12 (1989) 1148-1158
16. Brennan T.A. The Institute of Medicine report on medical errors-could it do harm?. N Engl J Med 342 15 (2000) 1123-1125
17. Sackett D.L., Haynes R.B., Guyatt G.H., and Tugwell P. The selection of diagnostic tests. Clinical epidemiology: a basic science for clinical medicine (1991), Little, Brown and Company, Boston 51-68
18. Gustafson D.H., Fryback D.G., Rose J.H., Yick V., Prokop C.T., Detmer D.E., et al. A decision theoretic methodology for severity index development. Med Decis Making 6 1 (1986) 27-35
19. Gustafson D.H., Fryback D.G., Rose J.H., Prokop C.T., Detmer D.E., Rossmeissl J.C., et al. An evaluation of multiple trauma severity indices created by different index development strategies. Med Care 21 7 (1983) 674-691
20. Walter S.D., and Irwig L.M. Estimation of test error rates, disease prevalence and relative risk from misclassified data: a review. J Clin Epidemiol 41 (1988) 923-937
21. Qu Y., Tan M., and Kutner M.H. Random effects models in latent class analysis for evaluating accuracy of diagnostic tests. Biometrics 52 (1996) 797-810
22. Bartholemew D.J. Latent variable models and factor analysis (1987), Charles Griffin & Co. Ltd., London
23. Dunn G. The design and analysis of reliability studies: the statistical evaluation of measurement errors (1989), Edward Arnold, London
24. Skrondal A., and Rabe-Hesketh S. Generalized latent variable modeling: multilevel, longitudinal, and structural equation models (2004), Chapman & Hall, Boca Raton, FL
25. Alvord W.G., Drummond J.E., Arthur L.O., Biggar R.J., Goedert J.J., Levine P.H., et al. A method for predicting individual HIV infection status in the absence of clinical information. AIDS Res Hum Retroviruses 4 4 (1988) 295-304
26. Espeland M.A., and Handelman S.L. Using latent class models to characterize and assess relative error in discrete measurements. Biometrics 45 2 (1989) 587-599
27. Rindskopf D., and Rindskopf W. The value of latent class analysis in medical diagnosis. Stat Med 5 1 (1986) 21-27
28. R Development Core Team. R: A language and environment for statistical computing. Vienna, Austria: Available at: http://www.r-project.org. R Foundation for Statistical Computing; 2004.
29. Wolfram S. The Mathematica Book. 5th edition (2004), Wolfram Media, Champaign, IL
30. Leape L.L. Institute of medicine medical error figures are not exaggerated. JAMA 284 (2000) 95-97
31. The Institute of Medicine. To err is human: building a safer health system (2000), National Academy Press, Washington, DC
32. Thomas E.J., Lipsitz S.R., Studdert D.M., and Brennan T.A. The reliability of medical record review for estimating adverse event rates. Ann Intern Med 136 11 (2002) 812-816
33. Phelps C.E. The methodologic foundations of studies of the appropriateness of medical care. N Engl J Med 329 17 (1993) 1241-1245
34. Caplan R.A., Posner K.L., and Cheney F.W. Effect of outcome on physician judgments of appropriateness of care. JAMA 265 (1991) 1957-1960
35. Hui S.L., and Zhou X.H. Evaluation of diagnostic tests without gold standards. [Review] [34 refs]. Stat Methods Med Res 7 4 (1998) 354-370
36. Albert P.S., and Dodd L.E. A cautionary note on the robustness of latent class models for estimating diagnostic error without a gold standard. Biometrics 60 (2004) 427-435
37. Schulzer M., Anderson D.R., and Drance S.M. Sensitivity and specificity of a diagnostic test determined by repeated observations in the absence of an external standard. [Erratum: J Clin Epidemiol 1992 Jan;45(1):91]. J Clin Epidemiol 44 (1991) 1167-1179
38. Vacek P.M. The effect of conditional dependence on the evaluation of diagnostic tests. Biometrics 41 4 (1985) 959-968
39. Hayward R.A., and Hofer T.P. Estimating hospital deaths due to medical errors: preventability is in the eye of the reviewer. JAMA 286 (2001) 415-420