Discussion between reviewers does not improve reliability of peer review of hospital quality

Medical Care

Volumn 38, Issue 2, 2000, Pages 152-161

  Hofer, Timothy P ^a,b,c   Bernstein, Steven J ^a,b   Demonner, Sonya ^a   Hayward, Rodney A ^a,b  

^a VETERANS AFFAIRS MEDICAL CENTER   (United States)

^b UNIVERSITY OF MICHIGAN MEDICAL SCHOOL   (United States)

^c Ann Arbor VA HSR and D Center of Excellence   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; DECISION MAKING; EPIDEMIOLOGY; HEALTH CARE QUALITY; HUMAN; IATROGENIC DISEASE; INFORMATION PROCESSING; INTERPERSONAL COMMUNICATION; MEDICAL ERROR; METHODOLOGY; OBSERVER VARIATION; PEER REVIEW; PUBLIC HOSPITAL; REGRESSION ANALYSIS; REPRODUCIBILITY; RISK MANAGEMENT; STANDARD; UNITED STATES;

CAUSALITY; COMMUNICATION; DATA COLLECTION; HOSPITALS, VETERANS; HUMANS; IATROGENIC DISEASE; JUDGMENT; MEDICAL ERRORS; OBSERVER VARIATION; PEER REVIEW, HEALTH CARE; QUALITY ASSURANCE, HEALTH CARE; REGRESSION ANALYSIS; REPRODUCIBILITY OF RESULTS; RISK MANAGEMENT; UNITED STATES;

EID: 0034133659     PISSN: 00257079     EISSN: None     Source Type: Journal    
DOI: 10.1097/00005650-200002000-00005     Document Type: Review

References (38)

1. Bernstein SJ, McGlynn EA, Siu AL, et al. The appropriateness of hysterectomy: a comparison of care in seven health plans. Health Maintenance Organization Quality of Care Consortium. JAMA 1993;269:2398-2402.
2. Bernstein SJ, Hilborne LH, Leape LL, et al. The appropriateness of use of cardiovascular procedures in women and men. Arch Intern Med 1994;154:2759-2765.
3. Benavente O, Moher D, Pham B. Carotid end-arterectomy for asymptomatic carotid stenosis: a metaanalysis. Br Med J 1998;317:1477-1480.
4. Dolovich LR, Addis A, Vaillancourt JM, et al. Benzodiazepine use in pregnancy and major malformations or oral cleft: meta-analysis of cohort and case-control studies. Br Med J 1998;317:839-843.
5. Heyland DK, MacDonald S, Keefe L, et al. Total parenteral nutrition in the critically ill patient: a meta-analysis. JAMA 1998;280:2013-2019.
6. Levine RD, Sugarman M, Schiller W, et al. The effect of group discussion on interrater reliability of structured peer review. Anesthesiology 1998;89:507-515.
7. Schmader K, Hanlon JT, Weinberger M, et al. Appropriateness of medication prescribing in ambulatory elderly patients. J Am Geriatr Soc 1994;42:1241-1247.
8. Lefevre F, Feinglass J, Potts S, et al. Iatrogenic complications in high-risk, elderly patients. Arch Intern Med 1992;152:2074-2080.
9. Schriger DL, Baraff LJ, Fink A. A comparison of implicit and explicit methods of process quality assurance for blunt trauma patients. Ann Emerg Med 1990;19:736-740.
10. Hayward RA, McMahon LF Jr, Bernard AM. Evaluating the care of general medicine inpatients: how good is implicit review? Ann Intern Med 1993;118:550-556.
11. MacKenzie EJ, Steinwachs DM, Bone LR, et al. Inter-rater reliability of preventable death judgments. The Preventable Death Shady Group. J Trauma 1992;33:292-302; discussion 302-303.
12. Norton PG, Dunn EV, Beckett R, et al. Long-term follow-up in the Peer Assessment Program for nonspecialist physicians in Ontario, Canada. Jt Comm J Qual Improv 1998;24:334-341.
13. Hofer TP, Bernstein SJ, Hayward RA, et al. Validating quality indicators for hospital care. Jt Comm J Qual Improv 1997;23:455-467.
14. Brennan TA, Leape LL, Laird NM, et al. Incidence of adverse events and negligence in hospitalized patients: results of the Harvard Medical Practice Study I. N Engl J Med 1991;324:370-376.
15. Dubois RW, Brook RH. Preventable deaths: who, how often, and why? Ann Intern Med 1988;109:582-589.
16. Brennan TA, Localio RJ, Laird NL. Reliability and validity of judgments concerning adverse events suffered by hospitalized patients. Med Care 1989;27:1148-1158.
17. Rubin HR, Rogers WH, Kahn KL, et al. Watching the doctor-watchers. how well do peer review organization methods detect hospital care quality problems? JAMA 1992;267:2349-2354.
18. Goldman RL. The reliability of peer assessments of quality of care. JAMA 1992;267:958-960.
19. McDowell I, Newell C. Measuring health: a guide to rating scales and questionnaires. 2nd ed. New York: Oxford University Press, 1996.
20. Butler JJ, Quinlan JW. Internal audit in the department of medicine at a community hospital: two years' experience. JAMA 1958;167:567-572.
21. Rubenstein LV, Kahn KL, Reinisch EJ, et al. Changes in quality of care for five diseases measured by implicit review, 1981 to 1986. JAMA 1990;264:1974-1979.
22. Kahn KL, Rubenstein LV, Sherwood MJ, et al. Structured implicit review for physician measurement of quality of care: development of the form and guidelines for its use. Santa Monica, CA: RAND Corporation, 1989.
23. Rubin HR, Kahn KL, Rubenstein LV, et al. Guidelines for structured implicit review of the quality of hospital care for diverse medical and surgical complications. Santa Monica, CA: RAND Corporation, 1990.
24. Bravo G, Potvin L. Estimating the reliability of continuous measures with Cronbach's alpha or the intraclass correlation coefficient: toward the integration of two traditions. J Clin Epidemiol 1991;44:381-390.
25. Evans WJ, Cayten CG, Green PA. Determining the generalizability of rating scales in clinical settings. Med Care 1981;19:1211-1220.
26. Longford NT. Reliability of essay rating and score adjustment. J Educ Behav Statis 1994;19:171-200.
27. Carmines EG, Zeller RA. Reliability and validity assessment. Newbury Park, California: Sage Publications, 1979. (Lewis-Beck MS, ed. Sage University paper series on quantitative applications in the social sciences; 07-001).
28. Fleiss JL. Statistical methods for rates and proportions. 2nd ed. New York: John Wiley & Sons, 1981:212-236.
29. Caplan RA, Posner KL, Cheney FW. Effect of outcome on physician judgments of appropriateness of care. JAMA 1991;265:1957-1960.
30. Goldstein H. Multilevel statistical models. 2nd ed. New York: Halstead Press, 1995.
31. MLwiN [multilevel modelling software], 1.02.0002 version. London: Multilevel Models Project, Institute of Education, 1998.
32. Stata Statistical Software: Release 6.0. College Station, TX: Stata Corporation, 1999.
33. Landis JR, Koch GG. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics 1977;33:363-374.
34. Gigone D, Hastie R. The common knowledge effect: information sharing and group judgment. J Pers Soc Psychol 1993;65:959-974.
35. Smith MA, Atherly AJ, Kane RL, et al. Peer review of the quality of care: reliability and sources of variability for outcome and process assessments. JAMA 1997;278:1573-1578.
36. Gleason J R. sg65: computing intraclass correlations and large ANOVAs. In: Newton H J, ed. The Stata technical bulletin Reprints. Vol. 6. College Station, TX: Stata Corporation, 1996:167-176.
37. Greene WH. Econometric analysis. 3rd ed. Upper Saddle River, NJ: Prentice-Hall, 1997:435-444.
38. Shekelle PG, Kahan JP, Bernstein SJ, et al. The reproducibility of a method to identify the overuse and underuse of medical procedures. N Engl J Med 1998;338:1888-1895.