Use of the false discovery rate when comparing multiple health care providers

Journal of Clinical Epidemiology

Volumn 61, Issue 3, 2008, Pages

  Jones, Hayley E ^a   Ohlssen, David I ^a   Spiegelhalter, David J ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Bonferroni correction; False discovery rate (FDR); Funnel plot; Mortality rates; Multiple testing; Provider profiling

Indexed keywords

COMPARATIVE STUDY; HEALTH CARE PERSONNEL; HEART SURGERY; HUMAN; PRACTICE GUIDELINE; PRIORITY JOURNAL; REVIEW; SURGICAL MORTALITY; SURGICAL RISK;

EID: 38349153879     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2007.04.017     Document Type: Review

References (29)

1. Perez A., Dennis R.J., Rondon M.A., Metcalfe M.A., and Rowan K.M. A Colombian survey found intensive care mortality ratios were better in private vs public hospitals. J Clin Epidemiol 59 (2006) 94-101
2. Normand S.-L.T., Glickman M.E., and Gatsonis C.A. Statistical methods for profiling providers of medical care: issues and applications. J Am Stat Assoc 92 (1997) 803-814
3. Rubin H.R., Pronovost P., and Diette G.B. From a process of care to a measure: the development and testing of a quality indicator. Int J Qual Health Care 13 (2001) 489-496
4. Rogers G., and Smith D.P. Reporting comparative results from hospital patient surveys. Int J Qual Health Care ll (1999) 251-259
5. Bender R., and Lange S. Adjusting for multiple testing-when and how?. J Clin Epidemiol 54 (2001) 343-349
6. Benjamini Y., and Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc B 57 (1995) 289-300
7. Storey J.D. The positive false discovery rate: a Bayesian interpretation and the q-value. Ann Stat 6 (2003) 2013-2035
8. Storey J.D., and Tibshirani R. Statistical significance for genomewide studies. Proc Natl Acad Sci USA 100 (2003) 9440-9445
9. Genovese C.R., Lazar N.A., and Nichols T. Thresholding of statistical maps in functional neuroimaging using the false discovery rate. NeuroImage 15 (2002) 870-878
10. Mehrotra D.V., and Heyse J.F. Use of the false discovery rate for evaluating clinical safety data. Stat Methods Med Res 13 (2004) 227-238
11. Marshall C., Best N., Bottle A., and Aylin P. Statistical issues in the prospective monitoring of health outcomes across multiple units. J R Stat Soc A 167 (2004) 541-559
12. Adult Cardiac Surgery in New York State, 2000-2002 (2004), New York State Department of Health, Albany: New York. http://www.health.state.ny.us/nysdoh/heart/pdf/2000-2002_cabg.pdf Accessed July 2006
13. Marshall E.C., and Spiegelhalter D.J. Reliability of league tables of in vitro fertilisation clinics: retrospective analysis of live birth rates. Br Med J 316 (1998) 1701-1704
14. Healthcare Commission. Performance ratings 2005. Available at (2005). http://ratings2005.healthcarecommission.org.uk/ Accessed July 2006
15. Spiegelhalter D.J. Funnel plots for comparing institutional performance. Stat Med 24 (2005) 1185-1202
16. Bland J.M., and Altman D.G. Multiple significance tests: the Bonferroni method. Br Med J 310 (1995) 170
17. Spiegelhalter D.J. Surgical audit: statistical lessons from Nightingale and Cod-man. J Royal Statist Soc A 162 (1999) 45-58
18. Campbell M.J., and Machin D. Medical statistics: A commonsense approach. 3rd ed. (1999), Wiley, Chichester
19. Feinstein A.R. Principles of medical statistics (2002), Chapman & Hall, Boca Raton, FL
20. Localio A.R., Hamory B.H., Sharp T.J., Weaver S.L., TenHave T.R., and Landis J.R. Comparing hospital mortality in adult patients with pneumonia. Ann Intern Med 122 (1995) 125-132
21. Aguilar O., and West M. In: Gatsonis C., Kass R.E., Carlin B., Carriquiry A., Gelman A., and Verdinelli I. (Eds). Case studies in Bayesian statistics. Analysis of hospital quality monitors using hierarchical time series models Vol. 4 (1998), Springer-Verlag, New York 287-302
22. Benjamini Y., and Yekutieli D. . The control of the false discovery rate in multiple testing under dependency. Ann Stat 29 (2001) 1165-1188
23. Burgess J.F., Christiansen C.L., Michalak S.E., and Morris C.N. Medical profiling: improving standards and risk adjustment using hierarchical models. J Health Econ 19 (2000) 291-309
24. Spiegelhalter D.J. Handling over-dispersion of performance indicators. Qual Saf Health Care 14 (2005) 347-351
25. Ohlssen DI, Sharples LD, Spiegelhalter DJ. A hierarchical modelling framework for identifying unusual performance in health care providers. J R Stat Soc A, In press.
26. Rice K., and Spiegelhalter D.J. A simple diagnostic plot connecting robust estimation, outliers and false discovery rates. J Appl Stat 33 (2006) 1131-1147
27. Goldstein H., and Spiegelhalter D.J. League tables and their limitations: statistical issues in comparisons of institutional performance. J R Stat Soc A 159 (1996) 385-443
28. Deely J.J., and Smith A.F.M. Quantitative refinements for comparisons of performance. J R Stat Soc A 161 (1998) 5-12
29. Longford N.T. Commissioned analysis of surgical performance using routine data: lessons from the Bristol inquiry-discussion on the paper by Spiegelhalter, Aylin, Best, Evans and Murray. J R Stat Soc A 165 (2002) 221-231