The probability of being identified as an outlier with commonly used funnel plot control limits for the standardised mortality ratio

BMC Medical Research Methodology

Volumn 12, Issue , 2012, Pages

  Seaton, Sarah E ^a   Manktelow, Bradley N ^a  

^a UNIVERSITY OF LEICESTER   (United Kingdom)

Author keywords

Funnel plot; Outlier; Poisson; Probability; SMR

Indexed keywords

ARTICLE; CONFIDENCE INTERVAL; HUMAN; POISSON DISTRIBUTION; PROBABILITY; STATISTICAL ANALYSIS; STATISTICAL MODEL; SURVIVAL;

CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; POISSON DISTRIBUTION; PROBABILITY; SURVIVAL ANALYSIS;

EID: 84866256004     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-12-98     Document Type: Article

References (23)

1. Surgical audit: statistical lessons from Nightingale and Codman. Spiegelhalter DJ, Journal Of The Royal Statistical Society Series A-Statistics In Society 1999 162 Pt1 45 58
2. Department of Health, Equity and excellence: Liberating the NHS Department of Health, London 2010
3. Simple Exact Analysis of the Standardized Mortality Ratio. Liddell FDK, J Epidemiol Community Health 1984 38 1 85 88 10.1136/jech.38.1.85 6707569 (Pubitemid 14155849)
4. Funnel plots for institutional comparison. Spiegelhalter D, Qual Saf Health Care 2002 11 4 390 391 10.1136/qhc.11.4.390 12468706
5. Mortality Control Charts for Comparing Performance of Surgical Units: Validation Study Using Hospital Mortality Data. Tekkis PP, Mcculloch P, Steger AC, Benjamin IS, Poloniecki JD, Br Med J 2003 326 7393 786 788A 10.1136/bmj.326.7393.786
6. Funnel plots for comparing institutional performance. Spiegelhalter D, Stat Med 2005 24 8 1185 1202 10.1002/sim.1970 15568194 (Pubitemid 40485757)
7. In the context of performance monitoring, the caterpillar plot should be mothballed in favor of the funnel plot. Mohammed MA, Deeks JJ, Ann Thorac Surg 2008 86 1 348 10.1016/j.athoracsur.2007.10.028 18573460
8. Funnel plots and their emerging application in surgery. Mayer EK, Bottle A, Rao C, Darzi AW, Athanasiou T, Ann Surg 2009 249 3 376 383 10.1097/SLA.0b013e31819a47b1 19247021
9. Displaying random variation in comparing hospital performance. van Dishoeck AM, Looman CWN, van der Wilden-van Lier ECM, Mackenbach JP, Steyerberg EW, BMJ Quality & Safety 2011 20 8) 651 657 22897459
10. Department of Health/Healthcare Quality Improvement Partnership, Detection and Management of Outliers Department of Health, London 2011
11. Flowers J, Technical Briefing 2: Statistical process control methods in public health intelligence Association of Public Health Observatories, York 2007
12. Funnel plots for institutional comparisons. Gini R, Forni S, United Kingdom Stata Users' Group Meetings 2009 Stata Users Group, 2009 Available at: http://www.stata.com/meeting/uk09/uk09-gini-forni.pdf (accessed 12 July 2012) 21948462
13. Centre for Maternal and Child Enquiries (CEMACE), Perinatal Mortality 2008 CEMACE, United Kingdom. London 2010
14. The use of statistical process control for monitoring institutional performance in trauma care. Kirkham JJ, Bouamra O, Journal of Trauma Injury, Infection, and Critical Care 2008 65 6 1494 1501 10.1097/TA.0b013e31815ebabf 22743365
15. Association of Public Health Observatories http://www.apho.org.uk/ default.aspx?RID=39403 (accessed 26 July 2011)
16. Application of AHRQ patient safety indicators to English hospital data. Bottle A, Aylin P, Qual Saf Health Care 2009 18 4 303 308 10.1136/qshc.2007. 026096 19651936
17. Eastern Region Public Health Observatory http://www.erpho.org.uk/topics/ tools/funnel.aspx#16009 (accessed 26 July 2011)
18. A comparison of nine confidence intervals for a Poisson parameter when the expected number of events5. Barker L, The American Statistician 2002 56 2 85 89 10.1198/000313002317572736
19. Fiducial limits for the Poisson distribution. Garwood F, Biometrika 1936 28 3/4 437 442 10.2307/2333958
20. On the problem of confidence intervals. Neyman J, Annals of Mathematical Statistics 1935 6 3 111 116 10.1214/aoms/1177732585
21. Control limits for p control charts with small subgroup sizes. Hart MK, Hart RF, Schmaltz S, Qual Manag Health Care 2007 16 2 123 129 17426610
22. Use of the false discovery rate when comparing multiple health care providers. Jones HE, Ohlssen DI, Spiegelhalter DJ, J Clin Epidemiol 2008 61 3 232 240 10.1016/j.jclinepi.2007.04.017 18226745
23. How to interpret your dot: decoding the message of clinical performance indicators. Schulman J, Spiegelhalter DJ, Parry G, J Perinatol 2008 28 9 588 596 10.1038/jp.2008.67 18633418