A technical review of the United Kingdom National Adult Cardiac Surgery Governance Analysis 2008-11

European Journal of Cardio-thoracic Surgery

Volumn 45, Issue 2, 2014, Pages 225-233

  Hickey, Graeme L ^a,b   Cosgriff, Rebecca ^b   Grant, Stuart W ^a,b   Cooper, Graham ^c   Deanfield, John ^b   Roxburgh, James ^d   Bridgewater, Ben ^a,b  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c NORTHERN GENERAL HOSPITAL   (United Kingdom)

^d ST THOMAS HOSPITAL   (United Kingdom)

Author keywords

Healthcare regulation; Outliers; Performance indicators; Registry data; Risk adjustment

Indexed keywords

ANALYTIC METHOD; DISEASE REGISTRY; EUROSCORE; HEALTH CARE PERSONNEL; HEALTH CARE QUALITY; HEALTH SERVICE; HOSPITAL POLICY; HUMAN; MORTALITY; OUTCOME ASSESSMENT; OUTCOMES RESEARCH; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; REVIEW; RISK ASSESSMENT; UNITED KINGDOM; UNITED KINGDOM NATIONAL ADULT CARDIAC SURGERY GOVERNANCE ANALYSIS;

HEALTHCARE REGULATION; OUTLIERS; PERFORMANCE INDICATORS; REGISTRY DATA; RISK-ADJUSTMENT;

CARDIAC SURGICAL PROCEDURES; GREAT BRITAIN; HUMANS; PROSPECTIVE STUDIES; REGISTRIES; RISK ADJUSTMENT; RISK FACTORS; TREATMENT OUTCOME;

EID: 84892555227     PISSN: 10107940     EISSN: 1873734X     Source Type: Journal    
DOI: 10.1093/ejcts/ezt476     Document Type: Review

References (53)

1. Bridgewater B. Mortality data in adult cardiac surgery for named surgeons: retrospective examination of prospectively collected data on coronary artery surgery and aortic valve replacement. Br Med J (Clinical Research Ed) 2005;330:506-9.
2. Bridgewater B. Cardiac registers: the adult cardiac surgery register. Heart 2010;96:1441-3.
3. Bridgewater B, Hickey GL, Cooper G, Deanfield J, Roxburgh J. Publishing cardiac surgery mortality rates: lessons for other specialties. Br Med J 2013;346:f1139.
4. BRI Inquiry Panel. Learning from Bristol: The Report of the Public Inquiry into Children's Heart Surgery at the Bristol Royal Infirmary 1984-1995. London, UK, 2001. http://www.bristol-inquiry.org.uk/final report/. (26 April 2013, date last accessed)
5. NHS Commissioning Board. Everyone counts: planning for patients 2013/ 2014. London, UK, 2012. www.commissioningboard.nhs.uk/files/2012/12/ everyonecounts-planning.pdf (26 April 2013, date last accessed).
6. Dominiczak P. Sir Bruce Keogh admits that 'inaccurate data' led him to suspend children's heart surgery. The Telegraph. 2013. http://www.telegraph. co.uk/health/healthnews/9980869/ Sir-Bruce-Keogh-admits-that-inaccurate- data-led-him-to-suspend-childrens-heart-surgery.html (24 May 2013, date last accessed).
7. Sibbald B. Twelve deaths in Winnipeg: Dudge must ponder 48,000 pages of inquest testimony. Can Med Assoc J 1998;159:1285-7.
8. Commission for Healthcare Audit and Inspection. Investigation into cardiothoracic surgical services at the Oxford Radcliffe Hospitals NHS Trust. London: Commission for Healthcare Audit and Inspection, 2007. http://archive.cqc.org.uk/_db/_documents/Oxford_Radcliffe_tagged1.pdf.
9. Grover FL, Shroyer LW, Hammermeister K, Edwards FH, Ferguson TB, Dziuban SW et al. A decade's experience with quality improvement in cardiac surgery using the Veterans Affairs and Society of Thoracic Surgeons national databases. Ann Surg 2001;234:464-74.
10. Francis R. Independent Inquiry into Care Provided by Mid Staffordshire NHS Foundation Trust January 2005-March 2009. London: The Stationery Office, 2013.
11. Bridgewater B, Irvine D, Keogh BE. NHS transparency. Br Med J 2013;347: f4402.
12. Hickey GL, Grant SW, Cosgriff R, Dimarakis I, Pagano D, Kappetein AP et al. Clinical registries: governance, management, analysis and applications. Eur J Cardiothorac Surg 2013;44:605-14.
13. Grant SW, Hickey GL, Dimarakis I, Cooper G, Jenkins DP, Uppal R et al. Performance of the EuroSCORE models in emergency cardiac surgery. Circ Cardiovasc Qual Outcomes 2013;6:178-85.
14. Roques F. The logistic EuroSCORE. Eur Heart J 2003;24:882.
15. Hannan EL, Wu C, DeLong ER, Raudenbush SW. Predicting risk-adjusted mortality for CABG surgery. Med Care 2005;43:726-35.
16. Racz MJ, Sedransk J. Bayesian and frequentist methods for provider profiling using risk-adjusted assessments of medical outcomes. J Am Stat Assoc 2010;105:48-58.
17. Hickey GL, Grant SW, Murphy GJ, Bhabra M, Pagano D, McAllister K et al. Dynamic trends in cardiac surgery: why the logistic EuroSCORE is no longer suitable for contemporary cardiac surgery and implications for future risk models. Eur J Cardiothorac Surg 2013;43:1146-52.
18. Bridgewater B, Keogh B, Kinsman R, Walton P. The Society for Cardiothoracic Surgery in Great Britain & Ireland: The Sixth National Adult Cardiac Surgical Database Report. Henley-on-Thames, UK: Dendrite Clinical Systems Ltd, 2009.
19. Choong CK, Sergeant P, Nashef SAM, Smith JA, Bridgewater B. The EuroSCORE risk stratification system in the current era: how accurate is it and what should be done if it is inaccurate? Eur J Cardiothorac Surg 2009; 35:59-61.
20. Steyerberg EW, Borsboom GJJM, Van Houwelingen HC, Eijkemans MJC, Habbema JDF. Validation and updating of predictive logistic regression models: a study on sample size and shrinkage. Stat Med 2004;23: 2567-86.
21. Hosmer DW, Lemeshow S. Applied Logistic Regression. 2nd edn. New York, NY: John Wiley & Sons, 2000.
22. Cleveland WS. Robust locally weighted regression and smoothing scatterplots. J Am Stat Assoc 1979;368:829-36.
23. Agresti A, Coull BA. Estimation of binomial proportions. Am Stat 1998;52: 119-26.
24. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982;143:29-36.
25. R Development Core Team R. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing. ISBN 3-900051-07-0.
26. Harrell FE Jr Hmisc: Harrell Miscellaneous. 2012. http://cran.r-project.org/ package=Hmisc (26 April 2013, date last accessed).
27. Dendrite Clinical Systems Ltd, The Society of Cardiothoracic Surgery in Great Britain & Ireland. The Society for Cardiothoracic Surgery in Great Britain & Ireland: Maintaining Patients' Trust: Modern Medical Professionalism. Henley-on-Thames, UK: Dendrite Clinical Systems Ltd, 2011.
28. Spiegelhalter DJ. Funnel plots for comparing institutional performance. Stat Med 2005;24:1185-202.
29. Wilcox RR. Introduction to Robust Estimation and Hypothesis Testing. 3rd edn. San Diego, CA: Academic Press, 2012.
30. Walker K, Neuburger J, Groene O, Cromwell D, van der Meulen J. Public reporting of surgeon outcomes: low numbers of procedures lead to false complacency. Lancet 2013;382:1674-7.
31. Siregar S, Groenwold RHH, de Mol BA, Speekenbrink RGH, Versteegh MIM, Brandon Bravo Bruinsma GJ et al. Evaluation of cardiac surgery mortality rates: 30-day mortality or longer follow-up?. Eur J Cardiothorac Surg 2013; 44:875-83.
32. Damhuis RAM, Wijnhoven BPL, Plaisier PW, Kirkels WJ, Kranse R, van Lanschot JJ. Comparison of 30-day, 90-day and in-hospital postoperative mortality for eight different cancer types. Br J Surg 2012;99:1149-54.
33. O'Brien SM, Shahian DM, DeLong ER, Normand S-LT, Edwards FH, Ferraris VA et al. Quality measurement in adult cardiac surgery: Part 2-statistical considerations in composite measure scoring and provider rating. Ann Thorac Surg 2007;83:S13-26.
34. Shahian DM, He X, Jacobs JP, Rankin JS, Welke KF, Filardo G et al. The Society of Thoracic Surgeons isolated aortic valve replacement (AVR) composite score: a report of the STS Quality Measurement Task Force. Ann Thorac Surg 2012;94:2166-71.
35. Gelman A, Hill J. Data Analysis Using Regression and Multilevel/ Hierarchical Models. New York, NY: Cambridge University Press, 2007.
36. Rubin DB, Schenker N. Multiple imputation in health-care databases: an overview and some applications. Stat Med 1991;10:585-98.
37. Norris CM, Ghali WA, Knudtson ML, Naylor CD, Saunders LD. Dealing with missing data in observational health care outcome analyses. J Clin Epidemiol 2000;53:377-83.
38. Head SJ, Osnabrugge RLJ, Howell NJ, Freemantle N, Bridgewater B, Pagano D et al. A systematic review of risk prediction in adult cardiac surgery: considerations for future model development. Eur J Cardiothorac Surg 2013;43:121-9.
39. Howell NJ, Keogh BE, Bonser RS, Graham TR, Mascaro J, Rooney SJ et al. Mild renal dysfunction predicts in-hospital mortality and post-discharge survival following cardiac surgery. Eur J Cardiothorac Surg 2008;34:390-5; discussion 395.
40. Grant SW, Grayson AD, Jackson M, Au J, Fabri BM, Grotte GJ et al. Does the choice of risk-adjustment model influence the outcome of surgeonspecific mortality analysis? A retrospective analysis of 14,637 patients under 31 surgeons. Heart 2008;94:1044-9.
41. Bridgewater B. Commentary: unintended consequences of governance. Br Med J 2011;342:d2865.
42. Nashef SAM, Roques F, Sharples LD, Nilsson J, Smith C, Goldstone AR et al. EuroSCORE II. Eur J Cardiothorac Surg 2012;41:1-12.
43. Grant SW, Hickey GL, Dimarakis I, Trivedi U, Bryan A, Treasure T et al. How does EuroSCORE II perform in UK cardiac surgery; an analysis of 23 740 patients from the Society for Cardiothoracic Surgery in Great Britain and Ireland National Database. Heart 2012;98:1568-72.
44. Takkenberg JJM. Dynamic trends in cardiac surgery require dynamic models. Eur J Cardiothorac Surg 2013;43:1153.
45. Cunningham D, Franklin R, Bridgewater B, Deanfield J, Spiegelhalter DJ. Investigation ofMortality from Paediatric Cardiac Surgery in England 2009-12. London. http://www.ucl.ac.uk/nicor/paediatric_cardiac_surgery_report (26 May 2013, date last accessed).
46. Jin R, Furnary AP, Fine SC, Blackstone EH, Grunkemeier GL. Using Society of Thoracic Surgeons risk models for risk-adjusting cardiac surgery results. Ann Thorac Surg 2010;89:677-82.
47. Kunadian B, Dunning J, Roberts AP, Morley R, de Belder MA. Funnel plots for comparing performance of PCI performing hospitals and cardiologists: demonstration of utility using the New York hospital mortality data. Catheter Cardiovasc Interv 2009;73:589-94.
48. Morris EJ, Taylor EF, Thomas JD, Quirke P, Finan PJ, Coleman MP et al. Thirty-day postoperative mortality after colorectal cancer surgery in England. Gut 2011;60:806-13.
49. Rogers C, Thomas H, Taylor R, Cromwell D, Parameshwar J, Banner NR. UK Cardiothoracic Transplant Audit. London: Clinical Effectiveness Unit, RCS, 2012. http://www.rcseng.ac.uk/surgeons/research/surgical-research/ docs/uk-cardiothoracic-transplant-audit-report-2011.
50. Spiegelhalter DJ, Sherlaw-Johnson C, Bardsley M, Blunt I, Wood C, Grigg O. Statistical methods for healthcare regulation: rating, screening and surveillance. J R Stat Soc A 2012;175:1-47.
51. DeLong ER, Peterson ED, DeLong DM, Muhlbaier LH, Hackett S, Mark DB. Comparing risk-adjustment methods for provider profiling. Stat Med 1997;16:2645-64.
52. Spiegelhalter DJ. Handling over-dispersion of performance indicators. Qual Saf Health Care 2005;14:347-51.
53. Jones HE, Ohlssen DI, Spiegelhalter DJ. Use of the false discovery rate when comparing multiple health care providers. J Clin Epidemiol 2008;61: 232-40.