Effect of provider volume on the accuracy of hospital report cards:A monte carlo study

Circulation: Cardiovascular Quality and Outcomes

Volumn 7, Issue 2, 2014, Pages 299-305

  Austin, Peter C ^a   Reeves, Mathew J ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b MICHIGAN STATE UNIVERSITY   (United States)

Author keywords

Health services research; Risk adjustment

Indexed keywords

ACCURACY; ACUTE HEART INFARCTION; ARTICLE; CANADA; HEALTH CARE QUALITY; HEALTH SERVICES RESEARCH; HOSPITAL CASE VOLUME; HOSPITAL MANAGEMENT; HOSPITAL PERFORMANCE; HOSPITAL REPORT CARD; MEDICAL RECORD; MONTE CARLO METHOD; PRIORITY JOURNAL; RISK ASSESSMENT;

HEALTH SERVICES RESEARCH; RISK ADJUSTMENT;

CANADA; HEALTH PERSONNEL; HOSPITALIZATION; HOSPITALS; HUMANS; MONTE CARLO METHOD; MYOCARDIAL INFARCTION; QUALITY ASSURANCE, HEALTH CARE; RESEARCH REPORT; RISK ADJUSTMENT;

EID: 84897974361     PISSN: 19417713     EISSN: 19417705     Source Type: Journal    
DOI: 10.1161/CIRCOUTCOMES.113.000685     Document Type: Article

References (33)

1. Luft HS, Romano PS, Remy LL, Rainwater J. Annual Report of the California Hospital Outcomes Project. Sacramento, CA: California Office of Statewide Health Planning and Development; 1993.
2. Pennsylvania Health Care Cost Containment Council. Focus on heart attack in Pennsylvania: research methods and results. Harrisburg, PA: Pennsylvania Health Care Cost Containment Council; 1996.
3. Naylor CD, Rothwell DM, Tu JV, Austin PC, the Cardiac Care Network Steering Committee. Outcomes of coronary artery bypass surgery in Ontario. In: Naylor CD, Slaughter PM, eds. Cardiovascular Health and Services in Ontario: An ICES Atlas. Toronto, Canada: Institute for Clinical Evaluative Sciences; 1999:189-198.
4. Clinical Outcomes Working Group. Clinical Outcome Indicators. Edinburgh: The Scottish Office Clinical Resource and Audit Group; 1995.
5. Massachusetts Data Analysis Center. Adult Coronary Artery Bypass Graft Surgery in the Commonwealth of Massachusetts: Fiscal Year 2010 Report. Boston, MA: Department of Health Care Policy, Harvard Medical School;2012.
6. Jacobs FM. Cardiac Surgery in New Jersey in 2002: A Consumer Report. Trenton, NJ: Department of Health and Senior Services; 2005.
7. New York State Department of Health. Coronary artery bypass graftsurgery in New York State 1989-1991. Albany, NY: New York State Department of Health; 1992.
8. Pennsylvania Health Care Cost Containment Council. Consumer Guideto Coronary Artery Bypass Graft Surgery. Volume 4. Harrisburg, PA:Pennsylvania Health Care Cost Containment Council; 1995.
9. Halm EA, Lee C, Chassin MR. Is volume related to outcome in healthcare? A systematic review and methodologic critique of the literature.Ann Intern Medicine 2002;137:51-520.
10. Dudley RA, Johansen KL, Brand R, Rennie DJ, Milstein A. Selective referralto high-volume hospitals: estimating potentially avoidable deaths.JAMA. 2000;283:1159-1166.
11. Birkmeyer JD, Siewers AE, Finlayson EV, Stukel TA, Lucas FL, Batista I, Welch HG, Wennberg DE. Hospital volume and surgical mortality in the United States. N Engl J Med. 2002;346:1128-1137.
12. Canadian Institute for Health Information. Health Care in Canada 2005.Ottawa, Canada: Canadian Institute for Health Information; 2005.
13. Hofer TP, Hayward RA. Identifying poor-quality hospitals. Can hospitalmortality rates detect quality problems for medical diagnoses? Med Care.1996;34:737-753.
14. Thomas JW, Hofer TP. Accuracy of risk-adjusted mortality rate as a measureof hospital quality of care. Med Care. 1999;37:83-92.
15. Austin PC, Reeves MJ. The relationship between the C-statistic of a risk-adjustment model and the accuracy of hospital report cards: a MonteCarlo Study. Med Care. 2013;51:275-284.
16. Austin PC. The impact of unmeasured clinical variables on the accuracyof hospital report cards: a Monte Carlo study. Med Decis Making. 2006;26:447-466.
17. Austin PC, Brunner LJ. Optimal Bayesian probability levels for hospitalreport cards. Health Services Outcomes Res Methodol. 2008;8:80-97.
18. Walker K, Neuburger J, Groene O, Cromwell DA, van der Meulen J.Public reporting of surgeon outcomes: low numbers of procedures lead to false complacency. Lancet. 2013;382:1674-1677.
19. Krumholz HM, Wang Y, Mattera JA, Wang Y, Han LF, Ingber MJ, RomanS, Normand SL. An administrative claims model suitable for profiling hospital performance based on 30-day mortality rates among patients with heart failure. Circulation. 2006;113:1693-1701.
20. Krumholz HM, Wang Y, Mattera JA, Wang Y, Han LF, Ingber MJ, Roman S, Normand SL. An administrative claims model suitable for profiling hospital performance based on 30-day mortality rates among patients with an acute myocardial infarction. Circulation. 2006;113:1683-1692.
21. Tu JV, Naylor CD, Austin P. Temporal changes in the outcomes of acute myocardial infarction in Ontario, 1992-1996. CMAJ. 1999;161:1257-1261.
22. Tu JV, Austin PC, Walld R, Roos L, Agras J, McDonald KM. Developmentand validation of the Ontario acute myocardial infarction mortality prediction rules. J Am Coll Cardiol. 2001;37:992-997.
23. Iezzoni LI. Risk Adjustment for Measuring Health Outcomes. 2nd ed.Chicago, IL: Health Administration Press; 1997.
24. COPSS-CMS White Paper Committee (Ash AS, Fienberg SE, Louis TA,Normand SLT, Stukel TA, Utts J). Statistical Issues in Assessing Hospital Performance. Paper commissioned by the Committee of Presidents of Statistical Societies (COPSS), 2012. Available at: http://www.cms.gov/Medicare/Quality-Initiatives- Patient-Assessment-Instruments/HospitalQualityInits/Downloads/ Statistical-Issues-in-Assessing-Hospital-Performance.pdf. Accessed January 24, 2014.
25. Fonarow GC, Pan W, Saver JL, Smith EE, Reeves MJ, Broderick JP,Kleindorfer DO, Sacco RL, Olson DM, Hernandez AF, Peterson ED, Schwamm LH. Comparison of 30-day mortality models for profiling hospital performance in acute ischemic stroke with vs without adjustment for stroke severity. JAMA. 2012;308:257-264.
26. Austin PC. Estimating multilevel logistic regression models when thenumber of clusters is low: a comparison of different statistical software procedures. Int J Biostat. 2010;6:1. DOI: 10.2202/1557-4679.1195.
27. Austin PC, Alter DA, Tu JV. The use of fixed- and random-effects models for classifying hospitals as mortality outliers: a Monte Carlo assessment. Med Decis Making. 2003;23:526-539.
28. Austin PC, Steyerberg EW. Interpreting the concordance statistic of a logisticregression model: relation to the variance and odds ratio of a continuousexplanatory variable. BMC Med Res Methodol. 2012;12:82.
29. Bronskill SE, Normand SL, Landrum MB, Rosenheck RA. Longitudinalprofiles of health care providers. Stat Med. 2002;21:1067-1088.
30. Normand SL, Glickman ME, Gatsonis CA. statistical methods for profiling providers of medical care: issues and applications. J Am Stat Assoc.1997;92:803-814.
31. Austin PC. A comparison of Bayesian methods for profiling hospital performance.Med Decis Making. 2002;22:163-172.
32. Austin PC. Bayes rules for optimally using Bayesian hierarchical regressionmodels in provider profiling to identify high-mortality hospitals.BMC Med Res Methodol. 2008;8:30.
33. Austin PC. The reliability and validity of bayesian methods for hospital profiling:A Monte Carlo assessment. J Stat Plan Inference. 2005;128:109-122.