On the accuracy of classifying hospitals on their performance measures

Statistics in Medicine

Volumn 33, Issue 7, 2014, Pages 1081-1103

  He, Yulei ^a   Selck, Frederic ^a   Normand, Sharon Lise T ^b  

^a NATIONAL CENTER FOR HEALTH STATISTICS   (United States)

^b HARVARD MEDICAL SCHOOL   (United States)

Author keywords

Bayesian; Hospital compare data; Hospital profiling; Mixture distribution; National hospital ambulatory medical care survey; Sensitivity; Specificity

Indexed keywords

ARTICLE; CLASSIFICATION; CLASSIFIER; HEALTH CARE QUALITY; HOSPITAL; HOSPITAL CARE; HUMAN; MEASUREMENT ACCURACY; MONTE CARLO METHOD; PERFORMANCE; PROBABILITY; PROTOCOL COMPLIANCE; RELIABILITY; SAMPLE SIZE; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS;

BAYESIAN; HOSPITAL COMPARE DATA; HOSPITAL PROFILING; MIXTURE DISTRIBUTION; NATIONAL HOSPITAL AMBULATORY MEDICAL CARE SURVEY; SENSITIVITY; SPECIFICITY;

BAYES THEOREM; COMPUTER SIMULATION; HUMANS; MODELS, STATISTICAL; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); REPRODUCIBILITY OF RESULTS;

EID: 84896739206     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.6012     Document Type: Article

References (51)

1. Donabedian A. Evaluating the quality of medical care. Milbank Memorial Fund Quarterly 1966; 44:166-203.
2. Iezzoni LI (ed.). Risk Adjustment for Measuring Health Care Outcomes. IL: Health Administration Press: Chicago, 2003.
3. Gatsonis CA. Profiling providers of medical care. In Encyclopedia of Biostatistics, Vol.3. Wiley: New York, 1998; 3536.
4. Institute of Medicine. Performance Measurement: Accelerating Improvement. The National Academies Press: Washington DC, 2006.
5. Rosenthal MB, Frank RG, Zhonghe L, Epstein AM. Early experience with pay-for-performance, from concept to practice. Journal of the American Medical Association 2005; 294:1788-1793.
6. Premier Inc. Centers for medicare and medicaid services (cms)/premier hospital quality incentive demonstration project: findings from year 2, 2007. accessed from http://www.premierinc.com/quality-safety/tools-services/p4p/hqi/resources/hqi-whitepaper-year2.pdf.
7. Rao JNK. Small Area Estimation. Wiley: New Jersey, 2003.
8. Christiansen CL, Morris CM. Improving the statistical approach to health care provider profiling. Annals of Internal Medicine 1997; 127:764-768.
9. McGlynn EA. Introduction and overview of the conceptual framework for a national quality measurement and reporting system. Medical Care 2003; 41:1-7.
10. Thomas JW, Hofer TP. Accuracy of risk-adjusted mortality rates as a measure of hospital quality of care. Medical Care 1999; 37:83-92.
11. Adams JL, Mehrotra A, Thomas JW, McGlynn EA. Physician cost profiling-reliability and risk of misclassification. New England Journal of Medicine 2010; 362:1014-1021.
12. Normand SLT, Shahian DM. Statistical and clinical aspects of hospital outcomes profiling. Statistical Science 2007; 22:206-226.
13. Miller M, Richardson JM, Bloniaz K. More on physician cost profiling. New England Journal of Medicine 2010; 363:2075-2076.
14. Adams JL, Mehrotra A, Thomas JW, McGlynn EA. The authors reply to "more on physician cost profiling" by Miller et al. (2010). New England Journal of Medicine 2010; 363:2076.
15. Normand SLT, Wolf RE, Ayanian AZ, McNeil BJ. Assessing the accuracy of hospital clinical performance measures. Medical Decision Making 2007; 27:9-20.
16. Austin PC. Bayes rules for optimally using Bayesian hierarchical regression models in provider profiling to identify high-mortality hospitals. BMC Medical Research Methodology 2008; 8:30-40.
17. Jones HE, Spiegelhalter DJ. The identification of "unusual" health-care providers from a hierarchical model. The American Statistician 2011; 65:154-163.
18. Teixeira-Pinto A, Normand SLT. Statistical methodology for classifying units on the basis of multiple-related measures. Statistics in Medicine 2008; 27:1329-1350.
19. McCulloch CE, Searle SR, Neuhaus JM. Generalized, Linear, and Mixed Models, 2nd Edition. Wiley: New Jersey, 2008.
20. James W, Stein C. Estimation with quadratic loss. In Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, 1, University of California Press: Berkeley, 1961; 361-379.
21. Efron B, Morris CN. Data analysis using stein's estimator and its generalizations. Journal of the American Statistical Association 1975; 70:311-319.
22. Burgess JF, Christiansen CL, Michalak SE, Morris CN. Medical profiling: improving standards and risk adjustment using hierarchical models. Journal of Health Economics 2000; 19:291-309.
23. Jones HE, Spiegelhalter DJ. Accounting for regression-to-the-mean in tests for recent changes in institutional performance: analysis and power. Statistics in Medicine 2009; 28:1645-1667.
24. Austin PC, Brunner LJ. Optimal bayesian probability levels for hospital report cards. Health Services and Outcomes Research Methodology 2008; 8:80-97.
25. Zheng H, Zhang W, Ayanian JZ, Zaborski LB, Zaslavsky AM. Profiling hospitals by survival of patients with colorectal cancer. Health Services Research 2011; 46:729-746.
26. Slepian D. The one-sided barrier problem for gaussian noise. Bell System Technolgoy Journal 1962; 41:463-501.
27. Neudecker H, Magnus JR. Matrix Differential Calculus with Applications in Statistics and Econometrics. Wiley: New York, 1988.
28. McCaig LF, McLemore T. Plan and operation of the National Hospital Ambulatory Medical Survey. Series 1: programs and collection procedures. Vital Health Statistics 1994; 34:1-78.
29. Pines JM, Decker SL, Hu T. Exogenous predictors of national performance measures for emergency department crowding. Annals of Emergency Medicine 2012; 60:293-298.
30. Gelman AE, Carlin JB, Stern HS, Rubin DB. Bayesian Data Analysis. Chapman and Hall: London, 2004.
31. Gelman A, Rubin DB. Inference from iterative simulation using multiple sequences (with discussion). Statistical Science 1992; 7:457-511.
32. Thomas N, Longford NT, Rolph JE. Empirical bayes method for estimating hospital-specific mortality rates. Statistics in Medicine 1994; 13:889-903.
33. Carter GM, Rolph JE. Empirical bayes methods applied to estimating fire alarm probabilities. Journal of the American Statistical Association 1974; 69:880-885.
34. Berger JO. Statistical Decision Theory and Bayesian Analysis. Springer-Verlag: New York, 1980.
35. Brown LD, Cai TT, DasGupta A. Interval estimation for a binomial proportion, (with discussion). Statistical Science 2001; 16:101-133.
36. Fellingham GW, Raghunathan TE. Sensitivity of point and interval estimates to distributional assumptions in longitudinal data analysis of small samples. Communications in Statistics - Simulation and Computation 1995; 24:617-630.
37. Austin PC. Bias in penalized quasi-likelihood estimation in random effects logistic regression models when the random effects are not normally distributed. Communications in Statistics-Simulation and Computation 2005; 34:549-565.
38. Litiere S, Alonso A, Molenberghs G. The impact of a misspecified random-effects distribution on the estimation and the performance of inferential procedures in generalized linear mixed models. Statistics in Medicine 2008; 27:3125-3144.
39. Paddock SM, Ridgeway G, Lin R, Louis TA. Flexible distributions for triple-goal estimates in two-stage hierarchical models. Computational Statistics and Data Analysis 2006; 50:3242-3262.
40. Ohlssen DI, Sharples LD, Spiegelhalter DJ. Flexible random-effects models using Bayesian semi-parametric models: applications to institutional comparisons. Statistics in Medicine 2007; 26:2088-2112.
41. Normand SLT, Wolf RE, McNeil BJ. Discriminating quality of hospital care in the US. Medical Decision Making 2008; 38:308-322.
42. Shwartz M, Justin R, Erol AP, Wang X, Cohen AB, Restuccia JD. Estimating a composite measure of hospital quality from the hospital compare database, differences when using a Bayesian hierarchical latent variable model versus denominator-based weights. Medical Care 2008; 46:778-785.
43. He Y, Wolfe RE, Normand SLT. Assessing geographical variations in hospital processes of care using multilevel item response models. Health Services and Outcomes Methodology 2010; 10:111-133.
44. Skrondal A, Rabe-Hesketh S. Generalized Latent Variable Modeling. Chapman and Hall/CRC: Boca Raton, FL, 2004.
45. Laird NM, Louis TA. Empirical bayes ranking methods. Journal of Educational Statistics 1989; 14:29-46.
46. Lockwood JR, Louis TA, McCaffrey DF. Uncertainty in rank estimation: implications for value-added modeling accountability systems. Journal of Educational and Behavioral Statistics 2002; 27:255-270.
47. Lin R, Louis TA, Paddock SM, Ridgeway G. Loss function based ranking in two-stage, hierarchical models. Bayesian Analysis 2006; 1:915-946.
48. Aitkin M, Longford NT. Statistical modelling issues in school effectiveness studies. Journal of the Royal Statistical Society, Series A 1986; 149:1-43.
49. Goldstein H, Speigelhalter D. League tables and their limitation: statistical issues in comparisons of institutional performance (with discussion). Journal of the Royal Statistical Society, Series A (Statistics in Society) 1996; 159:385-443.
50. Draper D, Gittoes M. Statistical analysis of performance indicators in UK higher education. Journal of the Royal Statistical Society, Series B (Statistical Methodology) 2004; 167:449-474.
51. Zhou XH, Obuchowski NA, McClish DK. Statistical Methods in Diagnostic Medicine. Wiley: New York, 2002.