Conventional models overestimate the statistical significance of volume-outcome associations, compared with multilevel models

Journal of Clinical Epidemiology

Volumn 58, Issue 4, 2005, Pages 391-400

  Urbach, David R ^a,b,c   Austin, Peter C ^a  

^a UNIVERSITY OF TORONTO   (Canada)

^b UNIVERSITY HEALTH NETWORK   (Canada)

^c UNIVERSITY OF TORONTO   (Canada)

Author keywords

Multilevel models; Outcome; Statistical methods; Surgical procedures; Volume

Indexed keywords

ARTICLE; CANCER SURGERY; COMPARATIVE STUDY; CONTROLLED STUDY; EMPIRICISM; ESOPHAGUS RESECTION; HOSPITAL ADMISSION; HOSPITALIZATION; HUMAN; LENGTH OF STAY; LUNG RESECTION; MAJOR CLINICAL STUDY; MORTALITY; PANCREATICODUODENECTOMY; POSTOPERATIVE PERIOD; PREDICTION; PRIORITY JOURNAL; REGRESSION ANALYSIS; STATISTICAL MODEL; STATISTICAL SIGNIFICANCE; SURGEON; SURGICAL TECHNIQUE;

EID: 18044372084     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2004.12.001     Document Type: Article

References (38)

1. H.S. Luft, J.P. Bunker, and A.C. Enthoven Should operations be regionalized? The empirical relation between surgical volume and mortality N Engl J Med 301 1979 1364 1369
2. D.M. Shahian, and S.-L.T. Normand The volume-outcome relationship: from Luft to Leapfrog Ann Thorac Surg 75 2003 1048 1058
3. A. Houghton Variation in outcome of surgical procedures Br J Surg 81 1994 653 660
4. J.D. Birkmeyer High-risk surgery - follow the crowd JAMA 283 2000 1191 1193
5. J.D. Birkmeyer Should we regionalize major surgery? Potential benefits and policy considerations J Am Coll Surg 190 2000 341 349
6. C. Duncan, K. Jones, and G. Moon Context, composition and heterogeneity: using multilevel models in health research Soc Sci Med 46 1998 97 117
7. H. Goldstein Multilevel statistical models 2nd ed. 1995 Edward Arnold London
8. H. Goldstein, and D.J. Spiegelhalter League tables and their limitations: statistical issues in comparisons of institutional performance J R Stat Soc A 159 1996 385 443
9. S.-L.T. Normand, M.E. Glickman, and C.A. Gatsonis Statistical methods for profiling providers of medical care: issues and applications J Am Stat Assoc 92 1997 803 814
10. N. Rice, and A. Leyland Multilevel models: applications to health data J Health Serv Res Policy 1 1996 154 164
11. M. Moerbeek, G.J.P. van Breukelen, and M.P.F. Berger A comparison between traditional methods and multilevel regression for the analysis of multicenter intervention studies J Clin Epidemiol 56 2003 341 350
12. S.W. Raudenbush, and A.S. Bryk Hierarchical linear models: applications and data analysis methods 2nd ed. 2002 Sage Publications Thousand Oaks, CA
13. T.A.B. Snijders, and R.J. Bosker Multilevel analysis: an introduction to basic and advanced multilevel modeling 1999 Sage Publications Thousand Oaks, CA
14. J.D. Birkmeyer, A.E. Siewers, E.V.A. Finlayson, T.A. Stukel, F.L. Lucas, I. Batista, H.G. Welch, and D.E. Wennberg Hospital volume and surgical mortality in the United States N Engl J Med 346 2002 1128 1137
15. P.B. Bach, L.D. Cramer, D. Schrag, R.J. Downey, S.E. Gelfand, and C.B. Begg The influence of hospital volume on survival after resection for lung cancer N Engl J Med 345 2001 181 188
16. M. Simunovic, T. To, M. Theriault, and B. Langer Relation between hospital surgical volume and outcome for pancreatic resection for neoplasm in a publicly funded health care system CMAJ 160 1999 643 648
17. C.B. Begg, L.D. Cramer, W.J. Hoskins, and M.F. Brennan Impact of hospital volume on operative mortality for major cancer surgery JAMA 280 1998 1747 1751
18. Canadian Centre for Health Information Nosology Reference Centre. Canadian classification of diagnostic, therapeutic, and surgical procedures. 2nd printing. Canadian Institute for Health Information; Toronto: Statistics Canada, 1993.
19. Medicode. 1999 Hospital & Payor ICD-9-CM: international classification of diseases. 9th rev., clinical modification. 1998;5th ed. Salt Lake City, Medicode.
20. K. Iron, V. Goel, and J.I. Williams Concordance with hospital discharge abstracts and physician claims for surgical procedures in Ontario. ICES Working Paper Series Report 42 1995 Institute for Clinical Evaluative Sciences Toronto
21. M.E. Charlson, P. Pompei, K.L. Ales, and C.R. MacKenzie A new method of classifying prognostic comorbidity in longitudinal studies: development and validation J Chronic Dis 40 1987 373 383
22. W.A. Ghali, R.E. Hall, A.K. Rosen, A.S. Ash, and M.A. Moskowitz Searching for an improved clinical comorbidity index for use with ICD-9-CM administrative data J Clin Epidemiol 49 1996 273 278
23. R.A. Deyo, D.C. Cherkin, and M.A. Ciol Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases J Clin Epidemiol 45 1992 613 619
24. N. Mantel Chi-square tests with one degree of freedom: extensions of the Mantel-Haenszel procedure J Am Stat Assoc 58 1963 690 700
25. P.C. Austin, D.M. Rothwell, and J.V. Tu A comparison of statistical modeling strategies for analyzing length of stay after CABG surgery Health Serv Outcomes Res Methodol 3 2002 107 133
26. S.L. Zeger, and K.-Y. Liang Longitudinal data analysis for discrete and continuous outcomes Biometrics 42 1986 121 130
27. S.L. Zeger, K.-Y. Liang, and P.S. Albert Models for longitudinal data: a generalized estimating equation approach [Erratum in: Biometrics 1989;45:347.] Biometrics 44 1988 1049 1060
28. N.E. Breslow, and D.G. Clayton Approximate inference in generalized linear mixed models J Am Stat Assoc 88 1993 9 25
29. E.R. DeLong, E.D. Peterson, D.M. DeLong, L.H. Muhlbaier, S. Hackett, and D.B. Mark Comparing risk-adjustment methods for provider profiling Stat Med 16 1997 2645 2664
30. A.H. Leyland, and F.A. Boddy League tables and acute myocardial infarction Lancet 351 1998 555 558
31. C.L. Christiansen, and C.N. Morris Improving the statistical approach to health care provider profiling Ann Intern Med 127 1997 764 768
32. P.C. Austin, C.D. Naylor, and J.V. Tu A comparison of a Bayesian vs. a frequentist method for profiling hospital performance J Eval Clin Pract 7 2001 35 45
33. K.S. Panageas, D. Schrag, E. Riedel, P.B. Bach, and C.B. Begg The effect of clustering of outcomes on the association of procedure volume and surgical outcomes Ann Intern Med 139 2003 658 665
34. S.F. Khuri, J. Daley, W. Henderson, K. Hur, J. Demakis, J.B. Aust, V. Chong, P.J. Fabri, J.O. Gibbs, F. Grover, K. Hammermeister, G. Irvin 3rd, G. McDonald, E. Passaro Jr., L. Phillips, F. Scamman, J. Spencer, and J.F. Stremple The Department of Veterans Affairs' NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program Ann Surg 228 1998 491 507
35. S.F. Khuri, J. Daley, W. Henderson, K. Hur, M. Hossain, D. Soybel, K.W. Kizer, J.B. Aust, R.H. Bell Jr., V. Chong, J. Demakis, P.J. Fabri, J.O. Gibbs, F. Grover, K. Hammermeister, G. McDonald, E. Passaro Jr., L. Phillips, F. Scamman, J. Spencer, and J.F. Stremple Relation of surgical volume to outcome in eight common operations: Results from the VA National Surgical Quality Improvement Program Ann Surg 230 1999 414 429 discussion 429-32
36. J.A. Sosa, H.M. Bowman, T.A. Gordon, E.B. Bass, C.J. Yeo, K.D. Lillemoe, H.A. Pitt, J.M. Tielsch, and J.L. Cameron Importance of hospital volume in the overall management of pancreatic cancer Ann Surg 228 1998 429 438
37. R.E. Glasgow, and S.J. Mulvihill Hospital volume influences outcome in patients undergoing pancreatic resection for cancer West J Med 165 1996 294 300
38. A.M. Epstein Volume and outcome - it is time to move ahead N Engl J Med 346 2002 1161 1164