The risks of risk adjustment

JAMA

Volumn 278, Issue 19, 1997, Pages 1600-1607

  Iezzoni, Lisa I ^a,b,c  

^a DANA FARBER CANCER INSTITUTE   (United States)

^b HARVARD MEDICAL SCHOOL   (United States)

^c BETH ISRAEL DEACONESS MEDICAL CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACUTE HEART INFARCTION; ARTICLE; CORONARY ARTERY BYPASS GRAFT; CORONARY ARTERY DISEASE; DIAGNOSIS RELATED GROUP; DISEASE CLASSIFICATION; DISEASE SEVERITY; HOSPITAL PATIENT; MORTALITY; PNEUMONIA; PRIORITY JOURNAL; QUALITY CONTROL; RISK ASSESSMENT; SCORING SYSTEM; STROKE; TREATMENT OUTCOME;

EID: 0030666228     PISSN: 00987484     EISSN: None     Source Type: Journal    
DOI: 10.1001/jama.278.19.1600     Document Type: Article

References (92)

1. Iezzoni LI. 100 Apples divided by 15 red herrings: a cautionary tale from the mid-19th century on comparing hospital mortality rates. Ann Intern Med. 1996;124:1079-1085.
2. Response to letter by William Farr. Med Times Gazette. February 13, 1864:187. Letter.
3. Epstein A. Performance reports on quality. N Engl J Med. 1995;333:57-61.
4. Keeler EB, Kahn KL, Draper D, et al. Changes in sickness at admission following the introduction of the prospective payment system. JAMA. 1990;264: 1962-1968.
5. Iezzoni LI, Shwartz M, Moskowitz MA, Ash AS, Sawitz E, Burnside S. Illness severity and costs of admissions at teaching and nonteaching hospitals. JAMA. 1990;264:1426-1431.
6. Sullivan LW, Wilensky GR. Medicare Hospital Mortality Information. 1987, 1988, 1989. Washington, DC: US Dept of Health and Human Services, Health Care Financing Administration; 1991.
7. US General Accounting Office, Health, Education, and Human Services Division. Employers and Individual Consumers Want Additional Information on Quality. Washington, DC: US General Accounting Office; 1995. GAO/HEHS-95-201.
8. US General Accounting Office, Health, Education, and Human Services Division. Health Care Reform: 'Report Cards' Are Useful but Significant Issues Need to Be Addressed. Washington, DC: US General Accounting Office; 1994. GAO/HEHS-94-219.
9. US General Accounting Office, Health, Education, and Human Services Division. Employers Urge Hospitals to Battle Costs Using Performance Data Systems. Washington, DC: US General Accounting Office; 1994. GAO/HEHS-95-1.
10. Pennsylvania Health Care Cost Containment Council. A Consumer Guide to Coronary Artery Bypass Graft Surgery, Volume IV: 1993 Data. Harrisburg: Pennsylvania Health Care Cost Containment Council; 1995.
11. Pennsylvania Health Care Cost Containment Council. Focus on Heart Attack in Western Pennsylvania: A 1993 Summary Report for Health Benefits Purchasers, Health Care Providers, Policymakers, and Consumers. Harrisburg: Pennsylvania Health Care Cost Containment Council; 1996.
12. Wilson P, Smoley SR, Werdegar D. Annual Report of the California Hospital Outcomes Project. Sacramento, Calif: Office of Statewide Health Planning and Development; 1993.
13. Wilson P, Smoley SR, Werdegar D. Second Report of the California Hospital Outcomes Project: Acute Myocardial Infarction, Volume One: Study Overview and Results Summary. Sacramento, Calif: Office of Statewide Health Planning and Development; 1996.
14. Iezzoni LI, Shwartz M, Restuccia J. The role of severity information in health policy debates. Inquiry. 1991;8:117-128.
15. Iezzoni LI, Greenberg LG. Widespread assessment of risk-adjusted outcomes: lessons from local initiatives. Jt Comm J Qual Improv. 1994;20:305-316.
16. Romano PS, Zach A, Luft HS, Rainwater J, Remy LL, Campa D. The California hospital outcomes project. Jt Comm J Qual Improv. 1995;21: 668-682.
17. Rosenthal GE, Harper DL. Cleveland health quality choice: a model for collaborative community-based outcomes assessment. Jt Comm J Qual Improv. 1994;20:425-442.
18. Freeman JL, Fetter RB, Park H, et al. Diagnosis-related group refinement with diagnosis- and procedure-specific comorbidities and complications. Med Care. 1995;33:806-827.
19. Iezzoni LI. Dimensions of risk. In: Iezzoni LI, ed. Risk Adjustment for Measuring Healthcare Outcomes. 2nd ed. Chicago, Ill: Health Administration Press; 1997.
20. Calkins DR, Rubenstein LV, Cleary PD, et al. Failure of physicians to recognize functional disability in ambulatory patients. Ann Intern Med. 1991; 114:451-454.
21. Kahn KL, Pearson ML, Harrison ER, et al. Health care for black and poor hospitalized Medicare patients. JAMA. 1994;15:1169-1174.
22. Burstin HR, Lipsitz SR, Brennan TA. Socioeconomic status and risk for substandard medical care. JAMA. 1992;268:2383-2387.
23. Knaus WA, Wagner DP, Draper EA, et al. The APACHE III prognostic system: risk prediction of hospital mortality for critically ill hospitalized adults. Chest. 1991;100:1619-1636.
24. Knaus WA, Wagner DP, Zimmerman JE, Draper EA. Variations in mortality and length of stay in intensive care units. Ann Intent Med. 1993;118:753-761.
25. Horn SD, Sharkey PD, Buckle JM, Backofen JE, Averill RF, Horn RA. The relationship between severity of illness and hospital length of stay and mortality. Med Care. 1991;29:305-317.
26. Iezzoni LI, Daley J. A description and clinical assessment of the computerized severity index. Qual Rev Bull. 1992;18:44-52.
27. Daley J, Jencks S, Draper D, Lenhart G, Thomas N. Walker J. Predicting hospital-associated mortality for Medicare patients. JAMA. 1988;260: 3617-3624.
28. Steen PM, Brewster AC, Bradbury RC, Estabrook E, Young JA. Predicted probabilities of hospital death as a measure of admission severity of illness. Inquiry. 1993;30:128-141.
29. Steen PM. Approaches to predictive modeling. Ann Thorac Surg. 1994;58:1836-1840.
30. Iezzoni LI, Moskowitz MA. A clinical assessment of Medis Groups. JAMA. 1988;260:3159-3163.
31. Hannan EL, Kilburn H, O'Donnell JF, Lukacik G, Shields EP. Adult open heart surgery in New York State: an analysis of risk factors and hospital mortality rates. JAMA. 1990;264:2768-2774.
32. Hannan EL, Kilburn H, Racz M, Shields E, Chassin MR. Improving the outcomes of coronary artery bypass surgery in New York State. JAMA. 1994;271:761-766.
33. Hannan EL, Siu AL, Kumar D, Kilburn H Jr, Chassin MR. The decline in coronary artery bypass graft surgery mortality in New York State. JAMA. 1995;273:209-213.
34. Chassin MR, Hannan EL, DeBuono BA. Benefits and hazards of reporting medical outcomes publicly. N Engl J Med. 1996;334:394-398.
35. O'Connor GT, Plume SK, Olmstead EM, et al, for the Northern New England Cardiovascular Disease Study Group. A regional prospective study of in-hospital mortality associated with coronary artery bypass grafting. JAMA. 1991;266:803-809.
36. O'Connor GT, Plume SK, Olmstead EM, et al, for the Northern New England Cardiovascular Disease Study Group. Multivariate prediction of inhospital mortality associated with coronary artery bypass graft surgery from the Northern New England Cardiovascular Disease Study Group. Circulation. 1992;85:2110-2118.
37. Edwards N, Honemann D, Burley D, Navarro M. Refinement of the Medicare diagnosis-related groups to incorporate a measure of severity. Health Care Financing Rev. 1994;16:45-64.
38. Goldfield N, Boland P, eds. Physician Profiling and Risk Adjustment. Gaithersburg, Md: Aspen Publishers Inc; 1996.
39. Gonnella JS, Hornbrook MC, Louis DZ. Staging of disease: a case-mix measurement. JAMA. 1984; 251:637-644.
40. Markson LE, Nash DB, Louis DZ, Gonnella JS. Clinical outcomes management and Disease Staging. Eval Health Prof. 1991;14:201-227.
41. Young WW, Kohler S, Kowalski J. PMC patient severity scale: derivation and validation. Health Serv Res. 1994;29:367-390.
42. Iezzoni LI. Severity of illness measures and assessing the quality of hospital care. In: Goldfield N, Nash DB, eds. Providing Quality Care: Future Challenges. 2nd ed. Ann Arbor, Mich: Health Administration Press; 1995:59-82.
43. Horn SD. Validity, reliability and implications of an index of inpatient severity of illness. Med Care. 1981;19:354-362.
44. Brewster AC, Karlin BG, Hyde LA, et al. MEDISGRPS: a clinically based approach to classifying hospital patients at admission. Inquiry. 1985;12: 377-387.
45. Gonnella JS, Louis DZ, McCord JJ. The staging concept-approach to the assessment of outcome of ambulatory care. Med Care. 1976;14:13-21.
46. Vladeck BC. Medicare hospital payment by diagnosis-related groups. Ann Intent Med. 1984;100: 576-591.
47. Fetter RB, Shin Y, Freeman JH, Averill R, Thompson J, Case mix definition by diagnosis related groups. Med Care. 1980;18(suppl):1-53.
48. Simborg DW. DRG creep: a new hospital-acquired disease. N Engl J Med. 1981;304:1602-1604.
49. Jencks SF, Williams DK, Kay TL. Assessing hospital-associated deaths from discharge data. JAMA. 1988;260:2240-2246.
50. Iezzoni LI, Foley SM, Daley J, Hughes J, Fisher ES, Heeren T. Comorbidities, complications, and coding bias: does the number of diagnosis codes matter in predictingin-hospital mortality? JAMA. 1992; 267:2197-2203.
51. Green J, Wintfeld N. How accurate are hospital discharge data for evaluating effectiveness of care? Med Care. 1993;31:719-731.
52. Young WW, Swinkola RB, Zorn DM. The measurement of hospital case mix. Med Care. 1982;20: 501-512.
53. Brinkley J. US releasing lists of hospitals with abnormal mortality. New York Times. March 12,1986:1.
54. Dubois RW. Hospital mortality as an indicator of quality. In: Goldfield N, Nash DB, eds. Providing Quality Care: Future Challenges. 2nd ed. Ann Arbor, Mich: Health Administration Press; 1995.
55. Iglehart JK. Competition and the pursuit of quality: a conversation with Walter McClure. Health Aff (Millwood). 1988;7:79-90.
56. Khuri SF, Daley J, Henderson WG, et al. The National Veterans Administration Surgical Risk Study: risk adjustment for the comparative assessment of the quality of surgical care. J Am Coll Surg. 1995;180:519-531.
57. Demise of two state-run commissions signals shift to voluntary initiatives in data collection. State Health Watch. 1995;2:4, 10.
58. Verna G. Dayton hospitals link to perform cost study. Cincinnati Business Courier. 1996;13:8C.
59. Thomas JW, Ashcraft MLF. Measuring severity of illness: a comparison of interrater reliability among severity methodologies. Inquiry. 1989;26:483-492.
60. Thomas JW, Ashcraft MLF. Measuring severity of illness: six severity systems and their ability to explain cost variations. Inquiry. 1991;28:39-55.
61. Alemi F, Rice J, Hankins R. Predicting in-hospital survival of myocardial infarction. Med Care. 1990;28:762-775.
62. MacKenzie TA, Willan AR, Lichter J, et al. Patient Classification Systems: An Evaluation of the State of the Art. Kingston, Ontario: Case Mix Research, Queen's College; 1991:1.
63. Green J, Wintfeld N. Report cards on cardiac surgeons: assessing New York State's approach. N Engl J Med. 1995;332:1229-1232.
64. Iezzoni LI, Ash AS, Shwartz M, Daley J, Hughes JS, Mackiernan YD. Judging hospitals by severity-adjusted mortality rates. Am J Public Health. 1996; 86:1379-1387.
65. Landon B, Iezzoni LI, Ash AS, et al. Judging hospitals by severity-adjusted mortality rates: the case of CABG surgery. Inquiry. 1996;33:155-166.
66. Iezzoni LI, Shwartz M, Ash AS, Hughes JS, Daley J, Mackiernan YD. Severity measurement methods and judging hospital death rates for pneumonia. Med Care. 1996;34:11-28.
67. Iezzoni LI, Shwartz M, Ash AS, Hughes JS, Daley J, Mackiernan YD. Using severity-adjusted stroke mortality rates to judge hospitals. Int J Qual Health Care. 1995;7:81-94.
68. Iezzoni LI, Ash AS, Shwartz M, Daley J, Hughes JS, Mackiernan YD. Predicting who dies depends on how severity is measured. Ann Intern Med. 1995;123: 763-770.
69. Iezzoni LI, Ash AS, Shwartz M, Landon B, Mackiernan YD. Predicting in-hospital deaths from CABG surgery. Med Care. In press.
70. Iezzoni LI, Shwartz M, Ash AS, Mackiernan YD. Using severity measures to predict the likelihood of death for pneumonia patients. J Gen Intern Med. 1996;11:23-31.
71. Iezzoni LI, Shwartz M, Ash AS, Mackiernan YD. Predicting in-hospital mortality for stroke patients: results differ across severity measurement systems. Med Decis Making. 1996;16:348-356.
72. Hughes JS, Iezzoni LI, Daley J, Greenberg L. How severity measures rate hospitalized patients. J Gen Intern Med. 1996;11:303-311.
73. Iezzoni LI, Ash AS, Shwartz M, Mackiernan YD. Differences in procedure use, outcomes, and illness severity by gender for acute myocardial infarction patients. Med Care. 1997;35:158-171.
74. Iezzoni LI, Hotchkin EK, Ash AS, Shwartz M, Mackiernan Y. MedisGroups databases: the impact of data collection guidelines on predicting in-hospital mortality. Med Care. 1993;31:277-283.
75. Harrell FE, Lee KL, Califf RM, Pryor DB, Rosati RA. Regression modelling strategies for improved prognostic prediction. Stat Med. 1984;3:143-152.
76. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29-36.
77. Efron B. Bootstrap methods: another look at the jaeknife. Ann Stat. 1979;7:1-26.
78. Hannan EL, Racz MJ, Jollis JG, Peterson ED. Using Medicare claims data to assess provider quality for CABG surgery: does it work well enough? Health Serv Res. 1997;31:659-678.
79. Iezzoni LI, Ash AS, Coffman GA, Moskowitz MA. Predicting in-hospital mortality: a comparison of severity measurement approaches. Med Care. 1992;30:347-359.
80. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159-174.
81. McMahon LF, Smits HL. Can Medicare prospective payment survive the ICD-9-CM disease classification system? Ann Intern Med. 1986;104:562-566.
82. Dubois RW, Brook RH, Rogers WH. Adjusted hospital death rates. Am J Pub Health. 1987;77: 1162-1167.
83. Green J, Passman LJ, Wintfeld N. Analyzing hospital mortality. JAMA. 1991;265:1849-1853.
84. Dubois RW, Rogers WH, Moxley JH, Draper D, Brook RH. Hospital inpatient mortality: is it a predictor of quality? N Engl J Med. 1987;317:1674-1680.
85. Kahn KL, Rogers WH, Rubenstein LV, et al. Measuring quality of care with explicit process criteria before and after implementation of the DRG-based prospective payment system. JAMA. 1990; 264:1969-1973.
86. Thomas JW, Holloway JJ, Guire KE. Validating risk-adjusted mortality as an indicator for quality of care. Inquiry. 1993;30:6-22.
87. Hartz AJ, Gottlieb MS, Kuhn EM, Rimm AA. The relationship between adjusted hospital mortality and the results of peer review. Health Serv Res. 1993;27:765-777.
88. Park RE, Brook RH, Kosecoff J, et al. Explaining variations in hospital death rates, randomness, severity of illness, quality of care. JAMA. 1990;64:484-490.
89. Best WR, Cowper DC. The ratio of observed-to-expected mortality as a quality of care indicator in non-surgical VA patients. Med Care. 1994;32:390-400.
90. Schneider EC, Epstein AM. Influence of cardiac-surgery performance reports on referral practices and access to care. N Engl J Med. 1996;335:251-250.
91. Omoigui NA, Miller DP, Brawn KJ, et al. Out-migration for coronary bypass surgery in an era of public dissemination of clinical outcomes. Circulation. 1996;93:27-33.
92. Vogel RA, Topol EJ. Practice guidelines and physician scorecards: grading the graders. Cleve Clin J Med. 1996;63:124-128.