Risk Aversion and Public Reporting. Part 2: Mitigation Strategies

Annals of Thoracic Surgery

Volumn 104, Issue 6, 2017, Pages 2102-2110

  Shahian, David M ^a   Jacobs, Jeffrey P ^b   Badhwar, Vinay ^c   D'Agostino, Richard S ^d   Bavaria, Joseph E ^e   Prager, Richard L ^f  

^a MASSACHUSETTS GENERAL HOSPITAL   (United States)

^b JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c WEST VIRGINIA UNIVERSITY   (United States)

^d Lahey Health ^*  (United States)

^e UNIVERSITY OF PENNSYLVANIA   (United States)

^f UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CARDIOLOGY; EDUCATION; HEART SURGERY; HIGH RISK PATIENT; HUMAN; PATIENT DECISION MAKING; PHYSICIAN; PRIORITY JOURNAL; REVIEW; RISK ASSESSMENT; STAKEHOLDER EDUCATION; SURGICAL RISK; DECISION MAKING; STATISTICS AND NUMERICAL DATA; THORAX SURGERY;

CARDIAC SURGICAL PROCEDURES; CARDIOLOGY; DECISION MAKING; HUMANS; THORACIC SURGERY;

EID: 85032950556     PISSN: 00034975     EISSN: 15526259     Source Type: Journal    
DOI: 10.1016/j.athoracsur.2017.06.076     Document Type: Review

References (70)

1. Shahian, D.M., Jacobs, J.P., Badhwar, V., D'Agostino, R.S., Bavaria, J.E., Prager, R.L., Risk aversion and public reporting. Part 1: observations from cardiac surgery and interventional cardiology. Ann Thorac Surg 104 (2017), 2093–2101.
2. Iezzoni, L.I., Risk Adjustment for Measuring Health Care Outcomes. 2012, Health Administration Press, Chicago.
3. Krumholz, H.M., Brindis, R.G., Brush, J.E., et al. Standards for statistical models used for public reporting of health outcomes: an American Heart Association Scientific Statement from the Quality of Care and Outcomes Research Interdisciplinary Writing Group: cosponsored by the Council on Epidemiology and Prevention and the Stroke Council. Endorsed by the American College of Cardiology Foundation. Circulation 113 (2006), 456–462.
4. Ash A, Fienberg S, Louis T, et al; the COPSS-CMS White Paper Committee. Statistical issues in assessing hospital performance. Commissioned by the Committee of Presidents of Statistical Societies. Available at https://www.Cms.Gov/medicare/quality-initiatives-patient-assessment-instruments/hospitalqualityinits/downloads/statistical-issues-in-assessing-hospital-performance.Pdf. 2011. Accessed May 30, 2017.
5. Normand, S.L., Shahian, D.M., Statistical and clinical aspects of hospital outcomes profiling. Stat Sci 22 (2007), 206–226.
6. Shahian, D.M., O'Brien, S.M., Filardo, G., et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 1—coronary artery bypass grafting surgery. Ann Thorac Surg 88:1 Suppl (2009), S2–S22.
7. O'Brien, S.M., Shahian, D.M., Filardo, G., et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 2—isolated valve surgery. Ann Thorac Surg 88:1 Suppl (2009), S23–S42.
8. Shahian, D.M., O'Brien, S.M., Filardo, G., et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 3—valve plus coronary artery bypass grafting surgery. Ann Thorac Surg 88:1 Suppl (2009), S43–S62.
9. Shahian, D.M., He, X., Jacobs, J.P., et al. Issues in quality measurement: target population, risk adjustment, and ratings. Ann Thorac Surg 96 (2013), 718–726.
10. Gupta, A., Yeh, R.W., Tamis-Holland, J.E., et al. Implications of public reporting of risk-adjusted mortality following percutaneous coronary intervention: misperceptions and potential consequences for high-risk patients including nonsurgical patients. JACC Cardiovasc Intervent 9 (2016), 2077–2085.
11. Young, M.N., Yeh, R.W., Public reporting and coronary revascularization: risk and benefit. Coron Artery Dis 25 (2014), 619–626.
12. Rosenbaum, L., Scoring no goal—further adventures in transparency. N Engl J Med 373 (2015), 1385–1388.
13. Kirtane, A.J., Nallamothu, B.K., Moses, J.W., The complicated calculus of publicly reporting mortality after percutaneous coronary intervention. JAMA Cardiol 1 (2016), 637–638.
14. Wasfy, J.H., Borden, W.B., Secemsky, E.A., McCabe, J.M., Yeh, R.W., Public reporting in cardiovascular medicine: accountability, unintended consequences, and promise for improvement. Circulation 131 (2015), 1518–1527.
15. Cutlip, D.E., Ho, K.K., Kuntz, R.E., Baim, D.S., Risk assessment for percutaneous coronary intervention: our version of the weather report?. J Am Coll Cardiol 42 (2003), 1896–1899.
16. Green, J., Wintfeld, N., Report cards on cardiac surgeons—assessing New York state's approach. N Engl J Med 332 (1995), 1229–1233.
17. Hannan, E.L., Kilburn, H. Jr., Racz, M., Shields, E., Chassin, M.R., Improving the outcomes of coronary artery bypass surgery in New York state. JAMA 271 (1994), 761–766.
18. Chassin, M.R., Hannan, E.L., DeBuono, B.A., Benefits and hazards of reporting medical outcomes publicly. N Engl J Med 334 (1996), 394–398.
19. Hannan, E.L., Siu, A.L., Kumar, D., Racz, M., Pryor, D.B., Chassin, M.R., Assessment of coronary artery bypass graft surgery performance in New York. Is there a bias against taking high-risk patients?. Med Care 35 (1997), 49–56.
20. Englum, B.R., Saha-Chaudhuri, P., Shahian, D.M., et al. The impact of high-risk cases on hospitals’ risk-adjusted coronary artery bypass grafting mortality rankings. Ann Thorac Surg 99 (2015), 856–862.
21. Sherwood, M.W., Brennan, J.M., Ho, K.K., et al. The impact of extreme-risk cases on hospitals’ risk-adjusted percutaneous coronary intervention mortality ratings. JACC Cardiovasc Interv 8(1 Pt A) (2015), 10–16.
22. Sherwood, M.W., Peterson, E.D., Risk adjusted mortality ratings and public reporting for high-risk PCI. JACC Cardiovasc Interv 8 (2015), 1134–1135.
23. Hannan, E.L., Cozzens, K., King, S.B. 3rd, Walford, G., Shah, N.R., The New York state cardiac registries: history, contributions, limitations, and lessons for future efforts to assess and publicly report healthcare outcomes. J Am Coll Cardiol 59 (2012), 2309–2316.
24. Peberdy, M.A., Donnino, M.W., Callaway, C.W., et al. Impact of percutaneous coronary intervention performance reporting on cardiac resuscitation centers: a scientific statement from the American Heart Association. Circulation 128 (2013), 762–773.
25. Bavaria J. Presidential address: quality and innovation in cardiothoracic surgery: colliding imperatives? Presented at The Society of Thoracic Surgeons 53rd Annual Meeting, Houston, Texas, January 21–25, 2017.
26. Sherman, K.L., Gordon, E.J., Mahvi, D.M., et al. Surgeons’ perceptions of public reporting of hospital and individual surgeon quality. Med Care 51 (2013), 1069–1075.
27. Schneider, E.C., Epstein, A.M., Influence of cardiac-surgery performance reports on referral practices and access to care—a survey of cardiovascular specialists. N Engl J Med 335 (1996), 251–256.
28. Jarral, O.A., Baig, K., Pettengell, C., et al. National survey of UK consultant surgeons’ opinions on surgeon-specific mortality data in cardiothoracic surgery. Circ Cardiovasc Qual Outcomes 9 (2016), 414–423.
29. Narins, C.R., Dozier, A.M., Ling, F.S., Zareba, W., The influence of public reporting of outcome data on medical decision making by physicians. Arch Intern Med 165 (2005), 83–87.
30. Burack, J.H., Impellizzeri, P., Homel, P., Cunningham, J.N. Jr., Public reporting of surgical mortality: a survey of New York state cardiothoracic surgeons. Ann Thorac Surg 68 (1999), 1195–1200.
31. Shahian, D., Silverstein, T., Lovett, A., Wolf, R., Normand, S.L., Comparison of clinical and administrative data sources for hospital coronary artery bypass graft surgery report cards. Circulation 115 (2007), 1518–1527.
32. Mack, M.J., Herbert, M., Prince, S., Dewey, T.M., Magee, M.J., Edgerton, J.R., Does reporting of coronary artery bypass grafting from administrative databases accurately reflect actual clinical outcomes?. J Thorac Cardiovasc Surg 129 (2005), 1309–1317.
33. Barringhaus, K.G., Zelevinsky, K., Lovett, A., Normand, S.L., Ho, K.K., Impact of independent data adjudication on hospital-specific estimates of risk-adjusted mortality following percutaneous coronary interventions in Massachusetts. Circ Cardiovasc Qual Outcomes 4 (2011), 92–98.
34. Jacobs, J.P., Shahian, D.M., He, X., et al. Penetration, completeness, and representativeness of The Society of Thoracic Surgeons Adult Cardiac Surgery Database. Ann Thorac Surg 101 (2016), 33–41.
35. Mass Data Analysis Center, Department of Health Care Policy, Harvard Medical School. Adult percutaneous coronary intervention reports. Available at http://www.massdac.org/reports/cardiac-study-annual/. Accessed May 12, 2017.
36. Mass Data Analysis Center, Department of Health Care Policy, Harvard Medical School. Adult coronary artery bypass graft surgery annual reports. Available at http://www.massdac.org/reports/cardiac-study-annual/. Accessed May 12, 2017.
37. Jacobs, J.P., O'Brien, S.M., Shahian, D.M., et al. Successful linking of The Society of Thoracic Surgeons database to Social Security data to examine the accuracy of Society of Thoracic Surgeons mortality data. J Thorac Cardiovasc Surg 145 (2013), 976–983.
38. Jacobs, J.P., Edwards, F.H., Shahian, D.M., et al. Successful linking of The Society of Thoracic Surgeons database to Social Security data to examine survival after cardiac operations. Ann Thorac Surg 92 (2011), 32–37.
39. Jacobs, J.P., Edwards, F.H., Shahian, D.M., et al. Successful linking of The Society of Thoracic Surgeons Adult Cardiac Surgery Database to Centers for Medicare and Medicaid Services Medicare data. Ann Thorac Surg 90 (2010), 1150–1156.
40. Morales, D.L., McClellan, A.J., Jacobs, J.P., Empowering a database with national long-term data about mortality: the use of national death registries. Cardiol Young 18:Suppl 2 (2008), 188–195.
41. Resnic, F.S., Welt, F.G., The public health hazards of risk avoidance associated with public reporting of risk-adjusted outcomes in coronary intervention. J Am Coll Cardiol 53 (2009), 825–830.
42. Resnic, F.S., Normand, S.L., Piemonte, T.C., et al. Improvement in mortality risk prediction after percutaneous coronary intervention through the addition of a “compassionate use” variable to the National Cardiovascular Data Registry CathPCI dataset: a study from the Massachusetts Angioplasty Registry. J Am Coll Cardiol 57 (2011), 904–911.
43. Shahian, D.M., Normand, S.L., Friedberg, M.W., Hutter, M.M., Pronovost, P.J., Rating the raters: the inconsistent quality of health care performance measurement. Ann Surg 264 (2016), 36–38.
44. Shahian, D.M., Blackstone, E.H., Edwards, F.H., et al. Cardiac surgery risk models: a position article. Ann Thorac Surg 78 (2004), 1868–1877.
45. Cohen, M.E., Ko, C.Y., Bilimoria, K.Y., et al. Optimizing ACS NSQIP modeling for evaluation of surgical quality and risk: patient risk adjustment, procedure mix adjustment, shrinkage adjustment, and surgical focus. J Am Coll Surg 217 (2013), 336–346.
46. Krell, R.W., Hozain, A., Kao, L.S., Dimick, J.B., Reliability of risk-adjusted outcomes for profiling hospital surgical quality. JAMA Surg 149 (2014), 467–474.
47. Osborne, N.H., Ko, C.Y., Upchurch, G.R. Jr., Dimick, J.B., The impact of adjusting for reliability on hospital quality rankings in vascular surgery. J Vasc Surg 53 (2011), 1–5.
48. Donabedian, A., Evaluating the quality of medical care. Milbank Mem Fund Q 44 (1966), 166–206.
49. Resnic, F.S., Majithia, A., Rationalizing our report cards. JACC Cardiovasc Interv 10 (2017), 232–234.
50. Pepper, J.R., Coonar, A.S., High-risk surgery: the courage to fail. J R Soc Med 108 (2015), 44–46.
51. Shahian, D.M., Edwards, F.H., Ferraris, V.A., et al. Quality measurement in adult cardiac surgery: part 1—conceptual framework and measure selection. Ann Thorac Surg 83:4 Suppl (2007), S3–S12.
52. O'Brien, S.M., Shahian, D.M., Delong, E.R., et al. Quality measurement in adult cardiac surgery: part 2—statistical considerations in composite measure scoring and provider rating. Ann Thorac Surg 83:4 Suppl (2007), S13–S26.
53. Rankin, J.S., Badhwar, V., He, X., et al. The Society of Thoracic Surgeons mitral valve repair/replacement plus coronary artery bypass grafting composite score: a report of The Society of Thoracic Surgeons quality measurement task force. Ann Thorac Surg 103 (2017), 1475–1481.
54. Shahian, D.M., He, X., Jacobs, J.P., et al. The STS AVR + CABG composite score: a report of the STS quality measurement task force. Ann Thorac Surg 97 (2014), 1604–1609.
55. Shahian, D.M., He, X., Jacobs, J.P., et al. The Society of Thoracic Surgeons isolated aortic valve replacement (AVR) composite score: a report of the STS quality measurement task force. Ann Thorac Surg 94 (2012), 2166–2171.
56. Badhwar, V., Rankin, J.S., He, X., et al. The Society of Thoracic Surgeons mitral repair/replacement composite score: a report of the Society of Thoracic Surgeons quality measurement task force. Ann Thorac Surg 101 (2016), 2265–2271.
57. Adams J. The reliability of provider profiling: a tutorial. Rand Health; 2009. Available at https://www.rand.org/content/dam/rand/pubs/technical_reports/2009/RAND_TR653.pdf. Accessed May 12, 2017.
58. Huffman, K.M., Cohen, M.E., Ko, C.Y., Hall, B.L., A comprehensive evaluation of statistical reliability in ACS NSQIP profiling models. Ann Surg 261 (2015), 1108–1113.
59. Hall, B.L., Huffman, K.M., Hamilton, B.H., et al. Profiling individual surgeon performance using information from a high-quality clinical registry: opportunities and limitations. J Am Coll Surg 221 (2015), 901–913.
60. Hannan, E.L., The public reporting risk of performing high-risk procedures: perception or reality?. JACC Cardiovasc Interv 8 (2015), 17–19.
61. Hannan, E.L., Zhong, Y., Cozzens, K., et al. The impact of excluding shock patients on hospital and physician risk-adjusted mortality rates for percutaneous coronary interventions: the implications for public reporting. JACC Cardiovasc Interv 10 (2017), 224–231.
62. Bangalore, S., Guo, Y., Xu, J., et al. Rates of invasive management of cardiogenic shock in New York before and after exclusion from public reporting. JAMA Cardiol 1 (2016), 640–647.
63. McCabe, J.M., Waldo, S.W., Kennedy, K.F., Yeh, R.W., Treatment and outcomes of acute myocardial infarction complicated by shock after public reporting policy changes in New York. JAMA Cardiol 1 (2016), 648–654.
64. New York State Department of Health. Percutaneous coronary interventions (PCI) in New York state 2011–2013. Available at https://www.health.ny.gov/statistics/diseases/cardiovascular/docs/pci_2011-2013.pdf. Accessed May 12, 2017.
65. Shahian, D.M., He, X., Jacobs, J.P., et al. The Society of Thoracic Surgeons composite measure of individual surgeon performance for adult cardiac surgery: a report of The Society of Thoracic Surgeons quality measurement task force. Ann Thorac Surg 100 (2015), 1315–1325.
66. Westaby S. Publishing individual surgeons’ death rates prompts risk averse behaviour. BMJ 2014;349:g5026.
67. Drozda, J.P. Jr., Hagan, E.P., Mirro, M.J., Peterson, E.D., Wright, J.S., ACCF 2008 health policy statement on principles for public reporting of physician performance data. J Am Coll Cardiol 51 (2008), 1993–2001.
68. Donelan, K., Rogers, R.S., Eisenhauer, A., Mort, E., Agnihotri, A.K., Consumer comprehension of surgeon performance data for coronary bypass procedures. Ann Thorac Surg 91 (2011), 1400–1405.
69. Shahian, D.M., Normand, S.L., Comparison of “risk-adjusted” hospital outcomes. Circulation 117 (2008), 1955–1963.
70. Hibbard, J.H., Peters, E., Slovic, P., Finucane, M.L., Tusler, M., Making health care quality reports easier to use. Jt Comm J Qual Improv 27 (2001), 591–604.