Predicting outcomes in cardiac surgery: Risk stratification matters?

Current Opinion in Cardiology

Volumn 23, Issue 6, 2008, Pages 560-567

  Dupuis, Jean Yves ^a  

^a UNIVERSITY OF OTTAWA HEART INSTITUTE   (Canada)

Author keywords

Heart; Prediction; Risk; Surgery

Indexed keywords

ANESTHESIA; CALIBRATION; HEART SURGERY; HIGH RISK PATIENT; HUMAN; OUTCOME ASSESSMENT; PREDICTOR VARIABLE; PRIORITY JOURNAL; REVIEW; RISK ASSESSMENT; RISK MANAGEMENT; SURGICAL MORTALITY;

CARDIOVASCULAR DISEASES; DATA INTERPRETATION, STATISTICAL; HUMANS; LOGISTIC MODELS; MODELS, STATISTICAL; OUTCOME ASSESSMENT (HEALTH CARE); RISK ASSESSMENT; RISK FACTORS; THORACIC SURGERY; TREATMENT OUTCOME;

EID: 55149119136     PISSN: 02684705     EISSN: None     Source Type: Journal    
DOI: 10.1097/HCO.0b013e32831217ed     Document Type: Review

References (67)

1. Paiement B, Pelletier C, Dyrda I, et al. A simple classification of the risk in cardiac surgery. Can Anaesth Soc J 1983; 30:61-68.
2. Hannan EL, Kilburn H Jr, O'Donnell JF, et al. Adult open heart surgery in New York State. An analysis of risk factors and hospital mortality rates. JAMA 1990; 26:2768-2774.
3. Williams SV, Nash DB, Goldfarb N. Differences in mortality from coronary artery bypass graft surgery at five teaching hospitals. JAMA 1991; 266:810-815.
4. Dupuis JY. Clinical predictions and decisions to perform cardiac surgery on high-risk patients. Sem Cardiothorac Vasc Anesth 2005; 9:179-186.
5. Hosmer DW, Lemeshow S. Assessing the fit of the model. In: Hosmer DW, Lemeshow S, editors. Applied logistic regression. New York: Wiley; 1989. pp. 135-175.
6. Tu JV, Sykora K, Naylor CD, for the Steering Committee of the Cardiac Care Network of Ontario. Assessing the outcomes of coronary artery bypass graft surgery: how many risk factors are enough? J Am Coll Cardiol 1997; 30:1317-1323.
7. Parsonnet V, Dean D, Bernstein AD. A method of uniform stratification of risk for evaluating the results of surgery in acquired adult heart disease. Circulation 1989; 79 (Suppl 1):3-12.
8. Tuman KJ, McCarthy RJ, March RJ, et al. Morbidity and duration of ICU stay after cardiac surgery. A model for preoperative risk assessment. Chest 1992; 102:36-44.
9. Tu JV, Jaglal SB, Naylor D, and the Steering Committee of the Provincial Adult Care Network of Ontario. Multicenter validation of a risk index for mortality, intensive care unit stay, and overall hospital length of stay after cardiac surgery. Circulation 1995; 91:677-684.
10. Nashef SAM, Roques F, Michel P, et al. European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardiothorac Surg 1999; 16:9-13.
11. Roques F, Michel P, Goldstone AR, Nashef SAM. The logistic EuroSCORE [letter], Eur Heart J 2003; 24:881-882.
12. Higgins TL, Estafanous FG, Loop FD, et al. Stratification of morbidity and mortality outcome by preoperative risk factors in coronary artery bypass patients. A clinical severity score. JAMA 1992; 267:2344-2348.
13. O'Connor GT, Plume SK, Olmstead EM, et al. Multivariate prediction of Inhospital mortality associated with coronary artery bypass graft surgery. Circulation 1992; 85:2110-2118.
14. Edwards FH, Clark RE, Schwartz M. Coronary artery bypass grafting: the Society of Thoracic Surgeons National Database Experience. Ann Thorac Surg 1994; 57:12-19.
15. Magovern JA, Sakert T, Magovern GJ Jr, et al. A model that predicts morbidity and mortality after coronary artery bypass graft surgery. J Am Coll Cardiol 1996; 28:1147-1153.
16. Edwards FH, Peterson ED, Coombs LP, et al. Prediction of operative mortality after valve replacement surgery. J Am Coll Cardiol 2001; 37:885-892.
17. Ambler G, Omar RZ, Royston P, et al. Generic, simple risk stratification model for heart valve surgery. Circulation 2005; 112:224-231.
18. Hannan EL, Wu C, Bennett EV, et al. Risk index for predicting in-hospital mortality for cardiac valve surgery. Ann Thorac Surg 2007; 83:921-929. This study proposes a logistic regression risk model for single valve surgery and a specific one for valve/CABG surgery. The models have a C-statistics of 0.794 and 0.750, respectively. Despite their greater specificity for particular types of surgery, those models do not perform any better than models developed for all types of surgery.
19. Swets JA. Measuring the accuracy of diagnostic systems. Science 1988; 240:1285-1293.
20. Gabrielle F, Roques F, Michel P, et al. Is the Parsonnet's score a good predictive score of mortality in adult cardiac surgery: assessment by a French multicentre study. Eur J Cardiothorac Surg 1997; 11:406-414.
21. Geissler HJ, Hölz P, Marohl S, et al. Risk stratification in heart surgery: comparison of six scores. Eur J Cardiothorac Surg 2000; 17:400-406.
22. Dupuis JY, Wang F, Nathan H, et al. The Cardiac Anesthesia Risk Evaluation Score. A clinically useful predictor of mortality and morbidity after cardiac surgery. Anesthesiology 2001; 94:194-204.
23. Nashef SAM, Roques F, Hammill BG, et al. Validation of European system for cardiac risk evaluation (EuroSCORE) in North American cardiac surgery. Eur J Cardiothorac Surg 2002; 22:101-105.
24. Ouattara A, Niculescu M, Ghazouani S, et al. Predictive performance and variability of the Cardiac Anesthesia Risk Evaluation score. Anesthesiology 2004; 100:1405-1410.
25. Toumpoulis IK, Anagnostopoulos CE, Swistel DG, DeRose JJ Jr. Does EuroSCORE predict length of stay and specific postoperative complications after cardiac surgery? Eur J Cardiothorac Surg 2005; 27:128-133.
26. Xu J, Ge Y, Hu S, et al. A simple predictive model of prolonged intensive care unit stay after surgery for acquired valve disease. J Heart Valve Dis 2007; 16:109-115. The study highlights the inability to improve risk predictions with risk models designed for valve surgery and the poorer discrimination of risk models in predicting prolonged LOS in the intensive care unit against mortality. The C-statistics for mortality and prolonged LOS was 0.82 and 0.76 with the new Fuwai risk score, respectively; and 0.71 and 0.67 with the EuroSCORE, respectively.
27. Jin R, Grunkemeier GL, for the Providence Health System Cardiovascular Study Group. Additive vs. logistic risk models for cardiac surgery mortality. Eur J Cardiothorac Surg 2005; 28:240-243.
28. Yap CH, Reid C, Yu M, et al. Validation of the EuroSCORE in Australia. Eur J Cardiothorac Surg 2006; 29:441-446.
29. Antunes PE, Eugénio L, de Oliviera JF, Antunes MJ. Mortality risk prediction in coronary surgery: a locally developed model outperforms external risk models. Interact Cardiovasc Thorac Surg 2007; 6:437-441.
30. Farrokhyar F, Wang X, Kent R, Lamy A. Early mortality from off-pump and on-pump coronary bypass surgery in Canada: a comparison of the STS and the EuroSCORE risk prediction algorithms. Can J Cardiol 2007; 23:879-883. Other studies have suggested that the Society of Thoracic Surgery (STS) risk model is a more accurate risk predictor than other ready-made models. This is not supported by this study: the C-statistics of the STS score and EuroSCORE were comparable: 0.81 and 0.79 in off-pump CABG, respectively; and 0.82 and 0.81 for on-pump CABG, respectively.
31. Pons JMV, Borras JM, Espinas JA, et al. Subjective versus statistical model assessment of mortality risk in open heart surgical procedures. Ann Thorac Surg 1999; 67:635-640.
32. Plackett RL. Karl Pearson and the chi-squared test, Int Stat Rev 1983; 51:59-72.
33. Lemeshow S, Hosmer DW. A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol 1982; 115:92-106.
34. Nashef SAM, Carey F, Charman S. The relationship between predicted and actual surgical mortality: impact of risk groupings and individual surgeons. Eur J Cardiothorac Surg 2001; 19:817-820.
35. Kawachi Y, Nakashima A, Toshima Y, et al. Risk stratification analysis of operative mortality in heart and thoracic aorta surgery: comparison between Parsonnet and EuroSCORE additive model. Eur J Cardiothorac Surg 2001; 20:961-966.
36. Northrup WF III, Emery RW, Nicoloff DM, et al. Opposite trends in coronary artery and valve surgery in a large multisurgeon practice, 1979-1999. Ann Thorac Surg 2004; 77:488-495.
37. Alexander KP, Anatrom KJ, Muhlbaier JH, et al. Outcomes of cardiac surgery in patients >80 years: results from the National Cardiovascular Network. J Am Coll Cardiol 2000; 35:731-738.
38. Kolh P, Kerzmann A, Lahaye L, et al. Cardiac surgery in octogenarians. Perioperative outcome and long-term results. Eur Heart J 2001; 22:1235-1243.
39. Suojaranta-Yinen RT, Kuitunen AH, Kukkonen SI, et al. Risk evaluation of cardiac surgery in octogenarians. J Cardiothorac Vasc Anesth 2006; 20:526-530.
40. Engoren M, Arslanian-Engoren C, Steckel D, et al. Cost, outcome, and functional status in octogenarians and septuagenarians after cardiac surgery. Chest 2002; 122:1309-1315.
41. Likosky DS, Dacey LJ, Baribeau YR, et al. Long-term survival of the very elderly undergoing coronary artery bypass grafting. Ann Thorac Surg 2008; 85: 1233-1238.
42. Bharathi HS, Seifert FC, Grimson R, Glass PSA. Octogenarians undergoing coronary artery bypass graft surgery: resource utilization, postoperative mortality, and morbidity. J Cardiothorac Vasc Anesth 2005; 19:583-588.
43. Filsoufi F, Rahmanian PB, Castillo JG, et al. Results and predictors of early and late outcomes of coronary artery bypass graft surgery in octogenarians. J Cardiothorac Vasc Anesth 2007; 21:784-792. This study reports a 4.6% mortality rate among 282 octogenarians who underwent CABG surgery between 1998 and 2006. This is one of the best mortality rates reported for patients of that age group.
44. Bernstein AD, Parsonnet V. Bedside estimation as an aid for decision-making in cardiac surgery. Ann Thorac Surg 2000; 69:823-828.
45. Berman M, Stamler A, Sahar G, et al. Validation of the 2000 Bernstein-Parsonnet score versus the EuroSCORE as a prognostic tool in cardiac surgery. Ann Thorac Surg 2006; 81:537-541.
46. de Varennes B, Lachapelle K, Cecere R, et al. Application of the Parsonnet scoring system for a Canadian cardiac surgery program. Can J Cardiol 2007; 23:1061-1065.
47. Gogbashian A, Sedrakyan A, Treasure T. EuroSCORE: a systematic review of international performance. Eur J Cardiothorac Surg 2004; 25:695-700.
48. Al-Ruzzeh S, Asimakopoulos G, Ambler G, et al. Validation of four different risk stratification systems in patients undergoing off-pump coronary artery bypass surgery: a UK multicentre analysis of 2223 patients. Heart 2003; 89:432-435.
49. Karabulut H, Toraman F, Alhan C, et al. EuroSCORE overestimates the cardiac operative risk. Cardiovasc Surg 2003; 11:295-298.
50. Bridgewater B, Grayson AD, Jackson M, et al. Surgeon specific mortality in adult cardiac surgery: comparison between crude and risk stratified data. BMJ 2003; 327:13-17.
51. Bhatti F, Grayson AD, Grotte G, et al. The logistic EuroSCORE in cardiac surgery: how well does it predict operative risk? Heart 2006; 92:1817-1820.
52. Grant SW, Grayson AD, Jackson M, et al. Does the choice of risk adjustment model influence the outcome of surgeon specific mortality analysis: a retrospective analysis of 14,637 patients under 31 surgeons? Heart 2008; 94:1044-1049.
53. Dewey TM, Brown D, Ryan WH, et al. Reliability in predicting early and late operative outcomes in high-risk patients undergoing valve replacement. J Thorac Cardiovasc Surg 2008; 135:180-187. This study found that the STS score was more accurate than the Ambler risk score and the additive and logistic EuroSCORE to predict perioperative and long-term mortality after aortic valve replacement in high-risk patients. Another finding is that the logistic EuroSCORE overpredicted mortality by 226% and the additive model by 17% only. This goes against a commonly accepted concept that logistic EuroSCORE performs better than the additive model.
54. Grossi EA, Schwartz CF, Yu PJ, et al. High-risk aortic valve replacement: are the outcomes as bad as predicted? Ann Thorac Surg 2008; 85:102-107. This is another study showing that the additive EuroSCORE performs better than the logistic model in high-risk patients undergoing aortic valve replacement; for an observed mortality of 7.8%, the additive model predicted a mortality of 9.7% and the logistic model predicted 17.2%.
55. Grube EG, Schuler G, Buellesfeld L, et al. Percutaneous aortic valve replacement for severe aortic stenosis in high-risk patients using the second- and current third generation self-expanding CoreValve prosthesis. J Am Coll Cardiol 2007; 50:69-76. This study illustrates how a ready-made risk model can be useful to identify highrisk patients for clinical research.
56. Fergusson DA, Hébert PC, Mazer CD, et al. A comparison of aprotinin and lysine analogues in high-risk cardiac surgery. N Engl J Med 2008; 358:2319-2331. This well designed randomized study did not use a ready-made risk model to identify high-risk patients but a combination of risk factors identified by various multifactorial risk models. The authors were able to find a significantly higher mortality at 30 days in patients receiving aprotinin (6.0%) for bleeding prevention against those receiving tranexamic acid (3.9%) or aminocaproic acid (4.0%).
57. Nilsson J, Algotsson L, Höglund P, et al. EuroSCORE predicts intensive care unit stay and costs of open heart surgery. Ann Thorac Surg 2004; 78:1528-1534.
58. Pinna Pintor P, Boobio M, Colangelo S, et al. Can EuroSCORE predict direct costs of cardiac surgery? Eur J Cardiothorac Surg 2003; 23:1595-1598.
59. Shahian DM, Normand SL, Torchiana DF, et al. Cardiac surgery report cards: comprehensive review and statistical critique. Ann Thorac Surg 2001; 72:2155-2168.
60. Shahian DM, Blackstone EH, Edwards FH, et al. Cardiac surgery risk models: a position article. Ann Thorac Surg 2004; 78:1868-1877.
61. Shahian DM, Normand SLT. Comparison of 'risk-adjusted' hospital outcomes. Circulation 2008; 117:1955-1963. This elegant and well designed study used hierarchical logistic regression to indirectly standardize the mortality rate in 14 Massachusetts hospitals. The authors found sufficient overlap between the case mix of each hospital and that of all the Massachusetts hospitals to make fair comparisons between the individual hospital performance and all the others. However, some pairwise hospital comparisons were not possible due to lack of comparability. This was true not only when RAM was different between hospitals, but also when it was similar. The authors concluded that, without adjustments for case-mix heterogeneity, risk-adjusted outcomes should not be used to compare institutions with each other.
62. Schneider EC, Epstein AM. Influence of cardiac-surgery performance reports on referral practices and access to care. N Engl J Med 1996; 335:251-256.
63. Burack JH, Impellizzeri P, Homel P, Cunningham JN. Public reporting of surgical mortality: a survey of New York State cardiothoracic surgeons. Ann Thorac Surg 1999; 68:1195-1202.
64. Hannan EL, Siu AL, Kumar D, et al. Assessment of coronary artery bypass graft surgery performance in New York. Is there a bias against taking high-risk patients? Med Care 1997; 35:49-56.
65. Bridgewater B, Grayson A, Brooks N, et al. Has the publication of cardiac surgery outcome data been associated with changes in practice in Northwest England? An analysis of 25,730 patients undergoing CABG surgery under 30 surgeons over 8 years. Heart 2007; 93:744-748.
66. Apolito RA, Greenberg MA, Menegus MA, et al. Impact of the New York cardiac surgery and percutaneous coronary intervention reporting system on the management of patients with acute myocardial infarction complicated by cardiogenic shock. Am Heart J 2008; 155:267-273. This very provocative study found that patients with acute myocardial infarction and cardiogenic shock in New York State waited 101.2 h before having CABG surgery as compared with 10.3 h in states without a public outcome reporting system (P < 0.001 ). The number of patients having CABG surgery within 3 days of shock onset was 32.3% in New York patients against 75.5% in non-New York patients (P < 0.001 ). The authors concluded that the reporting system in New York State is possibly associated with a reluctance to revascularize the highest-risk cardiac patients.
67. Glance LG, Dick A, Mukamel DB, et al. Are high-quality cardiac surgeons less likely to operate on high-risk patients compared to low-quality surgeons? Evidence from New York State. Health Serv Res 2008; 43:300-312.