Reliability of new scores in predicting perioperative mortality after isolated aortic valve surgery: A comparison with the society of thoracic surgeons score and logistic EuroSCORE

Fabio Barili, Davide Pacini, Antonio Capo, Enrico Ardemagni, Giovanni Pellicciari, Marco Zanobini, Claudio Grossi, Khaled Mohamed Shahin, Francesco Alamanni, Roberto Di Bartolomeo, Alessandro Parolari

Research output: Contribution to journalArticle

31 Citations (Scopus)

Abstract

Background: There is still a wide debate concerning the performance of commonly used risk prediction models in assessing the risk of patients undergoing isolated aortic valve surgery. This study was designed to compare the performances of European System for Cardiac Operative Risk Evaluation (EuroSCORE) II and age, creatinine, and ejection fraction (ACEF) score with those of The Society of Thoracic Surgeons (STS) score and logistic EuroSCORE in patients undergoing isolated aortic valve surgery. Methods: Data on 1,758 consecutive patients who underwent isolated aortic valve replacement in a 6-year period were retrieved from 3 prospective institutional databases. Discriminatory power was assessed using the c-index. Calibration was evaluated with calibration curves and associated statistics. Results: In-hospital mortality rate was 1.4%. The discriminatory power was similar in all algorithms (area under the curve 0.80, 95% confidence interval [CI] 0.72 to 0.88 for logistic EuroSCORE; 0.81, 95% CI 0.73 to -0.88 for EuroSCORE II; 0.78, 95% CI 0.68 to 0.88 for ACEF; 0.85, 95% CI 0.78-0.93 for STS score) and not significantly different (p values > 0.05 for all tests). The EuroSCORE II had a better calibration, being the only score with nonsignificant associated statistics (unreliability test, Hosmer-Lemeshow test, and Spiegelhalter Z-test for calibration accuracy). Nonetheless, EuroSCORE II calibration plot highlighted a trend over under-prediction. Conclusions: The EuroSCORE II is a good predictor of perioperative mortality in isolated aortic valve surgery, with lower discrimination if compared with STS and a better calibration when compared with logistic EuroSCORE, ACEF, and STS scores. Its performance is optimal in the lowest tertile of patients, whereas it under-predicts mortality afterward. None of these algorithms seems suitable for risk estimation in mid and high-risk patients that are the ones who might benefit most from transcatheter procedures.

Original languageEnglish
Pages (from-to)1539-1544
Number of pages6
JournalAnnals of Thoracic Surgery
Volume95
Issue number5
DOIs
Publication statusPublished - May 2013

Fingerprint

Aortic Valve
Thorax
Mortality
Calibration
Confidence Intervals
Creatinine
Surgeons
Hospital Mortality
Area Under Curve
Databases

ASJC Scopus subject areas

  • Cardiology and Cardiovascular Medicine
  • Surgery
  • Pulmonary and Respiratory Medicine

Cite this

Reliability of new scores in predicting perioperative mortality after isolated aortic valve surgery : A comparison with the society of thoracic surgeons score and logistic EuroSCORE. / Barili, Fabio; Pacini, Davide; Capo, Antonio; Ardemagni, Enrico; Pellicciari, Giovanni; Zanobini, Marco; Grossi, Claudio; Shahin, Khaled Mohamed; Alamanni, Francesco; Di Bartolomeo, Roberto; Parolari, Alessandro.

In: Annals of Thoracic Surgery, Vol. 95, No. 5, 05.2013, p. 1539-1544.

Research output: Contribution to journalArticle

Barili, Fabio ; Pacini, Davide ; Capo, Antonio ; Ardemagni, Enrico ; Pellicciari, Giovanni ; Zanobini, Marco ; Grossi, Claudio ; Shahin, Khaled Mohamed ; Alamanni, Francesco ; Di Bartolomeo, Roberto ; Parolari, Alessandro. / Reliability of new scores in predicting perioperative mortality after isolated aortic valve surgery : A comparison with the society of thoracic surgeons score and logistic EuroSCORE. In: Annals of Thoracic Surgery. 2013 ; Vol. 95, No. 5. pp. 1539-1544.
@article{4f9e1894011e4f549b9c6e6e9bd7e767,
title = "Reliability of new scores in predicting perioperative mortality after isolated aortic valve surgery: A comparison with the society of thoracic surgeons score and logistic EuroSCORE",
abstract = "Background: There is still a wide debate concerning the performance of commonly used risk prediction models in assessing the risk of patients undergoing isolated aortic valve surgery. This study was designed to compare the performances of European System for Cardiac Operative Risk Evaluation (EuroSCORE) II and age, creatinine, and ejection fraction (ACEF) score with those of The Society of Thoracic Surgeons (STS) score and logistic EuroSCORE in patients undergoing isolated aortic valve surgery. Methods: Data on 1,758 consecutive patients who underwent isolated aortic valve replacement in a 6-year period were retrieved from 3 prospective institutional databases. Discriminatory power was assessed using the c-index. Calibration was evaluated with calibration curves and associated statistics. Results: In-hospital mortality rate was 1.4{\%}. The discriminatory power was similar in all algorithms (area under the curve 0.80, 95{\%} confidence interval [CI] 0.72 to 0.88 for logistic EuroSCORE; 0.81, 95{\%} CI 0.73 to -0.88 for EuroSCORE II; 0.78, 95{\%} CI 0.68 to 0.88 for ACEF; 0.85, 95{\%} CI 0.78-0.93 for STS score) and not significantly different (p values > 0.05 for all tests). The EuroSCORE II had a better calibration, being the only score with nonsignificant associated statistics (unreliability test, Hosmer-Lemeshow test, and Spiegelhalter Z-test for calibration accuracy). Nonetheless, EuroSCORE II calibration plot highlighted a trend over under-prediction. Conclusions: The EuroSCORE II is a good predictor of perioperative mortality in isolated aortic valve surgery, with lower discrimination if compared with STS and a better calibration when compared with logistic EuroSCORE, ACEF, and STS scores. Its performance is optimal in the lowest tertile of patients, whereas it under-predicts mortality afterward. None of these algorithms seems suitable for risk estimation in mid and high-risk patients that are the ones who might benefit most from transcatheter procedures.",
author = "Fabio Barili and Davide Pacini and Antonio Capo and Enrico Ardemagni and Giovanni Pellicciari and Marco Zanobini and Claudio Grossi and Shahin, {Khaled Mohamed} and Francesco Alamanni and {Di Bartolomeo}, Roberto and Alessandro Parolari",
year = "2013",
month = "5",
doi = "10.1016/j.athoracsur.2013.01.058",
language = "English",
volume = "95",
pages = "1539--1544",
journal = "Annals of Thoracic Surgery",
issn = "0003-4975",
publisher = "The Society of Thoracic Surgeons. Published by Elsevier Inc",
number = "5",

}

TY - JOUR

T1 - Reliability of new scores in predicting perioperative mortality after isolated aortic valve surgery

T2 - A comparison with the society of thoracic surgeons score and logistic EuroSCORE

AU - Barili, Fabio

AU - Pacini, Davide

AU - Capo, Antonio

AU - Ardemagni, Enrico

AU - Pellicciari, Giovanni

AU - Zanobini, Marco

AU - Grossi, Claudio

AU - Shahin, Khaled Mohamed

AU - Alamanni, Francesco

AU - Di Bartolomeo, Roberto

AU - Parolari, Alessandro

PY - 2013/5

Y1 - 2013/5

N2 - Background: There is still a wide debate concerning the performance of commonly used risk prediction models in assessing the risk of patients undergoing isolated aortic valve surgery. This study was designed to compare the performances of European System for Cardiac Operative Risk Evaluation (EuroSCORE) II and age, creatinine, and ejection fraction (ACEF) score with those of The Society of Thoracic Surgeons (STS) score and logistic EuroSCORE in patients undergoing isolated aortic valve surgery. Methods: Data on 1,758 consecutive patients who underwent isolated aortic valve replacement in a 6-year period were retrieved from 3 prospective institutional databases. Discriminatory power was assessed using the c-index. Calibration was evaluated with calibration curves and associated statistics. Results: In-hospital mortality rate was 1.4%. The discriminatory power was similar in all algorithms (area under the curve 0.80, 95% confidence interval [CI] 0.72 to 0.88 for logistic EuroSCORE; 0.81, 95% CI 0.73 to -0.88 for EuroSCORE II; 0.78, 95% CI 0.68 to 0.88 for ACEF; 0.85, 95% CI 0.78-0.93 for STS score) and not significantly different (p values > 0.05 for all tests). The EuroSCORE II had a better calibration, being the only score with nonsignificant associated statistics (unreliability test, Hosmer-Lemeshow test, and Spiegelhalter Z-test for calibration accuracy). Nonetheless, EuroSCORE II calibration plot highlighted a trend over under-prediction. Conclusions: The EuroSCORE II is a good predictor of perioperative mortality in isolated aortic valve surgery, with lower discrimination if compared with STS and a better calibration when compared with logistic EuroSCORE, ACEF, and STS scores. Its performance is optimal in the lowest tertile of patients, whereas it under-predicts mortality afterward. None of these algorithms seems suitable for risk estimation in mid and high-risk patients that are the ones who might benefit most from transcatheter procedures.

AB - Background: There is still a wide debate concerning the performance of commonly used risk prediction models in assessing the risk of patients undergoing isolated aortic valve surgery. This study was designed to compare the performances of European System for Cardiac Operative Risk Evaluation (EuroSCORE) II and age, creatinine, and ejection fraction (ACEF) score with those of The Society of Thoracic Surgeons (STS) score and logistic EuroSCORE in patients undergoing isolated aortic valve surgery. Methods: Data on 1,758 consecutive patients who underwent isolated aortic valve replacement in a 6-year period were retrieved from 3 prospective institutional databases. Discriminatory power was assessed using the c-index. Calibration was evaluated with calibration curves and associated statistics. Results: In-hospital mortality rate was 1.4%. The discriminatory power was similar in all algorithms (area under the curve 0.80, 95% confidence interval [CI] 0.72 to 0.88 for logistic EuroSCORE; 0.81, 95% CI 0.73 to -0.88 for EuroSCORE II; 0.78, 95% CI 0.68 to 0.88 for ACEF; 0.85, 95% CI 0.78-0.93 for STS score) and not significantly different (p values > 0.05 for all tests). The EuroSCORE II had a better calibration, being the only score with nonsignificant associated statistics (unreliability test, Hosmer-Lemeshow test, and Spiegelhalter Z-test for calibration accuracy). Nonetheless, EuroSCORE II calibration plot highlighted a trend over under-prediction. Conclusions: The EuroSCORE II is a good predictor of perioperative mortality in isolated aortic valve surgery, with lower discrimination if compared with STS and a better calibration when compared with logistic EuroSCORE, ACEF, and STS scores. Its performance is optimal in the lowest tertile of patients, whereas it under-predicts mortality afterward. None of these algorithms seems suitable for risk estimation in mid and high-risk patients that are the ones who might benefit most from transcatheter procedures.

UR - http://www.scopus.com/inward/record.url?scp=84876684946&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84876684946&partnerID=8YFLogxK

U2 - 10.1016/j.athoracsur.2013.01.058

DO - 10.1016/j.athoracsur.2013.01.058

M3 - Article

C2 - 23473650

AN - SCOPUS:84876684946

VL - 95

SP - 1539

EP - 1544

JO - Annals of Thoracic Surgery

JF - Annals of Thoracic Surgery

SN - 0003-4975

IS - 5

ER -