The performance of SAPS II in a cohort of patients admitted to 99 Italian ICUs: Results from GiViTI

G. Apolone, C. Bertolini, R. D'Amico, G. Iapichino, A. Cattaneo, G. De Salvo, R. M. Melotti

Research output: Contribution to journalArticle

100 Citations (Scopus)

Abstract

Objective: To assess the validity of SAPS II (new Simplified Acute Physiology Score) in a cohort of patients admitted to a large sample of Italian intensive care units (ICU). Design and setting: The ability of the SAPS II scoring system to predict the probability of hospital mortality was assessed with calibration and discrimination measures obtained using published coefficients. A new logistic regression equation was then developed and further formal calibration and discrimination measures were estimated for the customized model. Patients: From the 2202 consecutive patients recruited during a 1-month period in 99 ICUs, a total of 1393 patients were included in this validation study. Results: When the parameters based on the standard model were applied, the expected probability of mortality did not fit those actually observed in the cohort (p <0.001), although it showed satisfactory discrimination (area under the receiver operating characteristic curve = 0.80). Such lack of fit yields an overall under prediction of mortality (observed/expected ratio = 1.14) that reflects a uniform pattern across a preselected set of subgroups. Customization allowed new mortality estimates to be calculated, with satisfactory calibration (p = 0.82) and a more uniform pattern across subgroups. Conclusions: SAPS II maintained its validity in an independent sample of patients recruited in a large network of Italian ICUs only after appropriate adaptation (first-level customization). Whether the determinants of this relatively poor performance are related to differences in unmeasured case-mix, methods of application, or quality of care delivered is a matter for discussion that cannot be solved with the data presently available. However, these findings suggest that caution is warranted before implementing the standard SAPS II scoring system parameters outside formal research projects.

Original languageEnglish
Pages (from-to)1368-1378
Number of pages11
JournalIntensive Care Medicine
Volume22
Issue number12
DOIs
Publication statusPublished - 1996

Fingerprint

Calibration
Mortality
Quality of Health Care
Validation Studies
Diagnosis-Related Groups
Hospital Mortality
ROC Curve
Intensive Care Units
Logistic Models
Simplified Acute Physiology Score
Research

Keywords

  • Critical care medicine
  • Hospital mortality
  • Intensive care units
  • SAPS II
  • Scoring systems
  • Severity of illness index

ASJC Scopus subject areas

  • Critical Care and Intensive Care Medicine

Cite this

Apolone, G., Bertolini, C., D'Amico, R., Iapichino, G., Cattaneo, A., De Salvo, G., & Melotti, R. M. (1996). The performance of SAPS II in a cohort of patients admitted to 99 Italian ICUs: Results from GiViTI. Intensive Care Medicine, 22(12), 1368-1378. https://doi.org/10.1007/s001340050266

The performance of SAPS II in a cohort of patients admitted to 99 Italian ICUs : Results from GiViTI. / Apolone, G.; Bertolini, C.; D'Amico, R.; Iapichino, G.; Cattaneo, A.; De Salvo, G.; Melotti, R. M.

In: Intensive Care Medicine, Vol. 22, No. 12, 1996, p. 1368-1378.

Research output: Contribution to journalArticle

Apolone, G, Bertolini, C, D'Amico, R, Iapichino, G, Cattaneo, A, De Salvo, G & Melotti, RM 1996, 'The performance of SAPS II in a cohort of patients admitted to 99 Italian ICUs: Results from GiViTI', Intensive Care Medicine, vol. 22, no. 12, pp. 1368-1378. https://doi.org/10.1007/s001340050266
Apolone, G. ; Bertolini, C. ; D'Amico, R. ; Iapichino, G. ; Cattaneo, A. ; De Salvo, G. ; Melotti, R. M. / The performance of SAPS II in a cohort of patients admitted to 99 Italian ICUs : Results from GiViTI. In: Intensive Care Medicine. 1996 ; Vol. 22, No. 12. pp. 1368-1378.
@article{7d448aa798f142cda1afb8ae1ec7a572,
title = "The performance of SAPS II in a cohort of patients admitted to 99 Italian ICUs: Results from GiViTI",
abstract = "Objective: To assess the validity of SAPS II (new Simplified Acute Physiology Score) in a cohort of patients admitted to a large sample of Italian intensive care units (ICU). Design and setting: The ability of the SAPS II scoring system to predict the probability of hospital mortality was assessed with calibration and discrimination measures obtained using published coefficients. A new logistic regression equation was then developed and further formal calibration and discrimination measures were estimated for the customized model. Patients: From the 2202 consecutive patients recruited during a 1-month period in 99 ICUs, a total of 1393 patients were included in this validation study. Results: When the parameters based on the standard model were applied, the expected probability of mortality did not fit those actually observed in the cohort (p <0.001), although it showed satisfactory discrimination (area under the receiver operating characteristic curve = 0.80). Such lack of fit yields an overall under prediction of mortality (observed/expected ratio = 1.14) that reflects a uniform pattern across a preselected set of subgroups. Customization allowed new mortality estimates to be calculated, with satisfactory calibration (p = 0.82) and a more uniform pattern across subgroups. Conclusions: SAPS II maintained its validity in an independent sample of patients recruited in a large network of Italian ICUs only after appropriate adaptation (first-level customization). Whether the determinants of this relatively poor performance are related to differences in unmeasured case-mix, methods of application, or quality of care delivered is a matter for discussion that cannot be solved with the data presently available. However, these findings suggest that caution is warranted before implementing the standard SAPS II scoring system parameters outside formal research projects.",
keywords = "Critical care medicine, Hospital mortality, Intensive care units, SAPS II, Scoring systems, Severity of illness index",
author = "G. Apolone and C. Bertolini and R. D'Amico and G. Iapichino and A. Cattaneo and {De Salvo}, G. and Melotti, {R. M.}",
year = "1996",
doi = "10.1007/s001340050266",
language = "English",
volume = "22",
pages = "1368--1378",
journal = "Intensive Care Medicine",
issn = "0342-4642",
publisher = "Springer Verlag",
number = "12",

}

TY - JOUR

T1 - The performance of SAPS II in a cohort of patients admitted to 99 Italian ICUs

T2 - Results from GiViTI

AU - Apolone, G.

AU - Bertolini, C.

AU - D'Amico, R.

AU - Iapichino, G.

AU - Cattaneo, A.

AU - De Salvo, G.

AU - Melotti, R. M.

PY - 1996

Y1 - 1996

N2 - Objective: To assess the validity of SAPS II (new Simplified Acute Physiology Score) in a cohort of patients admitted to a large sample of Italian intensive care units (ICU). Design and setting: The ability of the SAPS II scoring system to predict the probability of hospital mortality was assessed with calibration and discrimination measures obtained using published coefficients. A new logistic regression equation was then developed and further formal calibration and discrimination measures were estimated for the customized model. Patients: From the 2202 consecutive patients recruited during a 1-month period in 99 ICUs, a total of 1393 patients were included in this validation study. Results: When the parameters based on the standard model were applied, the expected probability of mortality did not fit those actually observed in the cohort (p <0.001), although it showed satisfactory discrimination (area under the receiver operating characteristic curve = 0.80). Such lack of fit yields an overall under prediction of mortality (observed/expected ratio = 1.14) that reflects a uniform pattern across a preselected set of subgroups. Customization allowed new mortality estimates to be calculated, with satisfactory calibration (p = 0.82) and a more uniform pattern across subgroups. Conclusions: SAPS II maintained its validity in an independent sample of patients recruited in a large network of Italian ICUs only after appropriate adaptation (first-level customization). Whether the determinants of this relatively poor performance are related to differences in unmeasured case-mix, methods of application, or quality of care delivered is a matter for discussion that cannot be solved with the data presently available. However, these findings suggest that caution is warranted before implementing the standard SAPS II scoring system parameters outside formal research projects.

AB - Objective: To assess the validity of SAPS II (new Simplified Acute Physiology Score) in a cohort of patients admitted to a large sample of Italian intensive care units (ICU). Design and setting: The ability of the SAPS II scoring system to predict the probability of hospital mortality was assessed with calibration and discrimination measures obtained using published coefficients. A new logistic regression equation was then developed and further formal calibration and discrimination measures were estimated for the customized model. Patients: From the 2202 consecutive patients recruited during a 1-month period in 99 ICUs, a total of 1393 patients were included in this validation study. Results: When the parameters based on the standard model were applied, the expected probability of mortality did not fit those actually observed in the cohort (p <0.001), although it showed satisfactory discrimination (area under the receiver operating characteristic curve = 0.80). Such lack of fit yields an overall under prediction of mortality (observed/expected ratio = 1.14) that reflects a uniform pattern across a preselected set of subgroups. Customization allowed new mortality estimates to be calculated, with satisfactory calibration (p = 0.82) and a more uniform pattern across subgroups. Conclusions: SAPS II maintained its validity in an independent sample of patients recruited in a large network of Italian ICUs only after appropriate adaptation (first-level customization). Whether the determinants of this relatively poor performance are related to differences in unmeasured case-mix, methods of application, or quality of care delivered is a matter for discussion that cannot be solved with the data presently available. However, these findings suggest that caution is warranted before implementing the standard SAPS II scoring system parameters outside formal research projects.

KW - Critical care medicine

KW - Hospital mortality

KW - Intensive care units

KW - SAPS II

KW - Scoring systems

KW - Severity of illness index

UR - http://www.scopus.com/inward/record.url?scp=0030475757&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0030475757&partnerID=8YFLogxK

U2 - 10.1007/s001340050266

DO - 10.1007/s001340050266

M3 - Article

C2 - 8986488

AN - SCOPUS:0030475757

VL - 22

SP - 1368

EP - 1378

JO - Intensive Care Medicine

JF - Intensive Care Medicine

SN - 0342-4642

IS - 12

ER -