How do we estimate survival? External validation of a tool for survival estimation in patients with metastatic bone disease-decision analysis and comparison of three international patient populations

Andrea Piccioli, M. Andrea Spinelli, Jonathan A. Forsberg, Rikard Wedin, John H. Healey, Vincenzo Ippolito, Primo Andrea Daolio, Pietro Ruggieri, Giulio Maccauro, Alessandro Gasbarrini, Roberto Biagini, Raimondo Piana, Flavio Fazioli, Alessandro Luzzati, Alberto Di Martino, Francesco Nicolosi, Francesco Camnasio, Michele Attilio Rosa, Domenico Andrea Campanacci, Vincenzo DenaroRodolfo Capanna

Research output: Contribution to journalArticle

Abstract

Background: We recently developed a clinical decision support tool, capable of estimating the likelihood of survival at 3 and 12 months following surgery for patients with operable skeletal metastases. After making it publicly available on www.PATHFx.org, we attempted to externally validate it using independent, international data. Methods: We collected data from patients treated at 13 Italian orthopaedic oncology referral centers between 2010 and 2013, then applied to PATHFx, which generated a probability of survival at three and 12-months for each patient. We assessed accuracy using the area under the receiver-operating characteristic curve (AUC), clinical utility using Decision Curve Analysis (DCA), and compared the Italian patient data to the training set (United States) and first external validation set (Scandinavia). Results: The Italian dataset contained 287 records with at least 12 months follow-up information. The AUCs for the three-month and 12-month estimates was 0.80 and 0.77, respectively. There were missing data, including the surgeon's estimate of survival that was missing in the majority of records. Physiologically, Italian patients were similar to patients in the training and first validation sets. However notable differences were observed in the proportion of those surviving three and 12-months, suggesting differences in referral patterns and perhaps indications for surgery. Conclusions: PATHFx was successfully validated in an Italian dataset containing missing data. This study demonstrates its broad applicability to European patients, even in centers with differing treatment philosophies from those previously studied.

Original languageEnglish
Article number424
JournalBMC Cancer
Volume15
Issue number1
DOIs
Publication statusPublished - May 22 2015

Fingerprint

Decision Support Techniques
Bone Diseases
Survival
Population
Area Under Curve
Referral and Consultation
Clinical Decision Support Systems
Scandinavian and Nordic Countries
ROC Curve
Orthopedics
Neoplasm Metastasis

Keywords

  • Bayesian statistics
  • Postoperative survival
  • Prognostic model
  • Skeletal metastasis

ASJC Scopus subject areas

  • Oncology
  • Cancer Research
  • Genetics

Cite this

How do we estimate survival? External validation of a tool for survival estimation in patients with metastatic bone disease-decision analysis and comparison of three international patient populations. / Piccioli, Andrea; Spinelli, M. Andrea; Forsberg, Jonathan A.; Wedin, Rikard; Healey, John H.; Ippolito, Vincenzo; Daolio, Primo Andrea; Ruggieri, Pietro; Maccauro, Giulio; Gasbarrini, Alessandro; Biagini, Roberto; Piana, Raimondo; Fazioli, Flavio; Luzzati, Alessandro; Di Martino, Alberto; Nicolosi, Francesco; Camnasio, Francesco; Rosa, Michele Attilio; Campanacci, Domenico Andrea; Denaro, Vincenzo; Capanna, Rodolfo.

In: BMC Cancer, Vol. 15, No. 1, 424, 22.05.2015.

Research output: Contribution to journalArticle

Piccioli, A, Spinelli, MA, Forsberg, JA, Wedin, R, Healey, JH, Ippolito, V, Daolio, PA, Ruggieri, P, Maccauro, G, Gasbarrini, A, Biagini, R, Piana, R, Fazioli, F, Luzzati, A, Di Martino, A, Nicolosi, F, Camnasio, F, Rosa, MA, Campanacci, DA, Denaro, V & Capanna, R 2015, 'How do we estimate survival? External validation of a tool for survival estimation in patients with metastatic bone disease-decision analysis and comparison of three international patient populations', BMC Cancer, vol. 15, no. 1, 424. https://doi.org/10.1186/s12885-015-1396-5
Piccioli, Andrea ; Spinelli, M. Andrea ; Forsberg, Jonathan A. ; Wedin, Rikard ; Healey, John H. ; Ippolito, Vincenzo ; Daolio, Primo Andrea ; Ruggieri, Pietro ; Maccauro, Giulio ; Gasbarrini, Alessandro ; Biagini, Roberto ; Piana, Raimondo ; Fazioli, Flavio ; Luzzati, Alessandro ; Di Martino, Alberto ; Nicolosi, Francesco ; Camnasio, Francesco ; Rosa, Michele Attilio ; Campanacci, Domenico Andrea ; Denaro, Vincenzo ; Capanna, Rodolfo. / How do we estimate survival? External validation of a tool for survival estimation in patients with metastatic bone disease-decision analysis and comparison of three international patient populations. In: BMC Cancer. 2015 ; Vol. 15, No. 1.
@article{3ac4c982f2ca443194ed604ddbbcbabc,
title = "How do we estimate survival? External validation of a tool for survival estimation in patients with metastatic bone disease-decision analysis and comparison of three international patient populations",
abstract = "Background: We recently developed a clinical decision support tool, capable of estimating the likelihood of survival at 3 and 12 months following surgery for patients with operable skeletal metastases. After making it publicly available on www.PATHFx.org, we attempted to externally validate it using independent, international data. Methods: We collected data from patients treated at 13 Italian orthopaedic oncology referral centers between 2010 and 2013, then applied to PATHFx, which generated a probability of survival at three and 12-months for each patient. We assessed accuracy using the area under the receiver-operating characteristic curve (AUC), clinical utility using Decision Curve Analysis (DCA), and compared the Italian patient data to the training set (United States) and first external validation set (Scandinavia). Results: The Italian dataset contained 287 records with at least 12 months follow-up information. The AUCs for the three-month and 12-month estimates was 0.80 and 0.77, respectively. There were missing data, including the surgeon's estimate of survival that was missing in the majority of records. Physiologically, Italian patients were similar to patients in the training and first validation sets. However notable differences were observed in the proportion of those surviving three and 12-months, suggesting differences in referral patterns and perhaps indications for surgery. Conclusions: PATHFx was successfully validated in an Italian dataset containing missing data. This study demonstrates its broad applicability to European patients, even in centers with differing treatment philosophies from those previously studied.",
keywords = "Bayesian statistics, Postoperative survival, Prognostic model, Skeletal metastasis",
author = "Andrea Piccioli and Spinelli, {M. Andrea} and Forsberg, {Jonathan A.} and Rikard Wedin and Healey, {John H.} and Vincenzo Ippolito and Daolio, {Primo Andrea} and Pietro Ruggieri and Giulio Maccauro and Alessandro Gasbarrini and Roberto Biagini and Raimondo Piana and Flavio Fazioli and Alessandro Luzzati and {Di Martino}, Alberto and Francesco Nicolosi and Francesco Camnasio and Rosa, {Michele Attilio} and Campanacci, {Domenico Andrea} and Vincenzo Denaro and Rodolfo Capanna",
year = "2015",
month = "5",
day = "22",
doi = "10.1186/s12885-015-1396-5",
language = "English",
volume = "15",
journal = "BMC Cancer",
issn = "1471-2407",
publisher = "BioMed Central Ltd.",
number = "1",

}

TY - JOUR

T1 - How do we estimate survival? External validation of a tool for survival estimation in patients with metastatic bone disease-decision analysis and comparison of three international patient populations

AU - Piccioli, Andrea

AU - Spinelli, M. Andrea

AU - Forsberg, Jonathan A.

AU - Wedin, Rikard

AU - Healey, John H.

AU - Ippolito, Vincenzo

AU - Daolio, Primo Andrea

AU - Ruggieri, Pietro

AU - Maccauro, Giulio

AU - Gasbarrini, Alessandro

AU - Biagini, Roberto

AU - Piana, Raimondo

AU - Fazioli, Flavio

AU - Luzzati, Alessandro

AU - Di Martino, Alberto

AU - Nicolosi, Francesco

AU - Camnasio, Francesco

AU - Rosa, Michele Attilio

AU - Campanacci, Domenico Andrea

AU - Denaro, Vincenzo

AU - Capanna, Rodolfo

PY - 2015/5/22

Y1 - 2015/5/22

N2 - Background: We recently developed a clinical decision support tool, capable of estimating the likelihood of survival at 3 and 12 months following surgery for patients with operable skeletal metastases. After making it publicly available on www.PATHFx.org, we attempted to externally validate it using independent, international data. Methods: We collected data from patients treated at 13 Italian orthopaedic oncology referral centers between 2010 and 2013, then applied to PATHFx, which generated a probability of survival at three and 12-months for each patient. We assessed accuracy using the area under the receiver-operating characteristic curve (AUC), clinical utility using Decision Curve Analysis (DCA), and compared the Italian patient data to the training set (United States) and first external validation set (Scandinavia). Results: The Italian dataset contained 287 records with at least 12 months follow-up information. The AUCs for the three-month and 12-month estimates was 0.80 and 0.77, respectively. There were missing data, including the surgeon's estimate of survival that was missing in the majority of records. Physiologically, Italian patients were similar to patients in the training and first validation sets. However notable differences were observed in the proportion of those surviving three and 12-months, suggesting differences in referral patterns and perhaps indications for surgery. Conclusions: PATHFx was successfully validated in an Italian dataset containing missing data. This study demonstrates its broad applicability to European patients, even in centers with differing treatment philosophies from those previously studied.

AB - Background: We recently developed a clinical decision support tool, capable of estimating the likelihood of survival at 3 and 12 months following surgery for patients with operable skeletal metastases. After making it publicly available on www.PATHFx.org, we attempted to externally validate it using independent, international data. Methods: We collected data from patients treated at 13 Italian orthopaedic oncology referral centers between 2010 and 2013, then applied to PATHFx, which generated a probability of survival at three and 12-months for each patient. We assessed accuracy using the area under the receiver-operating characteristic curve (AUC), clinical utility using Decision Curve Analysis (DCA), and compared the Italian patient data to the training set (United States) and first external validation set (Scandinavia). Results: The Italian dataset contained 287 records with at least 12 months follow-up information. The AUCs for the three-month and 12-month estimates was 0.80 and 0.77, respectively. There were missing data, including the surgeon's estimate of survival that was missing in the majority of records. Physiologically, Italian patients were similar to patients in the training and first validation sets. However notable differences were observed in the proportion of those surviving three and 12-months, suggesting differences in referral patterns and perhaps indications for surgery. Conclusions: PATHFx was successfully validated in an Italian dataset containing missing data. This study demonstrates its broad applicability to European patients, even in centers with differing treatment philosophies from those previously studied.

KW - Bayesian statistics

KW - Postoperative survival

KW - Prognostic model

KW - Skeletal metastasis

UR - http://www.scopus.com/inward/record.url?scp=84930204668&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84930204668&partnerID=8YFLogxK

U2 - 10.1186/s12885-015-1396-5

DO - 10.1186/s12885-015-1396-5

M3 - Article

AN - SCOPUS:84930204668

VL - 15

JO - BMC Cancer

JF - BMC Cancer

SN - 1471-2407

IS - 1

M1 - 424

ER -