Chronic obstructive lung disease "expert system": validation of a predictive tool for assisting diagnosis

Fulvio Braido, Pierachille Santus, Angelo Guido Corsico, Fabiano Di Marco, Giovanni Melioli, Nicola Scichilone, Paolo Solidoro

Research output: Contribution to journalArticle

Abstract

Purpose: The purposes of this study were development and validation of an expert system (ES) aimed at supporting the diagnosis of chronic obstructive lung disease (COLD).

Methods: A questionnaire and a WebFlex code were developed and validated in silico. An expert panel pilot validation on 60 cases and a clinical validation on 241 cases were performed.

Results: The developed questionnaire and code validated in silico resulted in a suitable tool to support the medical diagnosis. The clinical validation of the ES was performed in an academic setting that included six different reference centers for respiratory diseases. The results of the ES expressed as a score associated with the risk of suffering from COLD were matched and compared with the final clinical diagnoses. A set of 60 patients were evaluated by a pilot expert panel validation with the aim of calculating the sample size for the clinical validation study. The concordance analysis between these preliminary ES scores and diagnoses performed by the experts indicated that the accuracy was 94.7% when both experts and the system confirmed the COLD diagnosis and 86.3% when COLD was excluded. Based on these results, the sample size of the validation set was established in 240 patients. The clinical validation, performed on 241 patients, resulted in ES accuracy of 97.5%, with confirmed COLD diagnosis in 53.6% of the cases and excluded COLD diagnosis in 32% of the cases. In 11.2% of cases, a diagnosis of COLD was made by the experts, although the imaging results showed a potential concomitant disorder.

Conclusion: The ES presented here (COLDES) is a safe and robust supporting tool for COLD diagnosis in primary care settings.

Original languageEnglish
Pages (from-to)1747-1753
Number of pages7
JournalInternational journal of chronic obstructive pulmonary disease
Volume13
DOIs
Publication statusPublished - 2018

Fingerprint

Expert Systems
Chronic Obstructive Pulmonary Disease
Computer Simulation
Sample Size
Respiratory Center
Validation Studies
Primary Health Care

Keywords

  • Age Factors
  • Aged
  • Asthma/complications
  • Chronic Disease
  • Cough/complications
  • Expert Systems
  • Humans
  • Middle Aged
  • Pilot Projects
  • Pulmonary Disease, Chronic Obstructive/complications
  • Sample Size
  • Software Design
  • Spirometry
  • Surveys and Questionnaires

Cite this

Chronic obstructive lung disease "expert system" : validation of a predictive tool for assisting diagnosis. / Braido, Fulvio; Santus, Pierachille; Corsico, Angelo Guido; Di Marco, Fabiano; Melioli, Giovanni; Scichilone, Nicola; Solidoro, Paolo.

In: International journal of chronic obstructive pulmonary disease, Vol. 13, 2018, p. 1747-1753.

Research output: Contribution to journalArticle

Braido, Fulvio ; Santus, Pierachille ; Corsico, Angelo Guido ; Di Marco, Fabiano ; Melioli, Giovanni ; Scichilone, Nicola ; Solidoro, Paolo. / Chronic obstructive lung disease "expert system" : validation of a predictive tool for assisting diagnosis. In: International journal of chronic obstructive pulmonary disease. 2018 ; Vol. 13. pp. 1747-1753.
@article{bba501b6783548a2b0e66d2140b9d85f,
title = "Chronic obstructive lung disease {"}expert system{"}: validation of a predictive tool for assisting diagnosis",
abstract = "Purpose: The purposes of this study were development and validation of an expert system (ES) aimed at supporting the diagnosis of chronic obstructive lung disease (COLD).Methods: A questionnaire and a WebFlex code were developed and validated in silico. An expert panel pilot validation on 60 cases and a clinical validation on 241 cases were performed.Results: The developed questionnaire and code validated in silico resulted in a suitable tool to support the medical diagnosis. The clinical validation of the ES was performed in an academic setting that included six different reference centers for respiratory diseases. The results of the ES expressed as a score associated with the risk of suffering from COLD were matched and compared with the final clinical diagnoses. A set of 60 patients were evaluated by a pilot expert panel validation with the aim of calculating the sample size for the clinical validation study. The concordance analysis between these preliminary ES scores and diagnoses performed by the experts indicated that the accuracy was 94.7{\%} when both experts and the system confirmed the COLD diagnosis and 86.3{\%} when COLD was excluded. Based on these results, the sample size of the validation set was established in 240 patients. The clinical validation, performed on 241 patients, resulted in ES accuracy of 97.5{\%}, with confirmed COLD diagnosis in 53.6{\%} of the cases and excluded COLD diagnosis in 32{\%} of the cases. In 11.2{\%} of cases, a diagnosis of COLD was made by the experts, although the imaging results showed a potential concomitant disorder.Conclusion: The ES presented here (COLDES) is a safe and robust supporting tool for COLD diagnosis in primary care settings.",
keywords = "Age Factors, Aged, Asthma/complications, Chronic Disease, Cough/complications, Expert Systems, Humans, Middle Aged, Pilot Projects, Pulmonary Disease, Chronic Obstructive/complications, Sample Size, Software Design, Spirometry, Surveys and Questionnaires",
author = "Fulvio Braido and Pierachille Santus and Corsico, {Angelo Guido} and {Di Marco}, Fabiano and Giovanni Melioli and Nicola Scichilone and Paolo Solidoro",
year = "2018",
doi = "10.2147/COPD.S165533",
language = "English",
volume = "13",
pages = "1747--1753",
journal = "International Journal of COPD",
issn = "1176-9106",
publisher = "Dove Medical Press Ltd.",

}

TY - JOUR

T1 - Chronic obstructive lung disease "expert system"

T2 - validation of a predictive tool for assisting diagnosis

AU - Braido, Fulvio

AU - Santus, Pierachille

AU - Corsico, Angelo Guido

AU - Di Marco, Fabiano

AU - Melioli, Giovanni

AU - Scichilone, Nicola

AU - Solidoro, Paolo

PY - 2018

Y1 - 2018

N2 - Purpose: The purposes of this study were development and validation of an expert system (ES) aimed at supporting the diagnosis of chronic obstructive lung disease (COLD).Methods: A questionnaire and a WebFlex code were developed and validated in silico. An expert panel pilot validation on 60 cases and a clinical validation on 241 cases were performed.Results: The developed questionnaire and code validated in silico resulted in a suitable tool to support the medical diagnosis. The clinical validation of the ES was performed in an academic setting that included six different reference centers for respiratory diseases. The results of the ES expressed as a score associated with the risk of suffering from COLD were matched and compared with the final clinical diagnoses. A set of 60 patients were evaluated by a pilot expert panel validation with the aim of calculating the sample size for the clinical validation study. The concordance analysis between these preliminary ES scores and diagnoses performed by the experts indicated that the accuracy was 94.7% when both experts and the system confirmed the COLD diagnosis and 86.3% when COLD was excluded. Based on these results, the sample size of the validation set was established in 240 patients. The clinical validation, performed on 241 patients, resulted in ES accuracy of 97.5%, with confirmed COLD diagnosis in 53.6% of the cases and excluded COLD diagnosis in 32% of the cases. In 11.2% of cases, a diagnosis of COLD was made by the experts, although the imaging results showed a potential concomitant disorder.Conclusion: The ES presented here (COLDES) is a safe and robust supporting tool for COLD diagnosis in primary care settings.

AB - Purpose: The purposes of this study were development and validation of an expert system (ES) aimed at supporting the diagnosis of chronic obstructive lung disease (COLD).Methods: A questionnaire and a WebFlex code were developed and validated in silico. An expert panel pilot validation on 60 cases and a clinical validation on 241 cases were performed.Results: The developed questionnaire and code validated in silico resulted in a suitable tool to support the medical diagnosis. The clinical validation of the ES was performed in an academic setting that included six different reference centers for respiratory diseases. The results of the ES expressed as a score associated with the risk of suffering from COLD were matched and compared with the final clinical diagnoses. A set of 60 patients were evaluated by a pilot expert panel validation with the aim of calculating the sample size for the clinical validation study. The concordance analysis between these preliminary ES scores and diagnoses performed by the experts indicated that the accuracy was 94.7% when both experts and the system confirmed the COLD diagnosis and 86.3% when COLD was excluded. Based on these results, the sample size of the validation set was established in 240 patients. The clinical validation, performed on 241 patients, resulted in ES accuracy of 97.5%, with confirmed COLD diagnosis in 53.6% of the cases and excluded COLD diagnosis in 32% of the cases. In 11.2% of cases, a diagnosis of COLD was made by the experts, although the imaging results showed a potential concomitant disorder.Conclusion: The ES presented here (COLDES) is a safe and robust supporting tool for COLD diagnosis in primary care settings.

KW - Age Factors

KW - Aged

KW - Asthma/complications

KW - Chronic Disease

KW - Cough/complications

KW - Expert Systems

KW - Humans

KW - Middle Aged

KW - Pilot Projects

KW - Pulmonary Disease, Chronic Obstructive/complications

KW - Sample Size

KW - Software Design

KW - Spirometry

KW - Surveys and Questionnaires

U2 - 10.2147/COPD.S165533

DO - 10.2147/COPD.S165533

M3 - Article

C2 - 29881264

VL - 13

SP - 1747

EP - 1753

JO - International Journal of COPD

JF - International Journal of COPD

SN - 1176-9106

ER -