Expert reliability for the World Health Organization standardized ultrasound classification of cystic echinococcosis

Nadia Solomon, Paul J. Fields, Francesca Tamarozzi, Enrico Brunetti, Calum N.L. Macpherson

Research output: Contribution to journalArticlepeer-review

Abstract

Cystic echinococcosis (CE), a parasitic zoonosis, results in cyst formation in the viscera. Cyst morphology depends on developmental stage. In 2003, the World Health Organization (WHO) published a standardized ultrasound (US) classification for CE, for use among experts as a standard of comparison. This study examined the reliability of this classification. Eleven international CE and US experts completed an assessment of eight WHO classification images and 88 test images representing cyst stages. Inter- and intraobserver reliability and observer performance were assessed using Fleiss' and Cohen's kappa. Interobserver reliability was moderate for WHO images (κ = 0.600, P < 0.0001) and substantial for test images (κ = 0.644, P < 0.0001), with substantial to almost perfect interobserver reliability for stages with pathognomonic signs (CE1, CE2, and CE3) for WHO (0.618 < κ < 0.904) and test images (0.642 < κ < 0.768). Comparisons of expert performances against the majority classification for each image were significant for WHO (0.413 < κ < 1.000, P < 0.005) and test images (0.718 < κ < 0.905, P < 0.0001); and intraobserver reliability was significant for WHO (0.520 < κ < 1.000, P < 0.005) and test images (0.690 < κ < 0.896, P < 0.0001). Findings demonstrate moderate to substantial interobserver and substantial to almost perfect intraobserver reliability for the WHO classification, with substantial to almost perfect interobserver reliability for pathognomonic stages. This confirms experts' abilities to reliably identify WHO-defined pathognomonic signs of CE, demonstrating that the WHO classification provides a reproducible way of staging CE.

Original languageEnglish
Pages (from-to)686-691
Number of pages6
JournalAmerican Journal of Tropical Medicine and Hygiene
Volume96
Issue number3
DOIs
Publication statusPublished - Jan 1 2017

ASJC Scopus subject areas

  • Parasitology
  • Infectious Diseases
  • Virology

Fingerprint

Dive into the research topics of 'Expert reliability for the World Health Organization standardized ultrasound classification of cystic echinococcosis'. Together they form a unique fingerprint.

Cite this