Team Reading (Peer Review) of Suspicious/Positive Slides for Continuous Quality Improvement in Cervical-Vaginal Cytology: A Comparison between Methods and Indicators

Antonio Placidi, Paola Capparucci, Antonella Di Luzio, Gabriella Manca, Eloisa Mania, Tommaso Filippini, Paolo Giorgi Rossi

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Aim: In 2013, the Local Health Unit Roma 2 ex C screening laboratory introduced a new set of indicators for quality assurance. We compare 2 sets of indicators based on routine multiple readings (peer review) for their ability to identify problems in single-reader accuracy. Methods: All suspect slides were blindly reviewed by all the cytologists of the laboratory. The standard set of indicators includes interreader Cohen's kappa, positivity rate and atypical squamous cell of undetermined significance/squamous intraepithelial lesion (ASC-US/SIL) ratio. The new set included sensitivity for cervical intraepithelial neoplasia of grade 2 or worse (CIN2+), positive predictive value (PPV) and percentage of positive high-risk (HR)-HPV cases among ASC-US. In order to estimate sensitivity and PPV, we considered all women for whom there was a consensus of negative cytology, negative HR-HPV test, negative colposcopy or negative histology true negative. Results: Kappa values ranged from 0.521 to 0.753, with narrow 95% confidence intervals (CIs). Positivity rate ranged from 73.9 to 85.7 and the ASC-US/SIL ratio from 0.61 to 0.81. Sensitivity for CIN2+ at the low-grade SIL threshold ranged from 85.8 to 94.2, PPV ranged from 14.8 to 19.4, and both had a broad 95% CI. Readers with low sensitivity did not show low kappa values. The percentage proportion of HR-HPV-positives (HR-HPV+) among ASC-US ranged from 39.9 to 43.8% with a narrow 95% CI. Conclusion: The proportion of HR-HPV+ among ASC-US cases is a powerful indicator to address in training.

Original languageEnglish
Pages (from-to)458-64
Number of pages7
JournalActa Cytologica
Volume60
Issue number5
DOIs
Publication statusPublished - Sep 1 2016

Fingerprint

Peer Review
Quality Improvement
Cell Biology
Reading
Confidence Intervals
Roma
Colposcopy
Cervical Intraepithelial Neoplasia
Aptitude
Consensus
Histology
Atypical Squamous Cells of the Cervix
Health

Keywords

  • High-risk HPV
  • Quality assurance indicators
  • Team reading

ASJC Scopus subject areas

  • Pathology and Forensic Medicine
  • Histology

Cite this

Team Reading (Peer Review) of Suspicious/Positive Slides for Continuous Quality Improvement in Cervical-Vaginal Cytology : A Comparison between Methods and Indicators. / Placidi, Antonio; Capparucci, Paola; Di Luzio, Antonella; Manca, Gabriella; Mania, Eloisa; Filippini, Tommaso; Giorgi Rossi, Paolo.

In: Acta Cytologica, Vol. 60, No. 5, 01.09.2016, p. 458-64.

Research output: Contribution to journalArticle

Placidi, Antonio ; Capparucci, Paola ; Di Luzio, Antonella ; Manca, Gabriella ; Mania, Eloisa ; Filippini, Tommaso ; Giorgi Rossi, Paolo. / Team Reading (Peer Review) of Suspicious/Positive Slides for Continuous Quality Improvement in Cervical-Vaginal Cytology : A Comparison between Methods and Indicators. In: Acta Cytologica. 2016 ; Vol. 60, No. 5. pp. 458-64.
@article{a6152bb1857b400aad6bac6d72f32cdd,
title = "Team Reading (Peer Review) of Suspicious/Positive Slides for Continuous Quality Improvement in Cervical-Vaginal Cytology: A Comparison between Methods and Indicators",
abstract = "Aim: In 2013, the Local Health Unit Roma 2 ex C screening laboratory introduced a new set of indicators for quality assurance. We compare 2 sets of indicators based on routine multiple readings (peer review) for their ability to identify problems in single-reader accuracy. Methods: All suspect slides were blindly reviewed by all the cytologists of the laboratory. The standard set of indicators includes interreader Cohen's kappa, positivity rate and atypical squamous cell of undetermined significance/squamous intraepithelial lesion (ASC-US/SIL) ratio. The new set included sensitivity for cervical intraepithelial neoplasia of grade 2 or worse (CIN2+), positive predictive value (PPV) and percentage of positive high-risk (HR)-HPV cases among ASC-US. In order to estimate sensitivity and PPV, we considered all women for whom there was a consensus of negative cytology, negative HR-HPV test, negative colposcopy or negative histology true negative. Results: Kappa values ranged from 0.521 to 0.753, with narrow 95{\%} confidence intervals (CIs). Positivity rate ranged from 73.9 to 85.7 and the ASC-US/SIL ratio from 0.61 to 0.81. Sensitivity for CIN2+ at the low-grade SIL threshold ranged from 85.8 to 94.2, PPV ranged from 14.8 to 19.4, and both had a broad 95{\%} CI. Readers with low sensitivity did not show low kappa values. The percentage proportion of HR-HPV-positives (HR-HPV+) among ASC-US ranged from 39.9 to 43.8{\%} with a narrow 95{\%} CI. Conclusion: The proportion of HR-HPV+ among ASC-US cases is a powerful indicator to address in training.",
keywords = "High-risk HPV, Quality assurance indicators, Team reading",
author = "Antonio Placidi and Paola Capparucci and {Di Luzio}, Antonella and Gabriella Manca and Eloisa Mania and Tommaso Filippini and {Giorgi Rossi}, Paolo",
year = "2016",
month = "9",
day = "1",
doi = "10.1159/000448370",
language = "English",
volume = "60",
pages = "458--64",
journal = "Acta Cytologica",
issn = "0001-5547",
publisher = "Science Printers and Publishers Inc.",
number = "5",

}

TY - JOUR

T1 - Team Reading (Peer Review) of Suspicious/Positive Slides for Continuous Quality Improvement in Cervical-Vaginal Cytology

T2 - A Comparison between Methods and Indicators

AU - Placidi, Antonio

AU - Capparucci, Paola

AU - Di Luzio, Antonella

AU - Manca, Gabriella

AU - Mania, Eloisa

AU - Filippini, Tommaso

AU - Giorgi Rossi, Paolo

PY - 2016/9/1

Y1 - 2016/9/1

N2 - Aim: In 2013, the Local Health Unit Roma 2 ex C screening laboratory introduced a new set of indicators for quality assurance. We compare 2 sets of indicators based on routine multiple readings (peer review) for their ability to identify problems in single-reader accuracy. Methods: All suspect slides were blindly reviewed by all the cytologists of the laboratory. The standard set of indicators includes interreader Cohen's kappa, positivity rate and atypical squamous cell of undetermined significance/squamous intraepithelial lesion (ASC-US/SIL) ratio. The new set included sensitivity for cervical intraepithelial neoplasia of grade 2 or worse (CIN2+), positive predictive value (PPV) and percentage of positive high-risk (HR)-HPV cases among ASC-US. In order to estimate sensitivity and PPV, we considered all women for whom there was a consensus of negative cytology, negative HR-HPV test, negative colposcopy or negative histology true negative. Results: Kappa values ranged from 0.521 to 0.753, with narrow 95% confidence intervals (CIs). Positivity rate ranged from 73.9 to 85.7 and the ASC-US/SIL ratio from 0.61 to 0.81. Sensitivity for CIN2+ at the low-grade SIL threshold ranged from 85.8 to 94.2, PPV ranged from 14.8 to 19.4, and both had a broad 95% CI. Readers with low sensitivity did not show low kappa values. The percentage proportion of HR-HPV-positives (HR-HPV+) among ASC-US ranged from 39.9 to 43.8% with a narrow 95% CI. Conclusion: The proportion of HR-HPV+ among ASC-US cases is a powerful indicator to address in training.

AB - Aim: In 2013, the Local Health Unit Roma 2 ex C screening laboratory introduced a new set of indicators for quality assurance. We compare 2 sets of indicators based on routine multiple readings (peer review) for their ability to identify problems in single-reader accuracy. Methods: All suspect slides were blindly reviewed by all the cytologists of the laboratory. The standard set of indicators includes interreader Cohen's kappa, positivity rate and atypical squamous cell of undetermined significance/squamous intraepithelial lesion (ASC-US/SIL) ratio. The new set included sensitivity for cervical intraepithelial neoplasia of grade 2 or worse (CIN2+), positive predictive value (PPV) and percentage of positive high-risk (HR)-HPV cases among ASC-US. In order to estimate sensitivity and PPV, we considered all women for whom there was a consensus of negative cytology, negative HR-HPV test, negative colposcopy or negative histology true negative. Results: Kappa values ranged from 0.521 to 0.753, with narrow 95% confidence intervals (CIs). Positivity rate ranged from 73.9 to 85.7 and the ASC-US/SIL ratio from 0.61 to 0.81. Sensitivity for CIN2+ at the low-grade SIL threshold ranged from 85.8 to 94.2, PPV ranged from 14.8 to 19.4, and both had a broad 95% CI. Readers with low sensitivity did not show low kappa values. The percentage proportion of HR-HPV-positives (HR-HPV+) among ASC-US ranged from 39.9 to 43.8% with a narrow 95% CI. Conclusion: The proportion of HR-HPV+ among ASC-US cases is a powerful indicator to address in training.

KW - High-risk HPV

KW - Quality assurance indicators

KW - Team reading

UR - http://www.scopus.com/inward/record.url?scp=84981515971&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84981515971&partnerID=8YFLogxK

U2 - 10.1159/000448370

DO - 10.1159/000448370

M3 - Article

AN - SCOPUS:84981515971

VL - 60

SP - 458

EP - 464

JO - Acta Cytologica

JF - Acta Cytologica

SN - 0001-5547

IS - 5

ER -