Interreader variability in prostate MRI reporting using Prostate Imaging Reporting and Data System version 2.1

Giorgio Brembilla, Paolo Dell’Oglio, Armando Stabile, Anna Damascelli, Lisa Brunetti, Silvia Ravelli, Giulia Cristel, Elena Schiani, Elena Venturini, Daniele Grippaldi, Vincenzo Mendola, Paola Maria Vittoria Rancoita, Antonio Esposito, Alberto Briganti, Francesco Montorsi, Alessandro Del Maschio, Francesco De Cobelli

Research output: Contribution to journalArticlepeer-review

Abstract

Objectives: To evaluate the agreement among readers with different expertise in detecting suspicious lesions at prostate multiparametric MRI using Prostate Imaging Reporting and Data System (PI-RADS) version 2.1. Methods: We evaluated 200 consecutive biopsy-naïve or previously negative biopsy men who underwent MRI for clinically suspected prostate cancer (PCa) between May and September 2017. Of them, 132 patients underwent prostate biopsy. Seven radiologists (four dedicated uro-radiologists and three non-dedicated abdominal radiologists) reviewed and scored all MRI examinations according to PI-RADS v2.1. Agreement on index lesion detection was evaluated with Conger’s k coefficient, agreement coefficient 1 (AC1), percentage of agreement (PA), and indexes of specific positive and negative agreement. Clinical and radiological features that may influence variability were evaluated. Results: Agreement in index lesion detection among all readers was substantial (AC1 0.738; 95% CI 0.695–0.782); dedicated radiologists showed higher agreement compared with non-dedicated readers. Clinical and radiological parameters that positively influenced agreement were PSA density ≥ 0.15 ng/mL/cc, pre-MRI high risk for PCa, positivity threshold of PI-RADS score 4 + 5, PZ lesions, homogeneous signal intensity of the PZ, and subjectively easy interpretation of MRI. Positive specific agreement was significantly higher among dedicated readers, up to 93.4% (95% CI 90.7–95.4) in patients harboring csPCa. Agreement on absence of lesions was excellent for both dedicated and non-dedicated readers (respectively 85.1% [95% CI 78.4–92.3] and 82.0% [95% CI 77.2–90.1]). Conclusions: Agreement on index lesion detection among radiologists of various experiences is substantial to excellent using PI-RADS v2.1. Concordance on absence of lesions is excellent across readers’ experience. Key Points: • Agreement on index lesion detection among radiologists of various experiences is substantial to excellent using PI-RADS v2.1. • Concordance between experienced readers is higher than between less-experienced readers. • Concordance on absence of lesions is excellent across readers’ experience.

Original languageEnglish
Pages (from-to)3383-3392
Number of pages10
JournalEuropean Radiology
Volume30
Issue number6
DOIs
Publication statusPublished - Jun 1 2020

Keywords

  • Inter-observer variability
  • Magnetic resonance imaging
  • Prostate cancer

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Fingerprint Dive into the research topics of 'Interreader variability in prostate MRI reporting using Prostate Imaging Reporting and Data System version 2.1'. Together they form a unique fingerprint.

Cite this