TY - JOUR
T1 - Contouring variability of the penile bulb on CT images
T2 - Quantitative assessment using a generalized concordance index
AU - Carillo, Viviana
AU - Cozzarini, Cesare
AU - Perna, Lucia
AU - Calandra, Mauro
AU - Gianolini, Stefano
AU - Rancati, Tiziana
AU - Spinelli, Antonello Enrico
AU - Vavassori, Vittorio
AU - Villa, Sergio
AU - Valdagni, Riccardo
AU - Fiorino, Claudio
PY - 2012/11/1
Y1 - 2012/11/1
N2 - Purpose: Within a multicenter study (DUE-01) focused on the search of predictors of erectile dysfunction and urinary toxicity after radiotherapy for prostate cancer, a dummy run exercise on penile bulb (PB) contouring on computed tomography (CT) images was carried out. The aim of this study was to quantitatively assess interobserver contouring variability by the application of the generalized DICE index. Methods and Materials: Fifteen physicians from different Institutes drew the PB on CT images of 10 patients. The spread of DICE values was used to objectively select those observers who significantly disagreed with the others. The analyses were performed with a dedicated module in the VODCA software package. Results: DICE values were found to significantly change among observers and patients. The mean DICE value was 0.67, ranging between 0.43 and 0.80. The statistics of DICE coefficients identified 4 of 15 observers who systematically showed a value below the average (p value range, 0.013 - 0.059): Mean DICE values were 0.62 for the 4 "bad" observers compared to 0.69 of the 11 "good" observers. For all bad observers, the main cause of the disagreement was identified. Average DICE values were significantly worse from the average in 2 of 10 patients (0.60 vs. 0.70, p <0.05) because of the limited visibility of the PB. Excluding the bad observers and the "bad" patients," the mean DICE value increased from 0.67 to 0.70; interobserver variability, expressed in terms of standard deviation of DICE spread, was also reduced. Conclusions: The obtained values of DICE around 0.7 shows an acceptable agreement, considered the small dimension of the PB. Additional strategies to improve this agreement are under consideration and include an additional tutorial of the so-called bad observers with a recontouring procedure, or the recontouring by a single observer of the PB for all patients included in the DUE-01 study.
AB - Purpose: Within a multicenter study (DUE-01) focused on the search of predictors of erectile dysfunction and urinary toxicity after radiotherapy for prostate cancer, a dummy run exercise on penile bulb (PB) contouring on computed tomography (CT) images was carried out. The aim of this study was to quantitatively assess interobserver contouring variability by the application of the generalized DICE index. Methods and Materials: Fifteen physicians from different Institutes drew the PB on CT images of 10 patients. The spread of DICE values was used to objectively select those observers who significantly disagreed with the others. The analyses were performed with a dedicated module in the VODCA software package. Results: DICE values were found to significantly change among observers and patients. The mean DICE value was 0.67, ranging between 0.43 and 0.80. The statistics of DICE coefficients identified 4 of 15 observers who systematically showed a value below the average (p value range, 0.013 - 0.059): Mean DICE values were 0.62 for the 4 "bad" observers compared to 0.69 of the 11 "good" observers. For all bad observers, the main cause of the disagreement was identified. Average DICE values were significantly worse from the average in 2 of 10 patients (0.60 vs. 0.70, p <0.05) because of the limited visibility of the PB. Excluding the bad observers and the "bad" patients," the mean DICE value increased from 0.67 to 0.70; interobserver variability, expressed in terms of standard deviation of DICE spread, was also reduced. Conclusions: The obtained values of DICE around 0.7 shows an acceptable agreement, considered the small dimension of the PB. Additional strategies to improve this agreement are under consideration and include an additional tutorial of the so-called bad observers with a recontouring procedure, or the recontouring by a single observer of the PB for all patients included in the DUE-01 study.
KW - Contouring agreement
KW - Erectile dysfunction
KW - Prostate radiotherapy
UR - http://www.scopus.com/inward/record.url?scp=84866732189&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84866732189&partnerID=8YFLogxK
U2 - 10.1016/j.ijrobp.2011.12.057
DO - 10.1016/j.ijrobp.2011.12.057
M3 - Article
C2 - 22401919
AN - SCOPUS:84866732189
VL - 84
SP - 841
EP - 846
JO - International Journal of Radiation Oncology Biology Physics
JF - International Journal of Radiation Oncology Biology Physics
SN - 0360-3016
IS - 3
ER -