Improving interobserver variation in reporting gadolinium-enhanced MRI lesions in multiple sclerosis

F. Barkhof, M. Filippi, J. H. Van Waesberghe, P. Molyneux, M. Rovaris, G. Lycklama À Nijeholt, N. Tubridy, D. H. Miller, T. A. Yousry, E. W. Radue, H. J. Adèr

Research output: Contribution to journalArticle

100 Citations (Scopus)

Abstract

Gadolinium-enhanced MRI is a sensitive and objective means to monitor disease activity in multiple sclerosis (MS). We evaluated the interobserver agreement and the value of observer training in reporting enhancing lesions from serial MRI. Scans of 16 MS patients were evaluated by five inexperienced and five experienced observers before and after consensus formation and training. The number of lesions at baseline, and the number of new and persistent lesions at follow-up were scored. For each condition, weighted kappa values (κ) and the mean average difference to the median (MADM) scores were calculated. Without training, the experienced readers showed good agreement on number of lesions at baseline and new lesions at follow-up, and moderate agreement for persistent lesions. The inexperienced readers showed poor agreement for baseline and persistent lesions, and moderate agreement for new lesions. After training, both groups reported lower absolute numbers of lesions, especially the inexperienced readers. The experienced readers showed good agreement for all lesion types, the inexperienced readers showed agreement for baseline and new lesions, and agreement was moderate for persistent lesions. In both groups MADM scores were 1.2 for persistent lesions. Interobserver agreement is improved by training, especially in inexperienced readers. Interobserver agreement in reporting gadolinium-enhanced lesions is high, which validates the use of serial, enhanced MRI as an outcome parameter in treatment trials in MS.

Original languageEnglish
Pages (from-to)1682-1688
Number of pages7
JournalNeurology
Volume49
Issue number6
Publication statusPublished - Dec 1997

Fingerprint

Observer Variation
Gadolinium
Multiple Sclerosis
Therapeutics

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Barkhof, F., Filippi, M., Van Waesberghe, J. H., Molyneux, P., Rovaris, M., Lycklama À Nijeholt, G., ... Adèr, H. J. (1997). Improving interobserver variation in reporting gadolinium-enhanced MRI lesions in multiple sclerosis. Neurology, 49(6), 1682-1688.

Improving interobserver variation in reporting gadolinium-enhanced MRI lesions in multiple sclerosis. / Barkhof, F.; Filippi, M.; Van Waesberghe, J. H.; Molyneux, P.; Rovaris, M.; Lycklama À Nijeholt, G.; Tubridy, N.; Miller, D. H.; Yousry, T. A.; Radue, E. W.; Adèr, H. J.

In: Neurology, Vol. 49, No. 6, 12.1997, p. 1682-1688.

Research output: Contribution to journalArticle

Barkhof, F, Filippi, M, Van Waesberghe, JH, Molyneux, P, Rovaris, M, Lycklama À Nijeholt, G, Tubridy, N, Miller, DH, Yousry, TA, Radue, EW & Adèr, HJ 1997, 'Improving interobserver variation in reporting gadolinium-enhanced MRI lesions in multiple sclerosis', Neurology, vol. 49, no. 6, pp. 1682-1688.
Barkhof F, Filippi M, Van Waesberghe JH, Molyneux P, Rovaris M, Lycklama À Nijeholt G et al. Improving interobserver variation in reporting gadolinium-enhanced MRI lesions in multiple sclerosis. Neurology. 1997 Dec;49(6):1682-1688.
Barkhof, F. ; Filippi, M. ; Van Waesberghe, J. H. ; Molyneux, P. ; Rovaris, M. ; Lycklama À Nijeholt, G. ; Tubridy, N. ; Miller, D. H. ; Yousry, T. A. ; Radue, E. W. ; Adèr, H. J. / Improving interobserver variation in reporting gadolinium-enhanced MRI lesions in multiple sclerosis. In: Neurology. 1997 ; Vol. 49, No. 6. pp. 1682-1688.
@article{073bffe88f2442dfaa6ef62cb777e39c,
title = "Improving interobserver variation in reporting gadolinium-enhanced MRI lesions in multiple sclerosis",
abstract = "Gadolinium-enhanced MRI is a sensitive and objective means to monitor disease activity in multiple sclerosis (MS). We evaluated the interobserver agreement and the value of observer training in reporting enhancing lesions from serial MRI. Scans of 16 MS patients were evaluated by five inexperienced and five experienced observers before and after consensus formation and training. The number of lesions at baseline, and the number of new and persistent lesions at follow-up were scored. For each condition, weighted kappa values (κ) and the mean average difference to the median (MADM) scores were calculated. Without training, the experienced readers showed good agreement on number of lesions at baseline and new lesions at follow-up, and moderate agreement for persistent lesions. The inexperienced readers showed poor agreement for baseline and persistent lesions, and moderate agreement for new lesions. After training, both groups reported lower absolute numbers of lesions, especially the inexperienced readers. The experienced readers showed good agreement for all lesion types, the inexperienced readers showed agreement for baseline and new lesions, and agreement was moderate for persistent lesions. In both groups MADM scores were 1.2 for persistent lesions. Interobserver agreement is improved by training, especially in inexperienced readers. Interobserver agreement in reporting gadolinium-enhanced lesions is high, which validates the use of serial, enhanced MRI as an outcome parameter in treatment trials in MS.",
author = "F. Barkhof and M. Filippi and {Van Waesberghe}, {J. H.} and P. Molyneux and M. Rovaris and {Lycklama {\`A} Nijeholt}, G. and N. Tubridy and Miller, {D. H.} and Yousry, {T. A.} and Radue, {E. W.} and Ad{\`e}r, {H. J.}",
year = "1997",
month = "12",
language = "English",
volume = "49",
pages = "1682--1688",
journal = "Neurology",
issn = "0028-3878",
publisher = "Lippincott Williams and Wilkins",
number = "6",

}

TY - JOUR

T1 - Improving interobserver variation in reporting gadolinium-enhanced MRI lesions in multiple sclerosis

AU - Barkhof, F.

AU - Filippi, M.

AU - Van Waesberghe, J. H.

AU - Molyneux, P.

AU - Rovaris, M.

AU - Lycklama À Nijeholt, G.

AU - Tubridy, N.

AU - Miller, D. H.

AU - Yousry, T. A.

AU - Radue, E. W.

AU - Adèr, H. J.

PY - 1997/12

Y1 - 1997/12

N2 - Gadolinium-enhanced MRI is a sensitive and objective means to monitor disease activity in multiple sclerosis (MS). We evaluated the interobserver agreement and the value of observer training in reporting enhancing lesions from serial MRI. Scans of 16 MS patients were evaluated by five inexperienced and five experienced observers before and after consensus formation and training. The number of lesions at baseline, and the number of new and persistent lesions at follow-up were scored. For each condition, weighted kappa values (κ) and the mean average difference to the median (MADM) scores were calculated. Without training, the experienced readers showed good agreement on number of lesions at baseline and new lesions at follow-up, and moderate agreement for persistent lesions. The inexperienced readers showed poor agreement for baseline and persistent lesions, and moderate agreement for new lesions. After training, both groups reported lower absolute numbers of lesions, especially the inexperienced readers. The experienced readers showed good agreement for all lesion types, the inexperienced readers showed agreement for baseline and new lesions, and agreement was moderate for persistent lesions. In both groups MADM scores were 1.2 for persistent lesions. Interobserver agreement is improved by training, especially in inexperienced readers. Interobserver agreement in reporting gadolinium-enhanced lesions is high, which validates the use of serial, enhanced MRI as an outcome parameter in treatment trials in MS.

AB - Gadolinium-enhanced MRI is a sensitive and objective means to monitor disease activity in multiple sclerosis (MS). We evaluated the interobserver agreement and the value of observer training in reporting enhancing lesions from serial MRI. Scans of 16 MS patients were evaluated by five inexperienced and five experienced observers before and after consensus formation and training. The number of lesions at baseline, and the number of new and persistent lesions at follow-up were scored. For each condition, weighted kappa values (κ) and the mean average difference to the median (MADM) scores were calculated. Without training, the experienced readers showed good agreement on number of lesions at baseline and new lesions at follow-up, and moderate agreement for persistent lesions. The inexperienced readers showed poor agreement for baseline and persistent lesions, and moderate agreement for new lesions. After training, both groups reported lower absolute numbers of lesions, especially the inexperienced readers. The experienced readers showed good agreement for all lesion types, the inexperienced readers showed agreement for baseline and new lesions, and agreement was moderate for persistent lesions. In both groups MADM scores were 1.2 for persistent lesions. Interobserver agreement is improved by training, especially in inexperienced readers. Interobserver agreement in reporting gadolinium-enhanced lesions is high, which validates the use of serial, enhanced MRI as an outcome parameter in treatment trials in MS.

UR - http://www.scopus.com/inward/record.url?scp=0031442396&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0031442396&partnerID=8YFLogxK

M3 - Article

VL - 49

SP - 1682

EP - 1688

JO - Neurology

JF - Neurology

SN - 0028-3878

IS - 6

ER -