Good interobserver and intraobserver agreement in the evaluation of the new ILAE classification of focal cortical dysplasias

Roland Coras, Onno J. De Boer, Dawna Armstrong, Albert Becker, Thomas S. Jacques, Hajime Miyata, Maria Thom, Harry V. Vinters, Roberto Spreafico, Buge Oz, Gianluca Marucci, Jose Pimentel, Angelika Mühlebner, Josef Zamecnik, Anna Maria Buccoliero, Fabio Rogerio, Nathalie Streichenberger, Nobutaka Arai, Marianna Bugiani, Silke Vogelgesang & 13 others Rob MacAulay, Carolin Salon, Volkmar Hans, Marc Polivka, Felice Giangaspero, Dyah Fauziah, Jang Hee Kim, Lei Liu, Wang Dandan, Jing Gao, Benjamin Lindeboom, Ingmar Blümcke, Eleonora Aronica

Research output: Contribution to journalArticle

52 Citations (Scopus)

Abstract

Summary Purpose: An International League Against Epilepsy (ILAE) consensus classification system for focal cortical dysplasias (FCDs) has been published in 2011 specifying clinicopathologic FCD variants. The aim of the present work was to microscopically assess interobserver agreement and intraobserver reproducibility for FCD categories among an international group of neuropathologists with different levels of experience and access to epilepsy surgery tissue. Methods: Surgical FCD specimens covering a broad histopathology spectrum were retrieved from 22 patients with epilepsy. Three surgical nonepilepsy specimens served as controls. A total of 188 slides with routine or immunohistochemical stainings were digitalized with a slide scanner to allow Internet-based microscopy review. Nine experienced neuropathologists were invited to review these cases twice at a time gap of 3 months and different orders of case presentation. The 2011 ILAE FCD consensus classification served as instruction. Kappa analysis was calculated to estimate interobserver and intraobserver agreement levels. In a third evaluation round, 21 additional neuropathologists with different experience and access to epilepsy surgery reviewed the same case series. Key Findings: Interobserver agreement was good (ΰ = 0.6360), with 84% consensus of diagnoses during the first evaluation (21 of 25 cases). Kappa values increased to 0.6532 after reevaluation, and consensus was obtained in 24 (96%) of 25 cases. Overall intraobserver reproducibility was also good (ΰ = 0.7824, ranging from 0.4991 to 1.000). Fewest changes in the classification were made in the FCD type II group (2.2% of 225 original diagnoses), whereas the majority of changes occurred in FCD type III (13.7% of 225 original diagnoses). In the third evaluation round, interobserver agreement was reflected by the level of experience of each neuropathologist, with ΰ values ranging from moderate (0.5056; high level of experience >40 cases/year) to low (0.3265; low level of experience

Original languageEnglish
Pages (from-to)1341-1348
Number of pages8
JournalEpilepsia
Volume53
Issue number8
DOIs
Publication statusPublished - Aug 2012

Fingerprint

Malformations of Cortical Development
Partial Epilepsy
Epilepsy
Internet
Microscopy
Staining and Labeling
Neuropathology

Keywords

  • Agreement
  • Brain
  • Classification
  • Epilepsy
  • Neuropathology
  • Reproducibility

ASJC Scopus subject areas

  • Clinical Neurology
  • Neurology

Cite this

Coras, R., De Boer, O. J., Armstrong, D., Becker, A., Jacques, T. S., Miyata, H., ... Aronica, E. (2012). Good interobserver and intraobserver agreement in the evaluation of the new ILAE classification of focal cortical dysplasias. Epilepsia, 53(8), 1341-1348. https://doi.org/10.1111/j.1528-1167.2012.03508.x

Good interobserver and intraobserver agreement in the evaluation of the new ILAE classification of focal cortical dysplasias. / Coras, Roland; De Boer, Onno J.; Armstrong, Dawna; Becker, Albert; Jacques, Thomas S.; Miyata, Hajime; Thom, Maria; Vinters, Harry V.; Spreafico, Roberto; Oz, Buge; Marucci, Gianluca; Pimentel, Jose; Mühlebner, Angelika; Zamecnik, Josef; Buccoliero, Anna Maria; Rogerio, Fabio; Streichenberger, Nathalie; Arai, Nobutaka; Bugiani, Marianna; Vogelgesang, Silke; MacAulay, Rob; Salon, Carolin; Hans, Volkmar; Polivka, Marc; Giangaspero, Felice; Fauziah, Dyah; Kim, Jang Hee; Liu, Lei; Dandan, Wang; Gao, Jing; Lindeboom, Benjamin; Blümcke, Ingmar; Aronica, Eleonora.

In: Epilepsia, Vol. 53, No. 8, 08.2012, p. 1341-1348.

Research output: Contribution to journalArticle

Coras, R, De Boer, OJ, Armstrong, D, Becker, A, Jacques, TS, Miyata, H, Thom, M, Vinters, HV, Spreafico, R, Oz, B, Marucci, G, Pimentel, J, Mühlebner, A, Zamecnik, J, Buccoliero, AM, Rogerio, F, Streichenberger, N, Arai, N, Bugiani, M, Vogelgesang, S, MacAulay, R, Salon, C, Hans, V, Polivka, M, Giangaspero, F, Fauziah, D, Kim, JH, Liu, L, Dandan, W, Gao, J, Lindeboom, B, Blümcke, I & Aronica, E 2012, 'Good interobserver and intraobserver agreement in the evaluation of the new ILAE classification of focal cortical dysplasias', Epilepsia, vol. 53, no. 8, pp. 1341-1348. https://doi.org/10.1111/j.1528-1167.2012.03508.x
Coras, Roland ; De Boer, Onno J. ; Armstrong, Dawna ; Becker, Albert ; Jacques, Thomas S. ; Miyata, Hajime ; Thom, Maria ; Vinters, Harry V. ; Spreafico, Roberto ; Oz, Buge ; Marucci, Gianluca ; Pimentel, Jose ; Mühlebner, Angelika ; Zamecnik, Josef ; Buccoliero, Anna Maria ; Rogerio, Fabio ; Streichenberger, Nathalie ; Arai, Nobutaka ; Bugiani, Marianna ; Vogelgesang, Silke ; MacAulay, Rob ; Salon, Carolin ; Hans, Volkmar ; Polivka, Marc ; Giangaspero, Felice ; Fauziah, Dyah ; Kim, Jang Hee ; Liu, Lei ; Dandan, Wang ; Gao, Jing ; Lindeboom, Benjamin ; Blümcke, Ingmar ; Aronica, Eleonora. / Good interobserver and intraobserver agreement in the evaluation of the new ILAE classification of focal cortical dysplasias. In: Epilepsia. 2012 ; Vol. 53, No. 8. pp. 1341-1348.
@article{6cfe9f955cdc433f84e1910717fe31fd,
title = "Good interobserver and intraobserver agreement in the evaluation of the new ILAE classification of focal cortical dysplasias",
abstract = "Summary Purpose: An International League Against Epilepsy (ILAE) consensus classification system for focal cortical dysplasias (FCDs) has been published in 2011 specifying clinicopathologic FCD variants. The aim of the present work was to microscopically assess interobserver agreement and intraobserver reproducibility for FCD categories among an international group of neuropathologists with different levels of experience and access to epilepsy surgery tissue. Methods: Surgical FCD specimens covering a broad histopathology spectrum were retrieved from 22 patients with epilepsy. Three surgical nonepilepsy specimens served as controls. A total of 188 slides with routine or immunohistochemical stainings were digitalized with a slide scanner to allow Internet-based microscopy review. Nine experienced neuropathologists were invited to review these cases twice at a time gap of 3 months and different orders of case presentation. The 2011 ILAE FCD consensus classification served as instruction. Kappa analysis was calculated to estimate interobserver and intraobserver agreement levels. In a third evaluation round, 21 additional neuropathologists with different experience and access to epilepsy surgery reviewed the same case series. Key Findings: Interobserver agreement was good ({\^I}° = 0.6360), with 84{\%} consensus of diagnoses during the first evaluation (21 of 25 cases). Kappa values increased to 0.6532 after reevaluation, and consensus was obtained in 24 (96{\%}) of 25 cases. Overall intraobserver reproducibility was also good ({\^I}° = 0.7824, ranging from 0.4991 to 1.000). Fewest changes in the classification were made in the FCD type II group (2.2{\%} of 225 original diagnoses), whereas the majority of changes occurred in FCD type III (13.7{\%} of 225 original diagnoses). In the third evaluation round, interobserver agreement was reflected by the level of experience of each neuropathologist, with {\^I}° values ranging from moderate (0.5056; high level of experience >40 cases/year) to low (0.3265; low level of experience",
keywords = "Agreement, Brain, Classification, Epilepsy, Neuropathology, Reproducibility",
author = "Roland Coras and {De Boer}, {Onno J.} and Dawna Armstrong and Albert Becker and Jacques, {Thomas S.} and Hajime Miyata and Maria Thom and Vinters, {Harry V.} and Roberto Spreafico and Buge Oz and Gianluca Marucci and Jose Pimentel and Angelika M{\"u}hlebner and Josef Zamecnik and Buccoliero, {Anna Maria} and Fabio Rogerio and Nathalie Streichenberger and Nobutaka Arai and Marianna Bugiani and Silke Vogelgesang and Rob MacAulay and Carolin Salon and Volkmar Hans and Marc Polivka and Felice Giangaspero and Dyah Fauziah and Kim, {Jang Hee} and Lei Liu and Wang Dandan and Jing Gao and Benjamin Lindeboom and Ingmar Bl{\"u}mcke and Eleonora Aronica",
year = "2012",
month = "8",
doi = "10.1111/j.1528-1167.2012.03508.x",
language = "English",
volume = "53",
pages = "1341--1348",
journal = "Epilepsia",
issn = "0013-9580",
publisher = "Blackwell Publishing Inc.",
number = "8",

}

TY - JOUR

T1 - Good interobserver and intraobserver agreement in the evaluation of the new ILAE classification of focal cortical dysplasias

AU - Coras, Roland

AU - De Boer, Onno J.

AU - Armstrong, Dawna

AU - Becker, Albert

AU - Jacques, Thomas S.

AU - Miyata, Hajime

AU - Thom, Maria

AU - Vinters, Harry V.

AU - Spreafico, Roberto

AU - Oz, Buge

AU - Marucci, Gianluca

AU - Pimentel, Jose

AU - Mühlebner, Angelika

AU - Zamecnik, Josef

AU - Buccoliero, Anna Maria

AU - Rogerio, Fabio

AU - Streichenberger, Nathalie

AU - Arai, Nobutaka

AU - Bugiani, Marianna

AU - Vogelgesang, Silke

AU - MacAulay, Rob

AU - Salon, Carolin

AU - Hans, Volkmar

AU - Polivka, Marc

AU - Giangaspero, Felice

AU - Fauziah, Dyah

AU - Kim, Jang Hee

AU - Liu, Lei

AU - Dandan, Wang

AU - Gao, Jing

AU - Lindeboom, Benjamin

AU - Blümcke, Ingmar

AU - Aronica, Eleonora

PY - 2012/8

Y1 - 2012/8

N2 - Summary Purpose: An International League Against Epilepsy (ILAE) consensus classification system for focal cortical dysplasias (FCDs) has been published in 2011 specifying clinicopathologic FCD variants. The aim of the present work was to microscopically assess interobserver agreement and intraobserver reproducibility for FCD categories among an international group of neuropathologists with different levels of experience and access to epilepsy surgery tissue. Methods: Surgical FCD specimens covering a broad histopathology spectrum were retrieved from 22 patients with epilepsy. Three surgical nonepilepsy specimens served as controls. A total of 188 slides with routine or immunohistochemical stainings were digitalized with a slide scanner to allow Internet-based microscopy review. Nine experienced neuropathologists were invited to review these cases twice at a time gap of 3 months and different orders of case presentation. The 2011 ILAE FCD consensus classification served as instruction. Kappa analysis was calculated to estimate interobserver and intraobserver agreement levels. In a third evaluation round, 21 additional neuropathologists with different experience and access to epilepsy surgery reviewed the same case series. Key Findings: Interobserver agreement was good (ΰ = 0.6360), with 84% consensus of diagnoses during the first evaluation (21 of 25 cases). Kappa values increased to 0.6532 after reevaluation, and consensus was obtained in 24 (96%) of 25 cases. Overall intraobserver reproducibility was also good (ΰ = 0.7824, ranging from 0.4991 to 1.000). Fewest changes in the classification were made in the FCD type II group (2.2% of 225 original diagnoses), whereas the majority of changes occurred in FCD type III (13.7% of 225 original diagnoses). In the third evaluation round, interobserver agreement was reflected by the level of experience of each neuropathologist, with ΰ values ranging from moderate (0.5056; high level of experience >40 cases/year) to low (0.3265; low level of experience

AB - Summary Purpose: An International League Against Epilepsy (ILAE) consensus classification system for focal cortical dysplasias (FCDs) has been published in 2011 specifying clinicopathologic FCD variants. The aim of the present work was to microscopically assess interobserver agreement and intraobserver reproducibility for FCD categories among an international group of neuropathologists with different levels of experience and access to epilepsy surgery tissue. Methods: Surgical FCD specimens covering a broad histopathology spectrum were retrieved from 22 patients with epilepsy. Three surgical nonepilepsy specimens served as controls. A total of 188 slides with routine or immunohistochemical stainings were digitalized with a slide scanner to allow Internet-based microscopy review. Nine experienced neuropathologists were invited to review these cases twice at a time gap of 3 months and different orders of case presentation. The 2011 ILAE FCD consensus classification served as instruction. Kappa analysis was calculated to estimate interobserver and intraobserver agreement levels. In a third evaluation round, 21 additional neuropathologists with different experience and access to epilepsy surgery reviewed the same case series. Key Findings: Interobserver agreement was good (ΰ = 0.6360), with 84% consensus of diagnoses during the first evaluation (21 of 25 cases). Kappa values increased to 0.6532 after reevaluation, and consensus was obtained in 24 (96%) of 25 cases. Overall intraobserver reproducibility was also good (ΰ = 0.7824, ranging from 0.4991 to 1.000). Fewest changes in the classification were made in the FCD type II group (2.2% of 225 original diagnoses), whereas the majority of changes occurred in FCD type III (13.7% of 225 original diagnoses). In the third evaluation round, interobserver agreement was reflected by the level of experience of each neuropathologist, with ΰ values ranging from moderate (0.5056; high level of experience >40 cases/year) to low (0.3265; low level of experience

KW - Agreement

KW - Brain

KW - Classification

KW - Epilepsy

KW - Neuropathology

KW - Reproducibility

UR - http://www.scopus.com/inward/record.url?scp=84865014596&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84865014596&partnerID=8YFLogxK

U2 - 10.1111/j.1528-1167.2012.03508.x

DO - 10.1111/j.1528-1167.2012.03508.x

M3 - Article

VL - 53

SP - 1341

EP - 1348

JO - Epilepsia

JF - Epilepsia

SN - 0013-9580

IS - 8

ER -