Do neurologists agree in diagnosing drug resistance in adults with focal epilepsy?

Gaetano Zaccara, Marco Mula, Bruno Ferrò, Domenico Consoli, Maurizio Elia, Anna Teresa Giallonardo, Alfonso Iudice, Angela La Neve, Stefano Meletti, Paolo Tinuper, Leila Zummo, Emilio Perucca

Research output: Contribution to journalArticle

Abstract

OBJECTIVE: To evaluate interrater agreement in categorizing treatment outcomes and drug responsiveness status according to the International League Against Epilepsy (ILAE) definition of drug-resistant epilepsy.

METHODS: A total of 1053 adults with focal epilepsy considered by the investigators to meet ILAE criteria for drug resistance were enrolled consecutively at 43 centers and followed up prospectively for 18-34 months. Treatment outcomes for all antiepileptic drugs (AEDs) used up to enrollment (retrospective assessment), and on an AED newly introduced at enrollment, were categorized by individual investigators and by 2 rotating members of a 16-member expert panel (EP) that reviewed the patient records independently. Interrater agreement was tested by Cohen's kappa (k) statistics and rated according to Landis and Koch's criteria.

RESULTS: Agreement between EP members in categorizing outcomes on the newly introduced AED was almost perfect (90.1%, k = 0.84, 95% confidence interval [CI] 0.80-0.87), whereas agreement between the EP and individual investigators was moderate (70.4%, k = 0.57, 95% CI 0.53-0.61). Similarly, categorization of outcomes on previously used AEDs was almost perfect between EP members (91.7%, k = 0.83, 95% CI 0.81-0.84) and moderate between the EP and investigators (68.2%, k = 0.50, 95% CI 0.48-0.52). Disagreement was related predominantly to outcomes considered to be treatment failures by the investigators but categorized as undetermined by the EP. Overall, 19% of patients classified as having drug-resistant epilepsy by the investigators were considered by the EP to have "undefined responsiveness."

SIGNIFICANCE: Interrater agreement in categorizing treatment outcomes according to ILAE criteria ranges from moderate to almost perfect. Nearly 1 in 5 patients considered by enrolling neurologists to be "drug-resistant" were classified by the EP as having "undefined responsiveness."

Original languageEnglish
JournalEpilepsia
Volume60
Issue number1
DOIs
Publication statusE-pub ahead of print - 2018

Fingerprint

Partial Epilepsy
Drug Resistance
Research Personnel
Anticonvulsants
Confidence Intervals
Epilepsy
Treatment Failure
Pharmaceutical Preparations
Neurologists

Cite this

Zaccara, G., Mula, M., Ferrò, B., Consoli, D., Elia, M., Giallonardo, A. T., ... Perucca, E. (2018). Do neurologists agree in diagnosing drug resistance in adults with focal epilepsy? Epilepsia, 60(1). https://doi.org/10.1111/epi.14622

Do neurologists agree in diagnosing drug resistance in adults with focal epilepsy? / Zaccara, Gaetano; Mula, Marco; Ferrò, Bruno; Consoli, Domenico; Elia, Maurizio; Giallonardo, Anna Teresa; Iudice, Alfonso; La Neve, Angela; Meletti, Stefano; Tinuper, Paolo; Zummo, Leila; Perucca, Emilio.

In: Epilepsia, Vol. 60, No. 1, 2018.

Research output: Contribution to journalArticle

Zaccara, G, Mula, M, Ferrò, B, Consoli, D, Elia, M, Giallonardo, AT, Iudice, A, La Neve, A, Meletti, S, Tinuper, P, Zummo, L & Perucca, E 2018, 'Do neurologists agree in diagnosing drug resistance in adults with focal epilepsy?', Epilepsia, vol. 60, no. 1. https://doi.org/10.1111/epi.14622
Zaccara G, Mula M, Ferrò B, Consoli D, Elia M, Giallonardo AT et al. Do neurologists agree in diagnosing drug resistance in adults with focal epilepsy? Epilepsia. 2018;60(1). https://doi.org/10.1111/epi.14622
Zaccara, Gaetano ; Mula, Marco ; Ferrò, Bruno ; Consoli, Domenico ; Elia, Maurizio ; Giallonardo, Anna Teresa ; Iudice, Alfonso ; La Neve, Angela ; Meletti, Stefano ; Tinuper, Paolo ; Zummo, Leila ; Perucca, Emilio. / Do neurologists agree in diagnosing drug resistance in adults with focal epilepsy?. In: Epilepsia. 2018 ; Vol. 60, No. 1.
@article{b6e55e37fa7c4924a07a3593d6a06a99,
title = "Do neurologists agree in diagnosing drug resistance in adults with focal epilepsy?",
abstract = "OBJECTIVE: To evaluate interrater agreement in categorizing treatment outcomes and drug responsiveness status according to the International League Against Epilepsy (ILAE) definition of drug-resistant epilepsy.METHODS: A total of 1053 adults with focal epilepsy considered by the investigators to meet ILAE criteria for drug resistance were enrolled consecutively at 43 centers and followed up prospectively for 18-34 months. Treatment outcomes for all antiepileptic drugs (AEDs) used up to enrollment (retrospective assessment), and on an AED newly introduced at enrollment, were categorized by individual investigators and by 2 rotating members of a 16-member expert panel (EP) that reviewed the patient records independently. Interrater agreement was tested by Cohen's kappa (k) statistics and rated according to Landis and Koch's criteria.RESULTS: Agreement between EP members in categorizing outcomes on the newly introduced AED was almost perfect (90.1{\%}, k = 0.84, 95{\%} confidence interval [CI] 0.80-0.87), whereas agreement between the EP and individual investigators was moderate (70.4{\%}, k = 0.57, 95{\%} CI 0.53-0.61). Similarly, categorization of outcomes on previously used AEDs was almost perfect between EP members (91.7{\%}, k = 0.83, 95{\%} CI 0.81-0.84) and moderate between the EP and investigators (68.2{\%}, k = 0.50, 95{\%} CI 0.48-0.52). Disagreement was related predominantly to outcomes considered to be treatment failures by the investigators but categorized as undetermined by the EP. Overall, 19{\%} of patients classified as having drug-resistant epilepsy by the investigators were considered by the EP to have {"}undefined responsiveness.{"}SIGNIFICANCE: Interrater agreement in categorizing treatment outcomes according to ILAE criteria ranges from moderate to almost perfect. Nearly 1 in 5 patients considered by enrolling neurologists to be {"}drug-resistant{"} were classified by the EP as having {"}undefined responsiveness.{"}",
author = "Gaetano Zaccara and Marco Mula and Bruno Ferr{\`o} and Domenico Consoli and Maurizio Elia and Giallonardo, {Anna Teresa} and Alfonso Iudice and {La Neve}, Angela and Stefano Meletti and Paolo Tinuper and Leila Zummo and Emilio Perucca",
note = "Ricercatore distaccato presso IRCCS a seguito Convenzione esclusiva con Universit{\`a} di Bologna (Tinuper Paolo).",
year = "2018",
doi = "10.1111/epi.14622",
language = "English",
volume = "60",
journal = "Epilepsia",
issn = "0013-9580",
publisher = "Blackwell Publishing Inc.",
number = "1",

}

TY - JOUR

T1 - Do neurologists agree in diagnosing drug resistance in adults with focal epilepsy?

AU - Zaccara, Gaetano

AU - Mula, Marco

AU - Ferrò, Bruno

AU - Consoli, Domenico

AU - Elia, Maurizio

AU - Giallonardo, Anna Teresa

AU - Iudice, Alfonso

AU - La Neve, Angela

AU - Meletti, Stefano

AU - Tinuper, Paolo

AU - Zummo, Leila

AU - Perucca, Emilio

N1 - Ricercatore distaccato presso IRCCS a seguito Convenzione esclusiva con Università di Bologna (Tinuper Paolo).

PY - 2018

Y1 - 2018

N2 - OBJECTIVE: To evaluate interrater agreement in categorizing treatment outcomes and drug responsiveness status according to the International League Against Epilepsy (ILAE) definition of drug-resistant epilepsy.METHODS: A total of 1053 adults with focal epilepsy considered by the investigators to meet ILAE criteria for drug resistance were enrolled consecutively at 43 centers and followed up prospectively for 18-34 months. Treatment outcomes for all antiepileptic drugs (AEDs) used up to enrollment (retrospective assessment), and on an AED newly introduced at enrollment, were categorized by individual investigators and by 2 rotating members of a 16-member expert panel (EP) that reviewed the patient records independently. Interrater agreement was tested by Cohen's kappa (k) statistics and rated according to Landis and Koch's criteria.RESULTS: Agreement between EP members in categorizing outcomes on the newly introduced AED was almost perfect (90.1%, k = 0.84, 95% confidence interval [CI] 0.80-0.87), whereas agreement between the EP and individual investigators was moderate (70.4%, k = 0.57, 95% CI 0.53-0.61). Similarly, categorization of outcomes on previously used AEDs was almost perfect between EP members (91.7%, k = 0.83, 95% CI 0.81-0.84) and moderate between the EP and investigators (68.2%, k = 0.50, 95% CI 0.48-0.52). Disagreement was related predominantly to outcomes considered to be treatment failures by the investigators but categorized as undetermined by the EP. Overall, 19% of patients classified as having drug-resistant epilepsy by the investigators were considered by the EP to have "undefined responsiveness."SIGNIFICANCE: Interrater agreement in categorizing treatment outcomes according to ILAE criteria ranges from moderate to almost perfect. Nearly 1 in 5 patients considered by enrolling neurologists to be "drug-resistant" were classified by the EP as having "undefined responsiveness."

AB - OBJECTIVE: To evaluate interrater agreement in categorizing treatment outcomes and drug responsiveness status according to the International League Against Epilepsy (ILAE) definition of drug-resistant epilepsy.METHODS: A total of 1053 adults with focal epilepsy considered by the investigators to meet ILAE criteria for drug resistance were enrolled consecutively at 43 centers and followed up prospectively for 18-34 months. Treatment outcomes for all antiepileptic drugs (AEDs) used up to enrollment (retrospective assessment), and on an AED newly introduced at enrollment, were categorized by individual investigators and by 2 rotating members of a 16-member expert panel (EP) that reviewed the patient records independently. Interrater agreement was tested by Cohen's kappa (k) statistics and rated according to Landis and Koch's criteria.RESULTS: Agreement between EP members in categorizing outcomes on the newly introduced AED was almost perfect (90.1%, k = 0.84, 95% confidence interval [CI] 0.80-0.87), whereas agreement between the EP and individual investigators was moderate (70.4%, k = 0.57, 95% CI 0.53-0.61). Similarly, categorization of outcomes on previously used AEDs was almost perfect between EP members (91.7%, k = 0.83, 95% CI 0.81-0.84) and moderate between the EP and investigators (68.2%, k = 0.50, 95% CI 0.48-0.52). Disagreement was related predominantly to outcomes considered to be treatment failures by the investigators but categorized as undetermined by the EP. Overall, 19% of patients classified as having drug-resistant epilepsy by the investigators were considered by the EP to have "undefined responsiveness."SIGNIFICANCE: Interrater agreement in categorizing treatment outcomes according to ILAE criteria ranges from moderate to almost perfect. Nearly 1 in 5 patients considered by enrolling neurologists to be "drug-resistant" were classified by the EP as having "undefined responsiveness."

U2 - 10.1111/epi.14622

DO - 10.1111/epi.14622

M3 - Article

VL - 60

JO - Epilepsia

JF - Epilepsia

SN - 0013-9580

IS - 1

ER -