ICSD diagnostic criteria for narcolepsy: Interobserver reliability

Luca Vignatelli, Giuseppe Plazzi, Leona Bassein, Alfredo Barbato, Armando De Vincentiis, Elio Lugaresi, Roberto D'Alessandro

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

Study Objectives: To estimate the reliability of the diagnosis of narcolepsy after clinical interview and polysomnographic evaluation among sleep medicine doctors, before and after training in application of the International Classification of Sleep Disorders (ICSD). Setting: Videotaped semi-structured interviews of 10 patients complaining of daytime sleepiness of different etiologies. Questions referred to ICSD criteria for narcolepsy. A further series of 10 cases of narcolepsy without cataplexy were simulated, with at least a random one to three of the ICSD polysomnographic criteria at pathological levels. Participants and Design: Seventeen doctors were required to classify each videotaped case as "ascertained," "possible," or "excluded" narcolepsy, in two sessions: one before and one after discussion of ICSD criteria. The observers were invited to confirm or exclude the diagnosis of narcolepsy in the 10 simulated cases, according to the given polysomnographic findings, before and after an agreed proposal of the interpretation of ICSD polysomnographic criteria. Interobserver reliability was calculated using Kappa statistics. Interventions: N/A. Measurements and Results: Interobserver reliability of clinical judgement improved from "substantial" at baseline (Kappa 0.61) to "almost perfect" after training (Kappa 0.95). Interobserver reliability of polysomnographic findings was "fair" at baseline (Kappa 0.24), unanimous after the proposed interpretation of ICSD polysomnographic criteria. Conclusions: Baseline reliability of diagnostic judgement in suspected narcolepsy was found satisfactory among Italian sleep medicine doctors. Educational training, based on discussion of ICSD criteria, further improved agreement. Diagnosis based on polysomnographic findings, not reliable at baseline, needed a strict interpretation of ICSD criteria to attain standardization.

Original languageEnglish
Pages (from-to)193-196
Number of pages4
JournalSleep
Volume25
Issue number2
Publication statusPublished - Mar 15 2002

Fingerprint

Narcolepsy
Sleep
Medicine
Cataplexy
Interviews
Sleep Wake Disorders
Reproducibility of Results

Keywords

  • Diagnosis
  • Kappa statistics
  • Narcolepsy
  • Polysomnography
  • Reliability of results
  • Videotape recording

ASJC Scopus subject areas

  • Physiology

Cite this

Vignatelli, L., Plazzi, G., Bassein, L., Barbato, A., De Vincentiis, A., Lugaresi, E., & D'Alessandro, R. (2002). ICSD diagnostic criteria for narcolepsy: Interobserver reliability. Sleep, 25(2), 193-196.

ICSD diagnostic criteria for narcolepsy : Interobserver reliability. / Vignatelli, Luca; Plazzi, Giuseppe; Bassein, Leona; Barbato, Alfredo; De Vincentiis, Armando; Lugaresi, Elio; D'Alessandro, Roberto.

In: Sleep, Vol. 25, No. 2, 15.03.2002, p. 193-196.

Research output: Contribution to journalArticle

Vignatelli, L, Plazzi, G, Bassein, L, Barbato, A, De Vincentiis, A, Lugaresi, E & D'Alessandro, R 2002, 'ICSD diagnostic criteria for narcolepsy: Interobserver reliability', Sleep, vol. 25, no. 2, pp. 193-196.
Vignatelli L, Plazzi G, Bassein L, Barbato A, De Vincentiis A, Lugaresi E et al. ICSD diagnostic criteria for narcolepsy: Interobserver reliability. Sleep. 2002 Mar 15;25(2):193-196.
Vignatelli, Luca ; Plazzi, Giuseppe ; Bassein, Leona ; Barbato, Alfredo ; De Vincentiis, Armando ; Lugaresi, Elio ; D'Alessandro, Roberto. / ICSD diagnostic criteria for narcolepsy : Interobserver reliability. In: Sleep. 2002 ; Vol. 25, No. 2. pp. 193-196.
@article{27a5e990688147039bc3263c64a55f17,
title = "ICSD diagnostic criteria for narcolepsy: Interobserver reliability",
abstract = "Study Objectives: To estimate the reliability of the diagnosis of narcolepsy after clinical interview and polysomnographic evaluation among sleep medicine doctors, before and after training in application of the International Classification of Sleep Disorders (ICSD). Setting: Videotaped semi-structured interviews of 10 patients complaining of daytime sleepiness of different etiologies. Questions referred to ICSD criteria for narcolepsy. A further series of 10 cases of narcolepsy without cataplexy were simulated, with at least a random one to three of the ICSD polysomnographic criteria at pathological levels. Participants and Design: Seventeen doctors were required to classify each videotaped case as {"}ascertained,{"} {"}possible,{"} or {"}excluded{"} narcolepsy, in two sessions: one before and one after discussion of ICSD criteria. The observers were invited to confirm or exclude the diagnosis of narcolepsy in the 10 simulated cases, according to the given polysomnographic findings, before and after an agreed proposal of the interpretation of ICSD polysomnographic criteria. Interobserver reliability was calculated using Kappa statistics. Interventions: N/A. Measurements and Results: Interobserver reliability of clinical judgement improved from {"}substantial{"} at baseline (Kappa 0.61) to {"}almost perfect{"} after training (Kappa 0.95). Interobserver reliability of polysomnographic findings was {"}fair{"} at baseline (Kappa 0.24), unanimous after the proposed interpretation of ICSD polysomnographic criteria. Conclusions: Baseline reliability of diagnostic judgement in suspected narcolepsy was found satisfactory among Italian sleep medicine doctors. Educational training, based on discussion of ICSD criteria, further improved agreement. Diagnosis based on polysomnographic findings, not reliable at baseline, needed a strict interpretation of ICSD criteria to attain standardization.",
keywords = "Diagnosis, Kappa statistics, Narcolepsy, Polysomnography, Reliability of results, Videotape recording",
author = "Luca Vignatelli and Giuseppe Plazzi and Leona Bassein and Alfredo Barbato and {De Vincentiis}, Armando and Elio Lugaresi and Roberto D'Alessandro",
year = "2002",
month = "3",
day = "15",
language = "English",
volume = "25",
pages = "193--196",
journal = "Sleep",
issn = "0161-8105",
publisher = "American Academy of Sleep Medicine",
number = "2",

}

TY - JOUR

T1 - ICSD diagnostic criteria for narcolepsy

T2 - Interobserver reliability

AU - Vignatelli, Luca

AU - Plazzi, Giuseppe

AU - Bassein, Leona

AU - Barbato, Alfredo

AU - De Vincentiis, Armando

AU - Lugaresi, Elio

AU - D'Alessandro, Roberto

PY - 2002/3/15

Y1 - 2002/3/15

N2 - Study Objectives: To estimate the reliability of the diagnosis of narcolepsy after clinical interview and polysomnographic evaluation among sleep medicine doctors, before and after training in application of the International Classification of Sleep Disorders (ICSD). Setting: Videotaped semi-structured interviews of 10 patients complaining of daytime sleepiness of different etiologies. Questions referred to ICSD criteria for narcolepsy. A further series of 10 cases of narcolepsy without cataplexy were simulated, with at least a random one to three of the ICSD polysomnographic criteria at pathological levels. Participants and Design: Seventeen doctors were required to classify each videotaped case as "ascertained," "possible," or "excluded" narcolepsy, in two sessions: one before and one after discussion of ICSD criteria. The observers were invited to confirm or exclude the diagnosis of narcolepsy in the 10 simulated cases, according to the given polysomnographic findings, before and after an agreed proposal of the interpretation of ICSD polysomnographic criteria. Interobserver reliability was calculated using Kappa statistics. Interventions: N/A. Measurements and Results: Interobserver reliability of clinical judgement improved from "substantial" at baseline (Kappa 0.61) to "almost perfect" after training (Kappa 0.95). Interobserver reliability of polysomnographic findings was "fair" at baseline (Kappa 0.24), unanimous after the proposed interpretation of ICSD polysomnographic criteria. Conclusions: Baseline reliability of diagnostic judgement in suspected narcolepsy was found satisfactory among Italian sleep medicine doctors. Educational training, based on discussion of ICSD criteria, further improved agreement. Diagnosis based on polysomnographic findings, not reliable at baseline, needed a strict interpretation of ICSD criteria to attain standardization.

AB - Study Objectives: To estimate the reliability of the diagnosis of narcolepsy after clinical interview and polysomnographic evaluation among sleep medicine doctors, before and after training in application of the International Classification of Sleep Disorders (ICSD). Setting: Videotaped semi-structured interviews of 10 patients complaining of daytime sleepiness of different etiologies. Questions referred to ICSD criteria for narcolepsy. A further series of 10 cases of narcolepsy without cataplexy were simulated, with at least a random one to three of the ICSD polysomnographic criteria at pathological levels. Participants and Design: Seventeen doctors were required to classify each videotaped case as "ascertained," "possible," or "excluded" narcolepsy, in two sessions: one before and one after discussion of ICSD criteria. The observers were invited to confirm or exclude the diagnosis of narcolepsy in the 10 simulated cases, according to the given polysomnographic findings, before and after an agreed proposal of the interpretation of ICSD polysomnographic criteria. Interobserver reliability was calculated using Kappa statistics. Interventions: N/A. Measurements and Results: Interobserver reliability of clinical judgement improved from "substantial" at baseline (Kappa 0.61) to "almost perfect" after training (Kappa 0.95). Interobserver reliability of polysomnographic findings was "fair" at baseline (Kappa 0.24), unanimous after the proposed interpretation of ICSD polysomnographic criteria. Conclusions: Baseline reliability of diagnostic judgement in suspected narcolepsy was found satisfactory among Italian sleep medicine doctors. Educational training, based on discussion of ICSD criteria, further improved agreement. Diagnosis based on polysomnographic findings, not reliable at baseline, needed a strict interpretation of ICSD criteria to attain standardization.

KW - Diagnosis

KW - Kappa statistics

KW - Narcolepsy

KW - Polysomnography

KW - Reliability of results

KW - Videotape recording

UR - http://www.scopus.com/inward/record.url?scp=0037087175&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0037087175&partnerID=8YFLogxK

M3 - Article

C2 - 11902428

AN - SCOPUS:0037087175

VL - 25

SP - 193

EP - 196

JO - Sleep

JF - Sleep

SN - 0161-8105

IS - 2

ER -