Clinical guidelines in pediatric headache: evaluation of quality using the AGREE II instrument

Pasquale Parisi, Nicola Vanacore, Vincenzo Belcastro, Marco Carotenuto, Ennio Del Giudice, Rosanna Mariani, Laura Papetti, Piero Pavone, Salvatore Savasta, Pasquale Striano, Irene Toldo, Elisabetta Tozzi, Alberto Verrotti, Umberto Raucci

Research output: Contribution to journalArticle

25 Citations (Scopus)

Abstract

Background: The Appraisal of Guidelines for Research and Evaluation (AGREE II) tool is a validated questionnaire used to assess the methodological quality of clinical guidelines (CGs). We used the AGREE II tool to assess the development process, the methodological quality, and the quality of reporting of available pediatric CGs for the management of headache in children. We also studied the variability in responses related to the characteristics of eleven Italian neuropediatric centers, showing similarities and differences in the main recommendations reported in CGs.

Methods: A systematic literature search was conducted from January 2002 to June 2013 on Mediline, the Cochrane database, the National Guideline Clearinghouse website and the NHS evidence search tool, using the following terms: headache, cephalalgia, guidelines and children (MESH or text words). Six CGs providing information on the diagnosis and management of headache and specific recommendations for children were selected. Eleven neuropediatric centers assessed the overall quality and the appropriateness of all available CGs using of the AGREE II instrument.

Results: Six CGs meeting the inclusion and exclusion criteria were identified and assessed by 11 reviewers. Our study showed that the NICE CGs was “strongly recommended” while the French and Danish CGs were mainly “not recommended”. The comparison between the overall quality score of the French CGs and the NICE CGs was statistically significant (6.54 ± 0.69 vs 4.18 ± 1.08; p =0.001). The correlation analysis between quality domain score and guideline publication date showed a statistically significant association only for the “editorial independence” domain (r = 0.842 p = 0.035). The intra-class coefficients showed that the 11 reviewers had the highest agreement for the Lewis CGs (r = 0.857), and the lowest one for the NICE CGs (r = 0.656). Statistical analyses showed that professionals from outpatient services dedicated pediatric headache assigned a higher overall quality score to the NICE CGs as compared to professionals from non-outpatient services (6.86 ± 0.38 vs 6.0 ± 0.82; p = 0.038).

Conclusions: CGs resulted definitely of low-moderate quality and non “homogeneous”. Further major efforts are needed to update the existing CGs according to the principles of evidence based medicine.

Original languageEnglish
JournalJournal of Headache and Pain
Volume15
Issue number1
DOIs
Publication statusPublished - 2014

Fingerprint

Headache
Guidelines
Pediatrics
Evidence-Based Medicine
Ambulatory Care
Publications

Keywords

  • Agree II instrument
  • Children
  • Guidelines
  • Pediatric headache
  • Quality of guidelines

ASJC Scopus subject areas

  • Anesthesiology and Pain Medicine
  • Clinical Neurology
  • Medicine(all)

Cite this

Clinical guidelines in pediatric headache : evaluation of quality using the AGREE II instrument. / Parisi, Pasquale; Vanacore, Nicola; Belcastro, Vincenzo; Carotenuto, Marco; Giudice, Ennio Del; Mariani, Rosanna; Papetti, Laura; Pavone, Piero; Savasta, Salvatore; Striano, Pasquale; Toldo, Irene; Tozzi, Elisabetta; Verrotti, Alberto; Raucci, Umberto.

In: Journal of Headache and Pain, Vol. 15, No. 1, 2014.

Research output: Contribution to journalArticle

Parisi, P, Vanacore, N, Belcastro, V, Carotenuto, M, Giudice, ED, Mariani, R, Papetti, L, Pavone, P, Savasta, S, Striano, P, Toldo, I, Tozzi, E, Verrotti, A & Raucci, U 2014, 'Clinical guidelines in pediatric headache: evaluation of quality using the AGREE II instrument', Journal of Headache and Pain, vol. 15, no. 1. https://doi.org/10.1186/1129-2377-15-57
Parisi, Pasquale ; Vanacore, Nicola ; Belcastro, Vincenzo ; Carotenuto, Marco ; Giudice, Ennio Del ; Mariani, Rosanna ; Papetti, Laura ; Pavone, Piero ; Savasta, Salvatore ; Striano, Pasquale ; Toldo, Irene ; Tozzi, Elisabetta ; Verrotti, Alberto ; Raucci, Umberto. / Clinical guidelines in pediatric headache : evaluation of quality using the AGREE II instrument. In: Journal of Headache and Pain. 2014 ; Vol. 15, No. 1.
@article{f10fdc82d1884e608bc636856e04168f,
title = "Clinical guidelines in pediatric headache: evaluation of quality using the AGREE II instrument",
abstract = "Background: The Appraisal of Guidelines for Research and Evaluation (AGREE II) tool is a validated questionnaire used to assess the methodological quality of clinical guidelines (CGs). We used the AGREE II tool to assess the development process, the methodological quality, and the quality of reporting of available pediatric CGs for the management of headache in children. We also studied the variability in responses related to the characteristics of eleven Italian neuropediatric centers, showing similarities and differences in the main recommendations reported in CGs.Methods: A systematic literature search was conducted from January 2002 to June 2013 on Mediline, the Cochrane database, the National Guideline Clearinghouse website and the NHS evidence search tool, using the following terms: headache, cephalalgia, guidelines and children (MESH or text words). Six CGs providing information on the diagnosis and management of headache and specific recommendations for children were selected. Eleven neuropediatric centers assessed the overall quality and the appropriateness of all available CGs using of the AGREE II instrument.Results: Six CGs meeting the inclusion and exclusion criteria were identified and assessed by 11 reviewers. Our study showed that the NICE CGs was “strongly recommended” while the French and Danish CGs were mainly “not recommended”. The comparison between the overall quality score of the French CGs and the NICE CGs was statistically significant (6.54 ± 0.69 vs 4.18 ± 1.08; p =0.001). The correlation analysis between quality domain score and guideline publication date showed a statistically significant association only for the “editorial independence” domain (r = 0.842 p = 0.035). The intra-class coefficients showed that the 11 reviewers had the highest agreement for the Lewis CGs (r = 0.857), and the lowest one for the NICE CGs (r = 0.656). Statistical analyses showed that professionals from outpatient services dedicated pediatric headache assigned a higher overall quality score to the NICE CGs as compared to professionals from non-outpatient services (6.86 ± 0.38 vs 6.0 ± 0.82; p = 0.038).Conclusions: CGs resulted definitely of low-moderate quality and non “homogeneous”. Further major efforts are needed to update the existing CGs according to the principles of evidence based medicine.",
keywords = "Agree II instrument, Children, Guidelines, Pediatric headache, Quality of guidelines",
author = "Pasquale Parisi and Nicola Vanacore and Vincenzo Belcastro and Marco Carotenuto and Giudice, {Ennio Del} and Rosanna Mariani and Laura Papetti and Piero Pavone and Salvatore Savasta and Pasquale Striano and Irene Toldo and Elisabetta Tozzi and Alberto Verrotti and Umberto Raucci",
year = "2014",
doi = "10.1186/1129-2377-15-57",
language = "English",
volume = "15",
journal = "Journal of Headache and Pain",
issn = "1129-2369",
publisher = "BioMed Central Ltd.",
number = "1",

}

TY - JOUR

T1 - Clinical guidelines in pediatric headache

T2 - evaluation of quality using the AGREE II instrument

AU - Parisi, Pasquale

AU - Vanacore, Nicola

AU - Belcastro, Vincenzo

AU - Carotenuto, Marco

AU - Giudice, Ennio Del

AU - Mariani, Rosanna

AU - Papetti, Laura

AU - Pavone, Piero

AU - Savasta, Salvatore

AU - Striano, Pasquale

AU - Toldo, Irene

AU - Tozzi, Elisabetta

AU - Verrotti, Alberto

AU - Raucci, Umberto

PY - 2014

Y1 - 2014

N2 - Background: The Appraisal of Guidelines for Research and Evaluation (AGREE II) tool is a validated questionnaire used to assess the methodological quality of clinical guidelines (CGs). We used the AGREE II tool to assess the development process, the methodological quality, and the quality of reporting of available pediatric CGs for the management of headache in children. We also studied the variability in responses related to the characteristics of eleven Italian neuropediatric centers, showing similarities and differences in the main recommendations reported in CGs.Methods: A systematic literature search was conducted from January 2002 to June 2013 on Mediline, the Cochrane database, the National Guideline Clearinghouse website and the NHS evidence search tool, using the following terms: headache, cephalalgia, guidelines and children (MESH or text words). Six CGs providing information on the diagnosis and management of headache and specific recommendations for children were selected. Eleven neuropediatric centers assessed the overall quality and the appropriateness of all available CGs using of the AGREE II instrument.Results: Six CGs meeting the inclusion and exclusion criteria were identified and assessed by 11 reviewers. Our study showed that the NICE CGs was “strongly recommended” while the French and Danish CGs were mainly “not recommended”. The comparison between the overall quality score of the French CGs and the NICE CGs was statistically significant (6.54 ± 0.69 vs 4.18 ± 1.08; p =0.001). The correlation analysis between quality domain score and guideline publication date showed a statistically significant association only for the “editorial independence” domain (r = 0.842 p = 0.035). The intra-class coefficients showed that the 11 reviewers had the highest agreement for the Lewis CGs (r = 0.857), and the lowest one for the NICE CGs (r = 0.656). Statistical analyses showed that professionals from outpatient services dedicated pediatric headache assigned a higher overall quality score to the NICE CGs as compared to professionals from non-outpatient services (6.86 ± 0.38 vs 6.0 ± 0.82; p = 0.038).Conclusions: CGs resulted definitely of low-moderate quality and non “homogeneous”. Further major efforts are needed to update the existing CGs according to the principles of evidence based medicine.

AB - Background: The Appraisal of Guidelines for Research and Evaluation (AGREE II) tool is a validated questionnaire used to assess the methodological quality of clinical guidelines (CGs). We used the AGREE II tool to assess the development process, the methodological quality, and the quality of reporting of available pediatric CGs for the management of headache in children. We also studied the variability in responses related to the characteristics of eleven Italian neuropediatric centers, showing similarities and differences in the main recommendations reported in CGs.Methods: A systematic literature search was conducted from January 2002 to June 2013 on Mediline, the Cochrane database, the National Guideline Clearinghouse website and the NHS evidence search tool, using the following terms: headache, cephalalgia, guidelines and children (MESH or text words). Six CGs providing information on the diagnosis and management of headache and specific recommendations for children were selected. Eleven neuropediatric centers assessed the overall quality and the appropriateness of all available CGs using of the AGREE II instrument.Results: Six CGs meeting the inclusion and exclusion criteria were identified and assessed by 11 reviewers. Our study showed that the NICE CGs was “strongly recommended” while the French and Danish CGs were mainly “not recommended”. The comparison between the overall quality score of the French CGs and the NICE CGs was statistically significant (6.54 ± 0.69 vs 4.18 ± 1.08; p =0.001). The correlation analysis between quality domain score and guideline publication date showed a statistically significant association only for the “editorial independence” domain (r = 0.842 p = 0.035). The intra-class coefficients showed that the 11 reviewers had the highest agreement for the Lewis CGs (r = 0.857), and the lowest one for the NICE CGs (r = 0.656). Statistical analyses showed that professionals from outpatient services dedicated pediatric headache assigned a higher overall quality score to the NICE CGs as compared to professionals from non-outpatient services (6.86 ± 0.38 vs 6.0 ± 0.82; p = 0.038).Conclusions: CGs resulted definitely of low-moderate quality and non “homogeneous”. Further major efforts are needed to update the existing CGs according to the principles of evidence based medicine.

KW - Agree II instrument

KW - Children

KW - Guidelines

KW - Pediatric headache

KW - Quality of guidelines

UR - http://www.scopus.com/inward/record.url?scp=84919884610&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84919884610&partnerID=8YFLogxK

U2 - 10.1186/1129-2377-15-57

DO - 10.1186/1129-2377-15-57

M3 - Article

C2 - 25178699

AN - SCOPUS:84919884610

VL - 15

JO - Journal of Headache and Pain

JF - Journal of Headache and Pain

SN - 1129-2369

IS - 1

ER -