Abstract
Background: Whether information from clinical trial registries (CTRs) and published randomised controlled trial (RCTs) differs remains unknown. Knowing more about discrepancies should alert those who rely on RCTs for medical decision-making to possible dissemination or reporting bias. To provide help in critically appraising research relevant for clinical practice we sought possible discrepancies between what CTRs record and paediatric RCTs actually publish. For this purpose, after identifying six reporting domains including funding, design, and outcomes, we collected data from 20 consecutive RCTs published in a widely read peer-reviewed paediatric journal and cross-checked reported features with those in the corresponding CTRs. Methods: We collected data for 20 unselected, consecutive paediatric RCTs published in a widely read peer-reviewed journal from July to November 2013. To assess discrepancies, two reviewers identified and scored six reporting domains: funding and conflict of interests; sample size, inclusion and exclusion criteria or crossover; primary and secondary outcomes, early study completion, and main outcome reporting. After applying the Critical Appraisal Skills Programme (CASP) checklist, five reviewer pairs cross-checked CTRs and matching RCTs, then mapped and coded the reporting domains and scored combined discrepancy as low, medium and high. Results: The 20 RCTs were registered in five different CTRs. Even though the 20 RCTs fulfilled the CASP general criteria for assessing internal validity, 19 clinical trials had medium or high combined discrepancy scores for what the 20 RCTs reported and the matched five CTRs stated. All 20 RCTs selectively reported or failed to report main outcomes, 9 had discrepancies in declaring sponsorship, 8 discrepancies in the sample size, 9 failed to respect inclusion or exclusion criteria, 11 downgraded or modified primary outcome or upgraded secondary outcomes, and 13 completed early without justification. The CTRs for seven trials failed to index automatically the URL address or the RCT reference, and for 12 recorded RCT details, but the authors failed to report the results. Conclusions: Major discrepancies between what CTRs record and paediatric RCTs publish raise concern about what clinical trials conclude. Our findings should make clinicians, who rely on RCT results for medical decision-making, aware of dissemination or reporting bias. Trialists need to bring CTR data and reported protocols into line with published data.
| Original language | English |
|---|---|
| Article number | 430 |
| Journal | Trials |
| Volume | 17 |
| Issue number | 1 |
| DOIs | |
| Publication status | Published - Sep 23 2016 |
Fingerprint
Keywords
- Clinical trial registries
- Critical appraisal
- Dissemination bias
- Quality reporting
- Randomised controlled trials
- Reporting bias
- Reporting discrepancies
- Risk of bias
- Selective outcome reporting
ASJC Scopus subject areas
- Medicine (miscellaneous)
- Pharmacology (medical)
Cite this
Major discrepancies between what clinical trial registries record and paediatric randomised controlled trials publish. / Rosati, Paola; Porzsolt, Franz; Ricciotti, Gabriella; Testa, Giuseppina; Inglese, Rita; Giustini, Ferruccio; Fiscarelli, Ersilia; Zazza, Marco; Carlino, Cecilia; Balassone, Valerio; Fiorito, Roberto; D'Amico, Roberto.
In: Trials, Vol. 17, No. 1, 430, 23.09.2016.Research output: Contribution to journal › Article
}
TY - JOUR
T1 - Major discrepancies between what clinical trial registries record and paediatric randomised controlled trials publish
AU - Rosati, Paola
AU - Porzsolt, Franz
AU - Ricciotti, Gabriella
AU - Testa, Giuseppina
AU - Inglese, Rita
AU - Giustini, Ferruccio
AU - Fiscarelli, Ersilia
AU - Zazza, Marco
AU - Carlino, Cecilia
AU - Balassone, Valerio
AU - Fiorito, Roberto
AU - D'Amico, Roberto
PY - 2016/9/23
Y1 - 2016/9/23
N2 - Background: Whether information from clinical trial registries (CTRs) and published randomised controlled trial (RCTs) differs remains unknown. Knowing more about discrepancies should alert those who rely on RCTs for medical decision-making to possible dissemination or reporting bias. To provide help in critically appraising research relevant for clinical practice we sought possible discrepancies between what CTRs record and paediatric RCTs actually publish. For this purpose, after identifying six reporting domains including funding, design, and outcomes, we collected data from 20 consecutive RCTs published in a widely read peer-reviewed paediatric journal and cross-checked reported features with those in the corresponding CTRs. Methods: We collected data for 20 unselected, consecutive paediatric RCTs published in a widely read peer-reviewed journal from July to November 2013. To assess discrepancies, two reviewers identified and scored six reporting domains: funding and conflict of interests; sample size, inclusion and exclusion criteria or crossover; primary and secondary outcomes, early study completion, and main outcome reporting. After applying the Critical Appraisal Skills Programme (CASP) checklist, five reviewer pairs cross-checked CTRs and matching RCTs, then mapped and coded the reporting domains and scored combined discrepancy as low, medium and high. Results: The 20 RCTs were registered in five different CTRs. Even though the 20 RCTs fulfilled the CASP general criteria for assessing internal validity, 19 clinical trials had medium or high combined discrepancy scores for what the 20 RCTs reported and the matched five CTRs stated. All 20 RCTs selectively reported or failed to report main outcomes, 9 had discrepancies in declaring sponsorship, 8 discrepancies in the sample size, 9 failed to respect inclusion or exclusion criteria, 11 downgraded or modified primary outcome or upgraded secondary outcomes, and 13 completed early without justification. The CTRs for seven trials failed to index automatically the URL address or the RCT reference, and for 12 recorded RCT details, but the authors failed to report the results. Conclusions: Major discrepancies between what CTRs record and paediatric RCTs publish raise concern about what clinical trials conclude. Our findings should make clinicians, who rely on RCT results for medical decision-making, aware of dissemination or reporting bias. Trialists need to bring CTR data and reported protocols into line with published data.
AB - Background: Whether information from clinical trial registries (CTRs) and published randomised controlled trial (RCTs) differs remains unknown. Knowing more about discrepancies should alert those who rely on RCTs for medical decision-making to possible dissemination or reporting bias. To provide help in critically appraising research relevant for clinical practice we sought possible discrepancies between what CTRs record and paediatric RCTs actually publish. For this purpose, after identifying six reporting domains including funding, design, and outcomes, we collected data from 20 consecutive RCTs published in a widely read peer-reviewed paediatric journal and cross-checked reported features with those in the corresponding CTRs. Methods: We collected data for 20 unselected, consecutive paediatric RCTs published in a widely read peer-reviewed journal from July to November 2013. To assess discrepancies, two reviewers identified and scored six reporting domains: funding and conflict of interests; sample size, inclusion and exclusion criteria or crossover; primary and secondary outcomes, early study completion, and main outcome reporting. After applying the Critical Appraisal Skills Programme (CASP) checklist, five reviewer pairs cross-checked CTRs and matching RCTs, then mapped and coded the reporting domains and scored combined discrepancy as low, medium and high. Results: The 20 RCTs were registered in five different CTRs. Even though the 20 RCTs fulfilled the CASP general criteria for assessing internal validity, 19 clinical trials had medium or high combined discrepancy scores for what the 20 RCTs reported and the matched five CTRs stated. All 20 RCTs selectively reported or failed to report main outcomes, 9 had discrepancies in declaring sponsorship, 8 discrepancies in the sample size, 9 failed to respect inclusion or exclusion criteria, 11 downgraded or modified primary outcome or upgraded secondary outcomes, and 13 completed early without justification. The CTRs for seven trials failed to index automatically the URL address or the RCT reference, and for 12 recorded RCT details, but the authors failed to report the results. Conclusions: Major discrepancies between what CTRs record and paediatric RCTs publish raise concern about what clinical trials conclude. Our findings should make clinicians, who rely on RCT results for medical decision-making, aware of dissemination or reporting bias. Trialists need to bring CTR data and reported protocols into line with published data.
KW - Clinical trial registries
KW - Critical appraisal
KW - Dissemination bias
KW - Quality reporting
KW - Randomised controlled trials
KW - Reporting bias
KW - Reporting discrepancies
KW - Risk of bias
KW - Selective outcome reporting
UR - http://www.scopus.com/inward/record.url?scp=84992027468&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84992027468&partnerID=8YFLogxK
U2 - 10.1186/s13063-016-1551-6
DO - 10.1186/s13063-016-1551-6
M3 - Article
AN - SCOPUS:84992027468
VL - 17
JO - Trials
JF - Trials
SN - 1745-6215
IS - 1
M1 - 430
ER -