Poor description of non-pharmacological interventions: analysis of consecutive sample of randomised trials
- PMID: 24021722
- PMCID: PMC3768250
- DOI: 10.1136/bmj.f3755
Poor description of non-pharmacological interventions: analysis of consecutive sample of randomised trials
Abstract
Objectives: To evaluate the completeness of descriptions of non-pharmacological interventions in randomised trials, identify which elements are most frequently missing, and assess whether authors can provide missing details.
Design: Analysis of consecutive sample of randomised trials of non-pharmacological interventions.
Data sources and study selection: All reports of randomised trials of non-pharmacological interventions published in 2009 in six leading general medical journals; 133 trial reports, with 137 interventions, met the inclusion criteria.
Data collection: Using an eight item checklist, two raters assessed the primary full trial report, plus any reference materials, appendices, or websites. Questions about missing details were emailed to corresponding authors, and relevant items were then reassessed.
Results: Of 137 interventions, only 53 (39%) were adequately described; this was increased to 81 (59%) by using 63 responses from 88 contacted authors. The most frequently missing item was the "intervention materials" (47% complete), but it also improved the most after author response (92% complete). Whereas some authors (27/70) provided materials or further information, other authors (21/70) could not; their reasons included copyright or intellectual property concerns, not having the materials or intervention details, or being unaware of their importance. Although 46 (34%) trial interventions had further information or materials readily available on a website, many were not mentioned in the report, were not freely accessible, or the URL was no longer functioning.
Conclusions: Missing essential information about interventions is a frequent, yet remediable, contributor to the worldwide waste in research funding. If trial reports do not have a sufficient description of interventions, other researchers cannot build on the findings, and clinicians and patients cannot reliably implement useful interventions. Improvement will require action by funders, researchers, and publishers, aided by long term repositories of materials linked to publications.
Conflict of interest statement
Competing interests: All authors have completed the ICMJE uniform disclosure form at
Figures
![None](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/4793377/bin/hoft011296.f1_default.gif)
![None](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/4793377/bin/hoft011296.f2_default.gif)
![None](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/4793377/bin/hoft011296.f3_default.gif)
Comment in
-
Descriptions of non-pharmacological interventions in clinical trials.BMJ. 2013 Sep 11;347:f5212. doi: 10.1136/bmj.f5212. BMJ. 2013. PMID: 24026465 No abstract available.
Similar articles
-
The future of Cochrane Neonatal.Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
-
Do we really know what they were testing? Incomplete reporting of interventions in randomised trials of upper limb therapies in unilateral cerebral palsy.Res Dev Disabil. 2016 Dec;59:417-427. doi: 10.1016/j.ridd.2016.09.018. Epub 2016 Oct 11. Res Dev Disabil. 2016. PMID: 27736712
-
Completeness of the reporting of evidence-based practice educational interventions: a review.Med Educ. 2018 Feb;52(2):161-170. doi: 10.1111/medu.13410. Epub 2017 Nov 2. Med Educ. 2018. PMID: 29098706 Review.
-
How completely are physiotherapy interventions described in reports of randomised trials?Physiotherapy. 2016 Jun;102(2):121-6. doi: 10.1016/j.physio.2016.03.001. Epub 2016 Mar 12. Physiotherapy. 2016. PMID: 27033780 Review.
-
The Completeness of Intervention Descriptions in Randomised Trials of Supervised Exercise Training in Peripheral Arterial Disease.PLoS One. 2016 Mar 3;11(3):e0150869. doi: 10.1371/journal.pone.0150869. eCollection 2016. PLoS One. 2016. PMID: 26938879 Free PMC article. Review.
Cited by
-
Effective interventions in preventing gestational diabetes mellitus: A systematic review and meta-analysis.Commun Med (Lond). 2024 Apr 20;4(1):75. doi: 10.1038/s43856-024-00491-1. Commun Med (Lond). 2024. PMID: 38643248 Free PMC article.
-
Physical activity interventions in European primary schools: a scoping review to create a framework for the design of tailored interventions in European countries.Front Public Health. 2024 Feb 8;12:1321167. doi: 10.3389/fpubh.2024.1321167. eCollection 2024. Front Public Health. 2024. PMID: 38389941 Free PMC article.
-
Region of Attainable Redaction, an extension of Ellipse of Insignificance analysis for gauging impacts of data redaction in dichotomous outcome trials.Elife. 2024 Jan 29;13:e93050. doi: 10.7554/eLife.93050. Elife. 2024. PMID: 38284745 Free PMC article.
-
Pulmonary Rehabilitation with and without a Cognitive Behavioral Intervention for Breathlessness in People Living with Chronic Obstructive Pulmonary Disease: Randomized Controlled Trial.J Clin Med. 2023 Nov 24;12(23):7286. doi: 10.3390/jcm12237286. J Clin Med. 2023. PMID: 38068337 Free PMC article.
-
Completeness of intervention description in invasive cardiology trials: an observational study of ClinicalTrials.gov registry and corresponding publications.Front Med (Lausanne). 2023 Oct 10;10:1276847. doi: 10.3389/fmed.2023.1276847. eCollection 2023. Front Med (Lausanne). 2023. PMID: 37881632 Free PMC article.
References
-
- Aronson JK. Patent medicines and secret remedies. BMJ 2009;339:b5415. - PubMed
-
- Duff JM, Leather H, Walden EO, LaPlant KD, George TJ. Adequacy of published oncology randomized controlled trials to provide therapeutic details needed for clinical application. J Natl Cancer Inst 2010;102:702-5. - PubMed
-
- Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P. Extending the CONSORT statement to randomised trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med 2008;148:295-310. - PubMed
-
- Davidson KW, Goldstein M, Kaplan RM, Kaufmann PG, Knatterud GL, Orleans CT, et al. Evidence-based behavioral medicine: what is it and how do we achieve it? Ann Behav Med 2003;26:161-71. - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous