Quantifying publication bias in meta-analysis
- PMID: 29141096
- PMCID: PMC5953768
- DOI: 10.1111/biom.12817
Quantifying publication bias in meta-analysis
Abstract
Publication bias is a serious problem in systematic reviews and meta-analyses, which can affect the validity and generalization of conclusions. Currently, approaches to dealing with publication bias can be distinguished into two classes: selection models and funnel-plot-based methods. Selection models use weight functions to adjust the overall effect size estimate and are usually employed as sensitivity analyses to assess the potential impact of publication bias. Funnel-plot-based methods include visual examination of a funnel plot, regression and rank tests, and the nonparametric trim and fill method. Although these approaches have been widely used in applications, measures for quantifying publication bias are seldom studied in the literature. Such measures can be used as a characteristic of a meta-analysis; also, they permit comparisons of publication biases between different meta-analyses. Egger's regression intercept may be considered as a candidate measure, but it lacks an intuitive interpretation. This article introduces a new measure, the skewness of the standardized deviates, to quantify publication bias. This measure describes the asymmetry of the collected studies' distribution. In addition, a new test for publication bias is derived based on the skewness. Large sample properties of the new measure are studied, and its performance is illustrated using simulations and three case studies.
Keywords: Heterogeneity; Meta-analysis; Publication bias; Skewness; Standardized deviate; Statistical power.
© 2017, The International Biometric Society.
Figures
![Figure 1](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/5953768/bin/nihms917284f1.gif)
![Figure 2](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/5953768/bin/nihms917284f2.gif)
Comment in
-
Discussion of "quantifying publication bias in meta-analysis" by Lin et al.Biometrics. 2018 Sep;74(3):797-799. doi: 10.1111/biom.12816. Epub 2017 Nov 15. Biometrics. 2018. PMID: 29141098
-
Discussion on Quantifying publication bias in meta-analysis.Biometrics. 2018 Sep;74(3):795-796. doi: 10.1111/biom.12819. Epub 2017 Nov 15. Biometrics. 2018. PMID: 29141099
-
Rejoinder to "quantifying publication bias in meta-analysis".Biometrics. 2018 Sep;74(3):801-802. doi: 10.1111/biom.12815. Epub 2017 Nov 15. Biometrics. 2018. PMID: 29141108 Free PMC article. No abstract available.
-
Discussion on "Quantifying Publication Bias in Meta-Analysis" by Lin and Chu.Biometrics. 2018 Sep;74(3):800. doi: 10.1111/biom.12818. Epub 2017 Nov 15. Biometrics. 2018. PMID: 29141110 No abstract available.
Similar articles
-
Empirical Comparison of Publication Bias Tests in Meta-Analysis.J Gen Intern Med. 2018 Aug;33(8):1260-1267. doi: 10.1007/s11606-018-4425-7. Epub 2018 Apr 16. J Gen Intern Med. 2018. PMID: 29663281 Free PMC article.
-
A new improved graphical and quantitative method for detecting bias in meta-analysis.Int J Evid Based Healthc. 2018 Dec;16(4):195-203. doi: 10.1097/XEB.0000000000000141. Int J Evid Based Healthc. 2018. PMID: 29621038
-
Quantifying the risk of error when interpreting funnel plots.Syst Rev. 2015 Mar 11;4:24. doi: 10.1186/s13643-015-0004-8. Syst Rev. 2015. PMID: 25875027 Free PMC article.
-
Exploring and accounting for publication bias in mental health: a brief overview of methods.Evid Based Ment Health. 2014 Feb;17(1):11-5. doi: 10.1136/eb-2013-101700. Evid Based Ment Health. 2014. PMID: 24477532 Review.
-
Dissemination and publication of research findings: an updated review of related biases.Health Technol Assess. 2010 Feb;14(8):iii, ix-xi, 1-193. doi: 10.3310/hta14080. Health Technol Assess. 2010. PMID: 20181324 Review.
Cited by
-
Point prevalence of evidence-based antimicrobial use among hospitalized patients in sub-Saharan Africa: a systematic review and meta-analysis.Sci Rep. 2024 Jun 2;14(1):12652. doi: 10.1038/s41598-024-62651-6. Sci Rep. 2024. PMID: 38825623 Free PMC article.
-
A review and comparison of arm-based versus contrast-based network meta-analysis for binary outcomes-Understanding their differences and limitations.Wiley Interdiscip Rev Comput Stat. 2024 Jan-Feb;16(1):e1639. doi: 10.1002/wics.1639. Epub 2023 Nov 21. Wiley Interdiscip Rev Comput Stat. 2024. PMID: 38818353
-
Mortality, morbidity & clinical outcome with different types of vasopressors in out of hospital cardiac arrest patients- a systematic review and meta-analysis.BMC Cardiovasc Disord. 2024 May 30;24(1):283. doi: 10.1186/s12872-024-03962-4. BMC Cardiovasc Disord. 2024. PMID: 38816786 Free PMC article.
-
Level of perceived social support, and associated factors, in combat-exposed (ex-)military personnel: a systematic review and meta-analysis.Soc Psychiatry Psychiatr Epidemiol. 2024 May 21. doi: 10.1007/s00127-024-02685-3. Online ahead of print. Soc Psychiatry Psychiatr Epidemiol. 2024. PMID: 38771350 Review.
-
Safety and Efficacy of Atezolizumab/Bevacizumab in Patients with Hepatocellular Carcinoma and Impaired Liver Function: A Systematic Review and Meta-Analysis.Liver Cancer. 2023 Oct 14;13(3):227-237. doi: 10.1159/000533991. eCollection 2024 Jun. Liver Cancer. 2023. PMID: 38756146 Free PMC article.
References
-
- Altman DG. Poor-quality medical research: what can journals do? JAMA. 2002;287:2765–2767. - PubMed
-
- Antille A, Kersting G, Zucchini W. Testing symmetry. Journal of the American Statistical Association. 1982;77:639–646.
-
- Begg CB, Berlin JA. Publication bias: a problem in interpreting medical data. Journal of the Royal Statistical Society. Series A (Statistics in Society) 1988;151:419–463.
-
- Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50:1088–1101. - PubMed
-
- Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods. 2010;1:97–111. - PubMed
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources