Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Dec;13(4):331-338.
doi: 10.1016/j.afjem.2023.10.001. Epub 2023 Nov 24.

Quality of systematic reviews in African emergency medicine: a cross-sectional methodological study

Affiliations

Quality of systematic reviews in African emergency medicine: a cross-sectional methodological study

J van Niekerk et al. Afr J Emerg Med. 2023 Dec.

Abstract

Introduction: Reliable systematic reviews are essential to inform clinical practice guidelines, policies and further research priorities in Africa. For systematic review findings to be trustworthy, they need to be conducted with methodological rigour and reported transparently. We assessed the methodological quality of systematic reviews published in African emergency medicine journals, comparing them to those published in international emergency medicine journals. Additionally, we describe the types of review literature published in the African journals.

Methods: We performed a cross-sectional methodological study of systematic reviews published in selected African and international emergency medicine journals from 2012 to 2021. Studies were eligible if they were i) a systematic review on an emergency medicine topic, ii) published in one of the top five emergency medicine journals in the African region or internationally and iii) published between January 2012 and December 2021 in English or French. We searched PubMed, Web of Science and Scopus databases and hand-searched selected journals. Two authors screened titles, abstracts and full texts independently and in duplicate. Data extraction was performed by one reviewer, using a standardised form, after completing a calibration exercise. We described the characteristics of systematic reviews and assessed methodological quality using AMSTAR II.

Results: We identified 34 (37%) African and 511 (54%) international systematic reviews from 92 and 948 review articles respectively across 10 journals. We included all 34 African and a random sample of 100 international systematic reviews. Methodological quality was low or critically low for all the African systematic reviews (n=34, 100%) and all but three international systematic reviews (n=97, 97%). The median number of critical domain weaknesses was 4 (IQR 4;5) and 2 (IQR 2;4) for African and international systematic reviews respectively. The most common weaknesses across both African and international systematic reviews were i) not establishing a priori review protocols, ii) unclear selection of study designs iii) not providing a list of excluded studies and iv) unclear reporting on funding sources for included studies.

Conclusion: Emergency medicine systematic reviews published in African and international journals are lacking in methodological quality. Reporting an a priori protocol, developing a comprehensive search strategy, appropriate evidence synthesis and adequate assessment of risk of bias, heterogeneity and evidence certainty may improve the quality of systematic reviews.

Keywords: AMSTAR II; Emergency medicine; Methodological quality; Systematic review.

PubMed Disclaimer

Conflict of interest statement

The authors declare the following financial interests/personal relationships which may be considered as potential competing interests Michael McCaul (MM) is an editor of the African Journal of Emergency Medicine. MM was not involved in the editorial workflow for this manuscript. The African Journal of Emergency Medicine applies a double-blinded process for all manuscript peer reviews. The authors declared no further conflicts of interest.

Figures

Fig 1
Fig. 1
PRISMA flow diagram of included reviews. AEM, Academic Emergency Medicine; AFJEM, African Journal of Emergency Medicine; AJAIC, African Journal of Anaesthesia and Intensive Care; AoEM, Annals of Emergency Medicine; EMI, Emergency Medicine International; SAJCC, Southern African Journal of Critical Care; SAMJ, South African Medical Journal.
Fig 2
Fig. 2
AMSTAR II domain scores for systematic reviews published in African and International journals. *Critical Domains.

Similar articles

References

    1. McCaul M., Tovey D., Young T., Welch V., Dewidar O., Goetghebeur M., Kredo T., Tricco AC., Glover RE., Tufte J., et al. Resources supporting trustworthy, rapid and equitable evidence synthesis and guideline development: results from the COVID-19 evidence network to support decision-making (COVID-END) J Clin Epidemiol. 2022;151:88–95. doi: 10.1016/j.jclinepi.2022.07.008. - DOI - PMC - PubMed
    1. Clarke M., Brice A., Chalmers I. Accumulating research: A systematic account of how cumulative meta-analyses would have provided knowledge, improved health, reduced harm and saved resources. PLoS One. 2014;9(7):1–6. doi: 10.1371/journal.pone.0102670. - DOI - PMC - PubMed
    1. Stewart R., El-Harakeh A., Cherian SA. Evidence synthesis communities in low-income and middle-income countries and the COVID-19 response. Lancet. 2020;396(10262):1539–1541. doi: 10.1016/S0140-6736(20)32141-3. - DOI - PMC - PubMed
    1. Young T., Garner P., Clarke M., Volmink J. Series: clinical epidemiology in South Africa. Paper 1: evidence-based health care and policy in Africa: past, present, and future. J Clin Epidemiol. 2017;83:24–30. doi: 10.1016/j.jclinepi.2016.06.006. - DOI - PubMed
    1. Mould-Millman NK., Dixon J., Burkholder TW., Sefa N., Patel H., Yaffee AQ., Osisanya A., Oyewumi T., Botchey I., Osei-Ampofo M., et al. Fifteen years of emergency medicine literature in Africa: a scoping review. Afr J Emerg Med. 2019;9(1):45–52. doi: 10.1016/j.afjem.2019.01.006. - DOI - PMC - PubMed

LinkOut - more resources

-