Google Scholar is not enough to be used alone for systematic reviews
- PMID: 23923099
- PMCID: PMC3733758
- DOI: 10.5210/ojphi.v5i2.4623
Google Scholar is not enough to be used alone for systematic reviews
Abstract
Background: Google Scholar (GS) has been noted for its ability to search broadly for important references in the literature. Gehanno et al. recently examined GS in their study: 'Is Google scholar enough to be used alone for systematic reviews?' In this paper, we revisit this important question, and some of Gehanno et al.'s other findings in evaluating the academic search engine.
Methods: The authors searched for a recent systematic review (SR) of comparable size to run search tests similar to those in Gehanno et al. We selected Chou et al. (2013) contacting the authors for a list of publications they found in their SR on social media in health. We queried GS for each of those 506 titles (in quotes ""), one by one. When GS failed to retrieve a paper, or produced too many results, we used the allintitle: command to find papers with the same title.
Results: Google Scholar produced records for ~95% of the papers cited by Chou et al. (n=476/506). A few of the 30 papers that were not in GS were later retrieved via PubMed and even regular Google Search. But due to its different structure, we could not run searches in GS that were originally performed by Chou et al. in PubMed, Web of Science, Scopus and PsycINFO®. Identifying 506 papers in GS was an inefficient process, especially for papers using similar search terms.
Conclusions: Has Google Scholar improved enough to be used alone in searching for systematic reviews? No. GS' constantly-changing content, algorithms and database structure make it a poor choice for systematic reviews. Looking for papers when you know their titles is a far different issue from discovering them initially. Further research is needed to determine when and how (and for what purposes) GS can be used alone. Google should provide details about GS' database coverage and improve its interface (e.g., with semantic search filters, stored searching, etc.). Perhaps then it will be an appropriate choice for systematic reviews.
Keywords: MeSH Keywords: Google Scholar; PubMed; information retrieval; searching; systematic reviews.
Similar articles
-
The comparative recall of Google Scholar versus PubMed in identical searches for biomedical systematic reviews: a review of searches used in systematic reviews.Syst Rev. 2013 Dec 23;2:115. doi: 10.1186/2046-4053-2-115. Syst Rev. 2013. PMID: 24360284 Free PMC article.
-
The Role of Google Scholar in Evidence Reviews and Its Applicability to Grey Literature Searching.PLoS One. 2015 Sep 17;10(9):e0138237. doi: 10.1371/journal.pone.0138237. eCollection 2015. PLoS One. 2015. PMID: 26379270 Free PMC article.
-
Comparing the coverage, recall, and precision of searches for 120 systematic reviews in Embase, MEDLINE, and Google Scholar: a prospective study.Syst Rev. 2016 Mar 1;5:39. doi: 10.1186/s13643-016-0215-7. Syst Rev. 2016. PMID: 26932789 Free PMC article.
-
Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study.Syst Rev. 2017 Dec 6;6(1):245. doi: 10.1186/s13643-017-0644-y. Syst Rev. 2017. PMID: 29208034 Free PMC article. Review.
-
Information sources for obesity prevention policy research: a review of systematic reviews.Syst Rev. 2017 Aug 8;6(1):156. doi: 10.1186/s13643-017-0543-2. Syst Rev. 2017. PMID: 28789703 Free PMC article. Review.
Cited by
-
We know very little about pollination in the Platanthera Rich (Orchidaceae: Orchidoideae).Ecol Evol. 2024 Apr 10;14(4):e11223. doi: 10.1002/ece3.11223. eCollection 2024 Apr. Ecol Evol. 2024. PMID: 38606342 Free PMC article. Review.
-
Planning for Play? A Systematic Literature Review.J Plan Lit. 2024 Feb;39(1):25-35. doi: 10.1177/08854122231169228. Epub 2023 Apr 11. J Plan Lit. 2024. PMID: 38332804 Free PMC article.
-
The Role of AI in Serious Games and Gamification for Health: Scoping Review.JMIR Serious Games. 2024 Jan 15;12:e48258. doi: 10.2196/48258. JMIR Serious Games. 2024. PMID: 38224472 Free PMC article. Review.
-
Collaborative learning of new information in older age: a systematic review.R Soc Open Sci. 2023 Oct 4;10(10):211595. doi: 10.1098/rsos.211595. eCollection 2023 Oct. R Soc Open Sci. 2023. PMID: 37800148 Free PMC article.
-
A comprehensive database of amphibian heat tolerance.Sci Data. 2022 Oct 4;9(1):600. doi: 10.1038/s41597-022-01704-9. Sci Data. 2022. PMID: 36195601 Free PMC article.
References
-
- Kousha K, Thelwall M. 2008. Sources of Google Scholar citations outside the Science Citation Index: A comparison between four science disciplines. Scientometrics. 74(2), 273-94 10.1007/s11192-008-0217-x - DOI
-
- Anders ME, Evans DP. 2010. Comparison of PubMed and Google Scholar literature searches. Respir Care. 55(5), 578-83 - PubMed
LinkOut - more resources
Full Text Sources
Other Literature Sources
Research Materials