Factors associated with success in searching MEDLINE and applying evidence to answer clinical questions
- PMID: 11971889
- PMCID: PMC344588
- DOI: 10.1197/jamia.m0996
Factors associated with success in searching MEDLINE and applying evidence to answer clinical questions
Abstract
Objectives: This study sought to assess the ability of medical and nurse practitioner students to use MEDLINE to obtain evidence for answering clinical questions and to identify factors associated with the successful answering of questions.
Methods: A convenience sample of medical and nurse practitioner students was recruited. After completing instruments measuring demographic variables, computer and searching attitudes and experience, and cognitive traits, the subjects were given a brief orientation to MEDLINE searching and the techniques of evidence-based medicine. The subjects were then given 5 questions (from a pool of 20) to answer in two sessions using the Ovid MEDLINE system and the Oregon Health & Science University library collection. Each question was answered using three possible responses that reflected the quality of the evidence. All actions capable of being logged by the Ovid system were captured. Statistical analysis was performed using a model based on generalized estimating equations. The relevance-based measures of recall and precision were measured by defining end queries and having relevance judgments made by physicians who were not associated with the study.
Results: Forty-five medical and 21 nurse practitioner students provided usable answers to 324 questions. The rate of correctness increased from 32.3 to 51.6 percent for medical students and from 31.7 to 34.7 percent for nurse practitioner students. Ability to answer questions correctly was most strongly associated with correctness of the answer before searching, user experience with MEDLINE features, the evidence-based medicine question type, and the spatial visualization score. The spatial visualization score showed multi-colinearity with student type (medical vs. nurse practitioner). Medical and nurse practitioner students obtained comparable recall and precision, neither of which was associated with correctness of the answer.
Conclusions: Medical and nurse practitioner students in this study were at best moderately successful at answering clinical questions correctly with the assistance of literature searching. The results confirm the importance of evaluating both search ability and the ability to use the resulting information to accomplish a clinical task.
Similar articles
-
Nurse practitioners and physician assistants in the intensive care unit: an evidence-based review.Crit Care Med. 2008 Oct;36(10):2888-97. doi: 10.1097/CCM.0b013e318186ba8c. Crit Care Med. 2008. PMID: 18766097 Review.
-
Impact of web searching and social feedback on consumer decision making: a prospective online experiment.J Med Internet Res. 2008 Jan 22;10(1):e2. doi: 10.2196/jmir.963. J Med Internet Res. 2008. PMID: 18244893 Free PMC article.
-
Experiential curriculum improves medical students' ability to answer clinical questions using the internet.Fam Med. 2005 Sep;37(8):565-9. Fam Med. 2005. PMID: 16145634
-
Factors associated with successful answering of clinical questions using an information retrieval system.Bull Med Libr Assoc. 2000 Oct;88(4):323-31. Bull Med Libr Assoc. 2000. PMID: 11055299 Free PMC article.
-
The art and science of searching MEDLINE to answer clinical questions. Finding the right number of articles.Int J Technol Assess Health Care. 1999 Spring;15(2):281-96. Int J Technol Assess Health Care. 1999. PMID: 10507188 Review.
Cited by
-
SentiMedQAer: A Transfer Learning-Based Sentiment-Aware Model for Biomedical Question Answering.Front Neurorobot. 2022 Mar 10;16:773329. doi: 10.3389/fnbot.2022.773329. eCollection 2022. Front Neurorobot. 2022. PMID: 35360832 Free PMC article.
-
Search like an expert: Reducing expertise disparity using a hybrid neural index for COVID-19 queries.J Biomed Inform. 2022 Mar;127:104005. doi: 10.1016/j.jbi.2022.104005. Epub 2022 Feb 8. J Biomed Inform. 2022. PMID: 35144000 Free PMC article.
-
A Light-Weight Text Summarization System for Fast Access to Medical Evidence.Front Digit Health. 2020 Dec 4;2:585559. doi: 10.3389/fdgth.2020.585559. eCollection 2020. Front Digit Health. 2020. PMID: 34713057 Free PMC article.
-
A comparative analysis of system features used in the TREC-COVID information retrieval challenge.J Biomed Inform. 2021 May;117:103745. doi: 10.1016/j.jbi.2021.103745. Epub 2021 Apr 6. J Biomed Inform. 2021. PMID: 33831536 Free PMC article.
-
Physiotherapists' Use of Web-Based Information Resources to Fulfill Their Information Needs During a Theoretical Examination: Randomized Crossover Trial.J Med Internet Res. 2020 Dec 17;22(12):e19747. doi: 10.2196/19747. J Med Internet Res. 2020. PMID: 33331826 Free PMC article. Clinical Trial.
References
-
- Hersh WR, Hickam DH. How well do physicians use electronic information retrieval systems? A framework for investigation and review of the literature. JAMA. 1998;280:1347–52. - PubMed
-
- Swanson DR. Historical note: Information retrieval and the future of an illusion. J Am Soc Inf Sci. 1988;39:92–8.
-
- Harter SP. Psychological relevance and information science. J Am Soc Inf Sci. 1992;43:602–15.
-
- Hersh WR. Relevance and retrieval evaluation: perspectives from medicine. J Am Soc Inf Sci. 1994;45:201–6.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources