Do online information retrieval systems help experienced clinicians answer clinical questions?
- PMID: 15684126
- PMCID: PMC1090463
- DOI: 10.1197/jamia.M1717
Do online information retrieval systems help experienced clinicians answer clinical questions?
Abstract
Objective: To assess the impact of clinicians' use of an online information retrieval system on their performance in answering clinical questions.
Design: Pre-/post-intervention experimental design.
Measurements: In a computer laboratory, 75 clinicians (26 hospital-based doctors, 18 family practitioners, and 31 clinical nurse consultants) provided 600 answers to eight clinical scenarios before and after the use of an online information retrieval system. We examined the proportion of correct answers pre- and post-intervention, direction of change in answers, and differences between professional groups.
Results: System use resulted in a 21% improvement in clinicians' answers, from 29% (95% confidence interval [CI] 25.4-32.6) correct pre- to 50% (95% CI 46.0-54.0) post-system use. In 33% (95% CI 29.1-36.9) answers were changed from incorrect to correct. In 21% (95% CI 17.1-23.9) correct pre-test answers were supported by evidence found using the system, and in 7% (95% CI 4.9-9.1) correct pre-test answers were changed incorrectly. For 40% (35.4-43.6) of scenarios, incorrect pre-test answers were not rectified following system use. Despite significant differences in professional groups' pre-test scores [family practitioners: 41% (95% CI 33.0-49.0), hospital doctors: 35% (95% CI 28.5-41.2), and clinical nurse consultants: 17% (95% CI 12.3-21.7; chi(2) = 29.0, df = 2, p < 0.01)], there was no difference in post-test scores. (chi(2) = 2.6, df = 2, p = 0.73).
Conclusions: The use of an online information retrieval system was associated with a significant improvement in the quality of answers provided by clinicians to typical clinical problems. In a small proportion of cases, use of the system produced errors. While there was variation in the performance of clinical groups when answering questions unaided, performance did not differ significantly following system use. Online information retrieval systems can be an effective tool in improving the accuracy of clinicians' answers to clinical questions.
Similar articles
-
Clinical questions raised by clinicians at the point of care: a systematic review.JAMA Intern Med. 2014 May;174(5):710-8. doi: 10.1001/jamainternmed.2014.368. JAMA Intern Med. 2014. PMID: 24663331 Review.
-
Comparing the use of an online expert health network against common information sources to answer health questions.J Med Internet Res. 2012 Feb 2;14(1):e9. doi: 10.2196/jmir.1886. J Med Internet Res. 2012. PMID: 22356848 Free PMC article. Review.
-
Clinical decision velocity is increased when meta-search filters enhance an evidence retrieval system.J Am Med Inform Assoc. 2008 Sep-Oct;15(5):638-46. doi: 10.1197/jamia.M2765. Epub 2008 Jun 25. J Am Med Inform Assoc. 2008. PMID: 18579828 Free PMC article. Clinical Trial.
-
Effectiveness of clinician-selected electronic information resources for answering primary care physicians' information needs.J Am Med Inform Assoc. 2006 Nov-Dec;13(6):653-9. doi: 10.1197/jamia.M2087. Epub 2006 Aug 23. J Am Med Inform Assoc. 2006. PMID: 16929042 Free PMC article.
-
The impact of an online evidence system on confidence in decision making in a controlled setting.Med Decis Making. 2005 Mar-Apr;25(2):178-85. doi: 10.1177/0272989X05275155. Med Decis Making. 2005. PMID: 15800302
Cited by
-
Investigating the role of internet-based educational application in the dental sciences.Heliyon. 2023 Dec 13;10(1):e23643. doi: 10.1016/j.heliyon.2023.e23643. eCollection 2024 Jan 15. Heliyon. 2023. PMID: 38173526 Free PMC article.
-
Cluster-randomized implementation trial of two facilitation strategies to implement a novel information and communications technology at the Veterans Health Administration.Implement Sci. 2024 Jan 2;19(1):1. doi: 10.1186/s13012-023-01329-5. Implement Sci. 2024. PMID: 38166974 Free PMC article.
-
How searching under time pressure impacts clinical decision making.J Med Libr Assoc. 2020 Oct 1;108(4):564-573. doi: 10.5195/jmla.2020.915. J Med Libr Assoc. 2020. PMID: 33013213 Free PMC article.
-
Evaluating the Impact of the Grading and Assessment of Predictive Tools Framework on Clinicians and Health Care Professionals' Decisions in Selecting Clinical Predictive Tools: Randomized Controlled Trial.J Med Internet Res. 2020 Jul 9;22(7):e15770. doi: 10.2196/15770. J Med Internet Res. 2020. PMID: 32673228 Free PMC article. Clinical Trial.
-
Impact of a Search Engine on Clinical Decisions Under Time and System Effectiveness Constraints: Research Protocol.JMIR Res Protoc. 2019 May 28;8(5):e12803. doi: 10.2196/12803. JMIR Res Protoc. 2019. PMID: 31140437 Free PMC article.
References
-
- Lindberg D, Siegal E, Rapp B, Wallingford K, Wilson S. Use of MEDLINE by physicians for clinical problem solving. JAMA. 1993;269:3124–9. - PubMed
-
- Haynes R, McKibbon K, Walker C, Ryan N, Fitzgerald D, Ramsden M. Online access to MEDLINE in clinical settings. A study of use and usefulness. Ann Intern Med. 1990;112:78–84. - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Miscellaneous