Artificial Hallucinations in ChatGPT: Implications in Scientific Writing
- PMID: 36811129
- PMCID: PMC9939079
- DOI: 10.7759/cureus.35179
Artificial Hallucinations in ChatGPT: Implications in Scientific Writing
Abstract
While still in its infancy, ChatGPT (Generative Pretrained Transformer), introduced in November 2022, is bound to hugely impact many industries, including healthcare, medical education, biomedical research, and scientific writing. Implications of ChatGPT, that new chatbot introduced by OpenAI on academic writing, is largely unknown. In response to the Journal of Medical Science (Cureus) Turing Test - call for case reports written with the assistance of ChatGPT, we present two cases one of homocystinuria-associated osteoporosis, and the other is on late-onset Pompe disease (LOPD), a rare metabolic disorder. We tested ChatGPT to write about the pathogenesis of these conditions. We documented the positive, negative, and rather troubling aspects of our newly introduced chatbot's performance.
Keywords: artificial intelligence and education; artificial intelligence and writing; artificial intelligence in medicine; chatbot; chatgpt.
Copyright © 2023, Alkaissi et al.
Conflict of interest statement
The authors have declared that no competing interests exist.
Figures
![Figure 1](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/9939079/bin/cureus-0015-00000035179-i01.gif)
![Figure 2](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/9939079/bin/cureus-0015-00000035179-i02.gif)
![Figure 3](https://www.ncbi.nlm.nih.gov/pmc/articles/instance/9939079/bin/cureus-0015-00000035179-i03.gif)
Similar articles
-
The Revival of Essay-Type Questions in Medical Education: Harnessing Artificial Intelligence and Machine Learning.J Coll Physicians Surg Pak. 2024 May;34(5):595-599. doi: 10.29271/jcpsp.2024.05.595. J Coll Physicians Surg Pak. 2024. PMID: 38720222
-
ChatGPT: ethical concerns and challenges in academics and research.J Infect Dev Ctries. 2023 Sep 30;17(9):1292-1299. doi: 10.3855/jidc.18738. J Infect Dev Ctries. 2023. PMID: 37824352
-
Utilizing ChatGPT in clinical research related to anesthesiology: a comprehensive review of opportunities and limitations.Anesth Pain Med (Seoul). 2023 Jul;18(3):244-251. doi: 10.17085/apm.23056. Epub 2023 Jul 26. Anesth Pain Med (Seoul). 2023. PMID: 37691594 Free PMC article. Review.
-
ChatGPT for Future Medical and Dental Research.Cureus. 2023 Apr 8;15(4):e37285. doi: 10.7759/cureus.37285. eCollection 2023 Apr. Cureus. 2023. PMID: 37168166 Free PMC article. Review.
-
Generative artificial intelligence: Can ChatGPT write a quality abstract?Emerg Med Australas. 2023 Oct;35(5):809-811. doi: 10.1111/1742-6723.14233. Epub 2023 May 4. Emerg Med Australas. 2023. PMID: 37142327 Free PMC article.
Cited by
-
Transforming Virtual Healthcare: The Potentials of ChatGPT-4omni in Telemedicine.Cureus. 2024 May 30;16(5):e61377. doi: 10.7759/cureus.61377. eCollection 2024 May. Cureus. 2024. PMID: 38817799 Free PMC article.
-
Evidence-Based Learning Strategies in Medicine Using AI.JMIR Med Educ. 2024 May 24;10:e54507. doi: 10.2196/54507. JMIR Med Educ. 2024. PMID: 38801706 Free PMC article.
-
Evaluating the accuracy of Chat Generative Pre-trained Transformer version 4 (ChatGPT-4) responses to United States Food and Drug Administration (FDA) frequently asked questions about dental amalgam.BMC Oral Health. 2024 May 24;24(1):605. doi: 10.1186/s12903-024-04358-8. BMC Oral Health. 2024. PMID: 38789962 Free PMC article.
-
Art or Artifact: Evaluating the Accuracy, Appeal, and Educational Value of AI-Generated Imagery in DALL·E 3 for Illustrating Congenital Heart Diseases.J Med Syst. 2024 May 23;48(1):54. doi: 10.1007/s10916-024-02072-0. J Med Syst. 2024. PMID: 38780839
-
Evaluating ChatGPT-4's historical accuracy: a case study on the origins of SWOT analysis.Front Artif Intell. 2024 May 3;7:1402047. doi: 10.3389/frai.2024.1402047. eCollection 2024. Front Artif Intell. 2024. PMID: 38765634 Free PMC article.
References
-
- Survey of hallucination in natural language generation. Ji Z, Lee N, Frieske R, et al. ACM Comput Surv. 2022
-
- Abstracts written by ChatGPT fool scientists. [Preprint] Gao CA, Howard FM, Nikolay S. bioRxiv. 2022
-
- Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. [Preprint] Kung TH, Cheatham M, ChatGPT ChatGPT, et al. medRxiv. 2022
-
- ChatGPT listed as author on research papers: many scientists disapprove. Stokel-Walker C. Nature. 2023;613:620–621. - PubMed
Publication types
LinkOut - more resources
Full Text Sources
Miscellaneous