Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
[Preprint]. 2023 Oct 17:arXiv:2306.10070v2.

Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health

Shubo Tian  1 , Qiao Jin  1 , Lana Yeganova  1 , Po-Ting Lai  1 , Qingqing Zhu  1 , Xiuying Chen  2 , Yifan Yang  1 , Qingyu Chen  1 , Won Kim  1 , Donald C Comeau  1 , Rezarta Islamaj  1 , Aadit Kapoor  1 , Xin Gao  2 , Zhiyong Lu  1
Affiliations

Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health

Shubo Tian et al. ArXiv. .

Update in

Abstract

ChatGPT has drawn considerable attention from both the general public and domain experts with its remarkable text generation capabilities. This has subsequently led to the emergence of diverse applications in the field of biomedicine and health. In this work, we examine the diverse applications of large language models (LLMs), such as ChatGPT, in biomedicine and health. Specifically we explore the areas of biomedical information retrieval, question answering, medical text summarization, information extraction, and medical education, and investigate whether LLMs possess the transformative power to revolutionize these tasks or whether the distinct complexities of biomedical domain presents unique challenges. Following an extensive literature survey, we find that significant advances have been made in the field of text generation tasks, surpassing the previous state-of-the-art methods. For other applications, the advances have been modest. Overall, LLMs have not yet revolutionized biomedicine, but recent rapid progress indicates that such methods hold great potential to provide valuable means for accelerating discovery and improving health. We also find that the use of LLMs, like ChatGPT, in the fields of biomedicine and health entails various risks and challenges, including fabricated information in its generated responses, as well as legal and privacy concerns associated with sensitive patient data. We believe this survey can provide a comprehensive and timely overview to biomedical researchers and healthcare practitioners on the opportunities and challenges associated with using ChatGPT and other LLMs for transforming biomedicine and health.

Keywords: ChatGPT; biomedicine and health; generative AI; large language model; opportunities and challenges.

PubMed Disclaimer

Figures

Figure 1.
Figure 1.
The paradigm of LLMs. Pre-training: LLMs are trained on large scale corpus using autoregressive language model; Instruction Fine-tuning: pre-trained LLMs are fine-tuned on a dataset of human-written demonstrations of the desired output behavior on prompts using supervised learning; RLHF Fine-tuning: a reward model is trained using collected comparison data, then the supervised model is further fine-tuned against the reward model using reinforcement learning algorithm.
Figure 2.
Figure 2.
Performance of LLMs vs. human on the MedQA (USMLE) dataset in terms of accuracy.
See this image and copyright information in PMC

Similar articles

See all similar articles

References

    1. OpenAI. Introducing ChatGPT. 2022.
    1. OpenAI. GPT-4 Technical Report. 2023.
    1. Bommasani R., et al., On the Opportunities and Risks of Foundation Models. 2022. - PMC - PubMed
    1. Shin H.-C., et al., BioMegatron: Larger Biomedical Domain Language Model. 2020.
    1. Yang X., et al., GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records. 2022.

Publication types

LinkOut - more resources

-