PMC-LLaMA: toward building open-source language models for medicine.

Journal: Journal of the American Medical Informatics Association : JAMIA
Published Date:

Abstract

OBJECTIVE: Recently, large language models (LLMs) have showcased remarkable capabilities in natural language understanding. While demonstrating proficiency in everyday conversations and question-answering (QA) situations, these models frequently struggle in domains that require precision, such as medical applications, due to their lack of domain-specific knowledge. In this article, we describe the procedure for building a powerful, open-source language model specifically designed for medicine applications, termed as PMC-LLaMA.

Authors

  • Chaoyi Wu
    Cooperative Medianet Innovation Center (CMIC), Shanghai Jiao Tong University, Shanghai, 200240, China.
  • Weixiong Lin
    Cooperative Medianet Innovation Center (CMIC), Shanghai Jiao Tong University, Shanghai, 200240, China.
  • Xiaoman Zhang
    Department of Neurology, The First Hospital of Hebei Medical University, Shijiazhuang, Hebei, China.
  • Ya Zhang
    Department of Plant Protection, College of Plant Protection, Hunan Agricultural University, Changsha, China. Electronic address: zhangya230@126.com.
  • Weidi Xie
    Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, United Kingdom; Visual Geometry Group, Department of Engineering Science, University of Oxford, United Kingdom. Electronic address: weidi.xie@eng.ox.ac.uk.
  • Yanfeng Wang