The role of large language models in the peer-review process: opportunities and challenges for medical journal reviewers and editors.

Journal: Journal of educational evaluation for health professions
PMID:

Abstract

The peer review process ensures the integrity of scientific research. This is particularly important in the medical field, where research findings directly impact patient care. However, the rapid growth of publications has strained reviewers, causing delays and potential declines in quality. Generative artificial intelligence, especially large language models (LLMs) such as ChatGPT, may assist researchers with efficient, high-quality reviews. This review explores the integration of LLMs into peer review, highlighting their strengths in linguistic tasks and challenges in assessing scientific validity, particularly in clinical medicine. Key points for integration include initial screening, reviewer matching, feedback support, and language review. However, implementing LLMs for these purposes will necessitate addressing biases, privacy concerns, and data confidentiality. We recommend using LLMs as complementary tools under clear guidelines to support, not replace, human expertise in maintaining rigorous peer review standards.

Authors

  • Jisoo Lee
    Department of Radiology, Seoul National University College of Medicine, Seoul, Republic of Korea.
  • Jieun Lee
    Department of Pediatrics, Inje University College of Medicine, Ilsan Paik Hospital, Goyang, Republic of Korea.
  • Jeong-Ju Yoo
    Division of Gastroenterology and Hepatology, Department of Internal Medicine, Soonchunhyang University Bucheon Hospital, Bucheon, Korea.