Large Language Model-Assisted Risk-of-Bias Assessment in Randomized Controlled Trials Using the Revised Risk-of-Bias Tool: Usability Study.

Journal: Journal of medical Internet research
Published Date: Jun 24, 2025

Abstract

BACKGROUND: The revised Risk-of-Bias tool (RoB2) overcomes the limitations of its predecessor but introduces new implementation challenges. Studies demonstrate low interrater reliability and substantial time requirements for RoB2 implementation. Large language models (LLMs) may assist in RoB2 implementation, although their effectiveness remains uncertain.

Authors

  • Jiajie Huang
    Department of Emergency Medicine, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, Zhenjiang Province, China.
  • Honghao Lai
    Department of Health Policy and Health Management, School of Public Health, Lanzhou University, Lanzhou, China.
  • Weilong Zhao
    Department of Health Policy and Health Management, School of Public Health, Lanzhou University, Lanzhou, China.
  • Danni Xia
    Department of Health Policy and Health Management, School of Public Health, Lanzhou University, Lanzhou, China.
  • Chunyang Bai
    School of Nursing, Southern Medical University, Guangzhou, China.
  • Mingyao Sun
    School of Nursing, Peking University, Beijing, China.
  • Jianing Liu
    Department of Biomedical Engineering, College of Electrical Engineering, Yanshan University, Qinhuangdao, Hebei 066004, P.R.China.
  • Jiayi Liu
    Beijing University of Chinese Medicine, China-Japan Friendship Clinical School of Medicine, Beijing, 100029, People's Republic of China.
  • Bei Pan
    Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China.
  • Jinhui Tian
    Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China.
  • Long Ge
    Department of Health Policy and Health Management, School of Public Health, Lanzhou University, Lanzhou, China.

Keywords

External Resources

Popular Topics
Recent Journals