Vision-language large learning model, GPT4V, accurately classifies the Boston Bowel Preparation Scale score.

Journal: BMJ open gastroenterology
Published Date:

Abstract

INTRODUCTION: Large learning models (LLMs) such as GPT are advanced artificial intelligence (AI) models. Originally developed for natural language processing, they have been adapted for multi-modal tasks with vision-language input. One clinically relevant task is scoring the Boston Bowel Preparation Scale (BBPS). While traditional AI techniques use large amounts of data for training, we hypothesise that vision-language LLM can perform this task with fewer examples.

Authors

  • Daniel Yan Zheng Lim
    3Health Services Research Unit, Singapore General Hospital, Singapore.
  • Yu Bin Tan
    Dept of Gastroenterology and Hepatology, Singapore General Hospital, Singapore.
  • Jonas Ren Yi Ho
    Dept of Gastroenterology and Hepatology, Singapore General Hospital, Singapore.
  • Sushmitha Carkarine
    Dept of Gastroenterology and Hepatology, Singapore General Hospital, Singapore.
  • Tian Wei Valerie Chew
    Dept of Gastroenterology and Hepatology, Singapore General Hospital, Singapore.
  • Yuhe Ke
    Department of Anaesthesiology, Singapore General Hospital, Singapore.
  • Jen Hong Tan
    Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore.
  • Ting Fang Tan
    Singapore National Eye Center, Singapore Eye Research Institute Singapore Health Service Singapore Singapore.
  • Kabilan Elangovan
    Artificial Intelligence and Digital Innovation Research Group, Singapore Eye Research Institute, Singapore.
  • Le Quan
    Data Science and Artificial Intelligence Lab, Singapore General Hospital, Singapore.
  • Li Yuan Jin
    Artificial Intelligence Office, Singapore Health Services Pte Ltd, Singapore.
  • Jasmine Chiat Ling Ong
    Duke-NUS Medical School, Singapore, Singapore.
  • Gerald Gui Ren Sng
    1Department of Endocrinology, Singapore General Hospital, Singapore.
  • Joshua Yi Min Tung
    Data Science and Artificial Intelligence Lab, Singapore General Hospital, Singapore, Singapore.
  • Chee Kiat Tan
    Dept of Gastroenterology and Hepatology, Singapore General Hospital, Singapore.
  • Damien Tan
    Dept of Gastroenterology and Hepatology, Singapore General Hospital, Singapore.