ChatIOS: Improving automatic 3-dimensional tooth segmentation via GPT-4V and multimodal pre-training.

Journal: Journal of dentistry
PMID:

Abstract

OBJECTIVES: This study aims to propose a framework that integrates GPT-4V, a recent advanced version of ChatGPT, and multimodal pre-training techniques to enhance deep learning algorithms for 3-dimensional (3D) tooth segmentation in scans produced by intraoral scanners (IOSs).

Authors

  • Yongjia Wu
    Department of Orthodontics, Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Hangzhou, PR China. Electronic address: yogurtwu@zju.edu.cn.
  • Yun Zhang
    Biology Institute, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China.
  • Yange Wu
    Department of Orthodontics, Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Hangzhou, PR China.
  • Qianhan Zheng
    Department of Orthodontics, Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Hangzhou, PR China.
  • Xiaojun Li
    Jiangsu CM Clinical Innovation Center of Degenerative Bone & Joint Disease, Wuxi TCM Hospital Affiliated to Nanjing University of Chinese Medicine, Wuxi, China.
  • Xuepeng Chen
    Department of Orthodontics, Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Hangzhou, PR China. Electronic address: cxp1979@zju.edu.cn.