Eye-tracking dataset of endoscopist-AI teaming during colonoscopy: Retrospective and real-time acquisition.

Journal: Scientific data
PMID:

Abstract

Recent studies have demonstrated that integrating AI into colonoscopy procedures significantly improves the adenoma detection rate (ADR) and reduces the adenoma miss rate (AMR). However, few studies address the critical issue of endoscopist-AI collaboration in real-world settings. Eye-tracking data collection is considered a promising approach to uncovering how endoscopists and AI interact and influence each other during colonoscopy procedures. A common limitation of existing studies is their reliance on retrospective video clips, which fail to capture the dynamic demands of real-time colonoscopy, where endoscopists must simultaneously navigate the colonoscope and identify lesions on the screen. To address this gap, we established a dataset to analyze changes in endoscopists' eye movements during the colonoscopy withdrawal phase. Eye-tracking data was collected from graduate students, nurses, senior endoscopists, and novice endoscopists while they reviewed retrospectively recorded colonoscopy withdrawal videos, both with and without computer-aided detection (CADe) assistance. Furthermore, 80 real-time video segments were prospectively collected during endoscopists' actual colonoscopy withdrawal procedures, comprising 43 segments with CADe assistance and 37 segments without assistance (normal control).

Authors

  • Yan Zhu
    Department of Chemistry, Xixi Campus, Zhejiang University, Hangzhou, 310028, China. Electronic address: zhuyan@zju.edu.cn.
  • Rui-Jie Yang
    Shanghai Collaborative Innovation Center of Endoscopy, Shanghai, 200032, China.
  • Pei-Yao Fu
    Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University, Shanghai, 200032, China.
  • Zhen Zhang
    School of Pharmacy, Jining Medical University, Rizhao, Shandong, China.
  • Yi-Zhe Zhang
    School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, 210094, China.
  • Quan-Lin Li
    Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University, Shanghai, China.
  • Shuo Wang
    College of Tea & Food Science, Anhui Agricultural University, Hefei, China.
  • Ping-Hong Zhou
    Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University, Shanghai, China.