A Comprehensive Video Dataset for Surgical Laparoscopic Action Analysis.

Journal: Scientific data
Published Date:

Abstract

Laparoscopic surgery has been widely used in various surgical fields due to its minimally invasive and rapid recovery benefits. However, it demands a high level of technical expertise from surgeons. While advancements in computer vision and deep learning have significantly contributed to surgical action recognition, the effectiveness of these technologies is hindered by the limitations of existing publicly available datasets, such as their small scale, high homogeneity, and inconsistent labeling quality. To address the above issues, we developed the SLAM dataset (Surgical LAparoscopic Motions), which encompasses various surgical types such as laparoscopic cholecystectomy and appendectomy. The dataset includes annotations for seven key actions: Abdominal Entry, Use Clip, Hook Cut, Suturing, Panoramic View, Local Panoramic View, and Suction. In total, it includes 4,097 video clips, each labeled with corresponding action categories. In addition, we comprehensively validated the dataset using the ViViT model, and the experimental results showed that the dataset exhibited superior training and testing capabilities in laparoscopic surgical action recognition, with the highest classification accuracy of 85.90%. As a publicly available benchmark resource, the SLAM dataset aims to promote the development of laparoscopic surgical action recognition and artificial intelligence-driven surgery, supporting intelligent surgical robots and surgical automation.

Authors

  • Zi Ye
    State Grid General Aviation Co., Ltd., Beijing 102209, China.
  • Ru Zhou
    Department of General Surgery, RuiJin Hospital LuWan Branch, Shanghai Jiaotong University School of Medicine, Shanghai, 200020, China.
  • Zili Deng
    Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Zhejiang, 310024, China.
  • Dan Wang
    Guangdong Pharmaceutical University Guangzhou Guangdong China.
  • Ying Zhu
    China CDC Key Laboratory of Environment and Population Health, National Institute of Environmental Health, Chinese Center for Disease Control and Prevention, Beijing 100021, China.
  • Xiaoli Jin
    Department of Gastroenterology Surgery, The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310000, Zhejiang, China.
  • Lijun Zhang
    Department of Paediatric Orthopaedics, Shengjing Hospital of China Medical University, Shenyang, Liaoning Province, China.
  • Tianxiang Chen
    Ningbo Key Laboratory of Biomedical Imaging Probe Materials and Technology, Zhejiang International Cooperation Base of Biomedical Materials Technology and Application, Chinese Academy of Sciences (CAS) Key Laboratory of Magnetic Materials and Devices, Ningbo Cixi Institute of Biomedical Engineering, Zhejiang Engineering Research Center for Biomedical Materials, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo, 315201, PR China; Cixi Biomedical Research Institute, Wenzhou Medical University, Zhejiang, PR China; University of Chinese Academy of Sciences, Beijing, 100049, PR China.
  • Hanwei Zhang
    Institute of Intelligent Software, Guangzhou, Guangdong, 511400, China. zhanghanwei0912@gmail.com.
  • Mingliang Wang
    Faculty of Psychology, Tianjin Normal University, Tianjin, China.