Application and evaluation of surgical tool and tool tip recognition based on Convolutional Neural Network in multiple endoscopic surgical scenarios.

Journal: Surgical endoscopy
Published Date: Aug 14, 2023

Abstract

BACKGROUND: In recent years, computer-assisted intervention and robot-assisted surgery are receiving increasing attention. The need for real-time identification and tracking of surgical tools and tool tips is constantly demanding. A series of researches focusing on surgical tool tracking and identification have been performed. However, the size of dataset, the sensitivity/precision, and the response time of these studies were limited. In this work, we developed and utilized an automated method based on Convolutional Neural Network (CNN) and You Only Look Once (YOLO) v3 algorithm to locate and identify surgical tools and tool tips covering five different surgical scenarios.

Authors

  • Lu Ping
    8-Year MD Program, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China.
  • Zhihong Wang
    Department of Endocrinology, the First Affiliated Hospital of Chongqing Medical University, Chongqing, China.
  • Jingjing Yao
    Department of Nursing, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China.
  • Junyi Gao
    Analytics Center of Excellence, IQVIA, Beijing, China.
  • Sen Yang
    Key Laboratory of Symbol Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin University, Changchun, 130012, China.
  • Jiayi Li
    Department of Statistics, University of California Los Angeles, Los Angeles, CA 90095-1554, USA.
  • Jile Shi
    8-Year MD Program, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China.
  • Wenming Wu
    Department of General Surgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.
  • Surong Hua
    Department of General Surgery, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China. huasurong@tsinghua.org.cn.
  • Huizhen Wang
    Department of Rehabilitation Medicine, The 8th Medical Center of Chinese PLA General Hospital, Beijing,100091, China. whz01062020@163.com.

Keywords

External Resources

Popular Topics
Recent Journals