Real-time automatic surgical phase recognition in laparoscopic sigmoidectomy using the convolutional neural network-based deep learning approach.

Journal: Surgical endoscopy
Published Date:

Abstract

BACKGROUND: Automatic surgical workflow recognition is a key component for developing the context-aware computer-assisted surgery (CA-CAS) systems. However, automatic surgical phase recognition focused on colorectal surgery has not been reported. We aimed to develop a deep learning model for automatic surgical phase recognition based on laparoscopic sigmoidectomy (Lap-S) videos, which could be used for real-time phase recognition, and to clarify the accuracies of the automatic surgical phase and action recognitions using visual information.

Authors

  • Daichi Kitaguchi
    Department of Colorectal Surgery, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa-City, Chiba, 277-8577, Japan.
  • Nobuyoshi Takeshita
    Department of Colorectal Surgery, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa-City, Chiba, 277-8577, Japan. ntakeshi@east.ncc.go.jp.
  • Hiroki Matsuzaki
    Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa-City, Chiba, 277-8577, Japan.
  • Hiroaki Takano
    Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa-City, Chiba, 277-8577, Japan.
  • Yohei Owada
    Department of Gastrointestinal and Hepato-Biliary-Pancreatic Surgery, Faculty of Medicine, University of Tsukuba, Tsukuba, Ibaraki, 305-8575, Japan.
  • Tsuyoshi Enomoto
    Department of Gastrointestinal and Hepato-Biliary-Pancreatic Surgery, Faculty of Medicine, University of Tsukuba, Tsukuba, Ibaraki, 305-8575, Japan.
  • Tatsuya Oda
    Department of Gastrointestinal and Hepato-Biliary-Pancreatic Surgery, Faculty of Medicine, University of Tsukuba, Tsukuba, Ibaraki, 305-8575, Japan.
  • Hirohisa Miura
    Department of Surgery, Kitasato University School of Medicine, Kitasato 1-15-1, Minami-ku, Sagamihara, 252-0374, Japan.
  • Takahiro Yamanashi
    Department of Surgery, Kitasato University School of Medicine, Kitasato 1-15-1, Minami-ku, Sagamihara, 252-0374, Japan.
  • Masahiko Watanabe
    Department of Surgery, Kitasato University School of Medicine, Kitasato 1-15-1, Minami-ku, Sagamihara, 252-0374, Japan.
  • Daisuke Sato
    Carnegie Mellon University, Pittsburgh, Pennsylvania, USA.
  • Yusuke Sugomori
    MICIN, Inc., Nihon Building 13F, 2-6-2 Otemachi, Chiyoda-ku, Tokyo, 100-0004, Japan.
  • Seigo Hara
    MICIN, Inc., Nihon Building 13F, 2-6-2 Otemachi, Chiyoda-ku, Tokyo, 100-0004, Japan.
  • Masaaki Ito
    Department of Colorectal Surgery, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa, 277-8577, Japan.