Deep learning based identification of pituitary adenoma on surgical endoscopic images: a pilot study.

Journal: Neurosurgical review
Published Date:

Abstract

Accurate tumor identification during surgical excision is necessary for neurosurgeons to determine the extent of resection without damaging the surrounding tissues. No conventional technologies have achieved reliable performance for pituitary adenomas. This study proposes a deep learning approach using intraoperative endoscopic images to discriminate pituitary adenomas from non-tumorous tissue inside the sella turcica. Static images were extracted from 50 intraoperative videos of patients with pituitary adenomas. All patients underwent endoscopic transsphenoidal surgery with a 4 K ultrahigh-definition endoscope. The tumor and non-tumorous tissue within the sella turcica were delineated on static images. Using intraoperative images, we developed and validated deep learning models to identify tumorous tissue. Model performance was evaluated using a fivefold per-patient methodology. As a proof-of-concept, the model's predictions were pathologically cross-referenced with a medical professional's diagnosis using the intraoperative images of a prospectively enrolled patient. In total, 605 static images were obtained. Among the cropped 117,223 patches, 58,088 were labeled as tumors, while the remaining 59,135 were labeled as non-tumorous tissues. The evaluation of the image dataset revealed that the wide-ResNet model had the highest accuracy of 0.768, with an F1 score of 0.766. A preliminary evaluation on one patient indicated alignment between the ground truth set by neurosurgeons, the model's predictions, and histopathological findings. Our deep learning algorithm has a positive tumor discrimination performance in intraoperative 4-K endoscopic images in patients with pituitary adenomas.

Authors

  • Yutaro Fuse
    Department of Neurosurgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan.
  • Kazuhito Takeuchi
    Department of Neurosurgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan. ktakeuchi@med.nagoya-u.ac.jp.
  • Noriaki Hashimoto
    Graduate School of Medicine, Yamaguchi University, Tokiwadai 2-16-1, Ube, Yamaguchi, 755-8611, Japan.
  • Yuichi Nagata
    Department of Neurosurgery, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, 466-8550, Japan.
  • Yusuke Takagi
    Department of Computer Science, Nagoya Institute of Technology, Nagoya, Japan.
  • Tetsuya Nagatani
    Department of Neurosurgery, Japanese Red Cross Aichi Medical Center Nagoya Daini Hospital, Nagoya, Japan.
  • Ichiro Takeuchi
    RIKEN Center for Advanced Intelligent Project, Chuo-ku, Tokyo, 103-0027, Japan; Nagoya Institute of Technology, Gokiso-cho, Showa-ku, Nagoya, Aichi, 466-8555, Japan; and Center for Materials Research by Information Integration, National Institute for Material Science, Sengen, Tsukuba, Ibaraki, 305-0047, Japan takeuchi.ichiro@nitech.ac.jp.
  • Ryuta Saito
    Department of Neurology (S.N., T.M., Y.T., K.T., N.Y., H.K., M.A.), Department of Multiple Sclerosis Therapeutics (T.M.), Department of Neurosurgery (R.S., T.T.), and Department of Pathology (M.W.), Tohoku University Graduate School of Medicine, Sendai; Department of Anatomic Pathology (Y.S.-H.), Tokyo Medical University; Department of Virology 1 (K.N., M.S.), Laboratory of Neurovirology, National Institute of Infectious Diseases; Department of Neurology (I.N.), Tohoku Medical and Pharmaceutical University, Sendai; and Department of Multiple Sclerosis Therapeutics (K.F.), Fukushima Medical University School of Medicine and Multiple Sclerosis and Neuromyelitis Optica Center, Southern TOHOKU Research Institute for Neuroscience, Japan.