Active learning for extracting surgomic features in robot-assisted minimally invasive esophagectomy: a prospective annotation study.

Journal: Surgical endoscopy
Published Date:

Abstract

BACKGROUND: With Surgomics, we aim for personalized prediction of the patient's surgical outcome using machine-learning (ML) on multimodal intraoperative data to extract surgomic features as surgical process characteristics. As high-quality annotations by medical experts are crucial, but still a bottleneck, we prospectively investigate active learning (AL) to reduce annotation effort and present automatic recognition of surgomic features.

Authors

  • Johanna M Brandenburg
    Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany.
  • Alexander C Jenke
    Department of Translational Surgical Oncology, National Center for Tumor Diseases (NCT/UCC), Dresden, Germany.
  • Antonia Stern
    Corporate Research and Technology, Karl Storz SE & Co KG, Tuttlingen, Germany.
  • Marie T J Daum
    Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany.
  • André Schulze
    Department of Visceral, Thoracic and Vascular Surgery, University Hospital and Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany.
  • Rayan Younis
    Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany.
  • Philipp Petrynowski
    Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany.
  • Tornike Davitashvili
    Department for General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120 Heidelberg, Germany; National Center for Tumor Diseases (NCT) Heidelberg, Im Neuenheimer Feld 460, 69120 Heidelberg, Germany.
  • Vincent Vanat
    Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany.
  • Nithya Bhasker
    Division of Translational Surgical Oncology, National Center for Tumor Diseases (NCT), Partner Site Dresden, Dresden, Germany.
  • Sophia Schneider
    Corporate Research and Technology, Karl Storz SE & Co KG, Tuttlingen, Germany.
  • Lars Mündermann
    KARL STORZ SE & Co. KG, Tuttlingen, Germany.
  • Annika Reinke
    German Cancer Research Center DKFZ, Division of Computer Assisted Medical Interventions, Heidelberg, Germany. Electronic address: a.reinke@dkfz.de.
  • Fiona R Kolbinger
    Department of Visceral, Thoracic and Vascular Surgery, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Dresden, Germany; Weldon School of Biomedical Engineering, Purdue University, West Lafayette, Indiana.
  • Vanessa Jörns
    Institute of Medical Informatics, Heidelberg University Hospital, Heidelberg, Germany.
  • Fleur Fritz-Kebede
    Institute of Medical Informatics, Heidelberg University Hospital, Heidelberg, Germany.
  • Martin Dugas
    Institute of Medical Informatics, Heidelberg University, Heidelberg, Germany.
  • Lena Maier-Hein
    German Cancer Research Center (DKFZ), Computer Assisted Medical Interventions, Heidelberg, Germany.
  • Rosa Klotz
    Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany.
  • Marius Distler
    Department of Visceral, Thoracic and Vascular Surgery, University Hospital and Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany.
  • Jürgen Weitz
    Department of Visceral, Thoracic and Vascular Surgery, University Hospital and Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany.
  • Beat P Müller-Stich
  • Stefanie Speidel
    Division of Translational Surgical Oncology, National Center for Tumor Diseases (NCT), Partner Site Dresden, Dresden, Germany.
  • Sebastian Bodenstedt
    Division of Translational Surgical Oncology, National Center for Tumor Diseases (NCT), Partner Site Dresden, Dresden, Germany.
  • Martin Wagner
    Department of Biology, Norwegian University of Science and Technology, 5 Høgskoleringen, 7491 Trondheim, Norway. Electronic address: martin.wagner@ntnu.no.