Surgical data science - from concepts toward clinical translation.

Journal: Medical image analysis
Published Date: Nov 18, 2021

Abstract

Recent developments in data science in general and machine learning in particular have transformed the way experts envision the future of surgery. Surgical Data Science (SDS) is a new research field that aims to improve the quality of interventional healthcare through the capture, organization, analysis and modeling of data. While an increasing number of data-driven approaches and clinical applications have been studied in the fields of radiological and clinical data science, translational success stories are still lacking in surgery. In this publication, we shed light on the underlying reasons and provide a roadmap for future advances in the field. Based on an international workshop involving leading researchers in the field of SDS, we review current practice, key achievements and initiatives as well as available standards and tools for a number of topics relevant to the field, namely (1) infrastructure for data acquisition, storage and access in the presence of regulatory constraints, (2) data annotation and sharing and (3) data analytics. We further complement this technical perspective with (4) a review of currently available SDS products and the translational progress from academia and (5) a roadmap for faster clinical translation and exploitation of the full potential of SDS, based on an international multi-round Delphi process.

Authors

  • Lena Maier-Hein
    German Cancer Research Center (DKFZ), Computer Assisted Medical Interventions, Heidelberg, Germany.
  • Matthias Eisenmann
    German Cancer Research Center (DKFZ), Computer Assisted Medical Interventions, Heidelberg, Germany.
  • Duygu Sarikaya
    Department of Computer Engineering, Faculty of Engineering, Gazi University, Ankara, Turkey; LTSI, Inserm UMR 1099, University of Rennes 1, Rennes, France.
  • Keno März
    German Cancer Research Center (DKFZ), Computer Assisted Medical Interventions, Heidelberg, Germany.
  • Toby Collins
    IRCAD Strasbourg, Strasbourg, France.
  • Anand Malpani
    Department of Computer Science, The Johns Hopkins University, 3400 N. Charles St., Malone Hall Room 340, Baltimore, MD, 21218, USA. amalpan1@jhu.edu.
  • Johannes Fallert
    KARL STORZ SE & Co. KG, Tuttlingen, Germany.
  • Hubertus Feussner
    Department of Surgery, Research Group Minimally Invasive Interdisciplinary Therapeutical Intervention (MITI), Klinikum rechts der Isar, Technical University Munich (TUM), Munich, Germany, Department of Surgery, Klinikum rechts der Isar, Technical University Munich (TUM), Munich, Germany.
  • Stamatia Giannarou
    Hamlyn Centre of Robotic Surgery, Department of Surgery and Cancer Imperial College London London UK.
  • Pietro Mascagni
    IHU Strasbourg, Strasbourg, France.
  • Hirenkumar Nakawala
    Department of Electronics, Information and Bioengineering (DEIB), Politecnico di Milano, Piazza Leonardo da Vinci, Milan, 20133, Italy. Electronic address: hirenkumar.nakawala@polimi.it.
  • Adrian Park
    Department of Surgery, Anne Arundel Health System, Annapolis, Maryland, USA; Johns Hopkins University School of Medicine, Baltimore, Maryland, USA.
  • Carla Pugh
    Department of Surgery, Stanford University School of Medicine, Stanford, California. Electronic address: cpugh@stanford.edu.
  • Danail Stoyanov
    University College London, London, UK.
  • Swaroop S Vedula
    The Malone Center for Engineering in Healthcare, The Johns Hopkins University, Baltimore, Maryland, USA.
  • Kevin Cleary
  • Gabor Fichtinger
    Department of Mechanical and Material Engineering, Queen's University, Kingston, ON, Canada.
  • Germain Forestier
  • Bernard Gibaud
    Inserm, LTSI - UMR_S 1099, Univ Rennes, Rennes, France. bernard.gibaud@univ-rennes1.fr.
  • Teodor Grantcharov
    International Centre for Surgical Safety, Li Ka Shing Knowledge Institute of St Michael's Hospital, Toronto, Ontario, Canada.
  • Makoto Hashizume
  • Doreen Heckmann-Nötzel
    Division of Computer Assisted Medical Interventions (CAMI), German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Hannes G Kenngott
  • Ron Kikinis
    Department of Radiology, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, United States.
  • Lars Mündermann
    KARL STORZ SE & Co. KG, Tuttlingen, Germany.
  • Nassir Navab
    Chair for Computer Aided Medical Procedures & Augmented Reality, TUM School of Computation, Information and Technology, Technical University of Munich, Munich, Germany.
  • Sinan Onogur
    Division of Computer Assisted Medical Interventions (CAMI), German Cancer Research Center (DKFZ), Heidelberg, Germany.
  • Tobias Roß
    German Cancer Research Center (DKFZ), Computer Assisted Medical Interventions, Heidelberg, Germany.
  • Raphael Sznitman
    ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, Switzerland.
  • Russell H Taylor
    Johns Hopkins University, Baltimore, MD, USA.
  • Minu D Tizabi
    Division of Computer Assisted Medical Interventions, German Cancer Research Center, Heidelberg, Germany; HIP Helmholtz Imaging Platform, German Cancer Research Center, Heidelberg, Germany.
  • Martin Wagner
    Department of Biology, Norwegian University of Science and Technology, 5 Høgskoleringen, 7491 Trondheim, Norway. Electronic address: martin.wagner@ntnu.no.
  • Gregory D Hager
    Department of Computer Science, The Johns Hopkins University, 3400 N. Charles St., Malone Hall Room 340, Baltimore, MD, 21218, USA.
  • Thomas Neumuth
    Innovation Center Computer Assisted Surgery (ICCAS), University of Leipzig, Leipzig, Germany.
  • Nicolas Padoy
    IHU Strasbourg, Strasbourg, France.
  • Justin Collins
    ORSI Academy, Melle, Belgium.
  • Ines Gockel
    Department of Visceral, Transplant, Thoracic and Vascular Surgery, University Hospital of Leipzig, Leipzig, Germany.
  • Jan Goedeke
    Pediatric Surgery, Dr. von Hauner Children's Hospital, Ludwig-Maximilians-University, Munich, Germany.
  • Daniel A Hashimoto
    Department of Surgery, Massachusetts General Hospital, Boston, MA.
  • Luc Joyeux
    My FetUZ Fetal Research Center, Department of Development and Regeneration, Biomedical Sciences, KU Leuven, Leuven, Belgium; Center for Surgical Technologies, Faculty of Medicine, KU Leuven, Leuven, Belgium; Department of Obstetrics and Gynecology, Division Woman and Child, Fetal Medicine Unit, University Hospitals Leuven, Leuven, Belgium; Michael E. DeBakey Department of Surgery, Texas Children's Hospital and Baylor College of Medicine, Houston, Texas, USA.
  • Kyle Lam
    Department of Surgery and Cancer, Imperial College London, London, UK.
  • Daniel R Leff
    Department of Surgery and Cancer, Imperial College London, London, United Kingdom.
  • Amin Madani
    Department of Surgery, Columbia University Irving Medical Center, 161 Fort Washington Avenue, New York, NY 10032, USA.
  • Hani J Marcus
    The Hamlyn Centre for Robotic Surgery, Institute of Global Health Innovation, Imperial College London, Paterson Building (Level 3), Praed Street, London, W2 1NY, UK, hani.marcus10@imperial.ac.uk.
  • Ozanan Meireles
    - Harvard Medical School, Surgical Artificial Intelligence and Innovation Laboratory, Massachusetts General Hospital - Boston - MA - Estados Unidos.
  • Alexander Seitel
    German Cancer Research Center (DKFZ), Computer Assisted Medical Interventions, Heidelberg, Germany.
  • Dogu Teber
    Department of Urology, University Hospital Heidelberg, Im Neuenheimer Feld 110, 69120, Heidelberg, Germany.
  • Frank Ückert
    Institute for Applied Medical Informatics, Hamburg University Hospital, Hamburg, Germany.
  • Beat P Müller-Stich
  • Pierre Jannin
  • Stefanie Speidel
    Division of Translational Surgical Oncology, National Center for Tumor Diseases (NCT), Partner Site Dresden, Dresden, Germany.

Keywords

External Resources

Popular Topics
Recent Journals