SafeRPlan: Safe deep reinforcement learning for intraoperative planning of pedicle screw placement.

Journal: Medical image analysis
PMID:

Abstract

Spinal fusion surgery requires highly accurate implantation of pedicle screw implants, which must be conducted in critical proximity to vital structures with a limited view of the anatomy. Robotic surgery systems have been proposed to improve placement accuracy. Despite remarkable advances, current robotic systems still lack advanced mechanisms for continuous updating of surgical plans during procedures, which hinders attaining higher levels of robotic autonomy. These systems adhere to conventional rigid registration concepts, relying on the alignment of preoperative planning to the intraoperative anatomy. In this paper, we propose a safe deep reinforcement learning (DRL) planning approach (SafeRPlan) for robotic spine surgery that leverages intraoperative observation for continuous path planning of pedicle screw placement. The main contributions of our method are (1) the capability to ensure safe actions by introducing an uncertainty-aware distance-based safety filter; (2) the ability to compensate for incomplete intraoperative anatomical information, by encoding a-priori knowledge of anatomical structures with neural networks pre-trained on pre-operative images; and (3) the capability to generalize over unseen observation noise thanks to the novel domain randomization techniques. Planning quality was assessed by quantitative comparison with the baseline approaches, gold standard (GS) and qualitative evaluation by expert surgeons. In experiments with human model datasets, our approach was capable of achieving over 5% higher safety rates compared to baseline approaches, even under realistic observation noise. To the best of our knowledge, SafeRPlan is the first safety-aware DRL planning approach specifically designed for robotic spine surgery.

Authors

  • Yunke Ao
    ROCS, Balgrist University Hospital, University of Zurich, Forchstrasse 340, 8008 Zürich, Switzerland; Department of Computer Science, ETH Zurich, Universitätstrasse 6, 8092 Zürich, Switzerland; ETH AI Center, ETH Zürich, Andreasstrasse 5, 8092 Zürich, Switzerland. Electronic address: yunke.ao@ai.ethz.ch.
  • Hooman Esfandiari
    School of Biomedical Engineering, Surgical Technologies Lab, Centre for Hip Health and Mobility, University of British Columbia, Vancouver, British Columbia, Canada.
  • Fabio Carrillo
    Research in Orthopedic Computer Science, University Hospital Balgrist, University of Zurich, Zurich, Switzerland.
  • Christoph J Laux
    University Spine Center Zurich, University Hospital Balgrist, University of Zurich, Zurich, Switzerland.
  • Yarden As
    Department of Computer Science, ETH Zurich, Universitätstrasse 6, 8092 Zürich, Switzerland; ETH AI Center, ETH Zürich, Andreasstrasse 5, 8092 Zürich, Switzerland.
  • Ruixuan Li
    State Key Laboratory of Alternate Electrical Power System with Renewable Energy Sources, North China Electric Power University, Beijing, 102206, China.
  • Kaat Van Assche
    Department of Mechanical Engineering, KU Leuven, Celestijnenlaan 300, 3001 Leuven, Belgium.
  • Ayoob Davoodi
    School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran.
  • Nicola A Cavalcanti
    ROCS, Balgrist University Hospital, University of Zurich, Forchstrasse 340, 8008 Zürich, Switzerland; Department of Orthopedics, Balgrist University Hospital, University of Zurich, Forchstrasse 340, 8008 Zurich, Switzerland.
  • Mazda Farshad
    Balgrist University Hospital, 8008, Zurich, Switzerland.
  • Benjamin F Grewe
    Institute of Neuroinformatics University of Zürich and ETH, Zürich, Switzerland.
  • Emmanuel Vander Poorten
    Department of Mechanical Engineering, University of Leuven, Celestijnenlaan 300B, 3001, Heverlee, Belgium.
  • Andreas Krause
    Department of Computer Science, ETH Zurich, Zurich, Switzerland.
  • Philipp Fürnstahl
    Research in Orthopedic Computer Science (ROCS), University Hospital Balgrist, University of Zurich, Balgrist Campus, 8008, Zurich, Switzerland.