AI-powered real-time annotations during urologic surgery: The future of training and quality metrics.

Journal: Urologic oncology
Published Date:

Abstract

INTRODUCTION AND OBJECTIVE: Real-time artificial intelligence (AI) annotation of the surgical field has the potential to automatically extract information from surgical videos, helping to create a robust surgical atlas. This content can be used for surgical education and qualitative initiatives. We demonstrate the first use of AI in urologic robotic surgery to capture live surgical video and annotate key surgical steps and safety milestones in real-time.

Authors

  • Laura Zuluaga
    Department of Urology, Icahn School of Medicine at Mount Sinai, New York, NY.
  • Jordan Miller Rich
    Department of Urology, Icahn School of Medicine at Mount Sinai, New York, NY.
  • Raghav Gupta
    Division of Engineering in Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA. hshafiee@bwh.harvard.edu.
  • Adriana Pedraza
    Department of Urology, Icahn School of Medicine at Mount Sinai, The Mount Sinai Hospital, 1425 Madison Avenue, New York, NY, 10029, USA.
  • Burak Ucpinar
    Department of Urology, Icahn School of Medicine at Mount Sinai Hospital, New York, New York, USA.
  • Kennedy E Okhawere
    Department of Urology, Icahn School of Medicine at Mount Sinai, New York, New York.
  • Indu Saini
    Department of Urology, Icahn School of Medicine at Mount Sinai, New York, NY.
  • Priyanka Dwivedi
    Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY.
  • Dhruti Patel
    Department of Urology, Icahn School of Medicine at Mount Sinai, New York City, NY.
  • Osama Zaytoun
    Department of Urology, Icahn School of Medicine at Mount Sinai, The Mount Sinai Hospital, 1425 Madison Avenue, New York, NY, 10029, USA.
  • Mani Menon
  • Ashutosh Tewari
    Department of Radiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA.
  • Ketan K Badani
    Department of Urology, Icahn School of Medicine at Mount Sinai Hospital , New York, New York.