Integration of Virtual Reality in the Control System of an Innovative Medical Robot for Single-Incision Laparoscopic Surgery.

Journal: Sensors (Basel, Switzerland)
Published Date:

Abstract

In recent years, there has been an expansion in the development of simulators that use virtual reality (VR) as a learning tool. In surgery where robots are used, VR serves as a revolutionary technology to help medical doctors train in using these robotic systems and accumulate knowledge without risk. This article presents a study in which VR is used to create a simulator designed for robotically assisted single-uniport surgery. The control of the surgical robotic system is achieved using voice commands for laparoscopic camera positioning and via a user interface developed using the Visual Studio program that connects a wristband equipped with sensors attached to the user's hand for the manipulation of the active instruments. The software consists of the user interface and the VR application via the TCP/IP communication protocol. To study the evolution of the performance of this virtual system, 15 people were involved in the experimental evaluation of the VR simulator built for the robotic surgical system, having to complete a medically relevant task. The experimental data validated the initial solution, which will be further developed.

Authors

  • Florin Covaciu
    Research Center for Industrial Robots Simulation and Testing-CESTER, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania.
  • Nicolae Crisan
    Department of Urology, Iuliu Hatieganu University of Medicine and Pharmacy, Cluj-Napoca, Romania.
  • Calin Vaida
    CESTER, Technical University of Cluj-Napoca, 400641 Cluj-Napoca, Romania.
  • Iulia Andras
    ORSI Academy, Melle, Belgium.
  • Alexandru Pusca
    Research Center for Industrial Robots Simulation and Testing-CESTER, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania.
  • Bogdan Gherman
    CESTER, Technical University of Cluj-Napoca, 400641 Cluj-Napoca, Romania.
  • Corina Radu
    Department of Internal Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania.
  • Paul Tucan
    CESTER, Technical University of Cluj-Napoca, 400641 Cluj-Napoca, Romania.
  • Nadim Al Hajjar
    Department of Surgery, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania.
  • Doina Pisla
    CESTER, Technical University of Cluj-Napoca, 400641 Cluj-Napoca, Romania.