High-Quality Virtual Single-Viewpoint Surgical Video: Geometric Autocalibration of Multiple Cameras in Surgical Lights
Journal:
arXiv
Published Date:
Mar 5, 2025
Abstract
Occlusion-free video generation is challenging due to surgeons' obstructions
in the camera field of view. Prior work has addressed this issue by installing
multiple cameras on a surgical light, hoping some cameras will observe the
surgical field with less occlusion. However, this special camera setup poses a
new imaging challenge since camera configurations can change every time
surgeons move the light, and manual image alignment is required. This paper
proposes an algorithm to automate this alignment task. The proposed method
detects frames where the lighting system moves, realigns them, and selects the
camera with the least occlusion. This algorithm results in a stabilized video
with less occlusion. Quantitative results show that our method outperforms
conventional approaches. A user study involving medical doctors also confirmed
the superiority of our method.