Holoview: Interactive 3D visualization of medical data in AR
Journal:
arXiv
Published Date:
Jan 15, 2025
Abstract
We introduce HoloView, an innovative augmented reality (AR) system that
enhances interactive learning of human anatomical structures through immersive
visualization. Combining advanced rendering techniques with intuitive
gesture-based interactions, HoloView provides a comprehensive technical
solution for medical education. The system architecture features a distributed
rendering pipeline that offloads stereoscopic computations to a remote server,
optimizing performance and enabling high-quality visualization on less powerful
devices. To prioritize visual quality in the user's direct line of sight while
reducing computational load, we implement foveated rendering optimization,
enhancing the immersive experience. Additionally, a hybrid surface-volume
rendering technique is used to achieve faster rendering speeds without
sacrificing visual fidelity. Complemented by a carefully designed user
interface and gesture-based interaction system, HoloView allows users to
naturally manipulate holographic content and seamlessly navigate the learning
environment. HoloView significantly facilitates anatomical structure
visualization and promotes an engaging, user-centric learning experience.