Real-time integrated modeling of soft tissue deformation and stress based on deep learning.

Journal: Physics in medicine and biology
Published Date:

Abstract

. Accurately and in real-time simulating soft tissue deformation and visualizing stress distribution are crucial for advancing surgical simulators closer to real surgical environments. The concept of using neural networks to accelerate the finite element method has emerged as a powerful approach for real-time physical modeling of soft tissues due to its excellent performance. However, existing models primarily focus on deformation modeling, neglecting the important guiding role of soft tissue stress field modeling in surgical training. Moreover, when modeling multiple physical fields, the vast differences in data distribution between these fields can cause a model to become biased toward features with larger scales if they are simply concatenated and fed into the network for training. This paper aims to address the issue of missing stress rendering in surgical simulators by developing a neural network-based real-time multi-physics modeling framework for soft tissues.. By compactly encoding the nonlinear relationship between soft tissue boundary conditions and physical fields, the method accelerates the computation of deformation and stress fields. The feature scales of the physical fields are balanced using-Score normalization, which mitigates the problem of large-scale features dominating the model training.. We validated the effectiveness of our method on three-dimensional models of a cantilever beam, liver, spleen, and kidney. Experiments demonstrate that our method achieves an excellent balance between efficiency and accuracy. Compared to traditional methods, it offers a 1000-fold or even 10 000-fold improvement in efficiency with only around a 1% loss in accuracy.. The proposed model effectively predicts the displacement and stress distribution of soft tissue, offering the potential to enhance surgical simulators with the capability to render multiple physical properties.

Authors

  • Ziyang Hu
    Department of Dentomaxillofacial Radiology, Nanjing Stomatological Hospital, Medical School of Nanjing University, Zhong Yang Road 30, Nanjing City, 210008, Jiangsu, People's Republic of China.
  • Shenghui Liao
    School of Computer Science and Engineering, 12570Central South University, Changsha, PR China.
  • Xiaoyan Kui
    School of Computer Science and Engineering, Central South University, Changsha, Hunan, China.
  • Renzhong Wu
    School of Computer Science and Engineering, 12570Central South University, Changsha, PR China.
  • Feng Yuan
    School of Information Engineering, Shandong Management University, Jinan 250357, China.
  • Qiuyang Chen
    School of Computer Science, Central South University, China.