Deep Learning-Based Facial and Skeletal Transformations for Surgical Planning.

Journal: Journal of dental research
PMID:

Abstract

The increasing application of virtual surgical planning (VSP) in orthognathic surgery implies a critical need for accurate prediction of facial and skeletal shapes. The craniofacial relationship in patients with dentofacial deformities is still not understood, and transformations between facial and skeletal shapes remain a challenging task due to intricate anatomical structures and nonlinear relationships between the facial soft tissue and bones. In this study, a novel bidirectional 3-dimensional (3D) deep learning framework, named P2P-ConvGC, was developed and validated based on a large-scale data set for accurate subject-specific transformations between facial and skeletal shapes. Specifically, the 2-stage point-sampling strategy was used to generate multiple nonoverlapping point subsets to represent high-resolution facial and skeletal shapes. Facial and skeletal point subsets were separately input into the prediction system to predict the corresponding skeletal and facial point subsets via the skeletal prediction subnetwork and facial prediction subnetwork. For quantitative evaluation, the accuracy was calculated with shape errors and landmark errors between the predicted skeleton or face with corresponding ground truths. The shape error was calculated by comparing the predicted point sets with the ground truths, with P2P-ConvGC outperforming existing state-of-the-art algorithms including P2P-Net, P2P-ASNL, and P2P-Conv. The total landmark errors (Euclidean distances of craniomaxillofacial landmarks) of P2P-ConvGC in the upper skull, mandible, and facial soft tissues were 1.964 ± 0.904 mm, 2.398 ± 1.174 mm, and 2.226 ± 0.774 mm, respectively. Furthermore, the clinical feasibility of the bidirectional model was validated using a clinical cohort. The result demonstrated its prediction ability with average surface deviation errors of 0.895 ± 0.175 mm for facial prediction and 0.906 ± 0.082 mm for skeletal prediction. To conclude, our proposed model achieved good performance on the subject-specific prediction of facial and skeletal shapes and showed clinical application potential in postoperative facial prediction and VSP for orthognathic surgery.

Authors

  • J Bao
    Department of Oral and Craniomaxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
  • X Zhang
    Agricultural and Rural Bureau of Hanjiang District, Yangzhou 225100, China.
  • S Xiang
    School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China.
  • H Liu
    Joint Laboratory of Modern Agricultural Technology International Cooperation; Key Laboratory of Animal Production, Product Quality, and Security; College of Animal Science and Technology, Jilin Agricultural University, Changchun, China.
  • M Cheng
    Department of Internal Medical Oncology, Harbin Medical University Cancer Hospital, Harbin Medical University, Harbin, Heilongjiang Province, China.
  • Y Yang
    Department of Forensic Medicine, Inner Mongolia Medical University, Hohhot 010030, China.
  • X Huang
    Department of Oral and Craniomaxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
  • W Xiang
    Department of Oral and Craniomaxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
  • W Cui
    Department of Oral and Craniomaxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
  • H C Lai
    Department of Oral and Craniomaxillofacial Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
  • S Huang
    Department of Oral and Maxillofacial Surgery, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China.
  • Y Wang
    1 School of Public Health, Capital Medical University, Beijing, China.
  • D Qian
    School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China.
  • H Yu
    School of Forensic Medicine, China Medical University, Shenyang 110001, China.