Deep learning-based multimodal image analysis for cervical cancer detection.

Journal: Methods (San Diego, Calif.)
Published Date:

Abstract

Cervical cancer is the fourth most common cancer in women, and its precise detection plays a critical role in disease treatment and prognosis prediction. Fluorodeoxyglucose positron emission tomography and computed tomography, i.e., FDG-PET/CT and PET/CT, have established roles with superior sensitivity and specificity in most cancer imaging applications. However, a typical FDG-PET/CT analysis involves the time-consuming process of interpreting hundreds of images, and the intense image screening work has greatly hindered clinicians. We propose a computer-aided deep learning-based framework to detect cervical cancer using multimodal medical images to increase the efficiency of clinical diagnosis. This framework has three components: image registration, multimodal image fusion, and lesion object detection. Compared to traditional approaches, our adaptive image fusion method fuses multimodal medical images. We discuss the performance of deep learning in each modality, and we conduct extensive experiments to compare the performance of different image fusion methods with some state-of-the-art (SOTA) object-detection deep learning-based methods in images with different modalities. Compared with PET, which has the highest recognition accuracy in single-modality images, the recognition accuracy of our proposed method on multiple object detection models is improved by an average of 6.06%. And compared with the best results of other multimodal fusion methods, our results have an average improvement of 8.9%.

Authors

  • Yue Ming
    Beijing Key Laboratory of Work Safety and Intelligent Monitoring, School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing, China.
  • Xiying Dong
    Department of Orthopedic Surgery, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing 100730, China; Beijing Key Laboratory for Genetic Research of Skeletal Deformity, Beijing 100730, China; Key Laboratory of Big Data for Spinal Deformities, Chinese Academy of Medical Sciences, Beijing 100730, China; DISCO (Deciphering disorders Involving Scoliosis and COmobidities) study group.
  • Jihuai Zhao
    Beijing Advanced Innovation Center for Materials Genome Engineering, University of Science and Technology Beijing, China; Institute of Artificial Intelligence, University of Science and Technology Beijing, China; Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing, China; Shunde Graduate School of University of Science and Technology Beijing, China.
  • Zefu Chen
    Department of Orthopedic Surgery, Peking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Sciences, Beijing 100730, China; State Key Laboratory of Complex Severe and Rare Diseases, Beijing 100730, China; Beijing Key Laboratory for Genetic Research of Skeletal Deformity, Beijing 100730, China; Key Laboratory of Big Data for Spinal Deformities, Chinese Academy of Medical Sciences, Beijing 100730, China; DISCO (Deciphering disorders Involving Scoliosis and COmobidities) study group.
  • Hao Wang
    Department of Cardiology, Second Medical Center, Chinese PLA General Hospital, Beijing, China.
  • Nan Wu
    Department of Pharmaceutical Sciences and Computational Chemical Genomics Screening Center, School of Pharmacy, National Center of Excellence for Computational Drug Abuse Research, Drug Discovery Institute, Departments of Computational Biology and Structural Biology, School of Medicine , University of Pittsburgh , Pittsburgh , Pennsylvania 15261 , United States.