Research of Multimodal Medical Image Fusion Based on Parameter-Adaptive Pulse-Coupled Neural Network and Convolutional Sparse Representation.

Journal: Computational and mathematical methods in medicine
Published Date:

Abstract

Visual effects of medical image have a great impact on clinical assistant diagnosis. At present, medical image fusion has become a powerful means of clinical application. The traditional medical image fusion methods have the problem of poor fusion results due to the loss of detailed feature information during fusion. To deal with it, this paper proposes a new multimodal medical image fusion method based on the imaging characteristics of medical images. In the proposed method, the non-subsampled shearlet transform (NSST) decomposition is first performed on the source images to obtain high-frequency and low-frequency coefficients. The high-frequency coefficients are fused by a parameter-adaptive pulse-coupled neural network (PAPCNN) model. The method is based on parameter adaptive and optimized connection strength adopted to promote the performance. The low-frequency coefficients are merged by the convolutional sparse representation (CSR) model. The experimental results show that the proposed method solves the problems of difficult parameter setting and poor detail preservation of sparse representation during image fusion in traditional PCNN algorithms, and it has significant advantages in visual effect and objective indices compared with the existing mainstream fusion algorithms.

Authors

  • Jingming Xia
    School of Electronics and Information Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China.
  • Yi Lu
    Department of Gastrointestinal Endoscopy, The Sixth Affiliated Hospital, Sun Yat-Sen University, 26th Yuancun the Second Road, Guangzhou, 510655, Guangdong Province, China.
  • Ling Tan
    School of Chemistry and Chemical Engineering, Chongqing University Chongqing 400044 China qhzhang@cqu.edu.cn +86-023-65102531.