Unsupervised convolutional variational autoencoder deep embedding clustering for Raman spectra.

Journal: Analytical methods : advancing methods and applications
PMID:

Abstract

Unsupervised deep learning methods place increased emphasis on the process of cluster analysis of unknown samples without requiring sample labels. Clustering algorithms based on deep embedding networks have been recently developed and are widely used in data mining, speech processing and image recognition, but barely any of them have been used on spectra data. This study presents an unsupervised clustering algorithm for Raman spectra, called the convolutional variational autoencoder deep embedding clustering method (CVDE). It improves the network structure of the multi-layer perception (MLP) that is commonly used in other methods based on the VAE-GMM model, like VaDE, by replacing the hidden fully connected layer in the MLP with three convolution layers and two pooling layers for better clustering on the Raman spectra. The three convolution layers extend vertical channels to learn features, while pooling layers directly reduce the horizontal coding dimensions to prevent gradient explosion and overfitting. Furthermore, such network structures can easily incorporate the gradient-weighted class activation mapping (Grad-Cam) method to visualise the importance of spectral features for clustering, facilitating network tuning and spectral difference analysis. Moreover, through comparative experiments, CVDE has proven that it affords better clustering performance than current advanced clustering methods on not only the MNIST dataset but also two sets of Raman spectra: soybean oil Raman spectra with very small Raman feature differences and drug Raman spectra with a small data size. The clustering accuracies of these three datasets reach 94.48%, 90.43% and 98.70% respectively. Thus, CVDE is suitable for applications in static spectra, such as Raman spectra and LIBS spectra, and is more versatile than supervised methods in the spectral and chemical analysis fields.

Authors

  • Yixin Guo
    MoE Key Lab of Photoelectronic Imaging Technology and Systems, Beijing Institute of Technology, 6th Teaching Building, No. 5 Yard, Zhong Guan Cun South Street, Haidian District, Beijing 100081, China. jinwq@bit.edu.cn.
  • Weiqi Jin
    Key Laboratory of Photo-Electronic Imaging Technology and Systems, School of Optics and Photonics, Ministry of Education of China, Beijing Institute of Technology, Beijing 100081, China.
  • Weilin Wang
    Department of Clinical Pharmacy, School of Pharmacy, Shandong First Medical University & Shandong Academy of Medical Sciences, Tai'an, Shandong, 271016, China.
  • Zongyu Guo
    MoE Key Lab of Photoelectronic Imaging Technology and Systems, Beijing Institute of Technology, 6th Teaching Building, No. 5 Yard, Zhong Guan Cun South Street, Haidian District, Beijing 100081, China. jinwq@bit.edu.cn.
  • Yuqing He
    School of Transportation, Fujian University of Technology, Fuzhou 350118, China.