Contrastive independent subspace analysis network for multi-view spatial information extraction.

Journal: Neural networks : the official journal of the International Neural Network Society
PMID:

Abstract

Multi-view classification integrates features from different views to optimize classification performance. Most of the existing works typically utilize semantic information to achieve view fusion but neglect the spatial information of data itself, which accommodates data representation with correlation information and is proven to be an essential aspect. Thus robust independent subspace analysis network, optimized by sparse and soft orthogonal optimization, is first proposed to extract the latent spatial information of multi-view data with subspace bases. Building on this, a novel contrastive independent subspace analysis framework for multi-view classification is developed to further optimize from spatial perspective. Specifically, contrastive subspace optimization separates the subspaces, thereby enhancing their representational capacity. Whilst contrastive fusion optimization aims at building cross-view subspace correlations and forms a non overlapping data representation. In k-fold validation experiments, MvCISA achieved state-of-the-art accuracies of 76.95%, 98.50%, 93.33% and 88.24% on four benchmark multi-view datasets, significantly outperforming the second-best method by 8.57%, 0.25%, 1.66% and 5.96% in accuracy. And visualization experiments demonstrate the effectiveness of the subspace and feature space optimization, also indicating their promising potential for other downstream tasks. Our code is available at https://github.com/raRn0y/MvCISA.

Authors

  • Tengyu Zhang
    National Research Center for Rehabilitation Technical Aids, Beijing 100176, P.R.China.
  • Deyu Zeng
    College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, Guangdong, China; College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen, Guangdong, China. Electronic address: deyuzeng@szu.edu.cn.
  • Wei Liu
    Department of Radiation Oncology, Mayo Clinic, Scottsdale, AZ, United States.
  • Zongze Wu
    School of Automation, Guangdong University of Technology, Guangzhou, Guangdong, 510006, China. Electronic address: zzwu@gdut.edu.cn.
  • Chris Ding
    Department of Computer Science and Engineering, University of Texas at Arlington, Arlington, 76019, Texas, USA.
  • Xiaopin Zhong
    College of Mechatronics and Control Engineering, Shenzhen University, Shenzhen, Guangdong, China.