Task-augmented cross-view imputation network for partial multi-view incomplete multi-label classification.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

In real-world scenarios, multi-view multi-label learning often encounters the challenge of incomplete training data due to limitations in data collection and unreliable annotation processes. The absence of multi-view features impairs the comprehensive understanding of samples, omitting crucial details essential for classification. To address this issue, we present a task-augmented cross-view imputation network (TACVI-Net) for the purpose of handling partial multi-view incomplete multi-label classification. Specifically, we employ a two-stage network to derive highly task-relevant features to recover the missing views. In the first stage, we leverage the information bottleneck theory to obtain a discriminative representation of each view by extracting task-relevant information through a view-specific encoder-classifier architecture. In the second stage, an autoencoder based multi-view reconstruction network is utilized to extract high-level semantic representation of the augmented features and recover the missing data, thereby aiding the final classification task. Extensive experiments on five datasets demonstrate that our TACVI-Net outperforms other state-of-the-art methods.

Authors

  • Lian Zhao
    Department of Radiology, Children's Hospital of Soochow University, Suzhou 215025, China.
  • Jie Wen
    Bio-Computing Research Center, Shenzhen Graduate School, Harbin Institute of Technology, Shenzhen, 518055, Guangdong, China; Shenzhen Medical Biometrics Perception and Analysis Engineering Laboratory, Harbin Institute of Technology (Shenzhen), Shenzhen, 518055, Guangdong, China.
  • Xiaohuan Lu
    College of Big Data and Information Engineering, Guizhou University, Guiyang, China. Electronic address: xhlu3@gzu.edu.cn.
  • Wai Keung Wong
  • Jiang Long
    Department of Pancreatic Surgery, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200080, China.
  • Wulin Xie
    College of Big Data and Information Engineering, Guizhou University, Guiyang, China.