Evidence-based Multi-Feature Fusion for Adversarial Robustness.

Journal: IEEE transactions on pattern analysis and machine intelligence
Published Date:

Abstract

The accumulation of adversarial perturbations in the feature space makes it impossible for Deep Neural Networks (DNNs) to know what features are robust and reliable, and thus DNNs can be fooled by relying on a single contaminated feature. Numerous defense strategies attempt to improve their robustness by denoising, deactivating, or recalibrating non-robust features. Despite their effectiveness, we still argue that these methods are under-explored in terms of determining how trustworthy the features are. To address this issue, we propose a novel Evidence-based Multi-Feature Fusion (termed EMFF) for adversarial robustness. Specifically, our EMFF approach introduces evidential deep learning to help DNNs quantify the belief mass and uncertainty of the contaminated features. Subsequently, a novel multi-feature evidential fusion mechanism based on Dempster's rule is proposed to fuse the trusted features of multiple blocks within an architecture, which further helps DNNs avoid the induction of a single manipulated feature and thus improve their robustness. Comprehensive experiments confirm that compared with existing defense techniques, our novel EMFF method has obvious advantages and effectiveness in both scenarios of white-box and black-box attacks, and also prove that by integrating into several adversarial training strategies, we can improve the robustness of across distinct architectures, including traditional CNNs and recent vision Transformers with a few extra parameters and almost the same cost.

Authors

  • Zheng Wang
    Department of Infectious Diseases, Renmin Hospital of Wuhan University, Wuhan 430060, China.
  • Xing Xu
  • Lei Zhu
    School of Civil and Hydraulic Engineering, Ningxia University, Yinchuan, China.
  • Yi Bin
  • Guoqing Wang
    Department of Pathogenobiology, Basic Medical College of Jilin University, Changchun, Jilin, 130012, People's Republic of China. qing@jlu.edu.cn.
  • Yang Yang
    Department of Gastrointestinal Surgery, The Third Hospital of Hebei Medical University, Shijiazhuang, China.
  • Heng Tao Shen
    Center for Future Media, School of Computer Science & Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; Sichuan Artificial Intelligence Research Institute, Yibin 644000, China. Electronic address: shenhengtao@uestc.edu.cn.

Keywords

No keywords available for this article.