MuSIA: Exploiting multi-source information fusion with abnormal activations for out-of-distribution detection.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

In the open world, out-of-distribution (OOD) detection is crucial to ensure the reliability and robustness of deep learning models. Traditional OOD detection methods are often limited to using single-source information coupled with the abnormal activations of OOD data, resulting in poor detection performance for OOD samples. To this end, we propose MuSIA (Multi-Source Information Fusion with Abnormal Activations) to obtain effective information from multiple information sources and capture abnormal activations to improve the performance of OOD detection. To verify the effectiveness of MuSIA, we conducted experiments with six OOD datasets on six pre-trained models (ViT, RepVGG, DeiT, etc.). Experimental results show that compared with the SOTA method, MuSIA reduces FPR95 (↓) by an average of 7.78%. Further ablation studies deeply explore the role of each component in MuSIA, especially the synergy of capturing abnormal activation and multi-source information fusion.

Authors

  • Heng-Yang Lu
    School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China; The Laboratory for Advanced Computing and Intelligence Engineering, Wuxi, China. Electronic address: luhengyang@jiangnan.edu.cn.
  • Xin Guo
    Department of Applied Mathematics, The Hong Kong Polytechnic University, Hong Kong.
  • Wenyu Jiang
    Department of Neurological Rehabilitation, Jiangbin Hospital of Guangxi Zhuang Autonomous Region, Nanning, China.
  • Chenyou Fan
    School of Artificial Intelligence, South China Normal University, Guangzhou, China. Electronic address: fanchenyou@scnu.edu.cn.
  • Yuntao Du
    Beijing Institute for General Artificial Intelligence (BIGAI), Beijing, China.
  • Zhenhao Shao
    China Ship Scientific Research Center, Wuxi, China. Electronic address: shao123@mail.ustc.edu.cn.
  • Wei Fang
    GNSS Research Center, Wuhan University, Wuhan, 430079, China.
  • Xiaojun Wu
    Computational Biology Department, School of Computer Science, Carnegie Mellon University, Pittsburgh, Pennsylvania, United States of America.