Energy-Based Model for Accurate Estimation of Shapley Values in Feature Attribution.

Journal: IEEE transactions on pattern analysis and machine intelligence
Published Date:

Abstract

Shapley value is a widely used tool in explainable artificial intelligence (XAI), as it provides a principled way to attribute contributions of input features to model outputs. However, estimation of Shapley value requires capturing conditional dependencies among all feature combinations, which poses significant challenges in complex data environments. In this article, EmSHAP (Energy-based model for Shapley value estimation), an accurate Shapley value estimation method, is proposed to estimate the expectation of Shapley contribution function under the arbitrary subset of features given the rest. By utilizing the ability of energy-based model (EBM) to model complex distributions, EmSHAP provides an effective solution for estimating the required conditional probabilities. To further improve estimation accuracy, a GRU (Gated Recurrent Unit)-coupled partition function estimation method is introduced. The GRU network captures long-term dependencies with a lightweight parameterization and maps input features into a latent space to mitigate the influence of feature ordering. Additionally, a dynamic masking mechanism is incorporated to further enhance the robustness and accuracy by progressively increasing the masking rate. Theoretical analysis on the error bound as well as application to four case studies verified the higher accuracy and better scalability of EmSHAP in contrast to competitive methods.

Authors

  • Cheng Lu
    Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, 100700, People's Republic of China. [email protected].
  • Jiusun Zeng
  • Yu Xia
    Key Laboratory of Resources and Chemistry of Chinese Medicine, Hubei University of Chinese Medicine, Wuhan, 430065, China.
  • Jinhui Cai
    Department of Radiology, The Seventh Affiliated Hospital, Sun Yat-sen University, Shenzhen 518107, China.
  • Shihua Luo
    Center for Clinical Laboratory Diagnosis and Research, Key Laboratory of Research on Clinical Molecular Diagnosis for High Incidence Diseases in Western Guangxi of Guangxi Higher Education Institutions, Affiliated Hospital of Youjiang Medical University for Nationalities, Baise, Guangxi, 533000, P. R. China.

Keywords

No keywords available for this article.