Causal Inference via Style Bias Deconfounding for Domain Generalization.

Journal: IEEE transactions on pattern analysis and machine intelligence
Published Date:

Abstract

Deep neural networks (DNNs) often struggle with out-of-distribution data, limiting their reliability in real-world visual applications. To address this issue, domain generalization methods have been developed to learn domain-invariant features from single or multiple training domains, enabling generalization to unseen testing domains. However, existing approaches usually overlook the impact of style frequency within the training set. This oversight predisposes models to capture spurious visual correlations caused by style confounding factors, rather than learning truly causal representations, thereby undermining inference reliability. In this work, we introduce Style Deconfounding Causal Learning (SDCL), a novel causal inference-based framework that explicitly addresses style as a confounding factor to enhance domain generalization in image modalities. Our approaches begins with constructing a structural causal model (SCM) tailored to the domain generalization problem and applies a backdoor adjustment strategy to account for style influence. Building on this foundation, we design a style-guided expert module (SGEM) to adaptively clusters style distributions during training, capturing the global confounding style. Additionally, a backdoor causal learning module (BDCL) performs causal interventions during feature extraction, ensuring fair integration of global confounding styles into sample predictions, effectively reducing style bias. The SDCL framework is highly versatile and can be seamlessly integrated with state-of-the-art data augmentation techniques. Extensive experiments across diverse natural and medical image recognition tasks validate its efficacy, demonstrating superior performance in both multi-domain and the more challenging single-domain generalization scenarios.

Authors

  • Jiaxi Li
    Department of Clinical Laboratory Medicine, Jinniu Maternity and Child Health Hospital of Chengdu, Chengdu, China.
  • Di Lin
  • Hao Chen
    The First School of Medicine, Wenzhou Medical University, Wenzhou, China.
  • Hongying Liu
    Key Laboratory of Biorheological Science and Technology of Ministry of Education, College of Bioengineering, Chongqing University, Chongqing, China; Chongqing Engineering Technology Research Center of Medical Electronic, Chongqing, 400030, People's Republic of China. Electronic address: [email protected].
  • Liang Wan
    State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University,Guiyang,Guizhou,China.
  • Wei Feng
    Department of Epidemiology and Health Statistics, School of Public Health, Capital Medical University, You'anmenwai, Xitoutiao No.10, Beijing, P. R. China.

Keywords

No keywords available for this article.