Evolving Graph Learning for Out-of-Distribution Generalization in Non-Stationary Environments.

Journal: IEEE transactions on pattern analysis and machine intelligence
Published Date:

Abstract

Graph neural networks have shown remarkable success in exploiting the spatial and temporal patterns on dynamic graphs. However, existing GNNs exhibit poor generalization ability under distribution shifts, which is inevitable in dynamic scenarios. As dynamic graph generation progresses amid evolving latent non-stationary environments, it is imperative to explore their effects on out-of-distribution (OOD) generalization. This paper proposes a novel Evolving Graph Learning framework for OOD generalization (EvoGOOD) by environment-aware invariant pattern recognition. Specifically, we first design an environment sequential variational auto-encoder to model environment evolution and infer underlying environment distribution. Then, we introduce a mechanism for environment-aware invariant pattern recognition, tailored to address environmental diversification through inferred distributions. Finally, we conduct fine-grained causal interventions on individual nodes using a mixture of instantiated environment samples. This approach helps to distinguish spatio-temporal invariant patterns for OOD prediction, especially in non-stationary environments. Experimental results demonstrate the superiority of EvoGOOD on both real-world and synthetic dynamic datasets under distribution shifts. To the best of our knowledge, it is the first attempt to study the dynamic graph OOD generalization problem from the environment evolution perspective.

Authors

  • Qingyun Sun
  • Jiayi Luo
    College of Chemistry, Chemical Engineering & Environmental Science, Minnan Normal University, Zhangzhou 363000, China.
  • Haonan Yuan
  • Xingcheng Fu
  • Hao Peng
    Department of Radiation Oncology, Sun Yat-sen University Cancer Center, State Key Laboratory of Oncology in Southern China, Collaborative Innovation Center for Cancer Medicine, Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangdong, P. R. China.
  • Jianxin Li
    Department of Ultrasonography, Weihai Municipal Hospital, Shandong, China.
  • Philip S Yu
    Department of Computer Science, University of Illinois at Chicago, Chicago, IL 60612 USA.

Keywords

No keywords available for this article.